mscroggs.co.uk
mscroggs.co.uk

subscribe

Blog

 2017-11-14 
A few weeks ago, I took the copy of MENACE that I built to Manchester Science Festival, where it played around 300 games against the public while learning to play Noughts and Crosses. The group of us operating MENACE for the weekend included Matt Parker, who made two videos about it. Special thanks go to Matt, plus Katie Steckles, Alison Clarke, Andrew Taylor, Ashley Frankland, David Williams, Paul Taylor, Sam Headleand, Trent Burton, and Zoe Griffiths for helping to operate MENACE for the weekend.
As my original post about MENACE explains in more detail, MENACE is a machine built from 304 matchboxes that learns to play Noughts and Crosses. Each box displays a possible position that the machine can face and contains coloured beads that correspond to the moves it could make. At the end of each game, beads are added or removed depending on the outcome to teach MENACE to play better.

Saturday

On Saturday, MENACE was set up with 8 beads of each colour in the first move box; 3 of each colour in the second move boxes; 2 of each colour in third move boxes; and 1 of each colour in the fourth move boxes. I had only included one copy of moves that are the same due to symmetry.
The plot below shows the number of beads in MENACE's first box as the day progressed.

Sunday

Originally, we were planning to let MENACE learn over the course of both days, but it learned more quickly than we had expected on Saturday, so we reset is on Sunday, but set it up slightly differently. On Sunday, MENACE was set up with 4 beads of each colour in the first move box; 3 of each colour in the second move boxes; 2 of each colour in third move boxes; and 1 of each colour in the fourth move boxes. This time, we left all the beads in the boxes and didn't remove any due to symmetry.
The plot below shows the number of beads in MENACE's first box as the day progressed.

The data

You can download the full set of data that we collected over the weekend here. This includes the first two moves and outcomes of all the games over the two days, plus the number of beads in each box at the end of each day. If you do something interesting (or non-interesting) with the data, let me know!

Similar posts

MENACE
Visualising MENACE's learning
Building MENACEs for other games
MENACE in fiction

Comments

Comments in green were written by me. Comments in blue were not written by me.
WRT the comment 2017-11-17, and exactly one year later, I had the same thing happen whilst running MENACE in a 'Resign' loop for a few hours, unattended. When I returned, the orange overlay had appeared, making the screen quite difficult to read on an iPad.
g0mrb
                 Reply
On the JavaScript version, MENACE2 (a second version of MENACE which learns in the same way, to play against the original) keeps setting the 6th move as NaN, meaning it cannot function. Is there a fix for this?
Lambert
                 Reply
what would happen if you loaded the boxes slightly differently. if you started with one bead corresponding to each move in each box. if the bead caused the machine to lose you remove only that bead. if the game draws you leave the bead in play if the bead causes a win you put an extra bead in each of the boxes that led to the win. if the box becomes empty you remove the bead that lead to that result from the box before
Ian
                 Reply
Hi, I was playing with MENACE, and after a while the page redrew with a Dragon Curves design over the top. MENACE was still working alright but it was difficult to see what I was doing due to the overlay. I did a screen capture of it if you want to see it.
Russ
                 Reply
 Add a Comment 


I will only use your email address to reply to your comment (if a reply is needed).

Allowed HTML tags: <br> <a> <small> <b> <i> <s> <sup> <sub> <u> <spoiler> <ul> <ol> <li>
To prove you are not a spam bot, please type "oitar" backwards in the box below (case sensitive):

Archive

Show me a random blog post
 2020 

May 2020

A surprising fact about quadrilaterals
Interesting tautologies

Mar 2020

Log-scaled axes

Feb 2020

PhD thesis, chapter ∞
PhD thesis, chapter 5
PhD thesis, chapter 4
PhD thesis, chapter 3
Inverting a matrix
PhD thesis, chapter 2

Jan 2020

PhD thesis, chapter 1
Gaussian elimination
Matrix multiplication
Christmas (2019) is over
 2019 
▼ show ▼
 2018 
▼ show ▼
 2017 
▼ show ▼
 2016 
▼ show ▼
 2015 
▼ show ▼
 2014 
▼ show ▼
 2013 
▼ show ▼
 2012 
▼ show ▼

Tags

big internet math-off dates weather station speed radio 4 chess nine men's morris binary golden ratio inline code menace bodmas asteroids noughts and crosses braiding misleading statistics coins geometry electromagnetic field puzzles boundary element methods squares sport christmas matrix of minors countdown approximation tmip pizza cutting folding paper php geogebra advent calendar royal institution wave scattering go flexagons python statistics hats tennis simultaneous equations curvature books phd machine learning matrix multiplication platonic solids hannah fry captain scarlet sound rhombicuboctahedron oeis mathsjam fractals probability manchester interpolation raspberry pi trigonometry propositional calculus dragon curves hexapawn signorini conditions inverse matrices light royal baby game of life video games wool bempp ucl polynomials quadrilaterals folding tube maps european cup mathsteroids finite element method reddit preconditioning people maths matrix of cofactors football matt parker arithmetic the aperiodical harriss spiral javascript draughts realhats reuleaux polygons graph theory dataset convergence exponential growth game show probability london plastic ratio manchester science festival bubble bobble logs craft computational complexity london underground gaussian elimination graphs numerical analysis latex talking maths in public news sobolev spaces chebyshev accuracy stickers twitter data visualisation matrices golden spiral mathslogicbot map projections logic ternary palindromes data gerry anderson frobel pac-man martin gardner weak imposition error bars sorting estimation determinants final fantasy cambridge cross stitch world cup programming chalkdust magazine games triangles christmas card a gamut of games national lottery pythagoras rugby

Archive

Show me a random blog post
▼ show ▼
© Matthew Scroggs 2012–2020