mscroggs.co.uk
mscroggs.co.uk

subscribe

Blog

 2017-11-14 
A few weeks ago, I took the copy of MENACE that I built to Manchester Science Festival, where it played around 300 games against the public while learning to play Noughts and Crosses. The group of us operating MENACE for the weekend included Matt Parker, who made two videos about it. Special thanks go to Matt, plus Katie Steckles, Alison Clarke, Andrew Taylor, Ashley Frankland, David Williams, Paul Taylor, Sam Headleand, Trent Burton, and Zoe Griffiths for helping to operate MENACE for the weekend.
As my original post about MENACE explains in more detail, MENACE is a machine built from 304 matchboxes that learns to play Noughts and Crosses. Each box displays a possible position that the machine can face and contains coloured beads that correspond to the moves it could make. At the end of each game, beads are added or removed depending on the outcome to teach MENACE to play better.

Saturday

On Saturday, MENACE was set up with 8 beads of each colour in the first move box; 3 of each colour in the second move boxes; 2 of each colour in third move boxes; and 1 of each colour in the fourth move boxes. I had only included one copy of moves that are the same due to symmetry.
The plot below shows the number of beads in MENACE's first box as the day progressed.

Sunday

Originally, we were planning to let MENACE learn over the course of both days, but it learned more quickly than we had expected on Saturday, so we reset is on Sunday, but set it up slightly differently. On Sunday, MENACE was set up with 4 beads of each colour in the first move box; 3 of each colour in the second move boxes; 2 of each colour in third move boxes; and 1 of each colour in the fourth move boxes. This time, we left all the beads in the boxes and didn't remove any due to symmetry.
The plot below shows the number of beads in MENACE's first box as the day progressed.

The data

You can download the full set of data that we collected over the weekend here. This includes the first two moves and outcomes of all the games over the two days, plus the number of beads in each box at the end of each day. If you do something interesting (or non-interesting) with the data, let me know!

Similar posts

MENACE
Visualising MENACE's learning
Building MENACEs for other games
MENACE in fiction

Comments

Comments in green were written by me. Comments in blue were not written by me.
WRT the comment 2017-11-17, and exactly one year later, I had the same thing happen whilst running MENACE in a 'Resign' loop for a few hours, unattended. When I returned, the orange overlay had appeared, making the screen quite difficult to read on an iPad.
g0mrb
                 Reply
On the JavaScript version, MENACE2 (a second version of MENACE which learns in the same way, to play against the original) keeps setting the 6th move as NaN, meaning it cannot function. Is there a fix for this?
Lambert
                 Reply
what would happen if you loaded the boxes slightly differently. if you started with one bead corresponding to each move in each box. if the bead caused the machine to lose you remove only that bead. if the game draws you leave the bead in play if the bead causes a win you put an extra bead in each of the boxes that led to the win. if the box becomes empty you remove the bead that lead to that result from the box before
Ian
                 Reply
Hi, I was playing with MENACE, and after a while the page redrew with a Dragon Curves design over the top. MENACE was still working alright but it was difficult to see what I was doing due to the overlay. I did a screen capture of it if you want to see it.
Russ
                 Reply
 Add a Comment 


I will only use your email address to reply to your comment (if a reply is needed).

Allowed HTML tags: <br> <a> <small> <b> <i> <s> <sup> <sub> <u> <spoiler> <ul> <ol> <li>
To prove you are not a spam bot, please type "g" then "r" then "a" then "p" then "h" in the box below (case sensitive):

Archive

Show me a random blog post
 2021 

May 2021

Close encounters of the second kind

Jan 2021

Christmas (2020) is over
 2020 
▼ show ▼
 2019 
▼ show ▼
 2018 
▼ show ▼
 2017 
▼ show ▼
 2016 
▼ show ▼
 2015 
▼ show ▼
 2014 
▼ show ▼
 2013 
▼ show ▼
 2012 
▼ show ▼

Tags

bubble bobble quadrilaterals puzzles game show probability cross stitch error bars machine learning finite element method radio 4 harriss spiral matrix of minors sport weak imposition graph theory game of life curvature propositional calculus tennis light chalkdust magazine pac-man asteroids bempp pascal's triangle speed dates matt parker menace mathsteroids weather station people maths stickers probability manchester science festival inline code royal baby wave scattering world cup games oeis books matrices geometry chebyshev pi approximation day twitter polynomials ucl convergence coins news folding paper golden ratio numerical analysis interpolation braiding countdown gaussian elimination video games noughts and crosses tmip sobolev spaces electromagnetic field simultaneous equations hexapawn javascript manchester plastic ratio logic christmas computational complexity triangles php talking maths in public raspberry pi latex european cup matrix of cofactors sorting geogebra football binary accuracy national lottery folding tube maps logs chess mathsjam london dataset craft final fantasy determinants statistics golden spiral london underground royal institution platonic solids flexagons ternary python fractals misleading statistics reddit inverse matrices data visualisation a gamut of games nine men's morris pythagoras phd rhombicuboctahedron estimation map projections preconditioning data rugby reuleaux polygons big internet math-off stirling numbers mathslogicbot trigonometry christmas card signorini conditions numbers arithmetic the aperiodical guest posts bodmas graphs captain scarlet hannah fry gerry anderson programming palindromes draughts recursion approximation cambridge hats exponential growth frobel martin gardner matrix multiplication dragon curves pizza cutting squares wool boundary element methods sound realhats advent calendar go pi

Archive

Show me a random blog post
▼ show ▼
© Matthew Scroggs 2012–2021