how long did it take to run the whole thing?

[Arcadianlee]

Say, for example, the breakout and pong games. How much time did it take to run for the program to converge?

[jacobaustin123]

I don't remember exactly how long it took, but definitely less than a day? Maybe 12 hours until it performed reasonably well at Breakout (it was still improving).