PlayTrain games

Craftax: M. Matthews, M. Beukman, B. Ellis, M. Samvelyan, M. Jackson, S. Coward and J. Foerster, Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learning, ICML 2024. Dynamics matched against the C implementation in PufferLib (J. Suarez, 2024).

craftax ego-craftax ego-craftax.free

Levels from DMLab-30: C. Beattie, J. Z. Leibo, D. Teplyashin, T. Ward, M. Wainwright, H. Küttler, A. Lefrancq, S. Green, V. Valdés, A. Sadik et al., DeepMind Lab, arXiv 2016. Layouts, movement and rewards checked frame by frame against DeepMind Lab itself. Textures from its //assets, CC BY 4.0.

explore_goal_locations_large explore_goal_locations_small explore_object_locations_large explore_object_locations_small explore_object_rewards_few explore_object_rewards_many explore_obstructed_goals_large explore_obstructed_goals_small language_answer_quantitative_question language_execute_random_task language_select_described_object language_select_located_object psychlab_sequential_comparison psychlab_visual_search rooms_collect_good_objects_test rooms_collect_good_objects_train rooms_exploit_deferred_effects_test rooms_exploit_deferred_effects_train rooms_keys_doors_puzzle rooms_select_nonmatching_object rooms_watermaze skymaze_irreversible_path_hard skymaze_irreversible_path_varied

JavaScript clones of the ProcGen games: K. Cobbe, C. Hesse, J. Hilton and J. Schulman, Leveraging Procedural Generation to Benchmark Reinforcement Learning, ICML 2020.

bigfish bossfight caveflyer chaser climber coinrun dodgeball fruitbot heist jumper leaper maze miner ninja plunder starpilot

JavaScript clones of Atari 2600 games from the Arcade Learning Environment: M. G. Bellemare, Y. Naddaf, J. Veness and M. Bowling, The Arcade Learning Environment: An Evaluation Platform for General Agents, JAIR 2013.

asteroids breakout freeway frostbite pong qbert seaquest space_invaders

Games and reference emulator from Octax: W. Radji, T. Michel and H. Piteau, Octax: Accelerated CHIP-8 Arcade Environments for Reinforcement Learning in JAX, ICLR 2026.

airplane blinkyby Hans Christian Egeberg brixby Andreas Gustafsson cavern1by Matthew Mikolay cavern2by Matthew Mikolay cavern3by Matthew Mikolay cavern4aby Matthew Mikolay cavern4bby Matthew Mikolay cavern5by Matthew Mikolay cavern6by Matthew Mikolay deepby John Earnest filter flight_runnerby TodPunk missileby David Winter pongby 1 player rocketby Joseph Weisbecker shooting_starsby Philip Baltzer space_flight1 space_flight10 space_flight2 space_flight3 space_flight4 space_flight5 space_flight6 space_flight7 space_flight8 space_flight9 spacejamby WilliamDonnelly squashby David Winter submarineby Carmelo Cortez tank target_shooter1by Octax (LLM-generated) target_shooter2by Octax (LLM-generated) target_shooter3by Octax (LLM-generated) tetrisby Fran Dachille ufoby Lutz V vertical_brixby Paul Robson wipe_offby Joseph Weisbecker wormby RB-Revival Studios, Martijn Wenting

VGDL: T. Schaul, A Video Game Description Language for Model-based or Interactive Learning, IEEE CIG 2013. Engine checked against py-vgdl as ported by M. Tomov.

aliens avoidGeorge beesAndBirds jaws missile_command plaqueAttack portals preconditions pushBoulders relational tutorial

The games from M. S. Tomov, P. A. Tsividis, T. Pouncy, J. B. Tenenbaum and S. J. Gershman, The neural architecture of theory-based reinforcement learning, Neuron 2023. Engine checked against their RC_RL code. These are the study's v4 versions.

avoidgeorge bait chase helper lemmings sokoban zelda

PuzzleScript by Stephen Lavelle (increpare); engine and games from github.com/increpare/PuzzleScript. Engine © 2013 Stephen Lavelle, MIT License. Each game is by the author shown under it.

blockfakerby Droqen byyoursideby Alan Hazelden constellationzby increpare kettleby increpare limerickby Tommi Tuovinen microbanby David Skinner midasby wanderlands nekopuzzleby lexaloffle notsnakeby Terry Cavanagh octatby increpare randomrobotsby increpare randomspawnerby increpare sokoban_basicby David Skinner sokoban_eyeballby increpare sokoban_match3by increpare whaleworldby increpare zenpuzzlegardenby lexaloffle