Skip to content

Conversation

@kywch
Copy link
Contributor

@kywch kywch commented Jan 24, 2026

Inspired by @drubinstein 's recent 2048 simplification, I did -- so 300 less lines of code in 2048.h for better perf.

  • Used @drubinstein 's grid only obs, and value/pos embedding encoder
  • Removed heuristic/snake rewards completely, and endgame training
  • Simplified scaffolding curriculum
  • Prepared for 131k tiles
  • And, fixed wrong done signals.

Wandb curves:

Evaluation (this is one of the best runs. Perf changes from seed to seed, but hits 65k reliably):

    Num episodes: 95611
    Max tile avg: 40980.9
    Episode length -- Avg: 26792.1, Max: 37442.2
    Merge score -- Avg: 779238.6, Max: 997571.8
    Reached 32768 prob: 84.88 %
    Reached 65536 prob: 33.96 %
    Reached 131072 prob: 0.00 %   

Git commits are weird, but changed files are included here.

@jsuarez5341 jsuarez5341 merged commit f0bfbd1 into PufferAI:4.0 Jan 24, 2026
0 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants