The more the merrier!

I challenge you to fork the repo and solve it faster using less tokens/cost than Jev :)

I think “significantly dumber” might include traditional RL, and thus no tokens at all

This runs entirely on Jev as the only AI with a typescript harness that feeds it selective context.

Thank you! And interesting data point on Fable burning out on tokens so early.

Nothing fake here and fully open source if you wanna take a peek. It does make a bunch of mistakes, often. But it eventually recovers!

https://github.com/christianmat/jev-pokemon

For those curious how it works, it’s essentially a script that plays the game but uses jev as a source of rng to make it stochastic

Yeah, there's a lot hard-coded into the typescript files that make this much less impressive than the other "AI plays" versions that have come and gone that play with less help. A Claude one that only used screenshots would always get stuck in the rocket hideout...

For the record I did not mean to say that about your work, nice job.

Agreed this would be super cool and I do see that coming in the future. But Jev-level latency just isn't there yet with full images.

We just did exactly this - added TypeSafe-compatible API (incl. websocket support) for various VLMs. Latency right now is <250ms, but will be able to get it to <150ms (p95).

Take a look at a snake demo with streaming image inputs: https://x.com/spillai/status/2103630735425089957

That was how I first implemented it. Jev sadly never left Pallet Town.

It's connected to the ROM of the actual game, so it can see a lot of things. It has multiple tools available, including being able to move to coordinates.

All in the OSS repo if you wanna play around with it: https://github.com/christianmat/jev-pokemon

it made it through!

Like others have mentioned in this post, I think a mix of models like Jev for simple stuff + a smarter reasoning model for more strategic thinking is the optimal solution. This experiment however is purely Jev. Which sometimes can be kinda dumb.

Well in a lot of ways this demo actually is a mix of jev for simple stuff + a very intelligent harness to fill in the rest. Pay attention to the "jev counter" on when api calls actually happen and the kinds of decisions its making. Its very rarely in a tight loop, and when it is (eg in an item menu) it tends to randomly walk through options.

Its very cool, but the harness is doing a _ton_ of heavy lifting.