James Whittington ✓

@jcrwhittington

Neuroscience, AI, physics, medicine.

2 693Followers

184Following

445Posts total

1.2MViews on collected posts

Derniers posts

James Whittington ✓@jcrwhittington12 Aug

@fchollet @arcprize 2.2K views · 11 likes · 0 reposts · 0 replies Open on X →

James Whittington ✓@jcrwhittington12 Aug

@fchollet what do you think? Our attempt at text-based arc-agi-3 set of games :) 2.5K views · 24 likes · 0 reposts · 2 replies Open on X →

James Whittington ✓@jcrwhittington12 Aug

@jcrwhittington Nice! "Each is beaten by at least one human on their first attempt" — what pass at K is that (i.e., how many humans attempted)? And what's the population you sourced from? 1.8K views · 13 likes · 0 reposts · 1 replies Open on X →

James Whittington ✓@jcrwhittington12 Aug

The 21 public games are playable in your browser, and the API lets you run any model against them. No pressure, but we know humans can solve all of these on their first attempt :) https://t.co/EsdewBxS6W If you enjoy the puzzles, share them with a friend, or see if you can 3.8K views · 36 likes · 3 reposts · 3 replies Open on X →

James Whittington ✓@jcrwhittington12 Aug

We find that 1) Opus 5 & Fable marked a real increase in ability on these games, but they still struggle with the hardest tiers of games (Tiers 6 and 7) 2) Agentic harnesses like Prime don’t offer any benefit over a basic (non coding!) harness 3) There’s a large gap between https

14.8K views · 55 likes · 5 reposts · 3 replies Open on X →

James Whittington ✓@jcrwhittington12 Aug

Each of the 70 games is a self-contained, and different, world rendered as a short string, e.g., like this where you can “walk” around as the arrow 1____A___→_____2 () The rules and win conditions are hidden, you have to discover it all by experimentation. The games are https:

4.8K views · 37 likes · 4 reposts · 2 replies Open on X →

James Whittington ✓@jcrwhittington12 Aug

For AI to chart new science and genuinely make new discoveries, more than just combining known tools together, it first needs to prove it can make discoveries in the easiest possible setting. So, we present, DiG-bench, a benchmark of 70 discovery games, each based in text and ht

7.1K views · 50 likes · 6 reposts · 3 replies Open on X →

James Whittington ✓@jcrwhittington12 Aug

We’re excited to announce DiG-bench, a new benchmark for discovery! Over the last few weeks we’ve been testing frontier AI models on our novel discovery games and seeing how they score. Each game is a text-based environment, so they probe discovery capabilities in the natural h

1.2M views · 1.2K likes · 360 reposts · 44 replies Open on X →

Face aux comptes de taille comparable

8 posts des 90 derniers jours, à côté de la tranche de under 10K abonnés. en dessous de ses pairs à la fois en portée et en engagement.

Vues médianes4 276ce compte4 175médiane pour under 10K

Portée, %158.80%ce compte250.82%médiane pour under 10K

Engagement, %0.81%ce compte1.41%médiane pour under 10K

Indicateur	Ce compte	Médiane pour under 10K	Rapport
Vues médianes par post	4 276	4 175	1.02×
Portée (vues ÷ abonnés)	158.80%	2.5× audience	0.63×
Taux d'engagement	0.81%	1.41%	0.57×

Autres comptes de cette tranche → Comparer avec un autre compte → Comment ces repères sont établis →

Growth & engagement

How the posts we collected actually performed: views and reaction rate post by post, what the audience did with them, and where the follower count goes.

Views per post

1.2M12 Aug

7.1K

4.8K

14.8K

3.8K

1.8K

2.5K

2.2K

Last 8 collected posts, oldest on the left. The scale is logarithmic: one post can outrun the rest a hundred times over.

Engagement rate per post

0.15%12 Aug

0.84%

0.90%

0.45%

1.15%

0.77%

1.05%

0.50%

Reactions — likes, reposts, replies and quotes — divided by views. Median for under 10K accounts is 1.41%.

What the audience does

Likes56.7%1 418 in total

Reposts15.1%378 in total

Replies2.3%58 in total

Quotes10.0%250 in total

Bookmarks15.9%397 in total

Share of every reaction we collected for this account. Replies mean argument, reposts mean endorsement, bookmarks mean the post was worth keeping.

The follower curve appears once this account has two daily snapshots — we take one a day, and this one is on its first.

Derniers posts

Face aux comptes de taille comparable

Growth & engagement

Views per post

Engagement rate per post

What the audience does

Comptes similaires