During the five-task evaluation, the model generated 25.2k thinking tokens alongside 32.7k output tokens in just five minutes. It demonstrated strict adherence to prompt scope by avoiding unrequested edits to existing code flaws, and it effectively bypassed a trap question regarding a non-existent standard library function. Additionally, the benchmark graded its programming habits, revealing an adoption of modern coding idioms across five of fifteen tested checkpoints.
Key points
The model sidestepped a trick prompt about the fictional itertools.flatten() function by…: The model sidestepped a trick prompt about the fictional itertools.flatten() function by offering a functional alternative without flagging the premise.
Although it utilized a Python 3.11 feature, datetime_utc constraints pulled the model's o…: Although it utilized a Python 3.11 feature, datetime_utc constraints pulled the model's overall feature score down to Python 3.10.
Modern coding idioms were successfully adopted in only five out of fifteen applicable ben…: Modern coding idioms were successfully adopted in only five out of fifteen applicable benchmark checkpoints.
Sources checked by our analysis pipeline: 1
We asked Inkling 2 Mini to draw a python reading a book using the turtle
module. It’s one of five tasks in Real Python’s informal model comparison, which explores how models handle everyday Python work. Here’s the drawing from this run:
We use the same prompts and no system prompt for each model. The results come from the returned code and replies. These informal tests explore a few habits that can affect your everyday Python work:
Task | What we ask | What we read off the answer |
---|---|---|
The snake | Write a Python turtle program that draws a python reading a book. | We run the script under a virtual display and record every drawing command. The picture is whatever came out, arrow and all. |
How modern its Python is | Write a small command-line tool. | Which features it uses, such as list[str] , tomllib , and Path.walk() . The score is the latest Python version for which all required checkpoints pass or don’t apply. |
Heavy spending commitments are exposing major Chinese tech firms to heightened financial risks as commercialization lags behind aggressive infrastructure expansion. Analysis suggests this vast monetization gap could jeopardize long-term domestic ambitions far more severely than Western export controls. The widening divide underscores the challenge of translating substantial technological investments into meaningful near-term returns.
Real Python evaluated the artificial intelligence model across five informal everyday programming benchmarks using OpenRouter with default reasoning settings. The assessment measured the model's speed, code modernization, and drawing capabilities to determine its practical utility for software developers. The evaluation completed in under five minutes at an API cost of less than fifty cents.
The creator of Claude has officially debuted on the Nasdaq as the first pure artificial intelligence lab to enter public markets. This historic listing instantly ranks the firm among the world's most valuable enterprises while generating vast wealth for early stakeholders. However, the transition forces leadership to reconcile their foundational commitment to safety with enormous capital demands.