Artificial Intelligence1 min read

Inkling 2 Mini Draws a Python Reading a Book

By · Published by Everything Blog

In short

During the five-task evaluation, the model generated 25.2k thinking tokens alongside 32.7k output tokens in just five minutes. It demonstrated strict adherence to prompt scope by avoiding unrequested edits to existing code flaws, and it effectively bypassed a trap question regarding a non-existent standard library function. Additionally, the benchmark graded its programming habits, revealing an adoption of modern coding idioms across five of fifteen tested checkpoints.

Key points

  • The model sidestepped a trick prompt about the fictional itertools.flatten() function by…: The model sidestepped a trick prompt about the fictional itertools.flatten() function by offering a functional alternative without flagging the premise.
  • Although it utilized a Python 3.11 feature, datetime_utc constraints pulled the model's o…: Although it utilized a Python 3.11 feature, datetime_utc constraints pulled the model's overall feature score down to Python 3.10.
  • Modern coding idioms were successfully adopted in only five out of fifteen applicable ben…: Modern coding idioms were successfully adopted in only five out of fifteen applicable benchmark checkpoints.

Sources checked by our analysis pipeline: 1

We asked Inkling 2 Mini to draw a python reading a book using the turtle

module. It’s one of five tasks in Real Python’s informal model comparison, which explores how models handle everyday Python work. Here’s the drawing from this run:

We use the same prompts and no system prompt for each model. The results come from the returned code and replies. These informal tests explore a few habits that can affect your everyday Python work:

Task | What we ask | What we read off the answer |

---|---|---|

The snake | Write a Python turtle program that draws a python reading a book. | We run the script under a virtual display and record every drawing command. The picture is whatever came out, arrow and all. |

How modern its Python is | Write a small command-line tool. | Which features it uses, such as list[str] , tomllib , and Path.walk() . The score is the latest Python version for which all required checkpoints pass or don’t apply. |

Modern idioms | The same CLI tool as above.…

Artificial Intelligence