Artificial Intelligence1 min read

A visual explanation of reinforcement learning

By · Published by Everything Blog

In short

A spark operates with a four-neuron brain governed by three variables: straight connection strength, crossed connection strength, and an internal speed drive. The training algorithm applies small random modifications before each attempt, retaining beneficial shifts and reversing harmful adjustments based on whether light navigation improves. While early attempts result in spinning, the digital agents consistently advance toward approaching light at 500 attempts and master rapid tracking by 2,000 attempts.

Key points

  • Random brain adjustments paired with directional rewards allow digital agents to replace…: Random brain adjustments paired with directional rewards allow digital agents to replace manual wiring with autonomous adaptation.
  • Learning paths mapped in a three-dimensional brain space exhibit jitter, mistakes, and no…: Learning paths mapped in a three-dimensional brain space exhibit jitter, mistakes, and non-linear setbacks due to underlying randomness.
  • Visualizations confirm that hundreds of novice sparks starting from different random brai…: Visualizations confirm that hundreds of novice sparks starting from different random brain configurations eventually converge on the same state.

Sources checked by our analysis pipeline: 1

To try to answer this question, we’ll build a digital being with a simple brain, and watch it learn a new behavior.

In our previous article, we created a creature called a spark that could steer towards light. And we saw how small changes to its neural circuitry gave rise to very different behaviors.

Back then, we’d wired these circuits into the spark’s brain by hand. But now, we want it to learn the same behaviors by itself.

After all, you didn’t come into this world knowing how to walk, talk or read. While some of your abilities, such as breathing or swallowing, are wired by evolution, you gained others through an arduous process of trial and error.

We want our spark to do the same. To give you an intuition for this learning process, we’re going to hand over the controls to you. We’d like you to wire the spark’s brain.

But first, we need to tell you what you’ll be wiring. The spark’s brain has just four neurons — two neurons serving as its eyes, and two neurons…

Artificial Intelligence