TechnologyMonday, October 26, 20261 min read

Run Scale AI’s AgentEnv evals on Vercel Sandbox

By Engineering Blogs · Published by Everything Blog

In short

AgentEnv, a testing framework for Scale AI, is now available on Vercel Sandbox, allowing for separate task and agent environments. The example and command for running an evaluation are provided, with instructions for replacing team and project details.

Key points

Available on Vercel Sandbox for task and agent separation.: Available on Vercel Sandbox for task and agent separation.
Example and command provided for running an evaluation.: Example and command provided for running an evaluation.
Replace team and project details with actual values.: Replace team and project details with actual values.

Sources checked by our analysis pipeline: 1

AgentEnv, Scale AI's framework for testing agents against tasks and scoring their results, now runs on Vercel Sandbox. The Vercel provider ships in AgentEnv 0.9.1334 and later, and runs the agent and its task environment in separate Sandboxes.

Try the AgentEnv example to run an evaluation on Vercel Sandbox and inspect the task’s score and the agent’s recorded actions. After completing the setup guide, run this command from the cloned repository. It uses your existing Vercel CLI login:

./vercel-eval --scope YOUR_TEAM --project YOUR_PROJECT

Replace YOUR_TEAM

with your Vercel team slug and YOUR_PROJECT

with an existing project name.

Learn more in the Sandbox ecosystem documentation.

Original source: vercel.com

To make AI morally good, tech companies are turning to religion. But some experts say it isn't that simple
Tech companies are exploring religious frameworks to address ethical dilemmas in AI, but concerns about the separation of religion from morality persist. This approach could exacerbate existing biases and dilute the diversity of ethical perspectives.
13 min read
Uh oh, it sounds like the iPhone Duo keeps cracking and users aren’t happy about it
The iPhone Duo, a foldable phone by Apple, has faced widespread issues among early adopters, including cracked screens and display malfunctions, leading to user dissatisfaction. Bloomberg reports that some users have experienced loud crunching noises and visible cracks in the display, while others encountered big fat creases. Apple has acknowledged an issue impacting a small number of units, suggesting the problem may have been unaddressed. This marks a challenging beginning for the iPhone Duo, which was anticipat…
1 min read
iPhone Duo owners report cracks in Apple’s first foldable handset
Owners of the new foldable iPhone are reporting cracks in the device's screen, as Apple confirmed an issue with a "small number" of units. Reports of cracks have emerged on Reddit and social media platforms since the handset went on general sale globally on Friday. Experts said there had been too few examples to determine whether there was a more serious problem with Apple's first foldable device, which retails from $1,999 (£1,499).
2 min read

Run Scale AI’s AgentEnv evals on Vercel Sandbox

In short

Key points

More in Technology