Artificial Intelligence1 min read

curl on OSS-Scanner

By · Published by Everything Blog

In short

Maintainers confirmed only five of 45 reported security flaws as actual low-severity vulnerabilities, downgrading 36 claims to ordinary bugs and rejecting the remainder. The scanning platform, inspired by OSS-Fuzz, analyzed curl on Anthropic's machines following an enrollment pull request submitted in late October. Although curl recently raised its threshold for classifying low-severity vulnerabilities, maintainers observed that the automated findings still yielded an unusually high proportion of genuine, non-security defects.

Key points

  • Automated scanner findings proved technically useful but consistently overclassified stan…: Automated scanner findings proved technically useful but consistently overclassified standard programming defects as security vulnerabilities.
  • curl validated 80 percent of the disputed vulnerability claims as ordinary bugs, nearly d…: curl validated 80 percent of the disputed vulnerability claims as ordinary bugs, nearly double the project's typical baseline.
  • Human review remains essential to filter out flawed patches and properly prioritize autom…: Human review remains essential to filter out flawed patches and properly prioritize automated vulnerability reports.

Sources checked by our analysis pipeline: 1

OSS Scanner is a service by Anthropic to scan critical open-source repositories for security vulnerabilities

Enrollment

curl maintainer Max Dymond submitted pull-request 1191 to OSS-Scanner in the end of October and we were swiftly enrolled into the program.

The idea for this service is inspired by OSS-Fuzz: Anthropic scans the participating open source projects for security problems on their machines at some interval with their magic applied and they let us know if they find anything. I don’t think they officially say exactly which model they use for this nor how often they rescan.

First contact

Early in the morning of November 5 we received our first sign of life from them since they merged the PR. An automated mail:

Subject: [Anthropic OSS Scanner] Disclosing 45 security vulnerabilities in curl

Forty-five security vulnerabilities in a single shot is a lot. But sure, we did ask them to do this.

Of course, had we not asked them, chances are someone else would instead have figured these ones out and reported to us separately. There are many people with capable harnesses and…

Artificial Intelligence