Technology1 min read

The world's hardest sites protect their prices

By · Published by Everything Blog

In short

Zyte's State of Web Access 2026 study evaluated 11,100 landing pages to measure web defense tiers, identifying retail and e-commerce as nearly a third of the hardest-to-access destinations. Industries relying on dynamic public listings, such as automotive and property portals, appear among the most shielded domains at two to three times their sample distribution. Some real estate platforms have even introduced fictitious seed listings to trace and identify unauthorized data harvesting. Meanwhile, airlines rely on both technological countermeasures and aggressive litigation to block external aggregators from capturing fare structures.

Key points

  • Highly defended web architectures directly reflect the sensitivity of publicly exposed co…: Highly defended web architectures directly reflect the sensitivity of publicly exposed commercial data like product stock and pricing.
  • Sectors with high-value catalog listings, including real estate and automotive platforms,…: Sectors with high-value catalog listings, including real estate and automotive platforms, deploy advanced mechanisms like decoy listings to combat scrapers.
  • Commercial airlines increasingly complement technical web barriers with direct lawsuits a…: Commercial airlines increasingly complement technical web barriers with direct lawsuits against online travel agencies to protect fare data.

Sources checked by our analysis pipeline: 1

A fashion retailer cuts the price of a jacket at lunchtime. A property portal lists an apartment that will be gone by Friday. An airline moves a fare three times before dinner.

Each of those pages carries information that competitors, comparison services and analysts want to track, and each is published by a business that knows it.

Those are the sites that sit at the top of Zyte's State of Web Access 2026 difficulty scale. The study rates every site against Zyte API's five-tier access complexity model, from Simple (a plain HTTP request) to Advanced (full specialised infrastructure). Only 3.0% of the 11,100 landing pages it audited land at Complex, and just 1.2%, 132 sites, reach Advanced. Another 48 rated beyond the top of the scale on at least one access method, bringing the hardest corner of the web to 180 sites.

Which industries are hardest to scrape?

Ranked by mean recommended tier, the hardest categories are almost all places where people buy things. Against a research-wide average of 1.58, every one of them sits well above the baseline, and…

Technology