Omnicrawl's Zyte API, under any PHP host: pages fetched over HTTP with the target's headers, behind omnicrawl's gate - and only for targets declared under a licence (one's own site, written permission), because Zyte's ban avoidance cannot be turned off and may override the User-Agent. No browser mode (it cannot send the family's User-Agent). Its limits and terms declared as data.

Go to Download

omnicrawl/firecrawl

0 Favers
0 Downloads

Omnicrawl's Firecrawl (API v2), under any PHP host: pages fetched as raw HTML and batch runs over a fixed set of addresses, behind omnicrawl's gate (robots.txt, the target's declaration, per-host limits, provenance) - the family's User-Agent sent to the target, the basic proxy only (never Firecrawl's anti-bot proxies), no cache left at Firecrawl; Firecrawl always renders, so undeclared sites are refused. Its limits and terms declared as data.

Go to Download

omnicrawl/apify

0 Favers
0 Downloads

Omnicrawl's Apify, under any PHP host: runs over a fixed set of addresses with the Cheerio Scraper actor (no link followed, one page at a time, no retry, no Apify proxy, robots.txt honoured by the actor too), the target's raw HTML, status and headers kept, behind omnicrawl's gate. Its limits and terms declared as data.

Go to Download