Announcing BrowserQL, our next-gen automation tooling
Extract HTML from protected sites with our /unblock API
Use our stealth browsers via the /unblock API with residential proxies, to retrieve HTML, take a screenshot or generate an unlocked endpoint for Playwright or Puppeteer.
Bypass Cloudflare, Datadome and other bot detectors
Our /unblock API automatically hides even the most subtle signs that a browser is being automated. It controls browsers at the CDP level, removing typical traces a library leaves behind.
You can enable content or screenshots to get the HTML or PNG, or use the unlocked WebSocket endpoint with Playwright or Puppeteer
/unblock API doc
Use the HTML with Scrapy or other tools
Our APIs render and evaluates a page with our browsers, then returns the HTML or JSON.
You can then use a library such as Scrapy or Beautiful Soup to extract the data if needed. This gives you the advantages of headless such as JavaScript rendering and captcha avoidance, without having to run them yourself.
Check out the docs
Use the full power of Puppeteer and Playwright
Unlike many scraping tools, you can also use the standard Puppeteer and Playwright libraries to run any script.
You can click buttons, navigate dynamic content or anything else. Just host the scripts in your servers and connect them to our browsers.
Getting started docs