Announcing BrowserQL, our next-gen automation tooling

Browserless Blog

Advice and stories from our team about working with Puppeteer and Playwright.

February 21, 2025

Cutting Proxy Usage with Reconnects

Reduce proxy usage by up to 90% with reconnects. Learn how to optimize web scraping workflows using BrowserQL for session reuse, speed, and efficiency

February 14, 2025

How To Bypass Cloudflare When Scraping

Struggling with Cloudflare blocking your scrapers? Learn how to bypass bot detection, handle CAPTCHAs, and rotate IPs using open-source tools and BrowserQL.

February 11, 2025

Guide to JavaScript and Node.js Web Scraping with BQL

Learn JavaScript and Node.js web scraping with Axios, Cheerio, Puppeteer, and BQL. Handle dynamic content, CAPTCHAs, and bot detection for scalable workflows.

February 7, 2025

How to Scrape Protected Websites with ChatGPT

How to scrape websites with ChatGPT, including bypassing bot detectors using BrowserQL.

February 4, 2025

How to Scrape Shopify Stores with BrowserQL

Discover how to easily scrape Shopify stores for pricing, inventory, and product data with BQL.

January 30, 2025

How to Scrape Indeed with BrowserQL

How to scrape Indeed, including bypassing bot detection using BrowserQL

January 22, 2025

How to Scrape Reddit with BrowserQL

How to scrape Reddit, including bypassing bot detection using BrowserQL

January 14, 2025

How to Scrape Walmart.com with BrowserQL

How to scrape Walmart, including getting past bot detectors using BrowserQL

January 7, 2025

How to Scrape Yelp With Browserless

Learn how to scrape Yelp data with Browserless. Follow our step-by-step guide with anti-bot techniques to save time and boost your data collection ROI.

December 18, 2024

How To Scrape Zillow With Phone Numbers

How do you scrape Zillow with phone numbers? Read our complete guide here.

December 16, 2024

How to Download Files from Remote Browser Connections, With Puppeteer and Playwright

How to automate file downloads from a remote browser, using Puppeteer and Playwright, complete with sample scripts

December 12, 2024

How to Scrape eBay Using Browserless

Learn to scrape eBay data with Browserless. Follow our step-by-step guide with anti-bot techniques to save time and boost your data collection ROI.

December 5, 2024

How to Scrape Booking.com With Browserless

Learn to scrape Booking.com data with Browserless. Follow our step-by-step guide with anti-bot techniques to save time and boost your data collection ROI.

November 14, 2024

Announcing BrowserQL, Our Next-Gen Scraping And Automation Tool

Check out BrowserQL, our new browser automation tool. It has minimal fingerprints to get past even the toughest detectors, and a dedicated IDE and query language so you can write complex automations in a couple dozen lines.

November 7, 2024

How to Deploy Puppeteer on GCP Compute Engines, Complete with Dependencies Copy

How to deploy Puppeteer on GCP Compute Engines, complete with separate Chrome browsers and missing dependencies.

November 1, 2024

What are AI Digital Employees—and How are They Different From Regular AI Agents?

AI agents have become increasingly popular due to their ability to optimise business processes. But how do they work? Check out our guide to learn more.

October 29, 2024

How to Deploy Playwright on GCP Compute Engines

How to deploy Playwright and Chrome on GCP Virtual Machines, complete with VM selection and dependencies.

October 25, 2024

Searching API URLs and Extracting Objects with Puppeteer and Playwright

How to automatically find relevant JSON API URLs and the values within them, with libraries such as Playwright and Puppeteer.

October 17, 2024

A Guide to AI-Driven Testing (Benefits, Challenges and Strategies)

Learn about how AI can help with different types of automated software tests and the best tools to use.

October 10, 2024

How to Deploy Playwright on Azure VMs, Complete with Dependencies

How to deploy Playwright and Chrome on Azure Virtual Machines, complete with working dependencies.

October 4, 2024

How to Deploy Puppeteer on Azure VM, Complete with Dependencies

How to deploy Puppeteer on Azure Virtual Machines, complete with separate Chrome browsers and missing dependencies.

September 26, 2024

Patterns and Anti-Patterns in Web Scraping

How to avoid inefficient or unreliable unreliable web scraping, by swapping anti-patterns for patterns.

September 17, 2024

How to Deploy Playwright on AWS EC2

How to deploy Playwright and Chrome on AWS EC2, complete with advice on depencies, operating systems and configuring the environment.

September 13, 2024

How to Deploy Puppeteer on AWS EC2, Including Setup and Dependencies

How to deploy Puppeteer on AWS EC2, complete with tested solutions for OS compatibility and missing dependencies.

September 6, 2024

Selenium Alternatives: Choosing the Best Tool for Your Testing

Not sure if you should use an alternative to Selenium? Check out our guide on the top 5 choices and when you should choose them.

August 30, 2024

How to Debug Playwright & Puppeteer Automations With Effective Logging

Debugging automations without the right logs wastes time and resources. Check out our guide to learn how to set up logs and efficiently troubleshoot issues.

August 21, 2024

How to Select and Maintain CI Runners for Playwright

How to fix slow or flaky CI/CD test suites, through properly upgrading and maintaining test runners. Covers symptoms of small runners and how to plan an upgrade

August 8, 2024

Event Handling and Promises in Web Scraping

How to avoid common anti-patterns in web scraping, particularly in event handling and promises, including detailed code examples.

August 1, 2024

How to Create High Framerate Puppeteer Screencasts With Audio, Using Browserless

Struggling with screencasting using Puppeteer? It’s time to switch. Read our guide on how to use Browserless’ API to easily generatehigh quality videos.

July 26, 2024

Deploying Playwright on Google Cloud Functions

Use this tutorial to learn how to integrate Playwright with GCP, with code examples for deploying Chrome in a Function for seamless automations.

July 18, 2024

How to Run Puppeteer Within Chrome to Create Hybrid Automations

If you’re finding it hard to automate browser tasks due to security challenges, learn how to nest browsers for powerful hybrid automations in this guide.

July 16, 2024

Hiring - Senior Product Engineer

We're now hiring a a Senior Product Engineer to join our team.

July 11, 2024

Why HTTP load tests fail to catch critical errors

Why your load tests should include browsers as well as API call, and how to handle the required infrastructure.

July 5, 2024

How to Deploy Playwright on an Azure Functions App

Want to deploy Playwright on an Azure Functions App? This 4-step guide will show you how to get past size limitations and automate browser tasks.

June 28, 2024

How to Run Playwright Automations on Heroku

Looking to automate browser tasks on Heroku? Use this tutorial to learn how to integrate Playwright for seamless browser automation in the cloud.

June 19, 2024

Keep Puppeteer browsers alive with our Reconnect API

How to reuse a Chrome instance for multiple Puppeteer scripts with our /reconnect API, to speed up scraping or avoid repeat log ins.

June 13, 2024

How to Run Parallel Lighthouse Tests In Your CI Pipeline

How to run high volume Lighthouse tests as part of your continuous integration pipeline. Includes an overview of the benefits, and running concurrent tests with Browserless's /performance API

June 7, 2024

Join us at the 2024 edition of The Browser Conference

Join us at the next edition of the Browser Conference, featuring talks from Google, Sauce Labs and Selenium

June 6, 2024

How to Deploy Puppeteer on Google Cloud Functions

Looking to deploy Puppeteer on GCP? This guide includes the code required to run Puppeteer in a Function, including dealing with challenges such as compressed browsers.

May 29, 2024

How to Fix Slow Puppeteer Scripts With Three Underused Techniques

Common issues that cause slow Puppeteer scripts and how to fix them with underused features.

May 22, 2024

How to Deploy Puppeteer on Azure Functions for Browser Automation

How to deploy Puppeteer on Azure Functions, including instructions for using compressed browsers compatible with file size limits and saving outputs to a blob.

May 7, 2024

How to run Puppeteer on Heroku for Web Automation

Want to automate tasks on the web using Puppeteer-core and Heroku? This tutorial will walk you through the process and help you get started quickly.

April 29, 2024

How to Deploy Playwright on AWS Lambda

How to move your Playwright scripts onto AWS Lambda, with code examples for the required library files and layers.

April 24, 2024

How we manage individual user concurrencies with Nginx and Lua

A behind the scenes of how we manage fluctuating browser concurrency limits across our thousands of users.

April 12, 2024

Case Study: How My AskAI use Browserless to give their chatbots access the web

How My AskAI used Browserless to skip the deployment headaches of Puppeteer, and gives their AI agents internet access.

March 28, 2024

Automatically solve any captcha as part of your Playwright or Puppeteer script

Easily add captcha solving to your Puppeteer or Playwright scripts with our API, for web scraping and other automations.

March 22, 2024

How to run Playwright on Netlify

How to deploy Playwright on Netlify for testing or other automations, including advice on hosting headless browsers.

March 21, 2024

Stream login windows during Puppeteer scripts, with our Hybrid Automations

Screencast to an iframe while running a Puppeteer script, for actions such as entering details, solving captchas or authorizing a 2FA.

March 20, 2024

How to Deploy Puppeteer on AWS Lambda

How to deploy Puppeteer on AWS Lambda, including the use of puppeteer-core and sending generated files to an S3 bucket.

February 29, 2024

Deploying Playwright with Vercel for Effective End-to-End Testing

How to deploy Playwright on Vercel, with separately hosted browsers. Complete with code examples, you'll be up and running in no time.

February 28, 2024

How to use our new and improved SDK for Browserless v2

Diving into what's possible with Browserless's updated SDK and how to use it. Extend, modify or even re-implement parts of Browserless.

February 26, 2024

Announcing the /unblock API from Browserless, a new approach to dodging bot detectors

The /unblock API clears away bot fingerprints at the CDP level, to truly humanize your Puppeteer automations.

February 21, 2024

How and why we ripped our OS product apart for a full rebuild

Our battle with tech debt and the full details of completely rebuilding an open source product for v2.

February 20, 2024

How to use Puppeteer with Netlify

How to use Puppeteer on Netlify for tasks such as screenshots or PDF exports. This guide uses puppeteer-core with a separate Chrome instance.

February 15, 2024

How to Use Scrapy on Dynamic Sites, Without Playwright or Selenium

How to run Scrapy on our fleet of headless browsers, via our /content API. Run your existing scripts with a minimal code change, no need to touch Playwright, Puppeteer or Selenium.

February 13, 2024

Case study – How Semji create HTML snapshots for their SEO platform

How Semji ran their Puppeteer automations using Browserless, to generate HTML screenshots for their AI SEO tool.

February 2, 2024

Interview with Ben Fellows: Life Running a Top Quality Assurance Agency

Discussing the ins and outs of running a QA agency, including the realist's approach to continuous delivery and testing with Playwright.

January 23, 2024

How to Optimize Puppeteer Automations

Speed up your Puppeteer scraping and automations with practical tips on reusing browsers, cache management, and resource optimization.

January 17, 2024

Intelligent Data Extraction: What, Why, and How

Discover the transformative impact of intelligent data extraction for businesses. Dive into its significance, benefits, and the methodology behind turning vast amounts of raw data into actionable insights.

December 20, 2023

Case Study: How Takeoff Copenhagen got a 5x speed boost and reliable proxies for scraping with Browserless

Read how switching to Browserless helped Takeoff get reliable proxies, cut their bill and run faster scraping scripts.

December 18, 2023

Running scripts for Browserless using Zapier

You can run automations fully on the cloud by using Browserless with Zapier. Here's a quick guide on how to set up your first Zap.

December 15, 2023

How to generate Puppeteer scripts with Chrome's recorder

How to turn website interactions into Puppeteer scripts using Chrome's inbuilt Recorder, then run them through Browserless's API with a few tweaks.

December 13, 2023

Migrating from Selenium to Playwright

Outlining the advantages of Playwright over Selenium, with a detailed guide for how to convert your scripts and ditch the Grid.

December 6, 2023

browserless 2.0.0

We’re more than excited to announce today that we’ve rewritten browserless.io from the ground-up, and will be releasing it soon!

December 5, 2023

Advanced issues when managing Chrome on AWS

Key points to consider when hosting headless Chromium on AWS, for both EC2 and Lambda deployments

September 24, 2023

Announcing a residential proxy for browserless.io

We're excited to announce that we now have a built-in residential proxy for our paid cloud plans on browserless!

September 5, 2023

How to extract travel data at scale with Puppeteer

August 31, 2023

Headless Chrome with a GPU instance is fast!

The Power of GPU in Headless Chrome: Elevating Performance and Experience

August 22, 2023

WaitUntil option for Puppeteer and Playwright

Picking the best waitUntil option to use can be tricky, let's dive into the details of how each one works and how to pick the best one for each scenario.

July 18, 2023

Browserless now runs in LangChain

We’ve begun the process of integrating Browserless with the popular LangChain AI library, starting with Browserless’ REST APIs.

June 14, 2023

Using browserless to train your LLM

Large language models are only as good as the data you ingest into them. Read more about browserless and how to us it to train your LLMs!

March 21, 2023

How to use Puppeteer on Vercel

Using puppeteer on Vercel is hard! Here we dive into how to do it with the power of browserless

March 13, 2023

Announcing a new puppeteer benchmarking tool

Announcing a new puppeteer benchmarking tool to see how puppeteer performs version over version.

February 23, 2023

Scaling Puppeteer and Chrome Horizontally

This guide includes all the snippets you need to succeed at scaling puppeteer and chrome horizontally by using tools like nginx and docker.

February 2, 2023

Why we pick Puppeteer over Selenium almost every time

Choosing between Selenium and puppeteer can be hard, here's some suggestions of what we've found over the past several years to help.

December 30, 2022

Web Scraping Business Ideas for Everyone

In this article, we'll show you 12+ different web scraping ideas to use in your job or life.

December 8, 2022

Introducing Unit-based Pricing

New unit-based pricing is intuitive, predictable, and includes 7-day trial. Try Browserless today for free.

December 7, 2022

Turning sites into structured data | How to get JSON file from Wikipedia

In this article, we'll show you how you can turn any site into a structured data. The example is Wikipedia website to JSON.

October 18, 2022

What is Data Scraping? The Tutorial for Beginners

In this article, we'll answer on "what is Data Scraping" and how you can use Browserless to start scraping web data.

September 30, 2022

The Full Guide to Web Scraping & Automation with JavaScript and NodeJS

In this article, we'll share all steps that you need to take to start doing web automation and web scraping with NodeJS & JavaScript

September 16, 2022

The best open source web automation tools for 2022

In this article, we'll share the best open source web automation tools and libraries for 2022. Check out to find your fav tool!

September 16, 2022

What is Browser Automation? Guide to Get Started

In this article, we'll cover different browser automation use cases, tools and how to get started with automating browsers.

September 2, 2022

Getting started on web scraping with Selenium WebDriver and Python

In this article we'll show you how to use Selenium for web scraping. We'll show you a real example of how python web scraping works.

August 26, 2022

Zillow scraper guide | How to build your own Zillow web scraping tool

In this article we'll share real code that will let you build your own Zillow scraper tool. Copy & paste it to start your Zillow scraping.

August 26, 2022

Getting started with Website Test Automation | Browserless guide

In this article, we'll dive deeper into web automation test examples. We'll share a few use cases on website test automation.

August 19, 2022

Playwright vs Puppeteer: Which one to choose for Browser automation?

In this article, we'll dive deeper into browser automation and what framework you should use: playwright vs puppeteer.

August 3, 2022

How to create a time-lapse traffic with Browserless

Take a look at how to create time-lapse traffic using Browserless open source web automation tool for developers.

July 1, 2022

How to scrape data from Google Maps using Puppeteer & Browserless [Tutorial]

In this article, we'll show you how you can build your own Google Maps scraper so you can implement scraping Google Maps easily.

June 30, 2022

How Okra is using top-level browser automation with Browserless [Case Study]

Would you like to see how to implement browser automation in your business, check out how Okra did it with Browserless

June 28, 2022

How to scrape Google Shopping using Puppeteer and Browserless

In this article we'll show you how to scrape Google Shopping prices and results using Puppeteer and Browserless.

June 24, 2022

How to scrape Glassdoor data using Browserless automation and Node [Tutorial]

We'll show you how to scrape Glassdoor using Node.js & Browserless. This Glassdoor scraping tutorial includes a copy & paste code example.

June 13, 2022

How to build your own Twitter scraper tool using Browserless and Node.js

Today we'll show your a code to scrape Twitter profile, followers and other data. If you're interested in Twitter scraping, check it out!

June 10, 2022

How to automate a WebRTC video stream with Puppeteer & Browserless

We'll show you how to automate a WebRTC video stream with Puppeteer & Browserless.

June 10, 2022

How to do web automation with Puppeteer-core & Browserless [3 code examples]

Today we'll show you how to use Puppeteer-core for automation.

May 31, 2022

Web scrape YouTube videos with Browserless automation and Node.js [Copy & Paste code example]

We'll share with you the step by step guide on how to build your own Youtube scraper, so you can web scrape Youtube platform easily!

May 27, 2022

How BigBlueButton, an open source project, runs automated E2E tests with Browserless

Wanna see how our customers used Puppeteer & Browserless to automate PDF & PNG exporting from slide decks. Check it out!

May 18, 2022

How Cashfree implemented one-time-passwords with Browserless

Wanna see how our customers used Puppeteer & Browserless to implement one-time passwords in the banking industry! Check it out!

May 18, 2022

How Samsara does stress test automation of their app with Browserless

How Samsara did stress test automation of their app with Browserless

May 13, 2022

How to manage sessions for web automation with Puppeteer + Browserless

We'll share session management tactics, such as reusing cookies, reconnecting to browsers and using the --user-data-dir

May 13, 2022

How Dropdeck automated slide deck exporting to PDF and generation of PNG thumbnails 🗂

Wanna see how our customers used Puppeteer & Browserless to automate PDF & PNG exporting from slide decks. Check it out!

We have been writing, using and deploying headless browserless workloads for nearly 10 years.

We're committed to making headlessbrowser workloads as painless aspossible! I knew a solution like Browserlesscould dramatically simplify the work andmaintenance, but none existed, so Istarted Browserless.

Joel Griffith,
Founder & CEO