Top #headless Tools & Software

puppeteer

github

JavaScript API for Chrome and Firefox

refine

github

A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.

phantomjs

github

Scriptable Headless Browser

ArchiveBox

github

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

crawlee

github

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

katana

github

A next-generation crawling and spidering framework.

chromedp

github

A faster, simpler way to drive browsers supporting the Chrome DevTools Protocol.

crawlee-python

github

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

puppeteer-extra

github

💯 Teach puppeteer new tricks through plugins.

rod

github

A Chrome DevTools Protocol driver for web automation and scraping.

pydoll

github

Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.

HeadlessBrowsers

github

A list of (almost) all headless web browsers in existence

aquatone

github

A Tool for Domain Flyovers

gowitness

github

🔍 gowitness - a golang, web screenshot utility using Chrome Headless