apify/crawlee
steadyCrawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript
View on GitHub
Stars
25,867
Forks
1,679
Open issues
104
24h
+18
+0.1%
7d
+95
+0.4%
Refresh
1h
Star history (7 days)
Last checked
1h ago
Last pushed
11h ago
Next check
2m ago