LittleCrawler Python Framework: Master XHS, Xianyu & Zhihu Scraping in Minutes

1 days ago 高效码农

LittleCrawler: Run Once, Own the Data — An Async Python Framework for XHS, XHY, and Zhihu “ What exactly is LittleCrawler? It is a battery-included, open-source Python framework that uses Playwright, FastAPI and Next.js to scrape public posts, details and creator pages from Xiaohong-shu (RED), Xianyu (Idle Fish) and Zhihu in a single CLI or a point-and-click web console. 1. Why Yet Another Scraper? Core question: “My one-off script breaks every month—how can I stop babysitting logins, storage and anti-bot changes?” One-sentence answer: LittleCrawler moves those chores into pluggable modules so you spend time on data, not duct-tape. 1.1 Pain-points …