Pinned Loading

1. scrapydweb scrapydweb Public

   Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. Docs Wen Dang

   Python 3.4k 586

2. logparser logparser Public

   A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

   Python 93 25

3. scrapyd-cluster-on-heroku scrapyd-cluster-on-heroku Public

   Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO

   Python 123 81

4. scrapyd scrapyd Public

   Forked from scrapy/scrapyd

   [PR #326] Native support for basic auth `pip install -U git+https://github.com/scrapy/scrapyd.git`, then add `username = yourusername` and `password = yourpassword` in the scrapyd.conf file. DOCS

   Python 9 4

5. files files Public

   Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects

   421 69

6. notes notes Public

   Keep on reading

   Python 6 2