Skip to content
@Gerapy

Gerapy

Distributed Crawler Management Framework Based on Scrapy, Scrapyd.

Pinned Loading

  1. Gerapy Gerapy Public

    Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

    Python 3.2k 630

  2. GerapyAutoExtractor GerapyAutoExtractor Public

    Auto Extractor Module

    Python 310 75

  3. GerapyPyppeteer GerapyPyppeteer Public

    Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

    Python 136 37

  4. GerapyRabbitMQ GerapyRabbitMQ Public

    Distribution Support for Scrapy & Gerapy using RabbitMQ

    Python 8 1

  5. GerapyRedis GerapyRedis Public

    Distribution Support for Scrapy & Gerapy using Redis

    Python 8 1

  6. GerapyProxy GerapyProxy Public

    A package for supporting proxy in Scrapy & Gerapy

    Python 10 4

Repositories

Showing 10 of 12 repositories
  • Gerapy Public

    Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

    Gerapy/Gerapy’s past year of commit activity
    Python 3,248 MIT 630 62 4 Updated Jun 18, 2024
  • GerapyRabbitMQ Public

    Distribution Support for Scrapy & Gerapy using RabbitMQ

    Gerapy/GerapyRabbitMQ’s past year of commit activity
    Python 8 1 2 0 Updated Nov 27, 2023
  • GerapyItemPipeline Public

    Item Pipeline Components for Gerapy & Scrapy

    Gerapy/GerapyItemPipeline’s past year of commit activity
    Python 1 2 0 1 Updated Sep 20, 2023
  • GerapyAutoExtractor Public

    Auto Extractor Module

    Gerapy/GerapyAutoExtractor’s past year of commit activity
    Python 310 Apache-2.0 75 16 0 Updated Dec 28, 2022
  • GerapyPlaywright Public

    Downloader Middleware to support Playwright in Scrapy & Gerapy

    Gerapy/GerapyPlaywright’s past year of commit activity
    Python 106 24 13 0 Updated Mar 6, 2022
  • GerapyPyppeteer Public

    Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

    Gerapy/GerapyPyppeteer’s past year of commit activity
    Python 136 37 7 0 Updated Dec 27, 2021
  • GerapyPrometheusExporter Public

    Gerapy Prometheus Exporter

    Gerapy/GerapyPrometheusExporter’s past year of commit activity
    Python 5 2 1 0 Updated Mar 16, 2021
  • GerapyRedis Public

    Distribution Support for Scrapy & Gerapy using Redis

    Gerapy/GerapyRedis’s past year of commit activity
    Python 8 1 0 0 Updated Mar 16, 2021
  • GerapySelenium Public

    Downloader Middleware to support Selenium in Scrapy & Gerapy

    Gerapy/GerapySelenium’s past year of commit activity
    Python 30 3 4 0 Updated Sep 13, 2020
  • Acinonyx Public

    A package which can simplify your multiprocessing implementation

    Gerapy/Acinonyx’s past year of commit activity
    Python 4 0 0 0 Updated Jul 27, 2020
View all repositories

Top languages

Loading…

Most used topics

Loading…