< Python
Twitter logo Share LinkedIn logo Share Facebook logo Share

Awesome Python Web Crawling

  • grab grab 2,330
    star
    updated 10 months ago MIT License

    Web Scraping Framework

  • MechanicalSoup MechanicalSoup 4,501
    star
    updated 4 months ago MIT License

    A Python library for automating interaction with websites.

  • portia portia 8,991
    star
    updated 8 months ago BSD 3-Clause "New...

    Visual scraping for Scrapy

  • pyspider pyspider 16,220
    star
    updated 10 months ago Apache License 2.0

    A Powerful Spider(Web Crawler) System in Python.

  • robobrowser robobrowser 3,676
    star
    updated over 3 years ago BSD 3-Clause "New...