< Python

Share Share Share

Awesome Python Web Crawling

• grab 2,330

  

  | updated over 1 year ago | MIT License

  Web Scraping Framework

• MechanicalSoup 4,556

  

  | updated 11 months ago | MIT License

  A Python library for automating interaction with websites.

• portia 8,991

  

  | updated about 1 year ago | BSD 3-Clause "New...

  Visual scraping for Scrapy

• pyspider 16,434

  

  | updated 7 months ago | Apache License 2.0

  A Powerful Spider(Web Crawler) System in Python.

• robobrowser 3,676

  

  | updated about 4 years ago | BSD 3-Clause "New...