lorien/learning-web-scraping

Stars
9
Rank 1,939,727 (Top 39 %)
Language
Created almost 2 years ago
Updated over 1 year ago

lorien/learning-web-scraping

lorien

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

A list of articles and books teaching web scraping

awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

grab

Web Scraping Framework

user_agent

Generator of User-Agent header

captcha_solver

Universal python API to captcha solving services

awesome-osint

Yet another list of OSINT tools

awesome-pastebin

List of pastebin services

ru-osint-infosec-map

Graph of OSINT and InfoSec resources in Russian language

awesome-anti-captcha

Curated list of captcha solving software, libraries and API.

proxylist

Python library to work with proxy server items loaded from local file or network document.

awesome-python-dev

List of tools for debugging, profiling and analyzing python programs.

selection

API to extract data from HTML and XML documents

runscript

Simple script launcher

procstat

A tool to count runtime metrics

pyproject

Python Project Template for Cookiecutter

badserver

awesome-geoint

Tools for GEOINT

3proxy_confgen

3proxy config generator to use upstream proxies

unicodec

Tools to detect encoding and convert HTML bytes content to Unicode.

mongodb_toolbox

Tools to automate mongodb read/write operations.

test_server

Server to test HTTP clients

iohub

Dashboard to monitor ioweb crawlers

rucaptcha

Python library to access rucaptcha/twocaptcha API

mongoenum

Script to enumerate sizes of mongodb databases, collections and indexes.

captcha_solution

A simple interface to multiple captcha solving services