• Stars
    star
    494
  • Rank 88,523 (Top 2 %)
  • Language
    Python
  • License
    MIT License
  • Created about 4 years ago
  • Updated about 1 month ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

scrape proxies from more than 5 different sources and check which ones are still alive

Proxy scraper and checker

Tests

Scrape more than 1K HTTP - HTTPS - SOCKS4 - SOCKS5 proxies in less than 2 seconds.

Scraping fresh public proxies from different sources:

Installation

Use this command to install dependencies.

pip3 install -r requirements.txt

Usage

For scraping:

python3 proxyScraper.py -p http
  • With -p or --proxy, You can choose your proxy type. Supported proxy types are: HTTP - HTTPS - Socks (Both 4 and 5) - Socks4 - Socks5
  • With -o or --output, create and write to a .txt file. (Default is output.txt)
  • With -v or --verbose, more details.
  • With -h or --help, Show help to who did't read this README.

For checking:

python3 proxyChecker.py -t 20 -s google.com -l output.txt
  • With -t or --timeout, dismiss the proxy after -t seconds (Default is 20)
  • With -p or --proxy, check HTTPS or HTTP proxies (Default is HTTP)
  • With -l or --list, path to your list.txt. (Default is output.txt)
  • With -s or --site, check with specific website like google.com. (Default is google.com)
  • With -r or --random_agent, it will use a random user agent per proxy.
  • With -v or --verbose, more details.
  • With -h or --help, Show help to who did't read this README.

Good to know

  • Dead proxies will be removed and just alive proxies will stay.
  • This script is also able to scrape Socks, but proxyChecker only checks HTTP(S) proxies.

Star History

Star History Chart

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Issues

Feel free to submit issues and enhancement requests or contact me via vida.page/nima.

License

MIT

More Repositories

1

OpenConnect-Cisco-AnyConnect-VPN-Server-OneKey-ocserv

[Script and Docker 🐳] OpenConnect (Cisco AnyConnect) VPN Server (OCServ) script one key easy configurator and installer
Shell
255
star
2

telegram-cloud

Download and upload files via your Telegram account up to 2 GB
Python
203
star
3

torrentp

Python torrent downloader - Download from torrent with .torrent file or magnet link, with just 3 lines of python code.
Python
153
star
4

partialjson

Parsing ChatGPT JSON stream response — Partial and incomplete JSON parser python library for OpenAI
Python
57
star
5

Ton-Fragment

UnOfficial Fragment API (Telegram - Ton Coin) Python library
Python
32
star
6

Virtual-3D-Model-Conference-Room

Virtual 3D Model Conference Room
JavaScript
23
star
7

3D-Model-Viewer

An example of the <model-viewer> project from Google
HTML
11
star
8

WhatsApp-Tweak

Disable Read receipts WhatsApp.
Logos
4
star
9

Checklist

Checklist app - Swift
Swift
4
star
10

Twitter-Scraper

A Twitter Watcher (Tweet Scraper without API and limitations) - (Twitter Scraper)
Python
4
star
11

Fuck-SandBox

Get list of installed apps and their info on iOS
Swift
3
star
12

WhatsApp-2FA

retrieve 2FA code of your WhatsApp
Logos
3
star
13

iw4p.github.io

HTML
3
star
14

Arduino

Simple Arduino projects
C++
2
star
15

RadioJavanBot

Radio Javan Telegram Bot to fetch data and download links from URL
Python
2
star
16

python-OOP-unittest-design-pattern

basic OOP implementation - python calculator for learning test and design patterns
Python
2
star
17

RadioJavan-Password-retriever

Password retriever For Radio Javan Application - iOS
Logos
1
star
18

iw4p

I can get out of vim quickly
1
star
19

FandoghBot

simple https://fandogh.cloud telegram bot to fix my exec problem, maybe gonna bigger and add more features one day
Python
1
star
20

Verilog

Basic and simple Verilog programs with testbench
Verilog
1
star
21

RATGram

RAT (Remote Access Trojan) Via Telegram Bot
1
star
22

Bull-s-Eye

A simple game with simple codes [RW]
Swift
1
star
23

packet-sniffer

Python
1
star
24

Vebko-Chat-Service

chat service for Vebko company using React and TypeScript and .NET Framework 4
JavaScript
1
star
25

chip8-emulator

A chip8 emulator powered by Rust 🦀
Rust
1
star
26

Calculator

Very very simple calculator app for iOS devices. Created for learning purpose and fun.
Swift
1
star
27

iOS-AdsBlocker

DNS ads blocking
JavaScript
1
star
28

Infinity-loop

Move imageViews like a cloud on the sky (animation)
Swift
1
star
29

Reinforcement-Learning

Jupyter Notebook
1
star