Lookyloo/ScrapySplashWrapper Lookyloo/ScrapySplashWrapper

  • This repository has been archived on 03/May/2022
  • Stars
    star
    9
  • Rank 1,929,110 (Top 39 %)
  • Language
    Python
  • License
    Other
  • Created about 7 years ago
  • Updated over 2 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
Lookyloo/ScrapySplashWrapper
github

Lookyloo

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A wrapper that uses scrappy and splash to crawl a website.

More Repositories

1

lookyloo

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
Python
676
star
2

PlaywrightCapture

Capture a URL with Playwright
Python
29
star
3

sanejs

Use CDNJS as a source to build hashes of known JS/CSS/IMG/... content used all over the internet
Python
15
star
4

scraping-tutorial

This tutorial explains the benefits, pitfalls, and limitations of scraping, and why Lookyloo is an important tool.
Jupyter Notebook
10
star
5

pysecuritytxt

Tries to get and parse .well-known/security.txt from a domain
Python
8
star
6

phishtank-lookup

Simple web API using the hourly dump from Phishtank
Python
7
star
7

har2tree

Make a tree from a HAR file
HTML
7
star
8

PyLookyloo

Python CLI and module for Lookyloo
Python
6
star
9

monitoring

Example project to monitor a list of websites and detect changes
Python
5
star
10

project_template

Simple template used in most of the projects.
Python
3
star
11

webext

Web extension to submit a URL with its context to a Lookyloo instance
JavaScript
2
star
12

docs

Documentation for Looklyoo
Shell
2
star
13

PyPhishtankLookup

Python API for Phishtank Lookup
Python
2
star
14

testing

Simple webserver doing weird redirects and other stuff to test Lookyloo
HTML
1
star
15

pyproject_template

Python CLI and module for project template
Python
1
star