• Stars
    star
    205
  • Rank 191,264 (Top 4 %)
  • Language
  • License
    MIT License
  • Created over 1 year ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Monitoring the internet for new .zip domains

ZIP Domains Tweet

Newly registered .zip domains

Welcome to our project dedicated to providing up-to-date data on newly registered .zip domains. With the recent introduction of the .zip top-level domain (TLD) by Google, concerns have arisen within the community regarding potential attack vectors associated with this TLD. To address these concerns and ensure the safety of internet users, we have initiated this workflow aimed at gathering comprehensive information about .zip domains as they are registered.

Objective

Our mission is to provide a reliable and regularly updated dataset that contains valuable insights into newly registered .zip domains. By systematically collecting and analyzing information, we aim to shed light on potential risks and help the community make informed decisions when interacting with these domains. Our project focuses on promoting online security and mitigating any potential threats associated with the .zip TLD.

Disclaimer

While we strive to provide accurate and up-to-date information, it is important to note that our project serves as a supplementary resource and should not be considered a definitive indicator of the security status of any .zip domain. It is crucial for users to exercise their own judgment and employ additional security measures when interacting with any domain, including those under the .zip TLD.

DNS Data

This repository contains DNS data organized into CSV files. Each CSV file represents a collection of DNS records and includes the following properties for each record:

  • Host: The hostname or domain associated with the record.
  • A: The IP address corresponding to the host.
  • SOA: Start of Authority record for the domain.
  • NS: Name Servers responsible for the domain.
  • Status Code: The DNS response code for the query.
  • CDN: Indicates whether the record is served through a Content Delivery Network (CDN).
  • CDN Name: The name of the CDN used, if applicable.

The data

Here's an example of how the data is structured in the CSV files:

Filename Hosts SOA NS Status Code A CDN CDN Name AAAA MX TXT CNAME CAA PTR Has Internal IPs Internal IPs
backup.zip ns1.name.com, hostmaster.nsone.net ns4fmw.name.com, ns2dky.name.com, ns1bdg.name.com, ns3dkz.name.com NOERROR 91.195.240.94, 163.114.216.17, 163.114.216.49, 163.114.217.17, 163.114.217.49 2a00:edc0:107::49
microsoft-office.zip ns1.name.com, hostmaster.nsone.net ns4fmw.name.com, ns2dky.name.com, ns1bdg.name.com, ns3dkz.name.com NOERROR 91.195.240.94, 163.114.216.17, 163.114.216.49, 163.114.217.17, 163.114.217.49 2a00:edc0:107::49

Screenshots

This repository also includes screenshots of live web servers running on ports 80 or 443 of the found websites. All screenshots can be found in the screenshots directory and a Markdown report is available at screenshots.md for convenient browsing purposes.

How It Works

Trickest Workflow - SSL

TB; DZ (Too big; didn't zoom):

  1. Download 479k English words to be used as wordlist
  2. Download top 10 Million Websites. Use a bash script to delete .tlds and get only the company names
  3. Use custom-script to create permutations for company names with wordlists (backup, update, etc)
while read -r word; do
    while read -r line; do
        echo "${word}${line}"
        echo "${line}${word}"
        echo "${line}-${word}"
        echo "${word}-${line}"
    done < domains.txt
done < words.txt
  1. Download NewDomains_ZIP File and merge it with all generated data
  2. Use raft-small-words, raft-large-words, raft-large-directories-lowercase, directory-list-lowercase-2.3-big
  3. Use mgwls to generate .zip tlds
  4. Generate batched pattern to be able to execute the workflow in parallel on 50 machines or more
  5. Use puredns for faster resolving
  6. Use dnsx to resolve and get JSON data
  7. Use webscreenshot to take screenshots
  8. Merge the data from parallel executions
  9. Create CSV zip-domains.csv with python
  10. Create Markdown screenshots report screenshots.md
  11. Push to repository

Contribution

All contributions/ideas/suggestions are welcome! Feel free to create a new ticket via GitHub issues, tweet at us @trick3st, or join the conversation on Discord.

Build your own workflows

We believe in the value of tinkering; cookie-cutter solutions rarely cut it. Sign up to Trickest to customize this workflow to your use case, get access to many more workflows, or build your own workflows from scratch!

More Repositories

1

cve

Gather and update all available and newest CVEs with their PoC.
HTML
5,099
star
2

wordlists

Real-world infosec wordlists, updated regularly
804
star
3

inventory

Asset inventory on public bug bounty programs.
Shell
700
star
4

resolvers

The most exhaustive list of reliable DNS resolvers.
420
star
5

mksub

Generate tens of thousands of subdomain combinations in a matter of seconds
Go
191
star
6

dsieve

Filter and enrich a list of subdomains by level
Go
145
star
7

mkpath

Make URL path combinations using a wordlist
Go
140
star
8

find-gh-poc

Find CVE PoCs on GitHub
Go
110
star
9

log4j

Trickest Workflow for discovering log4j vulnerabilities and gathering the newest community payloads.
104
star
10

insiders

Archive of Potential Insider Threats
101
star
11

containers

Automated privilege escalation of the world's most popular Docker images.
Shell
62
star
12

enumerepo

List all public repositories for (valid) GitHub usernames
Go
52
star
13

safe-harbour

security.txt collection of most popular world-wide domains
50
star
14

trickest-cli

Execute Trickest workflows right from your terminal
Go
45
star
15

recon-and-vulnerability-scanner-template

Create your own recon & vulnerability scanner with Trickest and GitHub
40
star
16

cloud

Monitoring the Cloud Landscape
26
star
17

mgwls

Combine words from two wordlist files and concatenate them with an optional delimiter
Go
23
star
18

scripts

Handy scripts and one-liners to make life easier
22
star
19

elasticsearch_index

Manage attack surface data on Elasticsearch
Python
17
star
20

packages

Automated compromise detection of the world's most popular packages
13
star
21

action

Github Action for Trickest Workflows
Shell
6
star