• Stars
    star
    397
  • Rank 108,561 (Top 3 %)
  • Language
    HTML
  • License
    MIT License
  • Created over 1 year ago
  • Updated 9 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

In this repository you will find sample commands and test files for each day of the course "Linux for OSINT. A 21-day course for beginners".

Linux for OSINT. 21-day course for beginners

GitHub stars GitHub forks


Who Is This Course For?

The course is primarily intended for those who are professionally involved in or simply interested in OSINT. And you will find in it a lot about automation of collection and analysis of various data.

On my Twitter (https://twitter.com/cyb_detective) account, I regularly write about useful tools for OSINT, including various Linux utilities. And many times readers have asked, "Cool! Is it possible to run this on Windows?".

Yes, there are different methods of running Linux utilities on Windows. But they are more complicated than running Linux on a VM (virtual machine), VPS (virtual private server) or in an online development environment.

This short tutorial is created to show you clearly that:

  • Linux and the command line are very easy to use. Really easy. Extremely easy.
  • hundreds of tasks (OSINT related and not only) can be simplified and automated with Linux.
  • using Linux command line is a real, unparalleled pleasure.

This course is designed for the total beginners. I won't even ask you to install a VM with Linux until the last day, all examples can be tried in a browser. You also won't need any special knowledge. If you know how to use e-mail, you will be able to handle this course. Just relax and follow the instructions carefully.

When reading, keep in mind that this is a short course and so many things are left out. And really important things have been left out. It is designed primarily to show you the capabilities of Linux and to show you "which way to look" when faced with different tasks.

Who should avoid this course?

Linux is good because you can solve the same problem in many different ways. I am not sure that the ways described in this course are the best and fastest ways to solve problems. They are written to visually show you the magic of the command line and stimulate your inner inventor (but all examples work and solve the stated problems).

I would advise the following categories of readers to treat this book as critically as possible and certainly read other Linux books:

  • students who are preparing for exams
  • IT specialists who are preparing for Linux-related job interviews
  • people who want to become real Linux experts
  • pentesters and bug hunters

This book is primarily about OSINT.

Day 0. Getting ready to work

Eric Raymond, in his article β€œHow to become a hacker” (1 December 1997, https://cs.fit.edu/~wds/classes/cdc/Readings/BecomeAHacker.pdf), recommended going to a local Linuxoid meeting and asking to burn discs of some distro in exchange for beer (I found this article, but link "where to get Linux" no longer working now).

In the last 26 years progress has gone a long way and I'll just ask you to open a new tab in your browser.

Gitpod is a service that provides online development environments based on the Linux distribution Ubuntu (https://ubuntu.com). You can use it for 50 hours a month for free. This is definitely enough time for you to take this course many times.

You should use a Github (https://github.com/) account for authorization (registration is very fast and also free).

Open this link and create a workspace with standard settings:

https://gitpod.io#https://github.com/cipher387/linux-for-OSINT-21-day

If you are already using some Linux distribution, you can simply clone the https://github.com/cipher387/linux-for-OSINT-21-day repository to your computer or server.

If you don't know how to clone repositories yet, I recommend using Gitpod for now. On Day 19 you will learn how to clone repositories, and on Day 21 you will think about which Linux distribution is best for you.

Table of contents

Who Is This Course For?

Who should avoid this course?

Day 0. Getting ready to work

Day 1. Basic skills of working with files and directories in command line

Day 2. Basic bash script syntax

Day 3. Install and run utilities

Day 4. Batch file processing

Day 5. Downloading files and working with APIs. Curl.

Day 6. Search in files. Grep

Day 7. Sed and Awk

Day 8. Vim text editor

Day 9. Screen and Crone

Day 10. Text analyzing and editing utilities

Day 11. Video, audio and images

Day 12. Analyze PDF

Day 13. MS Office files

Day 14. JSON, XML, CSV

Day 15. Scraping

Day 16. Web search automation tools

Day 17. File sharing sites, torrents, FTP

Day 18. Domain investigation

Day 19. Git and Github

Day 20. Tools to make Linux easier to use

Day 21. Which Linux distribution is better to use?

What to do next?

Application. Is it possible to do the same thing on Windows?

My first course:

Python for OSINT. 21-day course for beginners

Thank you for following me! https://cybdetective.com

More Repositories

1

osint_stuff_tool_collection

A collection of several hundred online tools for OSINT
HTML
5,037
star
2

Dorks-collections-list

List of Github repositories and articles with list of dorks for different search engines
1,865
star
3

API-s-for-OSINT

List of API's for gathering information about phone numbers, addresses, domains etc
1,421
star
4

python-for-OSINT-21-days

In this repository you will find sample code files for each day of the course "Python for OSINT. A 21-day course for beginners".
Python
795
star
5

cheatsheets

High quality and text versions of cheat sheets from Cyber Detective Twitter
486
star
6

Advanced-search-operators-list

List of the links to the docs for different services, which explain using of advanced search operators
267
star
7

maltego-transforms-list

A list of tools that handle different data and make it usable in Maltego.
217
star
8

awesome-ip-search-engines

This repository contains tutorials and tools for working with IP search engines. Search engines that search all devices connected to the Internet and collect a lot of different information about them (open ports, protocols used for data transfer, Whois information etc)).
203
star
9

juicyinfo-nuclei-templates

Nuclei (https://github.com/projectdiscovery/nuclei) templates for extracting juicy info from web pages
170
star
10

osintmap

Worldwide map of OSINT tools. 614 services (cadastral maps, business registries, public transport maps, passengers lists, venicle information).
CSS
148
star
11

OSINT-and-Cybersecurity-accounts-in-Mastodon

This repository brings together tool builders, bloggers, speakers, book authors, and other interesting Mastodon accounts
119
star
12

code-understanding-tools

Tools for understanding other people's code
112
star
13

awesome-grep

List of GREP modifications and alternatives for a variety of purposes
112
star
14

grep_for_osint

GREP FOR OSINT is a set of very simple shell scripts that will help you quickly analyze a text or a folder with files for data useful for investigation (phone numbers, bank card numbers, URLs, emails and nicknames).
Shell
103
star
15

pastebinsearchengines

5 Google Custom Search Engines for searching in 48 pastebin sites
CSS
90
star
16

OSINT-Github-profiles

A list of Github users who distribute tools and tutorials on OSINT (as well as hacking, pentest, and forensics)
84
star
17

regex-for-OSINT

A list of application tools and information resources to help you effectively use regular expressions in OSINT (Open Source Intelligence)
66
star
18

Python-osint-automation-examples

In this repository, I will collect quick and simple code examples that use Python to automate various #osint tasks.
Python
45
star
19

cipher387

44
star
20

cipher387.github.io

Repo for site with links to my projects
HTML
43
star
21

domain_investigation_toolbox

Enter the domain name once and gather information about it with 33 tools
HTML
41
star
22

hashtags_and_keywords_social_media_quick_search

Tool of the buttons for quick search keywords ans hashtags in 70 different social media platforms
HTML
40
star
23

quickcacheandarchivesearch

Quick Cache and Archive search buttons
JavaScript
35
star
24

code_repository_google_custom_search_engines

Google Custom Search Engines for searching in code repositories
CSS
29
star
25

list-of-paste-sites-twitter-Ivan30394639

List of all pastebin.com analogs I know of. They are useful for finding leaked personal data
22
star
26

quickgeolocationsearch

This simple tool helps save a lot of time when gathering information about geolocation. Enter latitude and longitude once and click the buttons with the names of online maps, to quickly jump to it.
JavaScript
22
star
27

list_of_sites_for_court_rulings_search

List of websites to search for court documents in different countries
HTML
20
star
28

hacker-calendar

Hacker calendar 2024 in high resolution + template + some editing tips
20
star
29

webcamcse

Google Custom Search Engine for search in 10 worldwide webcams catalogs
CSS
18
star
30

test_for_osintmap

Repo for test Yandex Maps API and "World map of OSINT tools"
HTML
18
star
31

phonenumberqueryconstructor

A very simple tool that generates multiple spellings of a phone number (to effectively search for it using the OR operator and quotes)
JavaScript
18
star
32

corporative_registry_worldwide_catalog

Corporative registry worldwide catalog. 63 countries
HTML
16
star
33

venicle_number_search_toolbox

HTML
16
star
34

bazzellpy

A library for Pythonistas to call Michael Bazzell's OSINT tools as functions
Python
16
star
35

list_of_hashtags_which-are-retweeted-by-bots

A list of hashtags that bots automatically retweet. Use them to increase the reach of your tweets and increase the number of followers on your account.
HTML
16
star
36

awesome-overpass-turbo

Learning materials and tools for using Overpass turbo (web based data mining tool for OpenStreetMap that runs Overpass API query and shows the results on map)
16
star
37

passengers_lists_and_migrants_records

Collections of services for search data from passengers lists and emigrants records
HTML
13
star
38

collection_of_cadastral_maps

Collection of cadastral maps of different countries
HTML
12
star
39

public_transport_maps

Collection of online public transport maps
HTML
9
star
40

ivan30394639_twitter_cached_version

Cached versions of my old suspended Twitter account
HTML
7
star