hIMEI29A/gichidan hIMEI29A/gichidan

Crawlers
  • Stars
    star
    29
  • Rank 860,307 (Top 17 %)
  • Language
    Go
  • License
    Apache License 2.0
  • Created almost 7 years ago
  • Updated over 6 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
hIMEI29A/gichidan
github

hIMEI29A

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Gichidan - CLI wrapper for Ichidan deep-web search engine.

gichidan

gichidan - command line wrapper with enhanced pentest features for (onion link) Ichidan - deep-web search engine.

           โ–ˆโ–ˆโ–ˆ           โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ       โ–ˆโ–ˆโ–ˆ      โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ                     
          โ–‘โ–‘โ–‘           โ–‘โ–‘โ–ˆโ–ˆโ–ˆ       โ–‘โ–‘โ–‘      โ–‘โ–‘โ–ˆโ–ˆโ–ˆ                    
  โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ โ–ˆโ–ˆโ–ˆโ–ˆ   โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  โ–‘โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ   โ–ˆโ–ˆโ–ˆโ–ˆ   โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ   โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ   โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  
 โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆ  โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–‘โ–ˆโ–ˆโ–ˆ  โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆ  โ–‘โ–‘โ–‘โ–‘โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆ 
โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–‘โ–‘  โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ  โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ   โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ 
โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ  โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ  โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ  โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆ  โ–‘โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ 
โ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  โ–ˆโ–ˆโ–ˆโ–ˆ โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ โ–ˆโ–ˆโ–ˆโ–ˆ โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ
 โ–‘โ–‘โ–‘โ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘  โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘  โ–‘โ–‘โ–‘โ–‘ โ–‘โ–‘โ–‘โ–‘โ–‘ โ–‘โ–‘โ–‘โ–‘โ–‘  โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘  โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘ โ–‘โ–‘โ–‘โ–‘ โ–‘โ–‘โ–‘โ–‘โ–‘ 
 โ–ˆโ–ˆโ–ˆ โ–‘โ–ˆโ–ˆโ–ˆ           ___onion secrets for console cowboys___
โ–‘โ–‘โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ
โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘

Go Report Card GoDoc Apache-2.0 License

Copyright 2017 hIMEI

TOC

About

21.04.2018 UPD Ichidan is dead last 3 month, so Gichidan is deprecated :(

Forget about Tor Browser. Parse onion hosts from your console with Gichidan now.

License

Apache-2.0 License

About Gichidan

Gichidan is a CLI utility designed to collect information about deep-web hosts.

Dependencies
github.com/antchfx/htmlquery
github.com/antchfx/xpath
github.com/hIMEI29A/gotorsocks
golang.org/x/net/html
Short Ichidan's info

Short info about Ichidan search engine from here

Ichidan is a type of Japanese verb which implies the first (โ€œichiโ€) time something is done. Now, Ichidan is also a search engine for looking up websites that are hosted through the Tor network, which may be the first time that's been done at this scale.

The search engine is less like Google and more like Shodan, in that it allows users to see technical information about .onion websites, including their connected network interfaces, such as TCP/IP ports.

Ichidan is a valuable resource for security researchers and law enforcement agencies who want to learn about what's happening on the Dark Web.

Features

NEW! Since version 1.0.0 search with logical expressions supported. See Usage section of this paper for details.

Version

v1.1.1

Install

Install standalone deb binary package

Requirements: Linux Debian/Ubuntu amd64

Download deb package and install it with dpkg or gdebi:

wget https://github.com/hIMEI29A/gichidan/releases/download/1.1.1/\
gichidan-1.1.1-amd64.deb && sudo dpkg -i gichidan-1.1.1-amd64.deb

wget https://github.com/hIMEI29A/gichidan/releases/download/1.1.1/\
gichidan-1.1.1-amd64.deb && sudo gdebi gichidan-1.1.1-amd64.deb

Using of apt-get install will be implemented soon. Check the release page!

Install from source

If you are Golang programmer, you may want to get source code and build app from it manually. Do next steps.

Project uses glide to manage dependencies, so install it first

curl https://glide.sh/get | sh

Clone repo, install deps, then install Gichidan

mkdir -p $GOPATH/src/github.com/hIMEI29A/gichidan
cd $GOPATH/src/github.com/hIMEI29A/gichidan
git clone https://github.com/hIMEI29A/gichidan.git .
glide install
go install

Done.

Usage

Gichidan's CLI options are:

-b    show ASCII banner
-f string
      save results to file
-h    help message
-j    convert output to json
-m    Don't print GET request's messages (non-verbose output)
-r string
      your search request to Ichidan
-s    print hosts urls only
-v    print current version

Typical request to Ichidan looks like

gichidan -r ichidan

Output:

Hosts found:   1 
Only one page 

Full info:

http://ichidanv34wrx7m7.onion
2017-09-18 13:08:58 UTC
tcpwrapped
80
tcp
tcpwrapped
unknown VERSION

http-headers:

    Server: nginx/1.10.3 (Ubuntu)
    Date: Mon, 18 Sep 2017 13:08:55 GMT
    Content-Type: text/html; charset=utf-8
    Connection: close
    X-Frame-Options: SAMEORIGIN
    X-XSS-Protection: 1; mode=block
    X-Content-Type-Options: nosniff
    ETag: W/"7e087af022204d46cb9b655936aa2915"
    Cache-Control: max-age=0, private, must-revalidate
    Set-Cookie: _ichidan_session=NXQ5NWc4ZmJiSHRnVVM2TDFmblVzcmo4NnY1aUdtUFZFY0VmcVpCTzJHUUx2T25XOUhKa0hMT2F4QS9LanVEMGNYeXlKaEwyNGFITjA1bjdsSE1PRnR3TTIrNEJuc3dtMS9JczM1c3haL0xsa0U5K3E4RytSbHNWakxYVTdhYmZ3dFdhRGhzTWR4SXdlT2VhMlhFRzNRPT0tLWpiOU9SMFJnbTFXeTJFamN6Q3FmU3c9PQ%3D%3D--6281f0c900799f334e5f8eb76589c89c38212d37; path=/; HttpOnly
    X-Request-Id: 1e002391-0137-41e1-83cd-acc6b69b5019
    X-Runtime: 0.005388

    (Request type: HEAD)

http-server-header:
    nginx/1.10.3 (Ubuntu)
http-title:
    Ichidan

You may search by keywords (only to know what bad guys do):

gichidan -r hacking

gichidan -r paypal

As well as by protocol, application name or service detail:

gichidan -r ssh

gichidan -r irc

gichidan -r apache

gichidan -r tcpwrapped

gichidan -r prosody

gichidan -r raspbian

To save results in file use flag -f with full file path followed:

gichidan -r telnet -f ~/my_folder/telnet_search.txt

If you don't want to see all details info about collected servers, use -s ("short") option. In case of short info and output to file mode, your file will contains all details anymore:

gichidan -r apache -s -f ~/my_folder/apache_search.txt

To run program in non-verbose ("mute") mode, use -m flag. GET requests messages will not be printed in this case:

gichidan -r accounts -m

To print oldschool ASCII banner before crawling start, use -b flag:

gichidan -r ejabberd -b

Use -j flag to convert output to JSON format. This feature cannot use with -s flag. In case -j and -s provided both there will be error. You may also save JSON to output file with -f option.

gichidan -r CentOS -j -f

If Ichidan can not find anything by your request, application will display error:

gichidan -r jdfhchgbverugbvcevcegrfvcew

Output:

2013/01/20 16:12:12 Nothing found there!

Logical expressions

NEW! Since version v1.0.0 search with logical expressions supported. Here is a simple rules for its usage:

Expression MUST contain no more than two words (yet) with an operator between them and MUST NOT contain spaces between words and operator. Operators are:

AND "+"
NOT "-"
OR  "="

Examples:

It will show only results which satisfy "prosody" and "ejabberd" requests both:

gichidan -r prosody+ejabberd

It will show only results of "paypal" request wich not satisfy "crime" request:

gichidan -r paypal-crime

It will show results of "bbs" and "telnet" requests separately:

gichidan -r bbs=telnet

If search engine cannot find anything by one of words, application will display error:

gichidan -r ssh+jdfhchgbverugbvcevcegrfvcew

Request MUST NOT contain spaces. In case of request such as gichidan -r prosody client, only first word will be processed. Also search by host url is not supported (in most case) by app (and Ichidan too).

NOTE: Tor Network it is not your vanilla Internet. It may be unstable or slow and there may be unexpected delays and errors. In this case you may try to simply restart tor service on your mashine:

sudo service tor restart

NOTE: Ichidan it is not your vanilla Google, Yandex or Baidu. On its page you wont even find contact info or credits. In first january days of new 2018 it was absolutely unavailable! So there is no guarantee to recieve any response!

Contributing

Feel free to contribute!

Report a bug

[email protected]

More Repositories

1

FigletFonts

Figlet Fonts collection
Shell
23
star
2

gotorsocks

Easy to use Golang's torify.
Makefile
4
star
3

pwgator

pwgator - humanized passwords and passphrases generator
Go
2
star
4

getIpbyIsp

Simple cURL based console application for getting IP ranges from https://suip.biz
PHP
1
star
5

goulist

Unrolled Linked List in pure Go
Go
1
star