• Stars
    star
    1,308
  • Rank 35,971 (Top 0.8 %)
  • Language
    Go
  • License
    MIT License
  • Created over 4 years ago
  • Updated 9 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

jedi

Copy websites to your computer! Goclone is a utility that allows you to download a website from the Internet to a local directory. Get html, css, js, images, and other files from the server to your computer. Goclone arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link as if you were viewing it online.


Official Website



Example

Table of Contents

πŸš€ Installation

Brew

# tap
brew tap imthaghost/goclone
# install tool
brew install goclone

Manual

# Go version >= 1.20
go install github.com/imthaghost/goclone/cmd/goclone@latest

Or

# go get :)
go get github.com/imthaghost/goclone
# change to project directory using your GOPATH
cd $GOPATH/src/github.com/imthaghost/goclone/cmd/goclone
# build and install application
go install

Examples

# goclone <url>
goclone https://configtree.co

Config

Usage

Usage:
  goclone <url> [flags]

Flags:
  -C, --cookie strings        Pre-set these cookies
  -h, --help                  help for goclone
  -o, --open                  Automatically open project in default browser
  -p, --proxy_string string   Proxy connection string. Support http and socks5 https://pkg.go.dev/github.com/gocolly/colly#Collector.SetProxy
  -s, --serve                 Serve the generated files using Echo.
  -P, --servePort int         Serve port number. (default 5000)
  -u, --user_agent string     Custom User Agent

Contributors

Contributions are welcome! Please see Contributing Guide for more details.

Gary Frederick
Tha Ghost

πŸ’»
Juan Mesaglio
Juan Mesaglio

πŸ’»
Ben Lafferty
Ben Lafferty

πŸ’»
Omar Sagoo
Omar Sagoo

πŸ’»

More Repositories

1

scdl

SoundCloud music downloader 🎢
Go
62
star
2

stockapi

Stock data Rest-ful API built in Go. Various endpoints regarding stock data scraped directly from Yahoo Finance. Use this for a quick start regarding stock data.
Go
29
star
3

musik

Web application that helps you discover new music.
Go
13
star
4

spyyder

Informative machine learning trading application.
Swift
10
star
5

shareit

Share images and videos anonymously with a single command!
Go
8
star
6

Gram

Instagram analytics tool
HTML
6
star
7

merryGoRound

Example of how to build a HTTP Client with rotating IPs
Go
6
star
8

blacklister

A radix tree implementation of a IPv4/IPv6 blacklisting application
Python
3
star
9

Algo

A home for all my algorithms
Python
2
star
10

gostream

Golang realtime streaming server
Go
2
star
11

gocloneold

Website Cloner - Utilizes powerful go routines to clone websites to your computer within seconds.
Go
2
star
12

tiny

Tiny script with a big purpose. Send authenticated emails with DKIM signatures.
Python
2
star
13

chatserv

IRC server written in Go!
Go
2
star
14

crawler

Practice
Go
1
star
15

tornix

Tornix provides an easy way to manage streams over Tor. The program separates streams across circuits by connection metadata.
Go
1
star
16

garyf.dev

Code for my portfolio site
CSS
1
star
17

HackTheBox

My Hack The Box Solutions
Python
1
star
18

bookrating

Gather some interesting information from a CSV file and populate your Notion database
Go
1
star
19

aragog

Go
1
star
20

tweetGen

tweetGen generates tweets from any given corpus. The sentences are calculated via a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event (Markov Chain)
Python
1
star