goarchiver is an lightweight archiving tool written in Go.
- Fast creation of archives
- SimpleCLI
- mitmproxy addon for replaying archives
go install github.com/MathiasDPX/goarchiver@latest
goarchiver -start https://mathiasd.fr/ -whitelist mathiasd.fr
This command crawls the provided URLs, follows links limited to the whitelisted domain (to prevent escape to big sites like github) and generate a .warc.gz
You can provide multiple starting points and whitelisted domains by adding a comma between them like this
goarchiver -start https://thevalleyofcode.com/ -whitelist thevalleyofcode.com,fonts.googleapis.com,fonts.gstatic.com
A simple mitmproxy addon is provided in /replay. However, as it require warcio to read the archive you'll need to run mitmproxy via uv