WarchaeologyWarchaeology is a command line tool for inspecting, converting, deduplicating and validating WARC-files.
Features
Validation
Validate that WARC-files conforms to specification.
Inspection
Navigate WARC-files with terminal console or extract content from WARC-files.
Conversion
Convert webarchives into WARC-format.
Deduplication
Reformat WARC-files to use revisit records for duplicate content.