The Web Archive (ArchiveBox)

From Sea of Fate
Revision as of 08:18, 9 February 2026 by Wikisailor (talk | contribs) (Created page with "==📖 Introduction== ArchiveBox is a self-hosted web archiving solution. Unlike a simple bookmark, it takes a "snapshot" of a page in multiple formats so that if the original site goes down, you still have the full content. * The Outputs: For every URL you save, it creates a PDF, a Screenshot (PNG), a Single-File HTML, and a Wget clone. * The Goal: To build a searchable, permanent record of the specific web resources you use for research, separate from the broad scale o...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigationJump to search

📖 Introduction

ArchiveBox is a self-hosted web archiving solution. Unlike a simple bookmark, it takes a "snapshot" of a page in multiple formats so that if the original site goes down, you still have the full content.

  • The Outputs: For every URL you save, it creates a PDF, a Screenshot (PNG), a Single-File HTML, and a Wget clone.
  • The Goal: To build a searchable, permanent record of the specific web resources you use for research, separate from the broad scale of OpenAlex.
  • Synergy: Use OpenAlex to find a paper, use Kiwix for general encyclopedia background, and use ArchiveBox to save the specific blog posts or project wikis that support your work.

💾 The Infrastructure

ArchiveBox is heavy on disk I/O and storage, which is why it gets the dedicated 5TB drive.

  • Host: Blackberry (Proxmox VM)
  • Compute: Uses the same 4 Cores / 6GB RAM as the rest of the stack.
  • Storage: 5TB XFS disk mounted at /mnt/archive_data/archivebox.

Note: ArchiveBox can grow very fast (approx. 1GB per 1000 articles).