The Kiwix Archive

From Sea of Fate
Jump to navigationJump to search

๐Ÿ“– Introduction

Kiwix is an offline content reader that allows you to browse massive websitesโ€”like Wikipedia, StackExchange, or Project Gutenbergโ€”without an internet connection.

  • The Format: It uses highly compressed .ZIM files. A single file can contain the entirety of Wikipedia (with images) or the complete medical encyclopedia.
  • The Goal: To provide a permanent, offline knowledge base that remains accessible even if the internet is down, serving everyone on your local network.
  • Synergy: Works alongside OpenAlex (scholarly search) and ArchiveBox (personal web snapshots) to create a three-tier local research library.

๐Ÿ’พ The Infrastructure

Blackberry has been slimmed down to be more efficient now that indexing is handled elsewhere.

  • Host: Blackberry
  • VM Config: Debian | 4 Cores | 6GB RAM.
  • Storage: 4TB XFS disk mounted at /mnt/docker_data and an additional 5TB XFS disk for ArchiveBox /mnt/archive_data

๐Ÿ‹ The Software Stack (Docker)

๐Ÿ› ๏ธ Installing Dockge

Dockge allows us to manage our "Stacks" (Docker Compose files) through a clean web interface.

# Preparation: Create directories
mkdir -p /opt/stacks /opt/dockge
cd /opt/dockge
# Download and Start Dockge
curl https://raw.githubusercontent.com/louislam/dockge/master/compose.yaml --output compose.yaml
docker compose up -d

๐Ÿ› ๏ธ Preparation: Storage Folders

Organize The ZIM files on the 5TB disk so the container can find them easily.

mkdir -p /mnt/docker_data/stacks/kiwix-archive/zim/

๐Ÿ“„ Kiwix YAML (The Stack)

Deploy this in your Dockge instance on Blackberry (Port 5001) and name it kiwix

services:
  kiwix:
    image: ghcr.io/kiwix/kiwix-serve:latest
    container_name: kiwix_wikipedia
    volumes:
      - /mnt/docker_data/stacks/kiwix-archive/zim:/data
    ports:
      - 8081:8080
    command:
      - --library
      - library.xml
    restart: unless-stopped
networks: {}

๐ŸŒ Accessing and Using the Library

Tool URL Purpose
Kiwix Web UI http://blackberry:8080 Browsing your downloaded offline libraries.
ZIM Library kiwix.org/en/download Where to download new content (Wikipedia, StackOverflow, etc.).
German Zim Library https://ftp.fau.de/kiwix/zim/ lists of zim files.
Kewix org https://download.kiwix.org/zim/ More Lists of Zim files