Data Archive - Revision history

Wikisailor: /* The Kiwix Archive */

2026-02-09T08:14:31Z

The Kiwix Archive

← Older revision		Revision as of 08:14, 9 February 2026
Line 10:		Line 10:
	'''[[OpenAlex]]''' is a massive, open-source catalog of the global research system, containing over 250 million "Works" (papers, datasets, etc.). With a web dashboard to construct queries to search for papers it will complement the of research tool.		'''[[OpenAlex]]''' is a massive, open-source catalog of the global research system, containing over 250 million "Works" (papers, datasets, etc.). With a web dashboard to construct queries to search for papers it will complement the of research tool.

	==[[The Kiwix Archive]]==		==📚[[The Kiwix Archive]]==

	'''[[The Kiwix Archive]]''' is hosted on a docker container on Blackberry:8081 and is used to access the encyclopaedia made up of Wikipedia and a wide variety of related information sources. Most of the data is from either early 2026 or mid 2025 and before the internet becomes too flattened and AI washed to be unrecognisable.		'''[[The Kiwix Archive]]''' is hosted on a docker container on Blackberry:8081 and is used to access the encyclopaedia made up of Wikipedia and a wide variety of related information sources. Most of the data is from either early 2026 or mid 2025 and before the internet becomes too flattened and AI washed to be unrecognisable.

Wikisailor: /* The Kiwix Archive */

2026-02-09T08:13:59Z

The Kiwix Archive

← Older revision		Revision as of 08:13, 9 February 2026
Line 13:		Line 13:

	'''[[The Kiwix Archive]]''' is hosted on a docker container on Blackberry:8081 and is used to access the encyclopaedia made up of Wikipedia and a wide variety of related information sources. Most of the data is from either early 2026 or mid 2025 and before the internet becomes too flattened and AI washed to be unrecognisable.		'''[[The Kiwix Archive]]''' is hosted on a docker container on Blackberry:8081 and is used to access the encyclopaedia made up of Wikipedia and a wide variety of related information sources. Most of the data is from either early 2026 or mid 2025 and before the internet becomes too flattened and AI washed to be unrecognisable.

			==🕸️[[The Web Archive (ArchiveBox)]]==

			'''[[The Web Archive (ArchiveBox)]]''' is a self-hosted web archiving solution. Unlike a simple bookmark, it takes a "snapshot" of a page in multiple formats so that if the original site goes down, you still have the full content. It is also hosted as a docker application on Blackberry

Wikisailor: /* Kewix */

2026-02-09T07:02:35Z

Kewix

← Older revision		Revision as of 07:02, 9 February 2026
Line 10:		Line 10:
	'''[[OpenAlex]]''' is a massive, open-source catalog of the global research system, containing over 250 million "Works" (papers, datasets, etc.). With a web dashboard to construct queries to search for papers it will complement the of research tool.		'''[[OpenAlex]]''' is a massive, open-source catalog of the global research system, containing over 250 million "Works" (papers, datasets, etc.). With a web dashboard to construct queries to search for papers it will complement the of research tool.

	==[[~~Kewix~~]]==		==[[The Kiwix Archive]]==

	'''[[~~Kewix~~]]''' is hosted on a docker container on Blackberry:8081 and is used to access the encyclopaedia made up of Wikipedia and a wide variety of related information sources. Most of the data is from either early 2026 or mid 2025 and before the internet becomes too flattened and AI washed to be unrecognisable.		'''[[The Kiwix Archive]]''' is hosted on a docker container on Blackberry:8081 and is used to access the encyclopaedia made up of Wikipedia and a wide variety of related information sources. Most of the data is from either early 2026 or mid 2025 and before the internet becomes too flattened and AI washed to be unrecognisable.

Wikisailor: /* Kewix */

2026-02-09T06:59:46Z

Kewix

← Older revision		Revision as of 06:59, 9 February 2026
Line 11:		Line 11:

	==[[Kewix]]==		==[[Kewix]]==

			'''[[Kewix]]''' is hosted on a docker container on Blackberry:8081 and is used to access the encyclopaedia made up of Wikipedia and a wide variety of related information sources. Most of the data is from either early 2026 or mid 2025 and before the internet becomes too flattened and AI washed to be unrecognisable.

Wikisailor: /* Introduction */

2026-02-09T06:50:58Z

Introduction

← Older revision		Revision as of 06:50, 9 February 2026
Line 1:		Line 1:
	==Introduction==		==Introduction==
	We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''[[Virtual Machines]]''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a '''[[Docker Hosts \| GPU Passthrough]]'''. for the more general notes on [[Linux Docker And GPU Passthrough \| Linux Docker And GPU Passthrough check Here ]].		We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''[[Virtual Machines]]''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a '''[[Docker Hosts \| GPU Passthrough]]'''. for the more general notes on [[Linux Docker And GPU Passthrough \| Linux Docker And GPU Passthrough check Here ]]. Blackberry VM is hosting docker and some of the less intensive but equally useful tools.

	==Reasons for a Data Archive==		==Reasons for a Data Archive==

Wikisailor: /* OpenAlex */

2026-02-09T06:47:31Z

OpenAlex

← Older revision		Revision as of 06:47, 9 February 2026
Line 8:		Line 8:
	==[[OpenAlex]]==		==[[OpenAlex]]==

	'''[[OpenAlex]]''' is a massive, open-source catalog of the global research system, containing over 250 million "Works" (papers, datasets, etc.). With a web dashboard to construct queries to search for papers it will complement the of research tool		'''[[OpenAlex]]''' is a massive, open-source catalog of the global research system, containing over 250 million "Works" (papers, datasets, etc.). With a web dashboard to construct queries to search for papers it will complement the of research tool.

			==[[Kewix]]==

Wikisailor: /* Reasons for a Data Archive */

2026-02-09T06:46:53Z

Reasons for a Data Archive

← Older revision		Revision as of 06:46, 9 February 2026
Line 5:		Line 5:

	We want to have a completely offline copy of as much of the data currently on the WWW. The reason for doing so now as opposed to in the past is that the new wave of LLMs and AI are creating their own summarised and sanitised versions of the wealth of data that has accumulated in the last 30 or so years.		We want to have a completely offline copy of as much of the data currently on the WWW. The reason for doing so now as opposed to in the past is that the new wave of LLMs and AI are creating their own summarised and sanitised versions of the wealth of data that has accumulated in the last 30 or so years.

			==[[OpenAlex]]==

			'''[[OpenAlex]]''' is a massive, open-source catalog of the global research system, containing over 250 million "Works" (papers, datasets, etc.). With a web dashboard to construct queries to search for papers it will complement the of research tool

Wikisailor: /* Introduction */

2026-02-03T15:51:25Z

Introduction

← Older revision		Revision as of 15:51, 3 February 2026
Line 1:		Line 1:
	==Introduction==		==Introduction==
	We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''[[Virtual Machines]]''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a '''[[Docker Hosts \| GPU Passthrough]]'''.		We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''[[Virtual Machines]]''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a '''[[Docker Hosts \| GPU Passthrough]]'''. for the more general notes on [[Linux Docker And GPU Passthrough \| Linux Docker And GPU Passthrough check Here ]].

	==Reasons for a Data Archive==		==Reasons for a Data Archive==

	We want to have a completely offline copy of as much of the data currently on the WWW. The reason for doing so now as opposed to in the past is that the new wave of LLMs and AI are creating their own summarised and sanitised versions of the wealth of data that has accumulated in the last 30 or so years.		We want to have a completely offline copy of as much of the data currently on the WWW. The reason for doing so now as opposed to in the past is that the new wave of LLMs and AI are creating their own summarised and sanitised versions of the wealth of data that has accumulated in the last 30 or so years.

Wikisailor: /* Introduction */

2026-02-03T15:48:44Z

Introduction

← Older revision		Revision as of 15:48, 3 February 2026
Line 1:		Line 1:
	==Introduction==		==Introduction==
	We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''[[Virtual Machines]]''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a '''[[~~Linux~~ Docker ~~And GPU Passthrough~~ \| GPU Passthrough]]'''.		We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''[[Virtual Machines]]''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a '''[[Docker Hosts \| GPU Passthrough]]'''.


	==Reasons for a Data Archive==		==Reasons for a Data Archive==

	We want to have a completely offline copy of as much of the data currently on the WWW. The reason for doing so now as opposed to in the past is that the new wave of LLMs and AI are creating their own summarised and sanitised versions of the wealth of data that has accumulated in the last 30 or so years.		We want to have a completely offline copy of as much of the data currently on the WWW. The reason for doing so now as opposed to in the past is that the new wave of LLMs and AI are creating their own summarised and sanitised versions of the wealth of data that has accumulated in the last 30 or so years.

Wikisailor: Created page with "==Introduction== We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''Virtual Machines''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a ''' GPU Passthrough'''. ==Reasons for a Data..."

2026-02-03T15:46:30Z

Created page with "==Introduction== We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''Virtual Machines''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a ''' GPU Passthrough'''. ==Reasons for a Data..."

New page

==Introduction==
We are building an offline vault of data for use over the next few years. To accomplish that We need to have one or more '''[[Virtual Machines]]''' that will be able to download and store the data. As most of the load will be on CPU storage and Internet bandwidth for the archival we will keep this part separate from the AI and Jellyfin host Quince that is powered by a '''[[Linux Docker And GPU Passthrough | GPU Passthrough]]'''.

==Reasons for a Data Archive==

We want to have a completely offline copy of as much of the data currently on the WWW. The reason for doing so now as opposed to in the past is that the new wave of LLMs and AI are creating their own summarised and sanitised versions of the wealth of data that has accumulated in the last 30 or so years.