Offline KeenWiki

This is where you can post your Commander Keen related stories, artwork, or other stuff that is related to Commander Keen but otherwise doesn't belong in another forum.
Post Reply
User avatar
Nisaba
Vorticon Elite
Posts: 780
Joined: Fri Jan 01, 2016 23:34
Location: The Outpost
Contact:

Offline KeenWiki

Post by Nisaba » Thu Nov 23, 2017 14:44

Hello @Malvineous,
hello everybody,

I'm looking for an offline solution like Kiwix which enables you to have the whole KeenWiki at hand wherever you go! On a boat, in the middle of nowhere or in Jail...

For those who didn't know: Kiwix is an offline reader for web content. It's software intended to make Wikipedia available without using the internet, but it is potentially suitable for all HTML content. Kiwix supports the ZIM format, a highly compressed open format with additional meta-data.

So here is my question @Malvineous:
If you could, please share a static fork of the Wiki. HTML data would be fine. of course having an offline KeenWiki in the ZIM format would be brilliant. unfortunately the MediaWiki Collection Extension feature was removed. But as the KeenWiki is a deployment project, you may ask the Kiwix team to create a ZIM file for you. To do that you need to prepare the following information:
  • Text file with the list of article titles (one title per line, with underscores, UTF8)
  • The URL of the wiki you want to snapshot
  • Prepare a welcome page for the ZIM file (on the wiki, and share with the Kiwix Team the title of that page)
  • ZIM file metadata:
    • Title
    • Description (only a few words)
    • 48x48 PNG log

Useful links/further reading:
"We have come to conquer you all and bring you lots of candy!" | about me | my current project: play Keen mods on a GameBoy |

User avatar
Malvineous
Shikadi Webmaster
Posts: 362
Joined: Wed Oct 31, 2007 21:48
Location: Brisbane, Australia
Contact:

Re: Offline KeenWiki

Post by Malvineous » Thu Nov 23, 2017 21:52

I did share a full backup of the KeenWiki back in 2013 so it is probably time to give that an update. That backup was of the database (so includes version history) but to view it locally you'd need a MediaWiki install (e.g. running through Docker.)

People have scraped the HTML from the KeenWiki before but unfortunately it puts a huge load on the server so I'm not so keen on that method.

Probably the best thing would be to use an updated backup, restore it locally into a MediaWiki instance on your own PC, then use one of the tools in the link you posted to build a ZIM file from that.

If you're able to get the MediaWiki MySQL stack running on a local install of Docker then let me know and I'll see what I can do to get updated KeenWiki data into it.

User avatar
Levellass
S-Triazine
Posts: 5261
Joined: Tue Sep 23, 2008 6:40

Re: Offline KeenWiki

Post by Levellass » Fri Nov 24, 2017 5:15

I have all the patch wiki stored as MHT files, should the worst occur and te entire internet collapse. It's surprisingly compact, 76Mb or so.
What you really need, not what you think you ought to want.

User avatar
Nisaba
Vorticon Elite
Posts: 780
Joined: Fri Jan 01, 2016 23:34
Location: The Outpost
Contact:

Re: Offline KeenWiki

Post by Nisaba » Thu Nov 30, 2017 0:12

thanks for the reply.
it might take some time until I find the time to take care of things myself. till then, please tell me: how much disk space does the KeenWiki at it's current state take? I'm not speaking about hosted tools and mods but only the pure HTML section + images.
"We have come to conquer you all and bring you lots of candy!" | about me | my current project: play Keen mods on a GameBoy |

User avatar
Malvineous
Shikadi Webmaster
Posts: 362
Joined: Wed Oct 31, 2007 21:48
Location: Brisbane, Australia
Contact:

Re: Offline KeenWiki

Post by Malvineous » Thu Nov 30, 2017 1:13

Not sure about the HTML as it's not stored as HTML, but the MySQL database containing all the text content and page revision history is 212 MB. The images are 3.2 GB. The tools and mods are 786 MB.

Post Reply