{"id":28184457,"url":"https://github.com/niklas88/tinypedia","last_synced_at":"2025-05-16T05:15:45.140Z","repository":{"id":151224884,"uuid":"122380897","full_name":"niklas88/tinypedia","owner":"niklas88","description":"An bare bones, text only local Wikipedia server, working directly on the .bz2 compressed dumps","archived":false,"fork":false,"pushed_at":"2018-03-09T12:08:55.000Z","size":79,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2023-10-20T22:04:22.666Z","etag":null,"topics":["barebones","experimental","wikipedia"],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/niklas88.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2018-02-21T19:11:47.000Z","updated_at":"2023-10-20T22:04:24.785Z","dependencies_parsed_at":null,"dependency_job_id":"dc647459-580c-420d-b6f3-8e38f86bf90f","html_url":"https://github.com/niklas88/tinypedia","commit_stats":null,"previous_names":[],"tags_count":0,"template":null,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/niklas88%2Ftinypedia","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/niklas88%2Ftinypedia/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/niklas88%2Ftinypedia/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/niklas88%2Ftinypedia/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/niklas88","download_url":"https://codeload.github.com/niklas88/tinypedia/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254470931,"owners_count":22076588,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["barebones","experimental","wikipedia"],"created_at":"2025-05-16T05:15:44.549Z","updated_at":"2025-05-16T05:15:45.127Z","avatar_url":"https://github.com/niklas88.png","language":"Go","readme":"# tinypedia\nA very bare bones, text only, local Wikipedia server. It works directly on the\n`.bz2` compressed dumps without creating any additional files.\n\n## Current State\nRetrieving articles by title using the path `#\u003cURL-encoded-article-name\u003e`works\nand the text can be viewed as extracted by `wtf_wikipedia.js` + some formatting\nfor sections. Sadly this fails to extract the text from special markup such as\nIPA pronounciations. The raw mediawiki markdown can also be extracted using\n`/wiki/\u003cURL-encoded-article-name\u003e`\n\nSince we currently use URL encoding directly this is not compatible with the\ntitle encoding used by Wikipedia (e.g. `Ada%20Lovelace` instead of `Ada_Lovelace`).\n\n## Building and Installing\nFirst make sure you have Go and the `go` command installed and that\n`$GOTPATH/bin` is in your path. Then install with a simple `go get`\n\n    go get github.com/ad-freiburg/tinypedia\n\n## Running\nChange to the directory containing the dump files\n\n* enwiki-latest-pages-articles-multistream-index.txt.bz2\n* enwiki-latest-pages-articles-multistream.xml.bz2\n\nAnd simply run the tinypedia exectuable\n\n    tinypedia\n\nIf you have named the files differenty use the `-i` and `-d` command line\nswitches to point `tinypedia` to the _index_ and _data_ files respectively.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fniklas88%2Ftinypedia","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fniklas88%2Ftinypedia","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fniklas88%2Ftinypedia/lists"}