{"id":13463007,"url":"https://github.com/Rajan-sust/WikiTextCorpusDownloader","last_synced_at":"2025-03-25T06:31:29.705Z","repository":{"id":99526483,"uuid":"217317752","full_name":"Rajan-sust/WikiTextCorpusDownloader","owner":"Rajan-sust","description":"A Language Independent Wikipedia Text Corpus  Downloader","archived":false,"fork":false,"pushed_at":"2019-11-06T02:21:40.000Z","size":9957,"stargazers_count":11,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-10-29T13:50:17.205Z","etag":null,"topics":["gensim","nlp","python3","tensorflow","wikipedia"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Rajan-sust.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2019-10-24T14:21:22.000Z","updated_at":"2024-01-25T22:01:52.000Z","dependencies_parsed_at":null,"dependency_job_id":"cb160675-b65b-4b0f-b418-c2344e6bdf44","html_url":"https://github.com/Rajan-sust/WikiTextCorpusDownloader","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rajan-sust%2FWikiTextCorpusDownloader","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rajan-sust%2FWikiTextCorpusDownloader/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rajan-sust%2FWikiTextCorpusDownloader/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rajan-sust%2FWikiTextCorpusDownloader/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Rajan-sust","download_url":"https://codeload.github.com/Rajan-sust/WikiTextCorpusDownloader/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245413819,"owners_count":20611353,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gensim","nlp","python3","tensorflow","wikipedia"],"created_at":"2024-07-31T13:00:43.867Z","updated_at":"2025-03-25T06:31:29.412Z","avatar_url":"https://github.com/Rajan-sust.png","language":"Python","funding_links":[],"categories":["Corpora (Corpus) and Datasets"],"sub_categories":["Fixed and Phonetic Input specifications"],"readme":"# Cloning\n\n```bash\ngit clone https://github.com/Rajan-sust/WikiTextCorpusDownloader\n```\n\n# Requirements\n* Python 3\n* Gensim\n* TensorFlow 2.0.0\n\n```python\npip install gensim tensorflow==2.0.0\n```\n# Installation with virtual environment\nIf virtual environment is not installed, you can use this command.\n\n```python\npip install virtualenv\n```\nChange directory in cloned folder.\n\n```bash\ncd WikiTextCorpusDownloader\n```\nCreate virtual environment and activate in `WikiTextCorpusDownloader`.\n\n```\nvirtualenv --python python3 venv\nsource venv/bin/activate\npip install gensim tensorflow==2.0.0\n```\n\n# Run\n\nRun `main.py` with language flag\n\n```\n python3 main.py --language=bn\n```\n\nFor conveninece I've set the language flag `bn`. You can choose your language code from the following table.\n\n# Output\n\nThere will create a folder named `language_corpus` and all the `txt` file will be stored in `language_corpus`.\n\n```\nWikiTextCorpusDownloader/\n├── bn_corpus\n├── main.py\n└── README.md\n```\n\n# Language Code\n\n* Source: https://en.wikipedia.org/wiki/List_of_Wikipedias (last accessed 25/10/2019)\n\n|Language|Language (local)|Wiki Code|Articles|Total|Edits|Admins|Users|Active Users|Images|Depth|\n|--- |--- |--- |--- |--- |--- |--- |--- |--- |--- |--- |\n|English|English|en|5,957,940|48,851,073|918,220,332|1,154|37,454,878|133,972|883,255|974.22|\n|Cebuano|Cebuano|ceb|5,378,851|9,743,883|29,548,951|6|62,083|155|0|2|\n|Swedish|svenska|sv|3,747,946|7,760,405|46,384,811|58|695,764|2,643|0|6.85|\n|German|Deutsch|de|2,357,400|6,589,124|192,070,538|189|3,303,857|18,693|131,132|93.93|\n|French|français|fr|2,149,085|10,392,280|163,357,571|163|3,587,639|18,924|59,117|231.27|\n|Dutch|Nederlands|nl|1,982,009|4,129,436|54,682,204|38|1,027,038|3,968|20|15.54|\n|Russian|русский|ru|1,575,424|6,022,540|102,626,944|89|2,617,129|11,036|220,720|135.78|\n|Italian|italiano|it|1,560,426|6,410,902|108,157,717|108|1,886,789|8,344|140,406|163.01|\n|Spanish|español|es|1,552,670|6,825,081|120,285,131|69|5,596,433|17,608|0|203.22|\n|Polish|polski|pl|1,366,455|3,108,214|57,596,259|102|988,726|4,150|273|30.11|\n|Waray|Winaray|war|1,263,782|2,877,774|6,204,632|3|42,855|65|42|3.52|\n|Vietnamese|Tiếng Việt|vi|1,237,354|15,377,620|55,922,731|21|700,988|1,881|31,882|474.93|\n|Japanese|日本語|ja|1,174,111|3,479,762|74,550,080|39|1,547,059|13,910|85,744|82.62|\n|Chinese|中文|zh|1,078,756|5,951,763|56,304,809|84|2,830,664|8,185|52,288|193.04|\n|Portuguese|português|pt|1,014,859|4,913,949|56,373,530|75|2,316,501|5,815|53,699|169.34|\n|Arabic|العربية|ar|967,340|5,765,464|39,110,875|25|1,737,253|4,929|33,236|166.9|\n|Ukrainian|українська|uk|943,639|2,879,394|26,284,559|45|475,906|2,725|101,925|38.41|\n|Persian|فارسی|fa|696,669|4,462,246|27,395,768|31|864,161|4,998|59,214|179.37|\n|Catalan|català|ca|626,244|1,542,343|22,119,752|21|336,650|1,475|11,791|30.69|\n|Serbian|српски / srpski|sr|625,620|3,819,423|22,221,350|18|251,916|827|32,372|151.62|\n|Norwegian (Bokmål)|norsk|no|521,417|1,421,715|19,827,300|45|475,362|1,415|4|41.58|\n|Indonesian|Bahasa Indonesia|id|506,623|2,654,166|16,058,756|36|1,100,928|3,058|60,379|108.72|\n|Korean|한국어|ko|473,032|2,169,511|25,033,560|24|589,501|2,089|15,073|148.41|\n|Finnish|suomi|fi|471,135|1,261,220|18,438,308|35|431,385|1,720|57,852|41.11|\n|Hungarian|magyar|hu|458,848|1,325,315|21,793,115|31|427,015|1,831|14,383|58.64|\n|Serbo-Croatian|srpskohrvatski / српскохрватски|sh|450,177|4,619,978|40,902,823|11|140,404|182|10,051|759.59|\n|Czech|čeština|cs|437,419|1,217,337|17,720,831|32|470,778|2,268|1|46.28|\n|Romanian|română|ro|401,675|2,157,968|13,076,247|18|494,974|943|37,793|115.85|\n|Basque|euskara|eu|341,653|687,367|7,114,515|12|104,864|340|0|10.6|\n|Turkish|Türkçe|tr|335,060|1,673,038|21,023,548|23|1,046,927|687|32,739|200.38|\n|Malay|Bahasa Melayu|ms|330,732|912,992|4,645,251|13|244,660|477|21,628|15.77|\n|Esperanto|Esperanto|eo|269,886|596,903|6,746,374|19|163,925|335|6,222|16.59|\n|Armenian|հայերեն|hy|259,379|860,902|6,582,511|11|90,446|713|7,881|41.12|\n|Bulgarian|български|bg|256,834|570,130|9,627,555|27|259,132|697|590|25.13|\n|Chechen|нохчийн|ce|254,134|517,141|3,766,403|3|21,088|46|324|7.8|\n|Danish|dansk|da|254,048|839,870|10,073,437|24|365,020|882|0|63.78|\n|Hebrew|עברית|he|252,321|1,068,468|26,505,066|37|568,066|2,683|60,060|259.54|\n|Slovak|slovenčina|sk|231,418|511,373|6,905,258|9|179,326|543|0|19.76|\n|Min Nan|Bân-lâm-gú|zh-min-nan|228,395|742,394|1,933,304|5|40,162|69|362|13.19|\n|Kazakh|қазақша|kk|225,444|541,106|2,716,729|18|91,008|224|9,686|9.84|\n|Minangkabau|Minangkabau|min|223,245|324,498|1,956,620|5|9,908|156|111|1.24|\n|Croatian|hrvatski|hr|210,897|525,261|5,332,860|16|226,144|515|17,752|22.56|\n|Estonian|eesti|et|202,340|487,832|5,466,187|35|132,266|609|1,126|22.31|\n|Lithuanian|lietuvių|lt|196,979|467,646|5,644,565|13|136,856|337|22,643|22.79|\n|Belarusian|беларуская|be|178,981|557,198|3,463,186|10|89,914|249|2,949|27.75|\n|Greek|Ελληνικά|el|169,514|506,536|7,830,330|21|286,086|985|17,444|61.1|\n|Slovenian|slovenščina|sl|165,756|397,615|5,200,172|22|183,901|347|8,441|25.59|\n|Galician|galego|gl|159,406|427,419|5,273,688|9|102,054|258|9,311|34.88|\n|Southern Azerbaijani|تۆرکجه|azb|152,184|443,991|1,144,865|4|20,224|94|0|9.48|\n|Azerbaijani|azərbaycanca|az|150,724|392,645|4,894,365|16|182,739|622|22,727|32.11|\n|Simple English|Simple English|simple|150,633|521,223|6,676,120|17|896,149|793|36|77.53|\n|Norwegian (Nynorsk)|norsk nynorsk|nn|150,452|347,461|3,164,351|20|99,889|170|16|15.62|\n|Urdu|اردو|ur|149,403|834,250|3,977,948|11|102,089|279|10,066|100.19|\n|Hindi|हिन्दी|hi|133,789|928,717|4,350,046|9|497,185|1,540|4,134|165.36|\n|Thai|ไทย|th|133,694|814,819|8,537,626|14|367,411|1,239|34,798|271.96|\n|Uzbek|oʻzbekcha/ўзбекча|uz|132,476|628,756|2,060,739|10|47,634|167|1,095|46|\n|Georgian|ქართული|ka|132,358|384,683|3,735,156|4|114,786|237|14,270|35.29|\n|Latin|Latina|la|131,382|258,556|3,473,631|18|124,476|142|0|12.59|\n|Tamil|தமிழ்|ta|123,911|380,432|2,816,895|41|162,577|411|7,695|31.73|\n|Volapük|Volapük|vo|123,498|253,831|3,204,335|3|26,888|35|0|14.06|\n|Welsh|Cymraeg|cy|106,299|233,311|9,112,539|13|57,619|130|17,632|55.76|\n|Macedonian|македонски|mk|102,616|460,583|3,877,303|17|84,335|245|7,891|102.44|\n|Asturian|asturianu|ast|99,688|155,147|2,550,012|9|61,797|138|0|5.09|\n|Tajik|тоҷикӣ|tg|98,750|184,947|1,044,678|6|26,940|54|419|4.3|\n|Latvian|latviešu|lv|98,593|399,578|3,118,951|12|86,632|241|23,819|72.75|\n|Malagasy|Malagasy|mg|92,136|236,048|975,070|3|21,353|32|3|10.08|\n|Tatar|татарча/tatarça|tt|87,531|208,943|2,395,833|3|31,506|62|4,632|22.06|\n|Occitan|occitan|oc|86,441|145,139|2,133,954|5|39,327|88|900|6.78|\n|Afrikaans|Afrikaans|af|86,239|262,521|2,055,641|14|115,856|192|9,052|32.72|\n|Bosnian|bosanski|bs|80,922|372,472|3,043,634|9|118,345|191|24,272|106.07|\n|Kirghiz|Кыргызча|ky|79,736|105,425|351,575|3|23,821|58|2,679|0.35|\n|Albanian|shqip|sq|77,895|229,643|2,043,751|14|117,441|241|11,389|33.78|\n|Tagalog|Tagalog|tl|75,885|234,022|1,719,212|12|102,537|112|1,908|31.9|\n|Bengali|বাংলা|bn|75,469|708,549|3,755,854|12|251,740|1,218|6,773|373.01|\n|Cantonese|粵語|zh-yue|74,635|190,848|1,337,193|11|187,259|257|1,655|16.99|\n|Newar|नेपाल भाषा|new|72,231|196,454|845,210|2|20,809|16|0|12.73|\n|Telugu|తెలుగు|te|71,379|260,934|2,751,592|15|90,684|178|12,536|74.37|\n|Belarusian (Taraškievica)|беларуская (тарашкевіца)‎|be-tarask|68,177|188,834|2,087,604|4|61,316|118|1,460|34.63|\n|Breton|brezhoneg|br|67,284|131,423|1,847,714|5|56,027|78|5,401|12.78|\n|Malayalam|മലയാളം|ml|66,117|410,068|3,180,273|21|128,969|340|6,105|209.88|\n|Piedmontese|Piemontèis|pms|64,526|99,074|844,567|10|20,952|28|2,078|2.44|\n|Sundanese|Sunda|su|59,574|92,453|592,152|8|22,812|70|547|1.95|\n|Low Saxon|Plattdüütsch|nds|57,997|118,503|892,275|4|37,423|50|0|8.2|\n|Luxembourgish|Lëtzebuergesch|lb|57,318|123,398|2,213,050|5|45,103|80|2,596|23.84|\n|Javanese|Jawa|jv|56,707|152,687|1,494,771|8|41,489|156|5,446|28.05|\n|Haitian|Kreyòl ayisyen|ht|56,693|69,416|732,795|1|21,946|28|0|0.53|\n|Marathi|मराठी|mr|55,254|227,017|1,707,660|9|112,754|234|19,186|72.69|\n|Scots|Scots|sco|55,248|200,374|717,992|6|63,071|104|1,601|24.72|\n|Swahili|Kiswahili|sw|54,308|112,747|1,086,727|11|38,610|111|2,226|11.16|\n|Silesian|ślůnski|szl|51,653|63,231|330,705|3|16,576|38|0|0.26|\n|Irish|Gaeilge|ga|51,651|84,098|942,895|8|40,786|115|1,169|4.42|\n|Bashkir|башҡортса|ba|49,951|141,407|913,475|9|26,131|73|1,364|21.66|\n|Western Punjabi|پنجابی|pnb|49,162|78,410|534,596|3|24,127|35|238|2.41|\n|Icelandic|íslenska|is|48,474|128,780|1,648,612|28|69,863|149|3,060|35.14|\n|Burmese|မြန်မာဘာသာ|my|45,053|111,955|488,746|5|69,745|358|2,857|9.63|\n|West Frisian|Frysk|fy|42,910|130,172|975,047|9|34,735|71|6,918|30.98|\n|Chuvash|Чӑвашла|cv|42,208|75,432|660,461|3|25,243|45|536|5.43|\n|Lombard|lumbaart|lmo|39,059|100,944|990,933|7|27,443|34|4,437|24.64|\n|Aragonese|aragonés|an|36,117|111,538|1,640,703|6|54,407|69|1,282|64.15|\n|Nepali|नेपाली|ne|33,302|92,463|750,820|8|44,404|105|889|25.63|\n|Eastern Punjabi|ਪੰਜਾਬੀ|pa|32,047|112,479|491,976|9|30,182|121|1,399|27.55|\n|Yoruba|Yorùbá|yo|31,950|54,993|520,314|3|19,343|52|172|4.92|\n|Bavarian|Boarisch|bar|30,211|108,848|728,671|7|49,141|73|1,342|45.36|\n|Ido|Ido|io|28,866|43,320|951,170|5|27,385|39|1|5.51|\n|Gujarati|ગુજરાતી|gu|28,648|95,171|678,601|4|52,900|101|0|38.45|\n|Alemannic|Alemannisch|als|26,618|62,477|928,718|9|72,741|81|496|26.98|\n|Kurdish (Kurmanji)|kurdî|ku|26,309|64,771|738,757|4|38,855|49|580|24.38|\n|Sicilian|sicilianu|scn|26,060|55,242|726,144|8|33,518|33|1,408|16.48|\n|Kannada|ಕನ್ನಡ|kn|25,162|109,500|944,679|5|58,742|214|3,459|96.92|\n|Bishnupriya Manipuri|বিষ্ণুপ্রিয়া মণিপুরী|bpy|25,081|58,450|782,141|2|19,830|28|49|23.69|\n|Kurdish (Sorani)|کوردی|ckb|24,830|130,597|643,744|7|37,043|89|955|89.44|\n|Wu|吴语|wuu|22,215|34,270|255,930|4|61,781|37|238|2.2|\n|Interlingua|interlingua|ia|21,906|34,892|615,006|7|35,707|38|4|6.19|\n|Egyptian Arabic|مصرى|arz|21,756|185,491|904,598|6|116,951|109|1,457|276.22|\n|Quechua|Runa Simi|qu|21,490|53,469|637,975|3|22,165|36|0|26.42|\n|Mongolian|монгол|mn|18,932|74,632|593,077|5|60,907|99|1,450|68.79|\n|Samogitian|žemaitėška|bat-smg|16,804|28,335|348,719|5|20,246|29|109|5.8|\n|Sinhalese|සිංහල|si|15,409|71,115|441,801|3|42,687|79|4,557|81.19|\n|Walloon|walon|wa|15,374|39,561|350,019|2|17,652|16|2,143|21.9|\n|Min Dong|Mìng-dĕ̤ng-ngṳ̄|cdo|15,289|30,378|84,384|4|15,186|16|4|2.71|\n|Odia|ଓଡ଼ିଆ|or|15,159|64,809|375,691|6|23,022|72|126|62.19|\n|Yiddish|ייִדיש|yi|14,881|41,430|545,603|3|35,299|45|1,062|41.92|\n|Scottish Gaelic|Gàidhlig|gd|14,834|30,795|550,033|4|21,011|32|347|20.68|\n|Amharic|አማርኛ|am|14,786|45,275|357,401|3|29,987|30|1,745|33.56|\n|Neapolitan|Napulitano|nap|14,554|23,321|659,672|3|22,095|26|286|10.26|\n|Buginese|ᨅᨔ ᨕᨘᨁᨗ|bug|14,125|18,697|192,349|1|10,052|11|0|1.08|\n|Ilocano|Ilokano|ilo|13,575|51,934|343,096|2|13,381|18|0|52.75|\n|Maithili|मैथिली|mai|13,458|33,981|199,912|5|7,896|35|104|13.68|\n|Upper Sorbian|hornjoserbsce|hsb|13,437|34,272|366,147|4|19,107|27|138|25.69|\n|Banyumasan|Basa Banyumasan|map-bms|13,327|28,928|208,316|1|11,979|19|483|9.87|\n|Faroese|føroyskt|fo|13,210|39,021|356,283|4|21,770|33|0|34.86|\n|Mingrelian|მარგალური|xmf|13,191|28,877|139,056|3|12,924|22|0|6.81|\n|Mazandarani|مازِرونی|mzn|13,122|28,727|149,464|4|21,153|27|266|7.36|\n|Limburgish|Limburgs|li|12,628|62,342|437,516|7|21,026|37|624|108.77|\n|Venetian|vèneto|vec|12,435|36,766|604,318|3|24,499|37|723|62.93|\n|Sindhi|سنڌي|sd|12,284|35,964|156,075|3|11,011|36|66|16.13|\n|Emilian-Romagnol|emiliàn e rumagnòl|eml|12,152|31,995|132,489|3|17,508|21|2,225|11.04|\n|Sakha|саха тыла|sah|12,059|41,823|347,686|4|17,509|31|1,766|50.64|\n|Zazaki|Zazaki|diq|11,767|30,559|397,162|6|18,829|67|215|33.15|\n|Ossetian|Ирон|os|11,715|44,946|474,974|3|18,801|22|179|85.03|\n|Sanskrit|संस्कृतम्|sa|11,418|59,339|446,804|5|27,265|35|437|132.63|\n|Pashto|پښتو|ps|10,840|39,529|244,127|3|20,174|45|1,500|43.26|\n|Hill Mari|кырык мары|mrj|10,268|16,587|95,426|1|8,236|18|0|2.18|\n|Meadow Mari|олык марий|mhr|10,055|24,325|177,206|1|10,679|23|0|14.67|\n|Classical Chinese|文言|zh-classical|9,985|80,949|340,565|6|79,910|59|0|212.5|\n|Fiji Hindi|Fiji Hindi|hif|9,773|34,454|251,774|2|23,057|37|193|46.61|\n|Navajo|Diné bizaad|nv|9,620|21,112|224,126|4|11,966|9|541|15.15|\n|Central Bicolano|Bikol Central|bcl|9,257|17,089|185,018|2|14,627|25|880|7.75|\n|Tarantino|tarandíne|roa-tara|9,248|17,380|135,744|2|9,023|10|290|6.04|\n|North Frisian|Nordfriisk|frr|9,237|26,264|172,262|5|13,207|26|974|22.29|\n|Acehnese|Acèh|ace|9,237|16,477|115,310|2|18,913|30|0|4.3|\n|Hakka|客家語/Hak-kâ-ngî|hak|9,232|17,730|116,743|1|25,131|21|0|5.58|\n|Kapampangan|Kapampangan|pam|8,633|18,632|281,758|2|16,247|21|412|20.29|\n|Northern Sotho|Sesotho sa Leboa|nso|8,173|10,073|39,222|1|4,332|13|0|0.21|\n|Khmer|ភាសាខ្មែរ|km|7,741|29,011|236,532|5|28,028|59|1,196|61.56|\n|Northern Sami|davvisámegiella|se|7,554|18,956|291,618|5|20,932|36|0|35.05|\n|Rusyn|русиньскый|rue|7,281|14,807|114,758|1|18,493|16|0|8.28|\n|Maori|Māori|mi|7,153|12,803|148,593|2|11,251|14|0|7.24|\n|West Flemish|West-Vlams|vls|6,978|19,693|302,127|5|19,278|25|500|50.94|\n|Nahuatl|Nāhuatl|nah|6,968|18,370|447,773|3|17,394|16|175|65.27|\n|Bhojpuri|भोजपुरी|bh|6,933|54,845|661,665|2|19,738|25|56|576.17|\n|Dutch Low Saxon|Nedersaksies|nds-nl|6,845|17,110|303,094|6|19,867|20|611|39.84|\n|Crimean Tatar|qırımtatarca|crh|6,719|22,337|142,464|2|13,449|37|0|34.46|\n|Gan|贛語|gan|6,426|33,323|392,146|4|32,873|21|146|206.17|\n|Vepsian|vepsän kel’|vep|6,196|23,005|119,770|1|11,227|21|0|38.32|\n|Sardinian|sardu|sc|6,073|13,578|160,830|4|16,302|30|132|18.09|\n|Assamese|অসমীয়া|as|6,014|46,660|207,798|5|24,104|89|1,169|203.43|\n|Abkhazian|Аҧсшәа|ab|5,976|17,185|85,161|2|13,885|26|20|17.43|\n|Gilaki|گیلکی|glk|5,912|12,265|53,377|3|11,535|19|807|5.03|\n|Tibetan|བོད་ཡིག|bo|5,860|16,958|136,753|1|20,459|24|0|28.92|\n|Erzya|эрзянь|myv|5,772|16,654|115,410|3|9,320|24|0|24.63|\n|Corsican|corsu|co|5,689|12,932|363,967|2|15,654|28|0|45.62|\n|Somali|Soomaaliga|so|5,663|20,164|196,107|1|23,944|85|0|63.77|\n|Turkmen|Türkmençe|tk|5,563|13,174|209,910|3|18,164|27|308|29.83|\n|Võro|Võro|fiu-vro|5,515|10,427|169,070|3|10,610|16|211|12.86|\n|Northern Luri|لۊری شومالی|lrc|5,452|9,401|119,925|2|4,084|15|0|6.69|\n|Komi|коми|kv|5,322|14,404|133,142|1|10,717|15|0|26.92|\n|Kashubian|kaszëbsczi|csb|5,321|8,509|182,458|3|12,578|15|0|7.7|\n|Manx|Gaelg|gv|4,985|16,882|298,086|3|15,058|15|181|100.57|\n|Shona|chiShona|sn|4,829|11,720|69,079|1|10,331|21|0|12|\n|Udmurt|удмурт|udm|4,716|14,335|113,139|5|11,092|19|9|32.83|\n|Zeelandic|Zeêuws|zea|4,680|8,842|109,709|5|9,528|18|1|9.81|\n|Aymara|Aymar aru|ay|4,641|8,210|90,698|1|12,620|21|0|6.53|\n|Interlingue|Interlingue|ie|4,610|7,460|122,543|1|12,922|22|0|6.28|\n|Picard|Picard|pcd|4,577|9,426|63,782|2|11,329|25|52|7.59|\n|Norman|Nouormand|nrm|4,303|9,502|211,447|1|10,242|15|0|32.49|\n|Kabyle|Taqbaylit|kab|4,267|11,737|92,178|2|9,115|21|0|24.07|\n|Uyghur|ئۇيغۇرچە / Uyghurche|ug|4,161|12,210|145,845|1|15,395|16|291|44.7|\n|Lezgian|лезги|lez|4,010|10,913|79,018|6|7,457|25|10|21.46|\n|Saterland Frisian|Seeltersk|stq|4,009|10,421|118,206|4|10,368|13|442|29.02|\n|Hausa|Hausa|ha|3,940|8,920|52,964|2|9,613|34|0|9.49|\n|Cornish|kernowek|kw|3,900|8,034|174,862|1|10,878|15|0|24.46|\n|Mirandese|Mirandés|mwl|3,767|9,940|95,635|3|10,007|20|0|25.84|\n|Konkani|गोंयची कोंकणी / Gõychi Konknni|gom|3,719|8,294|181,208|3|5,378|11|0|33.06|\n|Guarani|Avañe'ẽ|gn|3,714|8,850|109,182|2|12,921|22|0|23.59|\n|Hawaiian|Hawaiʻi|haw|3,708|6,478|89,205|1|11,515|16|0|7.68|\n|Romansh|rumantsch|rm|3,630|8,723|156,830|3|14,808|27|50|35.39|\n|Ligurian|Ligure|lij|3,606|15,325|164,020|3|10,646|24|0|113.04|\n|Lingua Franca Nova|Lingua Franca Nova|lfn|3,589|5,608|31,421|2|3,808|21|0|——|\n|Ladino|Ladino|lad|3,535|12,702|204,792|5|16,077|22|23|108.42|\n|Lao|ລາວ|lo|3,502|10,788|83,005|1|11,775|24|0|33.3|\n|Komi-Permyak|Перем Коми|koi|3,452|8,910|55,772|1|6,431|9|0|15.65|\n|Maltese|Malti|mt|3,425|15,441|253,223|4|16,146|28|1,149|201.85|\n|Franco-Provençal|arpetan|frp|3,381|8,730|189,906|2|11,550|22|0|54.45|\n|Friulian|furlan|fur|3,336|7,817|166,472|2|10,828|18|318|38.42|\n|Lower Sorbian|dolnoserbski|dsb|3,245|10,874|137,198|1|14,390|21|0|69.74|\n|Doteli|डोटेली|dty|3,218|15,410|197,425|3|3,359|27|3|——|\n|Extremaduran|estremeñu|ext|3,152|7,155|110,612|1|13,213|19|0|24.93|\n|Anglo-Saxon|Ænglisc|ang|3,143|14,904|196,234|2|102,208|36|300|184.36|\n|Livvi-Karelian|Livvinkarjala|olo|3,128|7,612|25,988|2|4,010|20|0|——|\n|Lingala|lingála|ln|3,127|8,208|119,329|3|9,353|11|31|38.38|\n|Chavacano|Chavacano de Zamboanga|cbk-zam|3,007|5,517|99,903|2|11,331|13|0|12.62|\n|Divehi|ދިވެހިބަސް|dv|3,001|10,587|121,244|2|19,846|16|933|73.18|\n|Banjar|Banjar|bjn|2,867|16,014|64,274|2|9,581|14|1|84.4|\n|Ripuarian|Ripoarisch|ksh|2,858|10,347|1,600,668|3|17,999|18|0|1062.21|\n|Gagauz|Gagauz|gag|2,722|6,258|63,687|1|9,250|12|0|17.17|\n|Palatinate German|Pälzisch|pfl|2,547|6,603|84,052|4|8,071|16|0|32.28|\n|Pali|पालि|pi|2,540|4,468|96,392|1|5,239|5|0|12.43|\n|Pangasinan|Pangasinan|pag|2,528|7,693|66,358|1|5,959|9|0|36.01|\n|Avar|авар|av|2,348|9,865|69,701|1|10,595|18|0|72.42|\n|Buryat|буряад|bxr|2,162|7,888|54,210|2|10,922|19|0|48.21|\n|Gorontalo|Bahasa Hulontalo|gor|2,150|4,386|22,959|3|1,131|11|0|——|\n|Kalmyk|хальмг|xal|2,082|10,864|80,817|1|7,668|12|0|132.35|\n|Karachay-Balkar|къарачай-малкъар|krc|2,031|14,104|104,984|2|7,770|10|0|263.02|\n|Zhuang|Vahcuengh|za|1,932|4,067|38,563|1|7,769|7|0|11.58|\n|Papiamentu|Papiamentu|pap|1,916|4,658|72,031|2|9,570|15|0|31.67|\n|Karakalpak|Qaraqalpaqsha|kaa|1,877|4,785|42,829|2|8,241|12|0|21.48|\n|Pennsylvania German|Deitsch|pdc|1,871|5,655|102,992|1|25,072|14|0|74.49|\n|Tuvan|тыва дыл|tyv|1,830|7,289|29,939|1|5,751|16|0|36.55|\n|Kinyarwanda|Kinyarwanda|rw|1,824|5,164|71,681|1|8,303|11|0|46.54|\n|Tongan|lea faka-Tonga|to|1,702|4,986|39,504|2|6,526|10|11|29.5|\n|Greenlandic|kalaallisut|kl|1,671|3,992|72,052|2|10,028|15|0|34.82|\n|Novial|Novial|nov|1,666|4,518|174,741|2|8,623|8|0|113.34|\n|Jamaican Patois|Patois|jam|1,643|2,889|19,706|1|4,672|19|0|3.92|\n|Aramaic|ܐܪܡܝܐ|arc|1,637|5,984|93,084|2|15,512|17|0|109.69|\n|Kabiye|Kabɩyɛ|kbp|1,599|3,113|14,409|1|2,220|8|0|——|\n|Kabardian|Адыгэбзэ|kbd|1,583|6,639|42,206|1|7,311|5|0|64.85|\n|Santali|ᱥᱟᱱᱛᱟᱲᱤ|sat|1,507|5,730|30,588|3|1,760|34|0|——|\n|Tok Pisin|Tok Pisin|tpi|1,506|5,701|84,622|1|9,578|15|0|115.17|\n|Tetum|tetun|tet|1,473|3,779|62,994|2|7,166|10|0|40.85|\n|Igbo|Igbo|ig|1,430|5,950|64,661|2|9,837|39|0|108.58|\n|Kikuyu|Gĩkũyũ|ki|1,362|2,885|19,535|1|5,528|11|0|8.47|\n|Zulu|isiZulu|zu|1,351|5,469|54,216|1|12,457|69|0|92.1|\n|Wolof|Wolof|wo|1,342|4,944|101,564|2|11,429|18|0|147.99|\n|Nauruan|Dorerin Naoero|na|1,307|4,116|81,031|1|8,662|9|0|90.93|\n|Lojban|la .lojban.|jbo|1,246|5,591|109,019|3|12,124|15|0|237.11|\n|Aromanian|armãneashti|roa-rup|1,226|3,871|198,517|1|11,028|9|0|238.7|\n|Bislama|Bislama|bi|1,220|2,934|37,979|1|8,584|14|0|——|\n|Lak|лакку|lbe|1,219|12,259|45,233|1|6,513|8|0|302.64|\n|Tahitian|reo tahiti|ty|1,203|2,874|52,099|1|5,722|7|0|34.98|\n|Moksha|мокшень|mdf|1,198|6,453|50,770|2|6,918|15|0|151.38|\n|Kongo|Kongo|kg|1,198|2,801|42,726|2|7,731|12|0|27.31|\n|Tulu|ತುಳು|tcy|1,180|4,799|68,352|2|2,987|40|0|——|\n|Luganda|Luganda|lg|1,178|4,410|25,046|1|5,262|15|0|42.75|\n|Sranan|Sranantongo|srn|1,075|2,654|38,044|1|5,699|10|0|30.93|\n|Ingush|ГӀалгӀай|inh|1,050|4,136|30,545|2|1,325|7|0|——|\n|Xhosa|isiXhosa|xh|1,029|3,590|31,083|1|8,616|32|0|53.63|\n|Atikamekw|Atikamekw|atj|1,013|1,926|11,159|5|2,004|21|0|——|\n|Latgalian|latgaļu|ltg|921|3,090|33,878|1|5,216|11|0|60.81|\n|Cherokee|ᏣᎳᎩ|chr|826|3,644|43,812|1|15,414|11|0|139.94|\n|Samoan|Gagana Samoa|sm|812|2,905|39,275|1|6,840|10|0|89.82|\n|Norfolk|Norfuk / Pitkern|pih|792|3,063|41,108|2|8,012|12|0|——|\n|Oromo|Oromoo|om|786|3,268|31,718|1|6,623|15|0|96.78|\n|Akan|Akan|ak|729|2,625|21,313|1|8,608|23|0|——|\n|Tswana|Setswana|tn|699|2,814|22,623|1|6,807|7|0|73.6|\n|Old Church Slavonic|словѣньскъ / ⰔⰎⰑⰂⰡⰐⰠⰔⰍⰟ|cu|689|4,916|76,826|2|18,534|18|0|588.2|\n|Twi|Twi|tw|675|2,190|19,830|1|8,849|14|0|45.61|\n|Tsonga|Xitsonga|ts|673|3,531|34,517|2|6,708|21|0|——|\n|Romani|romani čhib|rmy|666|2,562|47,767|2|13,536|11|0|151.1|\n|Bambara|bamanankan|bm|654|2,534|38,161|1|7,967|11|0|——|\n|Sesotho|Sesotho|st|630|2,338|23,530|1|7,136|25|0|——|\n|Cheyenne|Tsetsêhestâhese|chy|618|2,181|23,346|1|8,338|17|0|68.47|\n|Kirundi|Kirundi|rn|615|2,331|20,314|1|5,953|13|0|——|\n|Gothic|𐌲𐌿𐍄𐌹𐍃𐌺|got|600|3,252|39,746|3|13,990|17|0|——|\n|Tumbuka|chiTumbuka|tum|576|1,898|21,641|1|5,630|8|0|60.06|\n|Chichewa|Chi-Chewa|ny|551|2,918|21,460|4|6,075|14|0|——|\n|Swati|SiSwati|ss|492|2,238|36,746|3|6,030|16|0|——|\n|Chamorro|Chamoru|ch|482|2,379|20,770|1|11,563|14|0|——|\n|Pontic|Ποντιακά|pnt|465|1,984|34,226|1|7,549|13|0|——|\n|Fijian|Na Vosa Vakaviti|fj|432|1,994|31,033|1|6,255|9|0|——|\n|Adyghe|адыгабзэ|ady|415|1,892|8,304|2|3,677|10|0|——|\n|Inuktitut|ᐃᓄᒃᑎᑐᑦ/inuktitut|iu|401|2,878|42,328|2|13,198|9|0|——|\n|Venda|Tshivenda|ve|369|1,760|17,093|1|4,978|8|0|——|\n|Ewe|eʋegbe|ee|355|2,664|48,137|2|10,586|15|0|——|\n|Kashmiri|कॉशुर / کٲشُر|ks|325|1,645|32,719|1|7,058|7|0|——|\n|Inupiak|Iñupiak|ik|278|2,301|35,306|1|6,123|9|0|——|\n|Sango|Sängö|sg|261|1,628|19,469|1|4,758|9|0|——|\n|Fula|Fulfulde|ff|229|1,822|21,379|1|6,049|13|0|——|\n|Dzongkha|ཇོང་ཁ|dz|218|2,031|27,836|1|7,135|11|0|——|\n|Tigrinya|ትግርኛ|ti|168|1,636|19,490|1|6,374|9|0|——|\n|Dinka|Thuɔŋjäŋ|din|106|717|4,854|1|4,137|10|0|——|\n|Cree|Nēhiyawēwin / ᓀᐦᐃᔭᐍᐏᐣ|cr|104|2,028|33,996|2|11,639|12|0|——|\n|Ndonga|Oshiwambo|ng|8|441|5,920|1|1,755|1|0|——|\n|Choctaw|Choctaw|cho|6|200|4,217|1|1,411|0|0|——|\n|Kuanyama|Kwanyama|kj|4|113|3,547|1|1,140|0|0|——|\n|Marshallese|Ebon|mh|4|205|4,211|1|1,743|0|0|——|\n|Hiri Motu|Hiri Motu|ho|3|128|3,785|1|1,278|0|0|——|\n|Nuosu|ꆇꉙ|ii|3|188|11,652|1|1,546|0|0|——|\n|Afar|Qafár af|aa|1|509|4,680|1|3,249|0|0|——|\n|Muscogee|Mvskoke|mus|1|114|3,600|1|1,630|0|0|——|\n|Herero|Otsiherero|hz|0|175|4,480|1|3,081|1|0|——|\n|Kanuri|Kanuri|kr|0|161|4,640|1|4,404|0|0|——|\n|Shan|ၽႃႇသႃႇတႆး|shn|0|0|0|0|0|0|0|——|\n|Western Armenian|Արեւմտահայերէն|hyw|0|0|0|0|0|0|0|——|\n|N'Ko|ߒߞߏ|nqo|0|0|0|0|0|0|0|——|\n|Balinese|Bali|ban|0|0|0|0|0|0|0|——|\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FRajan-sust%2FWikiTextCorpusDownloader","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FRajan-sust%2FWikiTextCorpusDownloader","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FRajan-sust%2FWikiTextCorpusDownloader/lists"}