{"id":13785797,"url":"https://github.com/humsha/USCorpus","last_synced_at":"2025-05-11T21:32:16.724Z","repository":{"id":215890168,"uuid":"59430555","full_name":"humsha/USCorpus","owner":"humsha","description":"Urdu Summary Corpus and Software Tools Version 1.0","archived":false,"fork":false,"pushed_at":"2022-10-16T09:27:33.000Z","size":19415,"stargazers_count":13,"open_issues_count":2,"forks_count":10,"subscribers_count":3,"default_branch":"master","last_synced_at":"2024-11-17T22:35:55.441Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://dl.dropboxusercontent.com/u/48044196/USCTools.zip","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/humsha.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2016-05-22T19:35:31.000Z","updated_at":"2023-08-14T09:48:56.000Z","dependencies_parsed_at":"2024-01-21T11:48:42.406Z","dependency_job_id":null,"html_url":"https://github.com/humsha/USCorpus","commit_stats":null,"previous_names":["humsha/uscorpus"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/humsha%2FUSCorpus","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/humsha%2FUSCorpus/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/humsha%2FUSCorpus/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/humsha%2FUSCorpus/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/humsha","download_url":"https://codeload.github.com/humsha/USCorpus/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253638973,"owners_count":21940434,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-03T19:01:04.566Z","updated_at":"2025-05-11T21:32:11.703Z","avatar_url":"https://github.com/humsha.png","language":null,"funding_links":[],"categories":["Others","Urdu Datasets"],"sub_categories":["General NLP Datasets"],"readme":"# USCorpus\n\n## Urdu Summary Corpus\n\nUrdu summary corpus consists of 50 articles collected from various sources.\nFrom the original HTML documents only unformatted content text was kept, removing all other things. \nWe provide abstractive summaries of these 50 articles. \nAfter normalization, we further applied different NLP tools on the articles to generate part-of-speech tagged, \nmorphologically analyzed, lemmatized and stemmed articles.\n\n## Urdu Summary Corpus Tools\n\nNormalization is taken from [1], Diacritic marks are also removed in this step. \n\n\nTable-lookup based Morphological Analyzer and lemmatizer is built from [3].\n\n\nStemmer is built from [1] \n\n\nTable-lookup based POS tagger is built from [4]. We used unigram and bigram counts.\n\n\n## Commands:\n\nUnzip USCTools.zip \n\nOpen Console\n\nGo to USCTools directly typing: cd USCTools\n\n## For Normalization\n\n$ java -cp bin USCTools normalize input.txt output.txt \t \n\n## For Lemmatization\n$ java -cp bin USCTools lemmatize input.txt output.txt \t \n\n## For Morphological analysis\n$ java -cp bin USCTools morph_analysis input.txt output.txt \t \n\n## For stemming by Assas-Band\n$ java -cp bin USCTools stemming input.txt output.txt \t \n\n## For POS tagging\n$ java -cp bin USCTools tagging input.txt output.txt \t \n\n\n## Contributers:\nMuhammad Humayoun, humayoun@gmail.com\n\nMuhammad Uzair, uzairnaroo@gmail.com\n\nSaba Aslam, saba12@hotmail.fr\n\nOmer Farzand, umerfarzand@gmail.com\n\nRao Muhammad Adeel Nawab, adeelnawab@ciitlahore.edu.pk\n\n## Maintainer\nMuhammad Humayoun (PhD)\n\nhumayoun@gmail.com\n\nAssistant Professor\n\nComputer Information Sciences Division\n\nAbu Dhabi Men’s Campus, Higher Colleges of Technology\n\nAbu Dhabi, United Arab Emirates\n\n\n## Related Publications:\nMuhammad Humayoun, Rao Muhammad Adeel Nawab, Muhammad Uzair, Saba Aslam, Omer Farzand (2016)\nUrdu Summary Corpus. Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016). European Language Resources Association (ELRA), ISBN: 978-2-9517408-9-1. http://www.lrec-conf.org/proceedings/lrec2016/index.html\n\nMuhammad Humayoun and Hwanjo Yu (2016), Analyzing Pre-processing Settings for Urdu Single-document Extractive Summarization. In Nicoletta Calzolari, et al., editors, Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016). European Language Resources Association (ELRA). ISBN: 978-2-9517408-9-1. \n\n\n## References:\n\n[1] Q.-u.-A. Akram, A. Naseer, and S. Hussain. Proceedings of the 7th Workshop\non Asian Language Resources (ALR7), chapter Assas-band, an Affix-\nException-List Based Urdu Stemmer, pages 40–47. Association for Computational\nLinguistics, 2009.\n\n\n[2] A. Gulzar. Urdu normalization utility v1.0. Technical report,\nCenter for Language Engineering, Al-kwarzimi Institute of Computer\nScience (KICS), University of Engineering, Lahore, Pakistan.\nhttp://www.cle.org.pk/software/langproc/urdunormalization.htm, 2007.\n\n\n[3] M. Humayoun, H. Hammarström, and A. Ranta. Urdu morphology, orthography\nand lexicon extraction. CAASL-2: The Second Workshop on\nComputational Approaches to Arabic Script-based Languages, LSA Linguistic\nInstitute. Stanford University, California, USA., pages 21–22, 2007.\nhttp://www.lama.univ-savoie.fr/ humayoun/UrduMorph/.\n\n\n[4] B. Jawaid, A. Kamran, and O. Bojar. A tagged corpus and a tagger for\nurdu. In N. C. C. Chair), K. Choukri, T. Declerck, H. Loftsson, B. Maegaard,\nJ. Mariani, A. Moreno, J. Odijk, and S. Piperidis, editors, Proceedings\nof the Ninth International Conference on Language Resources and\nEvaluation (LREC’14), Reykjavik, Iceland, may 2014. European Language\nResources Association (ELRA).\nhttps://lindat.mff.cuni.cz/repository/xmlui/handle/11858/00-097C-0000-0023-65A9-5\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhumsha%2FUSCorpus","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhumsha%2FUSCorpus","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhumsha%2FUSCorpus/lists"}