{"id":20114828,"url":"https://github.com/gatenlp/gateplugin-corpusstats","last_synced_at":"2026-06-10T05:31:56.062Z","repository":{"id":57743465,"uuid":"70247810","full_name":"GateNLP/gateplugin-CorpusStats","owner":"GateNLP","description":"A plugin for the GATE language technology framework for creating and storing corpus statistics like tf, df. ","archived":false,"fork":false,"pushed_at":"2023-02-10T13:32:37.000Z","size":4340,"stargazers_count":0,"open_issues_count":3,"forks_count":0,"subscribers_count":13,"default_branch":"master","last_synced_at":"2025-01-13T06:11:01.824Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://gatenlp.github.io/gateplugin-CorpusStats/","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"lgpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/GateNLP.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-10-07T13:12:54.000Z","updated_at":"2023-01-23T21:48:43.000Z","dependencies_parsed_at":"2023-02-13T03:35:12.119Z","dependency_job_id":null,"html_url":"https://github.com/GateNLP/gateplugin-CorpusStats","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GateNLP%2Fgateplugin-CorpusStats","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GateNLP%2Fgateplugin-CorpusStats/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GateNLP%2Fgateplugin-CorpusStats/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GateNLP%2Fgateplugin-CorpusStats/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/GateNLP","download_url":"https://codeload.github.com/GateNLP/gateplugin-CorpusStats/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241557194,"owners_count":19981881,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-13T18:32:15.080Z","updated_at":"2026-06-10T05:31:56.055Z","avatar_url":"https://github.com/GateNLP.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# gateplugin-CorpusStats\n\nA plugin for the GATE language technology framework for calculating various term and term pair\nstatistics over a corpus. \n\n\nThe plugin implements the following PRs:\n* [CorpusStatsiTfIdfPR](https://gatenlp.github.io/gateplugin-CorpusStats/doc-CorpusStatsTfIdfPR) for processing\n  a whole corpus and creating files that contain corpus statistics like document frequency, term frequency,\n  total number of documents etc.\n* [AssignStatsTfIdfPR](https://gatenlp.github.io/gateplugin-CorpusStats/doc-AssignStatsTfIdfPR) for processing\n  a corpus and using the corpus statistics file created with the CorpusStatsPR to add featires to terms\n  in each document of the corpus. This can be used to create features for scores like `tf` (term frequency),\n  `wtf` (weighted term frequency), `ltfidf` (logarithmic term frequency times inverse document frequency), and others.\n* [CorpusStatsCollocationsPR](https://gatenlp.github.io/gateplugin-CorpusStats/doc-CorpusStatsCollocationsPR) for processing a\n  corpus and creating TSV files that contain corpus statistics like PMI, Chi-Squared and others\n  for all pairs of terms.\n\nMore documentation:\n* [User Documentation](https://gatenlp.github.io/gateplugin-CorpusStats/)\n* [Developer Documentation](https://github.com/GateNLP/gateplugin-CorpusStats/wiki)\n* [JavaDoc](https://gatenlp.github.io/gateplugin-CorpusStats/apidocs/)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgatenlp%2Fgateplugin-corpusstats","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgatenlp%2Fgateplugin-corpusstats","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgatenlp%2Fgateplugin-corpusstats/lists"}