{"id":34073327,"url":"https://github.com/slanglab/freq-e","last_synced_at":"2025-12-14T08:48:45.484Z","repository":{"id":57432260,"uuid":"168028954","full_name":"slanglab/freq-e","owner":"slanglab","description":"Class frequency estimation software package ","archived":false,"fork":false,"pushed_at":"2019-09-01T18:29:44.000Z","size":4824,"stargazers_count":13,"open_issues_count":1,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-08-25T15:35:52.791Z","etag":null,"topics":["machine-learning","statistics"],"latest_commit_sha":null,"homepage":"http://slanglab.cs.umass.edu/doc_prevalence/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/slanglab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-01-28T20:08:47.000Z","updated_at":"2024-12-17T13:52:17.000Z","dependencies_parsed_at":"2022-09-19T08:02:31.226Z","dependency_job_id":null,"html_url":"https://github.com/slanglab/freq-e","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/slanglab/freq-e","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slanglab%2Ffreq-e","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slanglab%2Ffreq-e/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slanglab%2Ffreq-e/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slanglab%2Ffreq-e/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/slanglab","download_url":"https://codeload.github.com/slanglab/freq-e/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slanglab%2Ffreq-e/sbom","scorecard":{"id":831004,"data":{"date":"2025-08-11","repo":{"name":"github.com/slanglab/freq-e","commit":"d4cc08f95dc519b343a95b0fe39e68bed1e1541c"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3,"checks":[{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Code-Review","score":0,"reason":"Found 0/30 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"SAST","score":0,"reason":"no SAST tool detected","details":["Warn: no pull requests merged into dev branch"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}}]},"last_synced_at":"2025-08-23T17:48:38.178Z","repository_id":57432260,"created_at":"2025-08-23T17:48:38.178Z","updated_at":"2025-08-23T17:48:38.178Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":27723772,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-12-14T02:00:11.348Z","response_time":56,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["machine-learning","statistics"],"created_at":"2025-12-14T08:48:44.822Z","updated_at":"2025-12-14T08:48:45.468Z","avatar_url":"https://github.com/slanglab.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# freq-e = (class) frequency estimation \n\nUse this software to infer the class frequencies in a collection of items (e.g documents or images). \nFor example, given all blog posts about Barack Obama during a certain time period, what is the overall positive sentiment towards him? \n\nIn our [academic paper](http://www.aclweb.org/anthology/D18-1487) we show that naive approaches which aggregate the hard labels or soft probabilities outputted from a trained discriminative classifier were often biased. Instead, we use an *implicit likelihood* method which combines a discriminitive classifier in a generative framework and allows for more robust estimation when the true prevalences of the train and test groups differ. See also \n\n - Github repository: https://github.com/slanglab/freq-e\n - Research project website: http://slanglab.cs.umass.edu/doc_prevalence/\n - Paper: http://aclweb.org/anthology/D18-1487\n\nThis software currently only supports *binary* predictions. Future work will expand this to multiclass. \n\n# Installation \n\nInstalling the `freq-e` package, assuming Python 3:\n1. `pip install freq-e` \n2. Then follow `py_tutorial/tutorial.ipynb`. \n\n# Usage \n\nAs we specify in `py_tutorial/tutorial.ipynb`, there are three different ways to obtain class frequency estimates:  \n1. Create a `FreqEstimator` object and use the built-in training method. \n2. You can also train a scikit-learn classifier yourself and pass it in to freq-e. Here the model class is restricted to scikit-learn models that have a .decision_function() method. \n3. Use the standalone `infer_freq_from_predictions()` method and pass in the predicted probabilities of the positive class of the test set. This may be useful in the cases where you have certain classifier architectures that are not built from sklearn (e.g. an LSTM or CNN). \n\n# Citing \nIf you use this software, please cite our paper. Here is the Bibtex entry: \n```\n@inproceedings{keith2018uncertainty,\n  title={Uncertainty-aware generative models for inferring document class prevalence},\n  author={Keith, Katherine and O'Connor, Brendan},\n  booktitle={Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing},\n  year={2018}\n}\n```\n\n# Contact \nContact the software authors with any questions: Katherine Keith (kkeith@cs.umass.edu) and Brendan O'Connor (brenocon@cs.umass.edu).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fslanglab%2Ffreq-e","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fslanglab%2Ffreq-e","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fslanglab%2Ffreq-e/lists"}