{"id":19043294,"url":"https://github.com/zeionara/clusterizer","last_synced_at":"2026-05-09T09:30:19.316Z","repository":{"id":111791038,"uuid":"182296595","full_name":"zeionara/clusterizer","owner":"zeionara","description":"My first attempts to clusterize texts","archived":false,"fork":false,"pushed_at":"2019-04-21T17:07:53.000Z","size":510,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-01-02T07:46:22.768Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zeionara.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-04-19T16:46:18.000Z","updated_at":"2019-04-25T21:35:24.000Z","dependencies_parsed_at":null,"dependency_job_id":"7396b3bb-c028-4638-80ff-25ea4ee56623","html_url":"https://github.com/zeionara/clusterizer","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeionara%2Fclusterizer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeionara%2Fclusterizer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeionara%2Fclusterizer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeionara%2Fclusterizer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zeionara","download_url":"https://codeload.github.com/zeionara/clusterizer/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240100563,"owners_count":19747689,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-08T22:41:16.276Z","updated_at":"2026-05-09T09:30:19.284Z","avatar_url":"https://github.com/zeionara.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# clusterizer\r\n\r\nMy first attempts to clusterize texts.\r\n\r\nThe sequence of using scripts in order to get results is presented on the picture below.\r\n\r\n![scheme](https://github.com/zeionara/clusterizer/blob/master/docs/scheme.jpg)\r\n\r\nExample of usage of the presented scripts for splitting datasets into clusters and generating reports:\r\n\r\n```sh\r\npython3 -m clusterizer.lemmatize -in /mnt/c/Users/prote/big_data/news_lenta.csv -out /mnt/c/Users/prote/big_data/test.csv -i 1 -w 700000 -s 0.05 -n 5000 -v \u0026\u0026 \r\npython3 -m clusterizer.filter -in /mnt/c/Users/prote/big_data/russian_news.txt -out /mnt/c/Users/prote/big_data/test.txt -i 1 -w 1500000 -s 0.05 -n 10000 -v -k natural_disasters_keywords.txt -c \u0026\u0026 \r\npython3 -m clusterizer.filter -in /mnt/c/Users/prote/big_data/test.csv -out /mnt/c/Users/prote/big_data/test.txt -i 1 -w 700000 -s 0.05 -v -k natural_disasters_keywords.txt \u0026\u0026 \r\npython3 -m clusterizer.erase -in /mnt/c/Users/prote/big_data/test.txt -out /mnt/c/Users/prote/big_data/twsw.txt -v \u0026\u0026\r\npython3 -m clusterizer.randomize -in /mnt/c/Users/prote/big_data/twsw.txt -out /mnt/c/Users/prote/big_data/clustering_results/articles_for_reducing_vocabulary.txt -n 200 -v \u0026\u0026 \r\npython3 -m clusterizer.reduce -in /mnt/c/Users/prote/big_data/clustering_results/articles_for_reducing_vocabulary.txt -out /mnt/c/Users/prote/big_data/clustering_results/articles_for_clustering.txt -v \u0026\u0026 \r\npython3 -m clusterizer.clusterize -min 2 -max 10 -i 100 -in /mnt/c/Users/prote/big_data/clustering_results/articles_for_clustering.txt -ofo /mnt/c/Users/prote/big_data/clustering_results/results/results -ofi cluster -rfi /mnt/c/Users/prote/big_data/clustering_results/reports/results -d 100 -v -e -s \u0026\u0026\r\npython3 -m clusterizer.format -in /mnt/c/Users/prote/big_data/clustering_results/results/results_100 -out /mnt/c/Users/prote/big_data/clustering_results/reports/clusters_descriptions.txt -n 5 -v\r\n```\r\n\r\nPlot, built on the data from the output report generated by the command given above:\r\n\r\n![average silhouette](https://github.com/zeionara/clusterizer/blob/master/docs/avg_slh.jpg)\r\n\r\nAlso it is possible to calculate another metrics, not only silhouette, using special flags:\r\n\r\n![average silhouette](https://github.com/zeionara/clusterizer/blob/master/docs/metrics.png)\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzeionara%2Fclusterizer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzeionara%2Fclusterizer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzeionara%2Fclusterizer/lists"}