{"id":25862778,"url":"https://github.com/romaklimenko/dirty-archive","last_synced_at":"2026-06-05T22:31:28.838Z","repository":{"id":152408897,"uuid":"518601952","full_name":"romaklimenko/dirty-archive","owner":"romaklimenko","description":null,"archived":false,"fork":false,"pushed_at":"2023-12-19T16:37:25.000Z","size":1848,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-01T23:56:26.344Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/romaklimenko.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2022-07-27T20:25:18.000Z","updated_at":"2023-12-19T16:44:26.000Z","dependencies_parsed_at":"2023-12-19T17:28:32.772Z","dependency_job_id":null,"html_url":"https://github.com/romaklimenko/dirty-archive","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/romaklimenko/dirty-archive","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/romaklimenko%2Fdirty-archive","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/romaklimenko%2Fdirty-archive/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/romaklimenko%2Fdirty-archive/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/romaklimenko%2Fdirty-archive/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/romaklimenko","download_url":"https://codeload.github.com/romaklimenko/dirty-archive/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/romaklimenko%2Fdirty-archive/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33962959,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-05T02:00:06.157Z","response_time":120,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-01T23:56:36.192Z","updated_at":"2026-06-05T22:31:28.065Z","avatar_url":"https://github.com/romaklimenko.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# dirty backup\n\n![https://storage.googleapis.com/dirty-public/logo_main_retina_black.png](https://storage.googleapis.com/dirty-public/logo_main_retina_black.png)\n\nНекогда живое и интересное сообщество d3.ru в последние годы заметно деградировало. А после нападения России на Украину сайт все больше напоминает живой труп.\n\nС помощью этих простых скриптов можно хоть как-то сохранить то, что может быть удалено в любой момент.\n\nСо временем это выродилось в Kubernetes кластер с Grafana и MongoDB. Регулярно собирались данные обо всех постах, комментариях, голосах, голосах в карму, подписчиках сообществ, постов на главной, картинках с их EXIF-тегами и т.д.\n\n![./images/grafana.png](./images/grafana.png)\n\nПроект закрыт в связи с потерей моего интереса к нему.\n\n---\n\nКоличество данных на момент закрытия проекта (19 декабря 2023):\n\n```js\ndb.posts.countDocuments({})\n1_411_385\n```\n\n```js\ndb.comments.countDocuments({})\n19_233_667\n```\n\n```js\ndb.karma.countDocuments({})\n3_713_937\n```\n\n```js\ndb.votes.countDocuments({})\n63_289_098\n```\n\n```js\ndb.media.countDocuments({})\n2_246_832\n```\n\n```js\ndb.users.countDocuments({})\n157_124\n```\n\n```js\ndb.stats()\n{\n    \"db\" : \"dirty\",\n    \"collections\" : 14,\n    \"views\" : 0,\n    \"objects\" : 92902833,\n    \"avgObjSize\" : 510.181559242655,\n    \"dataSize\" : 47397312198.0,\n    \"storageSize\" : 20712538112.0,\n    \"indexes\" : 82,\n    \"indexSize\" : 16050503680.0,\n    \"totalSize\" : 36763041792.0, // 34.2382507 GiB\n    \"scaleFactor\" : 1.0,\n    \"fsUsedSize\" : 136483467264.0,\n    \"fsTotalSize\" : 419491782656.0,\n    \"ok\" : 1.0\n}\n```\n\n```\nmongodump-2023-12-19T15.43.16+0100.zip - 7.56 GiB\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fromaklimenko%2Fdirty-archive","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fromaklimenko%2Fdirty-archive","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fromaklimenko%2Fdirty-archive/lists"}