{"id":19094730,"url":"https://github.com/lowfie/processingservice","last_synced_at":"2026-05-03T10:41:07.750Z","repository":{"id":239392093,"uuid":"799391759","full_name":"lowfie/ProcessingService","owner":"lowfie","description":"A service for processing a high load of data and presenting aggregated information in a convenient form","archived":false,"fork":false,"pushed_at":"2024-05-16T12:05:32.000Z","size":81,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-22T08:27:05.969Z","etag":null,"topics":["docker","fastapi","pydantic","python","sqlalchemy"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/lowfie.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-12T02:04:27.000Z","updated_at":"2024-05-16T12:05:36.000Z","dependencies_parsed_at":"2024-05-12T04:25:49.895Z","dependency_job_id":"d9386ccd-9a2a-4225-a221-0db8cf163ef6","html_url":"https://github.com/lowfie/ProcessingService","commit_stats":null,"previous_names":["lowfie/processingservice"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/lowfie/ProcessingService","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lowfie%2FProcessingService","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lowfie%2FProcessingService/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lowfie%2FProcessingService/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lowfie%2FProcessingService/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/lowfie","download_url":"https://codeload.github.com/lowfie/ProcessingService/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lowfie%2FProcessingService/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32566444,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-03T06:36:36.687Z","status":"ssl_error","status_checked_at":"2026-05-03T06:36:09.306Z","response_time":103,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker","fastapi","pydantic","python","sqlalchemy"],"created_at":"2024-11-09T03:31:09.503Z","updated_at":"2026-05-03T10:41:07.736Z","avatar_url":"https://github.com/lowfie.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Processing Service\n\n## Описание\nСервис для обработки высокой нагрузки данных и представления агрегированной информацию в удобной форме.\n\nSwagger - http://localhost:8000/api/v1/docs  \nentrypoint - `src/api/main.py`\n## Запуск приложения\n\n#### Создание конфигурационных файлов.\nВ корне проекта создать `.env` файл, пример `.env.example` файл.  \nВ `src/config/files` создать `dev.yaml` или `production.yaml`, пример файла находится в этой же директории.\n\n### Полная инициализация\n#### Запуск проекта/миграций/админа\nКоманда `make init`\n\n### Частичная инициализация\n#### Запуск проекта\nКоманда `make up`\n\n#### Создаём миграции\nКоманда `make revision upgrade`\n\n#### Создаём админа \nКоманда `make create-admin`\n\n## Make команды\n1. init - инициализация включающая в себя пул команд\n2. up/down/restart - запуск/остановка/перезагрузка приложения\n3. logs-\u003cservice\u003e - просмотр логов (logs просмотр логов api)\n4. shell-\u003cservice\u003e - открытие интерактивной консоли (shell запуск python терминала приложения)\n5. revision - сделать миграцию\n6. upgrade - инициализировать +1 миграцию от предыдущей\n7. upgrade-head - инициализация всех миграций\n8. downgrade - откатиться на -1 миграцию\n9. clean-migrations - отчистка всех миграций\n10. clean - полная чистка базы данных и миграций\n11. create-admin - создание админа\n\n## Технологии\n - Python 3.12\n - FastApi [uvicorn]\n - Pydantic 2\n - SQLAlchemy [asyncpg]\n - PostgresSQL 15\n - Docker, Docker compose\n - Poetry\n\n## Нюансы\nЯ не хешировал пароли в базе данных,\nтак как это демонстрационный пример источников (пользователей)\n\nВ директории `src/scripts/populate.py` можно создать нагрузку для создания данных.\nВ нём нужно указать количество источников, ивентов в секунду от источников,\nтокен авторизации источника (пользователя), лимит на количество итераций.\n\nТакже можно добавить админ панель, используя SQLAdmin. \nНагрузочное тестирование проводил в мануальном режиме.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flowfie%2Fprocessingservice","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flowfie%2Fprocessingservice","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flowfie%2Fprocessingservice/lists"}