{"id":25612178,"url":"https://github.com/phantu279999/crawlpricedrug","last_synced_at":"2026-04-13T00:07:56.928Z","repository":{"id":276589435,"uuid":"929311144","full_name":"phantu279999/CrawlPriceDrug","owner":"phantu279999","description":null,"archived":false,"fork":false,"pushed_at":"2025-02-20T01:31:43.000Z","size":163,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-20T02:27:52.069Z","etag":null,"topics":["crawler","fastapi","mysql","python","redis","selenium"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/phantu279999.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-08T08:46:22.000Z","updated_at":"2025-02-20T01:32:03.000Z","dependencies_parsed_at":null,"dependency_job_id":"212dd0b6-d7e7-46c3-9e66-0affad7a9ee0","html_url":"https://github.com/phantu279999/CrawlPriceDrug","commit_stats":null,"previous_names":["phantu279999/crawlpricedrug"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/phantu279999%2FCrawlPriceDrug","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/phantu279999%2FCrawlPriceDrug/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/phantu279999%2FCrawlPriceDrug/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/phantu279999%2FCrawlPriceDrug/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/phantu279999","download_url":"https://codeload.github.com/phantu279999/CrawlPriceDrug/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240105465,"owners_count":19748465,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","fastapi","mysql","python","redis","selenium"],"created_at":"2025-02-22T00:17:48.666Z","updated_at":"2026-04-13T00:07:56.878Z","avatar_url":"https://github.com/phantu279999.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Crawl Price Drug\n### Dự án đơn giản lấy dữ liệu giá của các loại thuốc của các trang\n\n\n⚡ Cài đặt và chạy dự án\n\n```shell\n# Clone repository  \ngit clone https://github.com/phantu279999/CrawlPriceDrug.git\ncd CrawlPriceDrug  \n\n# Tạo và kích hoạt virtual environment  \npython -m venv venv  \nsource venv/bin/activate  # Windows: venv\\Scripts\\activate  \n\n# Cài đặt dependencies  \npip install -r requirements.txt  \n\n# Chạy migration  \npython main.py  \n\n```\n\nCấu hình lấy dự liệu các trang ở file: config.json\n\n\n####  Cấu trúc dữ liệu trong MySQL\n```mysql\nCREATE TABLE Drug(\n    drug_id INT PRIMARY KEY AUTO_INCREMENT,\n    declaration_date DATETIME NULL,\n    status VARCHAR(255) NULL,\n    petition VARCHAR(255) NULL,\n    name VARCHAR(255) NOT NULL UNIQUE,\n    hc_name VARCHAR(255) NULL, # Tên hoạt chất\n    nd_hl VARCHAR(255) NULL,  \n    gplh_gpnk VARCHAR(255) NULL,\n    dosage_form VARCHAR(255) NULL,\n    packaging_specifications VARCHAR(255) NULL,\n    DVT VARCHAR(50) NULL,\n    price VARCHAR(20) NULL,\n    url VARCHAR(200) NULL,\n    INDEX idx_drug_name (name)\n);\n\n```\n\nExample\n![](https://raw.githubusercontent.com/phantu279999/CrawlPriceDrug/refs/heads/master/example/example_data_sql.png)\n\n\n\n#### Cấu trúc dữ liệu trong Redis\n\n##### String Key\nkey = \"drug name\"\nvalue = \"string json\"\n\n##### Hash Key\nDrug\nfield = \"drug name\"\nvalue = \"string json\"\n\nExample\n![](https://raw.githubusercontent.com/phantu279999/CrawlPriceDrug/refs/heads/master/example/example_data.png)\n\n\n### Cấu trúc luồng dữ liệu của dự án: Data pipeline\n\n```\n[Extract data] -\u003e [Transform data] -\u003e [Load data]\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphantu279999%2Fcrawlpricedrug","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fphantu279999%2Fcrawlpricedrug","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphantu279999%2Fcrawlpricedrug/lists"}