{"id":26714332,"url":"https://github.com/nakyeonko3/livepitrack-crawler-python","last_synced_at":"2026-04-17T15:32:00.782Z","repository":{"id":284478797,"uuid":"955078325","full_name":"nakyeonko3/livepitrack-crawler-python","owner":"nakyeonko3","description":"법정가축전염병 사이트 크롤링(flask, react)","archived":false,"fork":false,"pushed_at":"2025-03-26T04:44:53.000Z","size":0,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-26T05:26:37.852Z","etag":null,"topics":["crawling","pyth","react"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nakyeonko3.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-26T04:28:17.000Z","updated_at":"2025-03-26T04:44:57.000Z","dependencies_parsed_at":"2025-03-26T05:36:58.766Z","dependency_job_id":null,"html_url":"https://github.com/nakyeonko3/livepitrack-crawler-python","commit_stats":null,"previous_names":["nakyeonko3/livepitrack-crawler-python"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/nakyeonko3/livepitrack-crawler-python","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakyeonko3%2Flivepitrack-crawler-python","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakyeonko3%2Flivepitrack-crawler-python/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakyeonko3%2Flivepitrack-crawler-python/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakyeonko3%2Flivepitrack-crawler-python/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nakyeonko3","download_url":"https://codeload.github.com/nakyeonko3/livepitrack-crawler-python/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nakyeonko3%2Flivepitrack-crawler-python/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31934330,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-17T12:37:54.787Z","status":"ssl_error","status_checked_at":"2026-04-17T12:37:25.095Z","response_time":62,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawling","pyth","react"],"created_at":"2025-03-27T13:19:19.007Z","updated_at":"2026-04-17T15:32:00.766Z","avatar_url":"https://github.com/nakyeonko3.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 법정가축전염병 사이트 크롤링\n\n## 목표\n\n- 법정가축전염병 사이트에서 발생 데이터를 크롤링하여 저장\n\n## 기술 스텍\n\n### python\n- Python 3.10.10\n- requests 2.32.3\n- pandas 2.2.3\n- lxml 5.3.1\n- openpyxl 3.1.5\n- playwright 1.50.0\n\n## 실행 방법\n\n1. 가상환경 생성\n```\npython -m venv .venv\n```\n\n1. 가상환경 활성화\n```\n.venv\\Scripts\\activate\n```\n\n1. 필요한 패키지 설치\n```\npip install -r requirements.txt\n```\n\n설치가 안되면\n```bash\npip install requests lxml openpyxl playwright\n```\n\nplaywright 설치하기\n```bash\npip install pytest-playwright\nplaywright install\n```\n\n\n4. 실행\n```bash\npython fetch_and_save_livestock_disease.py\n```\n\n5. 실행 결과\noutput 폴더에 csv와 excel 파일이 생성됨.\n\n\n## 커스텀하는 방법(질병명, 날짜, 발생지역등을 바꿔서 크롤링하고 싶을 때)\n\n## 방법\n1. index.py 코드 확인하기\n2. custom_params 변수값 확인하기 아래 `custom_params 변수값 분석`을 참고해서 커스텀을 할 수 있음\n![Image](https://i.imgur.com/NK0fh1U.png)\n3. custom_params 변수값을 바꿔서 크롤링\n예시\n```python\n# custom_params 설정\n# 기본 파라미터 설정 (사용자 입력 기반)\ncustom_params = { \n    \"turmGubun\": \"02\", # 02: 발생일\n    \"occrFromDt\": \"2000-01-13\", # 시작일\n    \"occrToDt\": \"2025-03-13\", # 종료일\n    \"dissCl\": \"0504\", # 질병명: 사슴만성소모성질병\n    \"lstkspCl\": \"\", # 축종: 전체\n    'ctprvn': '', # 발생지역: 전체\n    \"legalIctsdGradSe\": \"\" ,# 법정전염병: 전체\n}\n```\n\n\n## custom_params 변수값 분석\n\n| 키               | 값                           | 설명                             |\n|------------------|------------------------------|----------------------------------|\n| csSignature      | f8kcFfnwghfIToSYbM6uxQ%3D%3D | 시그니처                         |\n| turmGubun        | 01                           | 발생일(01), 진단일(02) 선택        |\n| occrFromDt       | 2024-03-13                   | 시작일                          |\n| occrToDt         | 2025-03-13                   | 종료일                          |\n| dissCl           | \"0007\"                       | 질병명(질병코드)                           |\n| ctprvn           | \"\"                           | 발생지역                         |\n| lstkspCl         | \"\"                           | 축종(가축)                         |\n| legalIctsdGradSe | \"\"                           | 법정전염병                       |\n\n\n### cssSignature\n- **무시해도 되는 값**\n\n### turmGubun\n- \"01\": 진단일을 기준으로 검색\n- \"02\": 발생일을 기준으로 검색\n\n### occrFromDt\n- \"YYYY-MM-DD\" \n- 발생일자(시작) or 진단일자(시작)\n\n### occrToDt\n- \"YYYY-MM-DD\" \n- 발생일자(종료) or 진단일자(종료)\n\n### dissCI\n- 질병명\n- \"\" : 전체\n- \"0007\" : 가금티푸스\n- \"0099\" : 결핵병\n- \"0111\" : 고병원성 조류인플루엔자\n- \"0191\" : 구제역\n- \"0333\" : 뉴캣슬병\n- \"0406\" : 돼지생식기호흡기증후군\n- \"0412\" : 돼지열병\n- \"0418\" : 돼지오제스키병\n- \"0504\" : 사슴만성소모성질병\n- \"0683\" : 브루셀라병\n- \"1442\" : 추백리\n- \"0296\" : 낭충봉아부패병 \n- \"1003\" : 아프리카돼지열병\n- \"0446\" : 럼피스킨\n\n### ctprvn\t \n- 발생 지역\n- \"\" : 전체\n- \"11\" : 서울특별시\n- \"26\" : 부산광역시\n- \"27\" : 대구광역시\n- \"28\" : 인천광역시\n- \"29\" : 광주광역시\n- \"30\" : 대전광역시\n- \"31\" : 울산광역시\n- \"36\" : 세종특별자치시\n- \"41\" : 경기도\n- \"51\" : 강원특별자치도\n- \"43\" : 충청북도\n- \"44\" : 충청남도\n- \"52\" : 전북특별자치도\n- \"46\" : 전라남도\n- \"47\" : 경상북도\n- \"48\" : 경상남도\n- \"50\" : 제주특별자치도\n\n### signgu\n- 세부 발생 지역\n- \"\" : 전체\n\n### lstkspCl\n- 축종\n- \"\" : 전 체\n- \"4120\" : 소\n- \"4141\" : 산양\n- \"4142\" : 면양\n- \"4130\" : 돼지\n- \"4150\" : 닭\n- \"4184\" : 사슴\n- \"4162\" : 오리\n- \"4163\" : 거위\n- \"4161\" : 칠면조\n- \"4164\" : 메추리\n- \"4186\" : 벌\n- \"4143\" : 염소\n\n### legalIctsdGradSe\n- 법정전염병명\n- \"\" : 전체\n- \"1\" : 1종\n- \"2\" : 2종\n- \"3\" : 3종\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnakyeonko3%2Flivepitrack-crawler-python","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnakyeonko3%2Flivepitrack-crawler-python","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnakyeonko3%2Flivepitrack-crawler-python/lists"}