{"id":17488664,"url":"https://github.com/daohoangson/js-fta-crawler","last_synced_at":"2025-03-28T15:42:33.383Z","repository":{"id":51082476,"uuid":"369626026","full_name":"daohoangson/js-fta-crawler","owner":"daohoangson","description":"Crawler to extract tariff information from https://fta.moit.gov.vn","archived":false,"fork":false,"pushed_at":"2021-05-25T02:51:10.000Z","size":54,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-12-22T21:06:10.347Z","etag":null,"topics":["csv","export","fta","import","vietnam"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/daohoangson.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-05-21T18:45:15.000Z","updated_at":"2021-05-25T03:33:14.000Z","dependencies_parsed_at":"2022-08-20T15:00:22.062Z","dependency_job_id":null,"html_url":"https://github.com/daohoangson/js-fta-crawler","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/daohoangson%2Fjs-fta-crawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/daohoangson%2Fjs-fta-crawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/daohoangson%2Fjs-fta-crawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/daohoangson%2Fjs-fta-crawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/daohoangson","download_url":"https://codeload.github.com/daohoangson/js-fta-crawler/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246056752,"owners_count":20716798,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["csv","export","fta","import","vietnam"],"created_at":"2024-10-19T04:08:47.804Z","updated_at":"2025-03-28T15:42:33.349Z","avatar_url":"https://github.com/daohoangson.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# FTA crawler\n\n[FTA website](https://fta.moit.gov.vn) crawler to extract tariff information.\n\n## Usage\n\n### Pre-built binaries\n\nThis repository has been setup to build standalone binaries for Linux, macOS and Windows for each commits.\nNode.js is no longer required if you are using the binary.\nReplace `npm start` with the downloaded file to use it directly:\n\n```bash\ncrawl-win.exe --export mexico\n```\n\nPlease note that some OSes have built-in protection which will block running the binary after downloading.\nYou may need to double click the file to trigger the bypass procedure before executing it in the command line.\n\n### Prerequisite\n\n```bash\n# Install Node.js via Homebrew\n# or go to https://nodejs.org/en/download/ yourself\nbrew install node\n\n# Install dependencies\nnpm install\n```\n\n### Command line arguments\n\nGet import tarrifs from Mexico:\n\n```bash\nnpm start -- --import mexico\n```\n\nGet export tarrifs to Mexico:\n\n```bash\nnpm start -- --export mexico\n```\n\nUse country ID instead of name (check the website or see [the table below](#countries)):\n\n```bash\n# 144 is the ID for Mexico\nnpm start -- --export 144\n```\n\nGet both import \u0026 export data:\n\n```bash\nnpm start -- --export --import mexico\n```\n\nGet data for multiple countries:\n\n```bash\nnpm start -- --export --import duc mexico\n```\n\n## Output\n\nThe script will save data into separate CSV files in the current directory.\nEach file contains data for a direction (export or import) of a country.\nFilename format: `country-direction.csv` (e.g. `mexico-in.csv`, [mexico-out.csv](https://gist.github.com/daohoangson/0f0e28defc6f394a24990eb0d1f4b20f)).\n\n## Countries\n\nThe script will get the up to date list upon execution.\nThe table below is for reference only:\n\n| ID | Name |\n| --- | --- |\n| 15 | Áo |\n| 177 | Ba Lan |\n| 22 | Bỉ |\n| 178 | Bồ Đào Nha |\n| 40 | Canada |\n| 60 | Cộng hòa Séc |\n| 59 | Cộng hòa Síp |\n| 56 | Croatia |\n| 61 | Đan Mạch |\n| 83 | Đức |\n| 70 | Estonia |\n| 157 | Hà Lan |\n| 101 | Hungary |\n| 86 | Hy Lạp |\n| 107 | Ireland |\n| 123 | Latvia |\n| 129 | Lithuania |\n| 130 | Luxembourg |\n| 138 | Malta |\n| 144 | Mexico |\n| 159 | New Zealand |\n| 112 | Nhật Bản |\n| 76 | Pháp |\n| 75 | Phần Lan |\n| 182 | Romania |\n| 200 | Singapore |\n| 202 | Slovakia |\n| 203 | Slovenia |\n| 209 | Tây Ban Nha |\n| 215 | Thụy Điển |\n| 14 | Úc |\n| 110 | Ý |\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdaohoangson%2Fjs-fta-crawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdaohoangson%2Fjs-fta-crawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdaohoangson%2Fjs-fta-crawler/lists"}