{"id":36953951,"url":"https://github.com/caiopizzol/fipe-data-pipeline","last_synced_at":"2026-05-29T00:01:18.380Z","repository":{"id":328015642,"uuid":"1113233349","full_name":"caiopizzol/fipe-data-pipeline","owner":"caiopizzol","description":"Dados da FIPE direto para seu banco","archived":false,"fork":false,"pushed_at":"2025-12-11T16:25:11.000Z","size":118,"stargazers_count":28,"open_issues_count":0,"forks_count":1,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-01-13T13:55:52.661Z","etag":null,"topics":["fipe","fipe-api","fipe-automoveis","fipe-json","fipe-node"],"latest_commit_sha":null,"homepage":"https://fipe.chat","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/caiopizzol.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-12-09T17:43:42.000Z","updated_at":"2026-01-02T03:06:07.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/caiopizzol/fipe-data-pipeline","commit_stats":null,"previous_names":["caiopizzol/fipe-data-pipeline"],"tags_count":19,"template":false,"template_full_name":null,"purl":"pkg:github/caiopizzol/fipe-data-pipeline","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/caiopizzol%2Ffipe-data-pipeline","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/caiopizzol%2Ffipe-data-pipeline/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/caiopizzol%2Ffipe-data-pipeline/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/caiopizzol%2Ffipe-data-pipeline/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/caiopizzol","download_url":"https://codeload.github.com/caiopizzol/fipe-data-pipeline/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/caiopizzol%2Ffipe-data-pipeline/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33630999,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-05-28T02:00:06.440Z","response_time":99,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["fipe","fipe-api","fipe-automoveis","fipe-json","fipe-node"],"created_at":"2026-01-13T12:54:35.689Z","updated_at":"2026-05-29T00:01:18.364Z","avatar_url":"https://github.com/caiopizzol.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://fipe.chat/favicon.svg\" width=\"80\" height=\"80\" alt=\"fipe.chat\"\u003e\n\u003c/p\u003e\n\n\u003ch1 align=\"center\"\u003eFIPE Data Pipeline\u003c/h1\u003e\n\n\u003cp align=\"center\"\u003e\n  Coleta e processa dados históricos de preços de veículos da Tabela FIPE para PostgreSQL.\n  \u003cbr\u003e\n  Parte do \u003ca href=\"https://fipe.chat\"\u003efipe.chat\u003c/a\u003e — os dados que a FIPE tem, a clareza que ela nunca deu.\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/caiopizzol/fipe-data-pipeline/releases\"\u003e\u003cimg src=\"https://img.shields.io/github/v/release/caiopizzol/fipe-data-pipeline\" alt=\"Release\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://bun.sh\"\u003e\u003cimg src=\"https://img.shields.io/badge/bun-1.x-f472b6\" alt=\"Bun\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://biomejs.dev\"\u003e\u003cimg src=\"https://img.shields.io/badge/biome-linter-60a5fa\" alt=\"Biome\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n## Requisitos\n\n- [Bun](https://bun.sh) — `brew install oven-sh/bun/bun`\n- Docker\n\n## Início Rápido\n\n```bash\ncp .env.example .env\ndocker compose up -d   # PostgreSQL\nbun install            # dependências\nbun run db:push        # schema\nbun run crawl          # crawl\n```\n\n## Comandos\n\n```bash\nbun install            # Instalar dependências\nbun run db:push        # Criar/atualizar schema\nbun run crawl          # Executar crawler\nbun run status         # Estatísticas do banco\nbun run classify       # Classificar modelos via AI\nbun run backup         # Backup (pg_dump) para storage S3/R2 com retenção\nbun run restore-drill  # Restaura o último backup num banco temporário e valida\nbun run lint           # Verificar código\nbun run format         # Formatar código\nbun run typecheck      # Verificar tipos\n```\n\n## Uso\n\n```bash\nbun run crawl                                    # ano atual, todos os meses\nbun run crawl -- --year 2024                     # ano específico\nbun run crawl -- --year 2020-2024                # range de anos\nbun run crawl -- --year 2020,2022,2024           # anos específicos\nbun run crawl -- --month 1-6                     # range de meses\nbun run crawl -- --year 2023-2024 --month 1,6,12 # combinar filtros\nbun run crawl -- --brand 59                      # marca específica (59 = VW)\nbun run crawl -- --brand 21,22,59                # múltiplas marcas\nbun run crawl -- --brand 59 --model 5940         # modelo específico\nbun run crawl -- --reference 328                 # tabela de referência específica\nbun run crawl -- --classify                      # classificar modelos novos via AI\nbun run crawl -- --force                         # re-buscar tudo\n\nbun run status                                   # estatísticas do banco\nbun run classify                                 # classificar modelos sem segmento\nbun run classify -- --dry-run                    # preview da classificação\n```\n\n## Docker\n\n```bash\ndocker build -t fipe-crawler .\ndocker run -d --name fipe --env-file .env fipe-crawler\n\ndocker exec fipe bun src/index.ts crawl --brand 25 --year 2024 --month 6\ndocker exec fipe bun src/index.ts status\n```\n\n## Configuração\n\n```bash\nDATABASE_URL=postgres://postgres:postgres@localhost:5433/fipe\nRATE_LIMIT_MS=800        # Delay mínimo entre requests (ms)\nMAX_THROTTLE_MS=5000     # Delay máximo quando rate limited (ms)\nMAX_RETRIES=3\nANTHROPIC_API_KEY=       # Para classificação de segmentos via AI (opcional)\n\n# Backup para storage S3-compatível (opcional; usado por backup/restore-drill)\nR2_ACCESS_KEY_ID=\nR2_SECRET_ACCESS_KEY=\nR2_ENDPOINT=             # ex: https://\u003caccount\u003e.r2.cloudflarestorage.com\nR2_BUCKET=\n```\n\n## Schema\n\n```mermaid\nflowchart LR\n    reference_tables --\u003e prices\n    brands --\u003e models --\u003e model_years --\u003e prices\n```\n\nSchema SQL completo em [`initial.sql`](./initial.sql).\n\n## Fonte de Dados\n\nEstes dados são **públicos e oficiais**, disponibilizados pela Fundação Instituto de Pesquisas Econômicas (FIPE).\n\n| | |\n|---|---|\n| **Fonte** | [veiculos.fipe.org.br](https://veiculos.fipe.org.br) |\n| **Atualização** | Mensal (desde 2001) |\n| **Cobertura** | Carros, motos, caminhões e utilitários |\n| **Uso** | Referência para seguros, financiamentos, IPVA e negociação de veículos |\n\nA Tabela FIPE é a referência de preço médio de veículos mais utilizada no Brasil. Os dados são coletados mensalmente junto a concessionárias, revendedoras e fabricantes em todo o país.\n\n## Contribuidores\n\n\u003ca href=\"https://github.com/caiopizzol\"\u003e\u003cimg src=\"https://github.com/caiopizzol.png\" width=\"50\" height=\"50\" alt=\"caiopizzol\" title=\"Caio Pizzol\" /\u003e\u003c/a\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcaiopizzol%2Ffipe-data-pipeline","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcaiopizzol%2Ffipe-data-pipeline","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcaiopizzol%2Ffipe-data-pipeline/lists"}