{"id":19414293,"url":"https://github.com/basedosdados/databasers-utils","last_synced_at":"2026-04-16T00:31:12.216Z","repository":{"id":246243127,"uuid":"814831351","full_name":"basedosdados/databasers-utils","owner":"basedosdados","description":"Pacote para uso da equipe de dados","archived":false,"fork":false,"pushed_at":"2025-05-30T15:05:52.000Z","size":36,"stargazers_count":0,"open_issues_count":2,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2026-03-01T06:43:29.009Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/basedosdados.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-06-13T19:50:58.000Z","updated_at":"2025-02-03T12:20:34.000Z","dependencies_parsed_at":"2024-06-26T19:58:04.885Z","dependency_job_id":"1f183e38-b1ca-416f-98ae-35c21d762dd4","html_url":"https://github.com/basedosdados/databasers-utils","commit_stats":null,"previous_names":["basedosdados/databasers-utils"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/basedosdados/databasers-utils","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/basedosdados%2Fdatabasers-utils","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/basedosdados%2Fdatabasers-utils/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/basedosdados%2Fdatabasers-utils/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/basedosdados%2Fdatabasers-utils/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/basedosdados","download_url":"https://codeload.github.com/basedosdados/databasers-utils/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/basedosdados%2Fdatabasers-utils/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31866206,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-15T15:24:51.572Z","status":"ssl_error","status_checked_at":"2026-04-15T15:24:39.138Z","response_time":63,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-10T12:37:10.356Z","updated_at":"2026-04-16T00:31:12.158Z","avatar_url":"https://github.com/basedosdados.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# databasers-utils\n\nPacote para uso da equipe de dados na Base dos Dados.\n\n- [CONTRIBUTING.md](./CONTRIBUTING.md)\n\n## Setup\n\n### Credenciais\n\nPara fazer o upload de colunas usando a arquitetura você deve configurar suas\ncredenciais.\n\n#### Linux/WSL\n\nAdicione no seu `.bashrc` ou `.zshrc`\n\n```sh\nexport BD_DJANGO_EMAIL=\"seuemail@basedosdados.org\"\nexport BD_DJANGO_PASSWORD=\"password\"\n```\n\n#### Windows\n\n- Em Pesquisar, procure e selecione: Sistema (Painel de Controle)\n- Clique no link Configurações avançadas do sistema.\n- Clique em Variáveis de Ambiente. \n- Na seção 'Variáveis do Sistema' clique em 'Novo' e insira `BD_DJANGO_EMAIL` como nome da variável e o seu email como valor. Faça o mesmo para `BD_DJANGO_PASSWORD`.\n- Clique em OK. Feche todas as janelas restantes clicando em OK.\n\n### Uso\n\n```python\nfrom databasers_utils import (\n    TableArchitecture,\n    copy_models_from_dev_to_prod,\n    get_architecture_table_from_api,\n)\n\narch = TableArchitecture(\n    dataset_id=\"br_ibge_pib\",\n    tables={\n        \"uf\": \"https://docs.google.com/spreadsheets/d/12F5NzhOYlN_bi9flLBEdXDWpa5iVakSP4EKm9UoyWuo/edit?usp=drive_link\",\n        \"gini\": \"https://docs.google.com/spreadsheets/d/1K1svie4Gyqe6NnRjBgJbapU5sTsLqXWTQUmTRVIRwQc/edit?usp=drive_link\",\n    },\n)\n\n# Retorna um dict[str, pd.DataFrame], cada chave o id da tabela e o dataframe\n# da arquitetura\narch.tables()\n\n# Cria o yaml file\narch.create_yaml_file()\n\n# Cria os arquivos sql\narch.create_sql_files()\n\n# Atualiza o dbt_project.yml\narch.update_dbt_project()\n\n# Faz o upload das colunas para o DJango\narch.upload_columns()\n\n# Copia os modelos em dev para prod\ncopy_models_from_dev_to_prod([\"br_ibge_ppm\", \"br_ibge_pam\"])\n\n# Retorna um DataFrame da arquitetura obtida na API\n# Util para gerar arquitetura quando ela não está no Drive\nget_architecture_table_from_api(\"br_ms_sinasc\", \"microdados\")\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbasedosdados%2Fdatabasers-utils","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbasedosdados%2Fdatabasers-utils","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbasedosdados%2Fdatabasers-utils/lists"}