Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ipeagit/censobr
https://github.com/ipeagit/censobr
brazil census census-data microdados microdata r rstats
Last synced: 5 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/ipeagit/censobr
- Owner: ipeaGIT
- License: other
- Created: 2023-08-24T09:36:40.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-24T02:00:14.000Z (about 2 months ago)
- Last Synced: 2024-10-24T17:55:12.009Z (about 2 months ago)
- Topics: brazil, census, census-data, microdados, microdata, r, rstats
- Language: R
- Homepage: https://ipeagit.github.io/censobr/
- Size: 8.08 MB
- Stars: 36
- Watchers: 2
- Forks: 6
- Open Issues: 14
-
Metadata Files:
- Readme: README.md
- Changelog: NEWS.md
- License: LICENSE
Awesome Lists containing this project
README
# censobr: Download Data from Brazil's Population Census 
[](https://CRAN.R-project.org/package=censobr)
[](https://CRAN.R-project.org/package=censobr) [](https://app.codecov.io/gh/ipeaGIT/censobr?branch=main)
[](https://lifecycle.r-lib.org/articles/stages.html)
[](https://github.com/ipeaGIT/censobr/actions?query=branch%3Amain)
**{censobr}** is an R package to download data from Brazil's Population Census. It provides a very simple and efficient way to download and read the data sets and documentation of all the population censuses taken in and after 1960 in the country. The package is built on top of the [Arrow platform](https://arrow.apache.org/docs/r/), which allows users to work with larger-than-memory census data using [{dplyr} familiar functions](https://arrow.apache.org/docs/r/articles/arrow.html#analyzing-arrow-data-with-dplyr).
## Installation
```R
# install from CRAN
install.packages("censobr")
# or use the development version with latest features
utils::remove.packages('censobr')
remotes::install_github("ipeaGIT/censobr", ref="dev")
library(censobr)
```
## Basic usage
The package currently includes 6 main functions to download & read census data:
1. `read_population()`
2. `read_households()`
3. `read_mortality()`
4. `read_families()`
5. `read_emigration()`
6. `read_tracts()`
**{censobr}** also includes a few support functions to help users navigate the documentation Brazilian censuses, providing convenient information on data variables and methodology:
7. `data_dictionary()`
8. `questionnaire()`
9. `interview_manual()`
Finally, the package includes two functions to help users manage the data chached locally.
10. `censobr_cache()`
11. `set_censobr_cache_dir()`
The syntax of all **{censobr}** functions to read data operate on the same logic so it becomes intuitive to download any data set using a single line of code. Like this:
```
read_households(
year, # year of reference
columns, # select columns to read
add_labels, # add labels to categorical variables
as_data_frame, # return an Arrow DataSet or a data.frame
showProgress, # show download progress bar
cache # cache data for faster access later
)
```
***Note:*** all data sets in **{censobr}** are enriched with geography columns following the name standards of the [{geobr} package](https://github.com/ipeaGIT/geobr/) to help data manipulation and integration with spatial data from {geobr}. The added columns are: `c(‘code_muni’, ‘code_state’, ‘abbrev_state’, ‘name_state’, ‘code_region’, ‘name_region’, ‘code_weighting’)`.
### Data cache
The first time the user runs a function, **{censobr}** will download the file and store it locally. This way, the data only needs to be downloaded once. When the `cache` parameter is set to `TRUE` (Default), the function will read the cached data, which is much faster.
- `censobr_cache()`: can be used to list and/or delete data files cached locally
- `set_censobr_cache_dir()`: can be used to set custom cache directory for **{censobr}** files
## Larger-than-memory Data
Microdata of Brazilian census are often be too big to load in users' RAM memory. To avoid this problem, **{censobr}** will by default return an [Arrow table](https://arrow.apache.org/docs/r/articles/arrow.html#tabular-data-in-arrow), which can be analyzed like a regular `data.frame` using the `dplyr` package without loading the full data to memory.
More info in the package [vignette](https://ipeagit.github.io/censobr/).
## Contributing to censobr
If you would like to contribute to **{censobr}**, you're welcome to open an issue to explain the proposed a contribution.
-----
#### **Related projects**
As far as we know, **{censobr}** is the only R package that provides fast and convenient access to the complete data sets and documentation of Brazilian censuses. The [microdadosBrasil](https://github.com/lucasmation/microdadosBrasil) package used to provide access to microdata of several public data sets, but unfortunately, it has been discontinued.
#### **Similar packages for other countries**
- Canada: [cancensus](https://mountainmath.github.io/cancensus/)
- Chile: [censo2017](https://docs.ropensci.org/censo2017/)
- US: [tidycensus](https://walker-data.com/tidycensus/)
- World: [ipumsr](https://tech.popdata.org/ipumsr/)
## Credits 
Original Census data is collected by the Brazilian Institute of Geography and Statistics (IBGE). The **{censobr}** package is developed by a team at the Institute for Applied Economic Research (Ipea), Brazil. If you want to cite this package, you can cite it as:
- Pereira, Rafael H. M.; Barbosa, Rogério J. (2023) censobr: Download Data from Brazil's Population Census. R package version v0.4.0, . DOI: 10.32614/CRAN.package.censobr.
```
bibentry(
bibtype = "Manual",
title = "censobr: Download Data from Brazil's Population Census",
author = "Rafael H. M. Pereira [aut, cre] and Rogério J. Barbosa [aut]",
year = 2023,
version = "v0.2.0",
url = "https://CRAN.R-project.org/package=censobr",
textVersion = "Pereira, R. H. M.; Barbosa, R. J. (2023) censobr: Download Data from Brazil's Population Census. R package version v0.2.0, ."
)
```