{"id":13401492,"url":"https://github.com/quanteda/quanteda","last_synced_at":"2025-05-16T06:05:39.777Z","repository":{"id":4294044,"uuid":"5424649","full_name":"quanteda/quanteda","owner":"quanteda","description":"An R package for the Quantitative Analysis of Textual Data","archived":false,"fork":false,"pushed_at":"2025-05-13T09:11:02.000Z","size":782794,"stargazers_count":853,"open_issues_count":57,"forks_count":187,"subscribers_count":52,"default_branch":"master","last_synced_at":"2025-05-13T10:23:39.756Z","etag":null,"topics":["corpus","natural-language-processing","quanteda","r","text-analytics"],"latest_commit_sha":null,"homepage":"https://quanteda.io","language":"R","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/quanteda.png","metadata":{"files":{"readme":"README.Rmd","changelog":"NEWS.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2012-08-15T10:15:43.000Z","updated_at":"2025-05-11T05:39:30.000Z","dependencies_parsed_at":"2024-01-24T05:48:02.316Z","dependency_job_id":"8ecdef35-faea-40bf-91b3-8a0f1f85cfb6","html_url":"https://github.com/quanteda/quanteda","commit_stats":{"total_commits":8661,"total_committers":43,"mean_commits":"201.41860465116278","dds":0.5791479043990302,"last_synced_commit":"9129bf18b78b6eb6b988e10eac374f0e7a5ba461"},"previous_names":["kbenoit/quanteda"],"tags_count":48,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanteda%2Fquanteda","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanteda%2Fquanteda/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanteda%2Fquanteda/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanteda%2Fquanteda/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/quanteda","download_url":"https://codeload.github.com/quanteda/quanteda/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254303140,"owners_count":22048182,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["corpus","natural-language-processing","quanteda","r","text-analytics"],"created_at":"2024-07-30T19:01:03.391Z","updated_at":"2025-05-16T06:05:34.763Z","avatar_url":"https://github.com/quanteda.png","language":"R","readme":"---\noutput: github_document\n---\n\n```{r, echo = FALSE}\nknitr::opts_chunk$set(\n warning = FALSE,\n collapse = TRUE,\n comment = \"##\",\n fig.path = \"man/images/\"\n)\n```\n```{r echo=FALSE, results=\"hide\", message=FALSE}\nlibrary(\"badger\")\n```\n\n[![quanteda: quantitative analysis of textual data](https://cdn.rawgit.com/quanteda/quanteda/master/images/quanteda_logo.svg)](http://quanteda.io)\n\n\u003c!-- badges: start --\u003e\n[![CRAN Version](https://www.r-pkg.org/badges/version/quanteda)](https://CRAN.R-project.org/package=quanteda)\n`r badge_devel(\"quanteda/quanteda\", \"royalblue\")`\n[![Downloads](https://cranlogs.r-pkg.org/badges/quanteda)](https://CRAN.R-project.org/package=quanteda)\n[![Total Downloads](https://cranlogs.r-pkg.org/badges/grand-total/quanteda?color=orange)](https://CRAN.R-project.org/package=quanteda)\n[![R-CMD-check](https://github.com/quanteda/quanteda/actions/workflows/check-standard.yaml/badge.svg)](https://github.com/quanteda/quanteda/actions/workflows/check-standard.yaml)\n[![codecov](https://codecov.io/gh/quanteda/quanteda/branch/master/graph/badge.svg)](https://app.codecov.io/gh/quanteda/quanteda) [![DOI](https://zenodo.org/badge/5424649.svg)](https://zenodo.org/badge/latestdoi/5424649)\n[![DOI](http://joss.theoj.org/papers/10.21105/joss.00774/status.svg)](https://doi.org/10.21105/joss.00774)\n\u003c!-- badges: end --\u003e\n\n## About\n\n\n**quanteda** is an R package for managing and analyzing text, created and maintained by [Kenneth Benoit](https://kenbenoit.net) and [Kohei Watanabe](https://blog.koheiw.net/). Its creation was funded by the European Research Council grant ERC-2011-StG 283794-QUANTESS and its continued development is supported by the [Quanteda Initiative CIC](https://quanteda.org).\n\nFor more details, see https://quanteda.io.\n\n## **quanteda** version 4\n\nThe **quanteda** 4.0 is a major release that improves functionality and performance and further improves function consistency by removing previously deprecated functions.  It also includes significant new tokeniser rules that make the default tokeniser smarter than ever, with new Unicode and ICU-compliant rules enabling it to work more consistently with even more languages.\n\nWe describe more fully these significant changes in:\n\n- an [article about the new external pointer tokens objects](https://quanteda.io/articles/pkgdown/tokens_xptr.html);\n- an [article showing performance benchmarks](https://quanteda.io/articles/pkgdown/benchmarks_xptr.html) for the new external pointer tokens objects, as well as some of the tokeniser improvements in v4; and\n- the [changelog for v4](https://github.com/quanteda/quanteda/blob/master/NEWS.md#quanteda-40) a full listing of the changes, improvements, and deprecations in v4.\n\n## The **quanteda** family of packages\n\nWe completed the trend of splitting **quanteda** into modular packages with the release of v3. The quanteda family of packages includes the following:\n\n- [**quanteda**](https://github.com/quanteda/quanteda): contains all of the core natural language processing and textual data management functions\n- [**quanteda.textmodels**](https://github.com/quanteda/quanteda.textmodels): contains all of the text models and supporting functions, namely the `textmodel_*()` functions. This was split from the main package with the v2 release\n- [**quanteda.textstats**](https://github.com/quanteda/quanteda.textstats): statistics for textual data, namely the `textstat_*()` functions, split with the v3 release\n- [**quanteda.textplots**](https://github.com/quanteda/quanteda.textplots): plots for textual data, namely the `textplot_*()` functions, split with the v3 release\n\nWe are working on additional package releases, available in the meantime from our GitHub pages:\n\n- [**quanteda.sentiment**](https://github.com/quanteda/quanteda.sentiment): Functions and lexicons for sentiment analysis using dictionaries\n- [**quanteda.tidy**](https://github.com/quanteda/quanteda.tidy): Extensions for manipulating document variables in core **quanteda** objects using your favourite **tidyverse** functions\n\nand more to come.\n\n## How To...\n\n### Install (binaries) from CRAN\n\nThe normal way from CRAN, using your R GUI or \n```{r eval = FALSE}\ninstall.packages(\"quanteda\") \n```\n\n**(New for quanteda v4.0)** For Linux users: Because all installations on Linux are compiled, Linux users will first need to install the Intel oneAPI Threading Building Blocks for parallel computing for installation to work.\n\nTo install TBB on Linux:\n\n```{bash eval = FALSE}\n# Fedora, CentOS, RHEL\nsudo yum install tbb-devel\n\n# Debian and Ubuntu\nsudo apt install libtbb-dev\n```\n\n### Compile from source (macOS and Windows)\n\nBecause this compiles some C++ and Fortran source code, you will need to have installed the appropriate compilers to build the development version.  \n\nYou will also need to install TBB:\n\n**macOS:**\n\nFirst, you will need to install XCode command line tools.\n\n```{bash eval = FALSE}\nxcode-select --install\n```\n\nThen install the TBB libraries and the pkg-config utility: (after installing [Homebrew](https://brew.sh)):\n\n```{bash eval = FALSE}\nbrew install tbb pkg-config\n```\n\nFinally, you will need to install [gfortran](https://github.com/fxcoudert/gfortran-for-macOS/releases).\n\n**Windows:**\n\nInstall [RTools](https://cran.r-project.org/bin/windows/Rtools/), which includes the TBB libraries.\n\n\n\n### Enable parallelisation\n\n\n**quanteda** takes advantage of parallel computing through the [TBB (Threading Building Blocks) library](https://en.wikipedia.org/wiki/Threading_Building_Blocks) to speed up computations. This guide provides step-by-step instructions on how to set up your system for using Quanteda with parallel capabilities on Windows, macOS, and Linux.\n\n\n**Windows:**\n\nDownload and install RTools from [RTools download page](https://cran.r-project.org/bin/windows/Rtools/).\n\n\n**macOS:**\n\n1. **Install XCode Command Line Tools**\n   - Type the following command in the terminal:\n     ```bash\n     xcode-select --install\n     ```\n     \n2. **Install Homebrew**\n   - If Homebrew is not installed, run:\n     ```bash\n     /bin/bash -c \"$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)\"\n     ```\n\n3. **Install TBB and pkg-config**\n   - After installing Homebrew, run:\n     ```bash\n     brew install tbb pkg-config\n     ```\n\n4. **Install gfortran**\n   - Required for compiling Fortran code, install using Homebrew:\n     ```bash\n     brew install gcc\n     ```\n\n**Linux:**\n\nInstall TBB:\n\n- For Fedora, CentOS, RHEL:\n  ```bash\n  sudo yum install tbb-devel\n  ```\n- For Debian and Ubuntu:\n  ```bash\n  sudo apt install libtbb-dev\n  ```\n\nMore details are provided in the [quanteda documentation](http://quanteda.io/articles/pkgdown/parallelisation.html).\n\n\n### Use **quanteda**\n\nSee the [quick start guide](https://quanteda.io/articles/quickstart.html) to learn how to use **quanteda**.\n\n### Get Help\n\n* Read out documentation at https://quanteda.io.\n* Check out the [**quanteda** cheatsheet](https://github.com/quanteda/quanteda/blob/master/tests/cheatsheet/quanteda-cheatsheet.pdf).\n* Submit a question on the [**quanteda** channel on StackOverflow](https://stackoverflow.com/questions/tagged/quanteda).\n* See our [tutorial site](https://tutorials.quanteda.io/).\n\n### Cite the package\n\nBenoit, Kenneth, Kohei Watanabe, Haiyan Wang, Paul Nulty, Adam Obeng, Stefan Müller, and Akitaka Matsuo. (2018) \"[quanteda: An R package for the quantitative analysis of textual data](https://www.theoj.org/joss-papers/joss.00774/10.21105.joss.00774.pdf)\". _Journal of Open Source Software_ 3(30), 774. [https://doi.org/10.21105/joss.00774](https://doi.org/10.21105/joss.00774).\n\nFor a BibTeX entry, use the output from `citation(package = \"quanteda\")`.\n\n### Leave Feedback\n\nIf you like **quanteda**, please consider leaving [feedback or a testimonial here](https://github.com/quanteda/quanteda/issues/461).\n\n### Contribute\n\nContributions in the form of feedback, comments, code, and bug reports are most welcome. How to contribute:\n\n* Fork the source code, modify, and issue a [pull request](https://help.github.com/articles/creating-a-pull-request-from-a-fork/) through the [project GitHub page](https://github.com/quanteda/quanteda). See our [Contributor Code of Conduct](https://github.com/quanteda/quanteda/blob/master/CONDUCT.md) and the all-important **quanteda** [Style Guide](https://github.com/quanteda/quanteda/wiki/Style-guide).\n* Issues, bug reports, and wish lists: [File a GitHub issue](https://github.com/quanteda/quanteda/issues).\n* Contact [the maintainer](mailto:kbenoit@lse.ac.uk) by email.\n","funding_links":[],"categories":["R"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquanteda%2Fquanteda","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fquanteda%2Fquanteda","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquanteda%2Fquanteda/lists"}