{"id":13857509,"url":"https://github.com/jonathanbratt/RBERTviz","last_synced_at":"2025-07-13T21:32:59.203Z","repository":{"id":49551992,"uuid":"209370444","full_name":"jonathanbratt/RBERTviz","owner":"jonathanbratt","description":"Visualization tools to use with RBERT","archived":false,"fork":false,"pushed_at":"2021-06-14T21:41:42.000Z","size":6124,"stargazers_count":44,"open_issues_count":3,"forks_count":6,"subscribers_count":4,"default_branch":"master","last_synced_at":"2024-08-06T03:04:02.520Z","etag":null,"topics":["bert","htmlwidgets","natural-language-processing","nlp","rstats","rstudio","tensorflow"],"latest_commit_sha":null,"homepage":"","language":"R","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jonathanbratt.png","metadata":{"files":{"readme":"README.Rmd","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-09-18T17:49:25.000Z","updated_at":"2024-01-04T16:37:53.000Z","dependencies_parsed_at":"2022-08-20T12:10:22.149Z","dependency_job_id":null,"html_url":"https://github.com/jonathanbratt/RBERTviz","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanbratt%2FRBERTviz","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanbratt%2FRBERTviz/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanbratt%2FRBERTviz/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanbratt%2FRBERTviz/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jonathanbratt","download_url":"https://codeload.github.com/jonathanbratt/RBERTviz/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":225920370,"owners_count":17545476,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bert","htmlwidgets","natural-language-processing","nlp","rstats","rstudio","tensorflow"],"created_at":"2024-08-05T03:01:39.203Z","updated_at":"2024-11-22T15:30:51.349Z","avatar_url":"https://github.com/jonathanbratt.png","language":"R","funding_links":[],"categories":["R"],"sub_categories":[],"readme":"---\noutput: github_document\n---\n\n\u003c!-- README.md is generated from README.Rmd. Please edit that file --\u003e\n\n```{r, include = FALSE}\nknitr::opts_chunk$set(\n  collapse = TRUE,\n  comment = \"#\u003e\",\n  fig.path = \"man/figures/README-\",\n  out.width = \"100%\"\n)\n```\n\n\u003c!-- badges: start --\u003e\n[![Lifecycle: maturing](https://img.shields.io/badge/lifecycle-maturing-blue.svg)](https://www.tidyverse.org/lifecycle/#maturing)\n[![Travis build status](https://travis-ci.org/jonathanbratt/RBERTviz.svg?branch=master)](https://travis-ci.org/jonathanbratt/RBERTviz)\n[![AppVeyor build status](https://ci.appveyor.com/api/projects/status/github/jonathanbratt/RBERTviz?branch=master\u0026svg=true)](https://ci.appveyor.com/project/jonathanbratt/RBERTviz)\n[![Codecov test coverage](https://codecov.io/gh/jonathanbratt/RBERTviz/branch/master/graph/badge.svg)](https://codecov.io/gh/jonathanbratt/RBERTviz?branch=master)\n\u003c!-- badges: end --\u003e\n\nRBERTviz provides tools for convenient visualization of BERT models in the RBERT package.\n\n\n\n## Installation\n\nYou can install RBERTviz from [GitHub](https://github.com/) with:\n\n```{r installation, eval = FALSE}\n# install.packages(\"devtools\")\ndevtools::install_github(\n  \"jonathanbratt/RBERTviz\", \n  build_vignettes = TRUE\n)\n```\n\n### RBERT Installation\n\nRBERTviz is intended to be used alongside the RBERT package. See the installation instructions\nin that [repository](https://github.com/jonathanbratt/RBERT).\n\n\n\n## Basic usage\n\nRBERTviz currently enables visualization of\n\n1. the attention matrices for each attention head\n2. the output vectors at each transformer layer\n\nThe attention visualizer is basically a wrapper around an earlier\nversion of the [transformer visualization tools](https://github.com/tensorflow/tensor2tensor/tree/master/tensor2tensor/visualization),\nas adapted by [Jesse Vig](https://github.com/jessevig/bertviz/).\n\n![Chicken](man/attention1.png) ![Road](man/attention2.png)\n\n\n\nThe output vector visualizer is a collection of routines for generating 2D PCA\nplots of the layer outputs, which can be interpreted as context-dependent\nembedding vectors.\n\n![Train](man/embeddings_layers_animation.gif)\n\nSee the \"Introduction to RBERTviz\" vignette included with the package for more\ndetailed examples of usage.\n\n\n\n## Disclaimer\n\nThis is not an officially supported Macmillan Learning product.\n\n## Contact information\n\nQuestions or comments should be directed to Jonathan Bratt\n(jonathan.bratt@macmillan.com) and Jon Harmon (jon.harmon@macmillan.com).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjonathanbratt%2FRBERTviz","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjonathanbratt%2FRBERTviz","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjonathanbratt%2FRBERTviz/lists"}