https://github.com/antonio-f/bert_from_scratch

Training a BERT model from scratch.
https://github.com/antonio-f/bert_from_scratch

bert from-scratch huggingface-transformers latin oscar oscar-datasets transformers-library tutorial

Last synced: 10 months ago
JSON representation

Training a BERT model from scratch.

• Host: GitHub
• URL: https://github.com/antonio-f/bert_from_scratch
• Owner: antonio-f
• Created: 2021-08-27T07:20:04.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2023-10-15T06:29:48.000Z (over 2 years ago)
• Last Synced: 2025-03-27T15:21:23.791Z (11 months ago)
• Topics: bert, from-scratch, huggingface-transformers, latin, oscar, oscar-datasets, transformers-library, tutorial
• Language: Jupyter Notebook
• Homepage:
• Size: 38.1 KB
• Stars: 10
• Watchers: 2
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# BERT from scratch

Training a BERT model from scratch

This example is based on a part of the OSCAR dataset (https://oscar-corpus.com/) and the Hugging Face *transformers* library.