https://github.com/cohere-ai/magikarp
Code for the paper "Fishing for Magikarp"
https://github.com/cohere-ai/magikarp
large-language-models tokenization
Last synced: 10 months ago
JSON representation
Code for the paper "Fishing for Magikarp"
- Host: GitHub
- URL: https://github.com/cohere-ai/magikarp
- Owner: cohere-ai
- License: apache-2.0
- Created: 2024-04-29T14:29:13.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2025-03-17T10:26:46.000Z (11 months ago)
- Last Synced: 2025-03-29T12:07:00.495Z (11 months ago)
- Topics: large-language-models, tokenization
- Language: Python
- Homepage: https://arxiv.org/abs/2405.05417
- Size: 2.48 GB
- Stars: 151
- Watchers: 5
- Forks: 13
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- License: LICENSE