https://github.com/andrewgcodes/falconstreaming

Falcon40B and 7B (Instruct) with streaming, top-k, and beam search
https://github.com/andrewgcodes/falconstreaming

Last synced: 3 months ago
JSON representation

Falcon40B and 7B (Instruct) with streaming, top-k, and beam search

• Host: GitHub
• URL: https://github.com/andrewgcodes/falconstreaming
• Owner: andrewgcodes
• Created: 2023-06-06T17:41:37.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-06-06T18:40:39.000Z (over 1 year ago)
• Last Synced: 2024-07-31T07:17:21.314Z (3 months ago)
• Language: Jupyter Notebook
• Size: 107 KB
• Stars: 39
• Watchers: 2
• Forks: 7
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-ChatGPT-repositories - FalconStreaming - Falcon40B and 7B (Instruct) with streaming, top-k, and beam search (Others)

README

        
# FalconStreaming

Falcon40B and 7B (Instruct) with streaming, top-k, and beam search

4bit

## You must change the runtime type for Colab to run both 7B and 40B!



Adapted from Serin32's starter code on huggingface: https://huggingface.co/tiiuae/falcon-40b/discussions/38