https://github.com/zayedrais/llm_1b_7b-experiment_inference

ry out various LLM models in experiments. Finally, we'll perform real-time inference on Colab GPU using Text-Generation-Inference.
https://github.com/zayedrais/llm_1b_7b-experiment_inference

Last synced: 9 months ago
JSON representation

ry out various LLM models in experiments. Finally, we'll perform real-time inference on Colab GPU using Text-Generation-Inference.

• Host: GitHub
• URL: https://github.com/zayedrais/llm_1b_7b-experiment_inference
• Owner: zayedrais
• Created: 2024-01-28T10:04:57.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-01-28T10:09:38.000Z (over 2 years ago)
• Last Synced: 2025-03-16T01:28:26.416Z (about 1 year ago)
• Language: Jupyter Notebook
• Size: 242 KB
• Stars: 3
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# LLM_1B_7B-experiment_inference

Try out various LLM 1B & 7B parameter models in experiments. Finally, we'll perform real-time inference on Colab GPU using Text-Generation-Inference.