https://github.com/eniompw/sambanovarest

Llama 3.1 405B using Samba Nova REST API
https://github.com/eniompw/sambanovarest

Last synced: 10 months ago
JSON representation

Llama 3.1 405B using Samba Nova REST API

• Host: GitHub
• URL: https://github.com/eniompw/sambanovarest
• Owner: eniompw
• License: mit
• Created: 2024-08-28T10:34:12.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-08-28T10:41:14.000Z (almost 2 years ago)
• Last Synced: 2025-03-27T04:43:45.703Z (about 1 year ago)
• Language: Python
• Size: 4.88 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# SambaNova Chat Completion API Client

Llama 3.1 405B using Samba Nova using REST 

This Python script provides a simple client for interacting with a chat completion API. It allows users to send queries and receive streamed responses from the API.

## Features

- Send chat completion queries to the API

- Handle streamed responses

- Process and display the response in real-time

## Prerequisites

- Python 3.x

- `requests` library

## Installation

1. Clone this repository or download the `rest.py` file.

2. Install the required library: