https://github.com/kazssym/stablelm-study-2

Experiments of the StableLM 3B 4E1T model with ONNX Runtime
https://github.com/kazssym/stablelm-study-2

Last synced: 3 months ago
JSON representation

Experiments of the StableLM 3B 4E1T model with ONNX Runtime

• Host: GitHub
• URL: https://github.com/kazssym/stablelm-study-2
• Owner: kazssym
• Created: 2024-02-25T12:30:31.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-03-31T12:43:35.000Z (about 1 year ago)
• Last Synced: 2025-01-07T09:47:03.540Z (5 months ago)
• Language: Python
• Homepage:
• Size: 31.3 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Description

This is a repository for testing scripts to export StableLM ONNX models from [stabilityai/stablelm-3b-4e1t](https://huggingface.co/stabilityai/stablelm-3b-4e1t).

They might require a [modified version](https://github.com/kazssym/optimum/tree/feature/stablelm) of Hugging Face Optimum.

  - test_export.py

    This script exports a StableLM model into ONNX with optional float16 conversion.