https://github.com/ydrmaster/llama.cu

https://github.com/ydrmaster/llama.cu

Last synced: about 1 year ago
JSON representation

• Host: GitHub
• URL: https://github.com/ydrmaster/llama.cu
• Owner: YdrMaster
• License: mit
• Created: 2025-05-07T09:00:16.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2025-06-06T06:29:49.000Z (about 1 year ago)
• Last Synced: 2025-06-06T07:27:57.410Z (about 1 year ago)
• Language: Rust
• Size: 355 KB
• Stars: 1
• Watchers: 1
• Forks: 4
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# llama.cu

[![CI](https://github.com/YdrMaster/llama.cu/actions/workflows/build.yml/badge.svg?branch=main)](https://github.com/YdrMaster/llama.cu/actions)

[![license](https://img.shields.io/github/license/YdrMaster/llama.cu)](https://mit-license.org/)

[![GitHub Issues](https://img.shields.io/github/issues/YdrMaster/llama.cu)](https://github.com/YdrMaster/llama.cu/issues)

[![GitHub Pull Requests](https://img.shields.io/github/issues-pr/YdrMaster/llama.cu)](https://github.com/YdrMaster/llama.cu/pulls)

![GitHub repo size](https://img.shields.io/github/repo-size/YdrMaster/llama.cu)

![GitHub code size in bytes](https://img.shields.io/github/languages/code-size/YdrMaster/llama.cu)

![GitHub contributors](https://img.shields.io/github/contributors/YdrMaster/llama.cu)

![GitHub commit activity](https://img.shields.io/github/commit-activity/m/YdrMaster/llama.cu)

## 使用说明

### 帮助信息

```shell

cargo xtask help

```

```plaintext

Usage: xtask 

Commands:

  generate  text generation

  chat      chat in console

  service   web service

  help      Print this message or the help of the given subcommand(s)

Options:

  -h, --help     Print help

  -V, --version  Print version

```

### 文本生成

```shell

cargo generate --help

```

简写：

```shell

cargo gen --help

```

```plaintext

text generation

Usage: xtask generate [OPTIONS] 

Arguments:

  

Options:

      --gpus 

      --max-steps 

  -p, --prompt 

  -t, --use-template

  -h, --help

```

### 对话

```shell

cargo chat --help

```

```plaintext

chat in console

Usage: xtask chat [OPTIONS] 

Arguments:

  

Options:

      --gpus 

      --max-steps 

  -h, --help                   Print help

```

### web 服务

```shell

cargo service --help

```

```plaintext

web service

Usage: xtask service [OPTIONS] --port  

Arguments:

  

Options:

      --gpus 

      --max-steps 

  -p, --port 

  -h, --help

```