https://github.com/ericlbuehler/candle-sampling

Sampling techniques for Candle.
https://github.com/ericlbuehler/candle-sampling

Last synced: 3 months ago
JSON representation

Sampling techniques for Candle.

• Host: GitHub
• URL: https://github.com/ericlbuehler/candle-sampling
• Owner: EricLBuehler
• License: mit
• Created: 2023-11-06T10:31:45.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2024-04-03T00:49:34.000Z (about 2 years ago)
• Last Synced: 2025-09-21T11:42:22.783Z (9 months ago)
• Language: Rust
• Homepage:
• Size: 1.15 MB
• Stars: 18
• Watchers: 3
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# candle-sampling

[![Continuous integration](https://github.com/EricLBuehler/candle-sampling/actions/workflows/ci.yml/badge.svg)](https://github.com/EricLBuehler/candle-sampling/actions/workflows/ci.yml)

[![Documentation](https://github.com/EricLBuehler/candle-sampling/actions/workflows/docs.yml/badge.svg)](https://ericlbuehler.github.io/candle-sampling/candle_sampling/)

Sampling techniques for Candle.

Currently implemented methods are:

- multinomial (ancestral)

- top-k

- top-p (nucleus)

- top-n logprobs

- repeat penalty (frequency penalty)

- presence penalty

- logit bias