Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/valentimarco/ollama-fix

A CheshireCat plugin to fix stop inference strings
https://github.com/valentimarco/ollama-fix

Last synced: 20 days ago
JSON representation

A CheshireCat plugin to fix stop inference strings

Awesome Lists containing this project

README

        

# Ollamafix

[![awesome plugin](https://custom-icon-badges.demolab.com/static/v1?label=&message=awesome+plugin&color=383938&style=for-the-badge&logo=cheshire_cat_ai)](https://)
[![Awesome plugin](https://custom-icon-badges.demolab.com/static/v1?label=&message=Awesome+plugin&color=000000&style=for-the-badge&logo=cheshire_cat_ai)](https://)
[![awesome plugin](https://custom-icon-badges.demolab.com/static/v1?label=&message=awesome+plugin&color=F4F4F5&style=for-the-badge&logo=cheshire_cat_black)](https://)

A Cheshire Cat plugin for fix Langchain's Ollama class

## Why exist?

The langchain integrations is a very mess, espcialy with Ollama where they Hard coded the list of stop strings!

This creates problems with the inference by generating endless tokens .-.