{"id":13533000,"url":"https://github.com/YiVal/YiVal","last_synced_at":"2025-04-01T21:31:41.357Z","repository":{"id":181571092,"uuid":"666612077","full_name":"YiVal/YiVal","owner":"YiVal","description":"Your Automatic Prompt Engineering Assistant for GenAI Applications","archived":false,"fork":false,"pushed_at":"2024-04-22T04:42:25.000Z","size":22871,"stargazers_count":2430,"open_issues_count":18,"forks_count":419,"subscribers_count":240,"default_branch":"master","last_synced_at":"2024-04-25T19:22:35.896Z","etag":null,"topics":["ai","ai-experiments","ai-toolkit","aigc","api","auto-prompting","autogpt","fine-tuning","framework","generative-ai","gpt4","llm","midjourney","prompt","prompt-engineering","prompt-tuning","promptengineering","python","stable-diffusion"],"latest_commit_sha":null,"homepage":"https://yival.io/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/YiVal.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"docs/contributing.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-07-15T02:04:35.000Z","updated_at":"2024-07-19T22:05:17.059Z","dependencies_parsed_at":null,"dependency_job_id":"c867621c-49de-4f52-8655-1e8eb9a919d1","html_url":"https://github.com/YiVal/YiVal","commit_stats":null,"previous_names":["yival/yival"],"tags_count":9,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YiVal%2FYiVal","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YiVal%2FYiVal/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YiVal%2FYiVal/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/YiVal%2FYiVal/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/YiVal","download_url":"https://codeload.github.com/YiVal/YiVal/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246713168,"owners_count":20821851,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","ai-experiments","ai-toolkit","aigc","api","auto-prompting","autogpt","fine-tuning","framework","generative-ai","gpt4","llm","midjourney","prompt","prompt-engineering","prompt-tuning","promptengineering","python","stable-diffusion"],"created_at":"2024-08-01T07:01:15.706Z","updated_at":"2025-04-01T21:31:36.336Z","avatar_url":"https://github.com/YiVal.png","language":"Python","readme":"\u003c!-- markdownlint-disable MD033 --\u003e\n\n\u003c!-- markdownlint-disable MD041 --\u003e\n\n\u003cp align=\"center\"\u003e\n \u003ch1 align=\"center\"\u003e\n \u003cimg src=\"https://github.com/YiVal/YiVal/assets/1544154/b0c681e7-7474-4b87-9c69-fde6e0e47401\"\n alt=\"YiVal Logo\" width=\"100\"\n height=\"100\" style=\"vertical-align: middle;\"\u003e\n YiVal\n \u003c/h1\u003e\n \u003cp align=\"center\"\u003e⚡ Auto Prompting ⚡\u003c/p\u003e\n\u003c/p\u003e\n\n\u003c!-- markdownlint-disable-next-line MD013 --\u003e\n\n👉 Follow\nus: [![Twitter](https://img.shields.io/twitter/url/https/twitter.com/YiValai.svg?style=social\u0026label=Follow%20%40YiVal)](https://twitter.com/yivalloveaigc) |\n[![Discord](https://dcbadge.vercel.app/api/server/HnUWVW4kth?compact=true\u0026style=flat)](https://discord.gg/HnUWVW4kth)\n\n👉 Sponsored by Discord AIGC community:\n[![Discord](https://dcbadge.vercel.app/api/server/aigc?compact=true\u0026style=flat)](https://discord.gg/aigc)\n\n[![License: MIT](https://img.shields.io/badge/License-Apache2.0-yellow.svg)](https://opensource.org/licenses/MIT)\n[![GitHub star chart](https://img.shields.io/github/stars/YiVal/YiVal?style=social)](https://star-history.com/#YiVal/YiVal)\n[![Open Issues](https://img.shields.io/github/issues-raw/YiVal/YiVal)](https://github.com/YiVal/YiVal/issues)\n\n## What is YiVal?\n\n**YiVal: Your Automatic Prompt Engineering Assistant for GenAI Applications**\nYiVal is a state-of-the-art tool designed to streamline the tuning process for\nyour GenAI app prompts and **ANY** configs in the loop. With YiVal, manual adjustments\nare a thing of the past. This **data-driven and evaluation-centric** approach ensures\noptimal prompts, precise RAG configurations, and fine-tuned model parameters.\nEmpower your applications to achieve\n**enhanced results, reduce latency, and minimize inference costs**\neffortlessly with YiVal!\n\n**Problems YiVal trying to tackle:**\n\n1. Prompt Development Challenge: \"I can't create a better prompt. A score of 60\n for my current prompt isn't helpful at all🤔.\"\n2. Fine-tuning Difficulty: \"I don't know how to fine-tune; the terminology and\n numerous fine-tune algorithms are overwhelming😵.\"\n3. Confidence and Scalability: \"I learned tutorials to build agents from Langchain\n and LlamaIndex, but am I doing it right? Will the bot burn through my money\n when I launch? Will users like my GenAI app🤯?\"\n4. Models and Data Drift: \"Models and data keep changing; I worry a well-performing\n GenAI app now may fail later😰.\"\n5. Relevant Metrics and Evaluators: \"Which metrics and evaluators should I focus\n on for my use case📊?\"\n\n[Check out our quickstart guide!][1]\n\n[1]: https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/tutorial.md\n\u003cimg src=\"https://github.com/YiVal/YiVal/assets/1544154/dba5acd9-995c-45fd-9d08-c7cf198a77ad\"\u003e\n\n### Link to demo\n\n**[Tiktok title autotune](http://ec2-35-85-28-134.us-west-2.compute.amazonaws.com:8074/enhancer-experiment-results)**\n\n## Installation\n\n### Docker Runtime\n\nInstall Docker and pull ourimage on DockerHub:\n\n```bash\ndocker pull yival/release:latest\n```\n\nRun our image:\n\n```bash\ndocker run --it yival/release:latest\n```\n\nVSCode with Docker extension is recommended for running and developments. If you are developer using GPU with Pytorch, or need jupyter lab for data science:\n\n```bash\ndocker pull yival/release:cu12_torch_jupyter\ndocker run --gpus all --it -p 8888:8888 yival/release:cu12_torch_jupyter\n```\n\n### Prerequisites\n\n- **Python Version**: Ensure you have `Python 3.10` or later installed.\n- **OpenAI API Key**: Obtain an API key from OpenAI. Once you have the key, set\n it as an environment variable named `OPENAI_API_KEY`.\n\n### Installation Methods\n\n#### Using pip (Recommended for Users)\n\nInstall the `yival` package directly using pip:\n\n```bash\npip install yival\n```\n\n#### Development Setup Using Poetry\n\nIf you're looking to contribute or set up a development environment:\n\n1. **Install Poetry**: If you haven't already, [install Poetry](https://python-poetry.org/docs/#installation).\n2. **Clone the Repository, or use CodeSpace**:\n\n 2.1 **Use CodeSpace**\n The easiest way to get YiVal enviornment. Click below to use the GitHub Codespace, then go to the next step.\n\n [![Open in GitHub Codespaces](https://github.com/codespaces/badge.svg)](https://codespaces.new/YiVal/YiVal?quickstart=1)\n\n 2.2 **Clone the Repository**\n\n ```bash\n git clone https://github.com/YiVal/YiVal.git\n cd YiVal\n ```\n\n3. **Setup with Poetry**: Initialize the Python virtual environment and install\n dependencies using Poetry. Make sure to run the below cmd in `/YiVal` directory:\n\n ```bash\n poetry install --sync\n ```\n\n## Trying Out YiVal\n\nAfter setting up, you can quickly get started with YiVal by generating datasets\nof random tech startup business names.\n\n### Steps to Run Your First YiVal Program\n\n1. **Navigate to the yival Directory**:\n\n ```bash\n cd /YiVal/src/yival\n ```\n\n2. **Set OpenAI API Key**: Replace `$YOUR_OPENAI_API_KEY` with your\n actual OpenAI API key.\n\n On macOS or Linux systems,\n\n ```bash\n export OPENAI_API_KEY=$YOUR_OPENAI_API_KEY\n ```\n\n On Windows systems,\n\n ```powershell\n setx OPENAI_API_KEY $YOUR_OPENAI_API_KEY\n ```\n\n3. **Define YiVal Configuration**:\n Create a configuration file named `config_data_generation.yml` for automated\n test dataset generation with the following content:\n\n ```yaml\n description: Generate test data\n dataset:\n data_generators:\n openai_prompt_data_generator:\n chunk_size: 100000\n diversify: true\n model_name: gpt-4\n input_function:\n description: # Description of the function\n Given a tech startup business, generate a corresponding landing\n page headline\n name: headline_generation_for_business\n parameters:\n tech_startup_business: str # Parameter name and type\n number_of_examples: 3\n output_csv_path: generated_examples.csv\n source_type: machine_generated\n ```\n\n4. **Execute YiVal**:\n Run the following command from within the `/YiVal/src/yival` directory:\n\n ```bash\n yival run config_data_generation.yml\n ```\n\n5. **Check the Generated Dataset**:\n The generated test dataset will be stored in `generated_examples.csv`.\n\nPlease refer to [YiVal Docs Page](https://yival.github.io/YiValApi/) for more details about YiVal!\n\n## Demo\n\n[Demo Video](https://github.com/YiVal/YiVal/assets/80620352/f2438449-2c13-45d1-a660-a783c5ae4eb6)\n\n| Use Case Demo | Supported Features | Github Link | Video Demo Link |\n| ----------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------- |\n| 🐯 Craft your AI story with ChatGPT and MidJourney | **Multi-modal** support: Design an AI-powered narrative using YiVal's multi-modal support of simultaneous text and images. It supports native and seamless [Reinforcement Learning from Human Feedback](https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback)(RLHF) and [Reinforcement Learning from AI Feedback](https://arxiv.org/abs/2309.00267)(RLAIF). Please watch the video above for this use case. | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/yival_midjourney_animal_story.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/) |\n| 🌟 Evaluate performance of multiple LLMs with your own Q\u0026A test dataset | Conveniently**evaluate and compare** performance of your model of choice against 100+ models, thanks to [LiteLLM](https://github.com/BerriAI/litellm). Analyze model performance benchmarks tailored to your **customized test data** or use case. | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/model_compare.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/) |\n| 🔥 Startup Company Headline Generation Bot | Streamline generation of headlines for your startup with automated test data**creation**, prompt **crafting**, results **evaluation**, and performance **enhancement** via GPT-4. | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/headline_generation.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://github.com/YiVal/YiVal/assets/80620352/1a2916c1-de6a-452a-88e0-fb4461e7c04b) |\n| 🧳 Build a Customized Travel Guide Bot | Leverage**automated prompts** inspired by the travel **community's** most popular suggestions, such as those from [awesome-chatgpt-prompts](https://github.com/f/awesome-chatgpt-prompts). | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/yival_prompt_retrieval.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/watch?v=rIggQqW4iAM) |\n| 📖 Build a Cheaper Translator: Use GPT-3.5 to teach Llama2 to create a translator with lower inference cost | Using[Replicate](https://replicate.com/docs/guides/fine-tune-a-language-model) and GPT-3.5's test data, you can **fine-tune** Llama2's translation bot. Benefit from 18x savings while experiencing only a 6% performance decrease. | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/yival_translator_demo.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://github.com/YiVal/YiVal/assets/80620352/f2438449-2c13-45d1-a660-a783c5ae4eb6) |\n| 🤖️ Chat with Your Favorite Characters - Dantan Ji from Till the End of the Moon | Bring your favorite characters to life through automated prompt creation and**character script retrieval**. | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/yival_auto_reply.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/watch?v=xD1G2Sl9UeU) |\n| 🔍Evaluate guardrails's performance in generating Python(.py) outputs | [Guardrails](https://github.com/ShreyaR/guardrails): where are my guardrails? 😭 `\u003cbr\u003e`Yival: I am here. ⭐️`\u003cbr\u003e\u003cbr\u003e`The **integrated evaluation** [experiment](https://github.com/ShreyaR/guardrails/issues/345) is carried out with 80 LeetCode problems in csv, using guardrail and using only GPT-4. The accuracy drops from 0.625 to 0.55 with guardrail, latency increases by 44%, and cost increases by 140%. Guardrail still has a long way to go from demo to production. | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/Guardrails_run_leetcode.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/watch?v=UMPxORBBTFI) |\n| 🍨Visualize different foods around the world!🍱 | Just give the place where the food belongs and the best season to taste it, and you can get a video of the season-specific food!🤩 | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/place_food_demo.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/watch?v=qJj7zSXQbTI) |\n| 🎈News article summary with CoD | By integrating the[\u0026#34;Chain of Density\u0026#34;](https://huggingface.co/papers/2309.04269) method, **evaluate the enhancer's ability** in text summarization.🎆 Using **3** articles points generated by GPT-4 for evaluation, the coherent score increased by **20.03%**, the attributive score increased by **25.18%!**, the average token usage from **2054.6 -\u003e 1473.4(-28.3%)** 🚀. | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/news_summary_with_CoD.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/watch?v=W86Bct9k7fI) |\n| 🥐 Automated TikTok Title Generation Bot | With only two input lines, you can easily create**concise and polished** TikTok video titles based on your desired target audience and video content summaries. This is presented by our **auto-prompt feature**: the process is automated, so you can input your requirements and enjoy the results hassle-free! | [![Open In GitHub](https://img.shields.io/badge/Github-@YiVal-CAC6FC)](https://github.com/YiVal/YiVal/blob/master/demo/tutorial_notebook/Auto_TikTok_Title_Generation_Bots_Demo.ipynb) | [![Open In Youtube](https://img.shields.io/badge/_-Open%20in%20Youtube-red?logo=youtube\u0026logoColor=red\u0026labelColor=white)](https://www.youtube.com/) |\n\n## Contribution Guidelines\n\nIf you want to contribute to YiVal, be sure to review\nthe [contribution guidelines](https://yival.github.io/YiVal/contributing/).\nWe use [GitHub issues](https://github.com/YiVal/YiVal/issues) for tracking\nrequests and bugs.\nPlease join [YiVal\u0026#39;s discord channel](https://discord.gg/HnUWVW4kth) for\ngeneral questions and discussion.\nJoin our collaborative community where your unique expertise as researchers and\nsoftware engineers is highly valued! Contribute to our project and be a part of\nan innovative space where every line of code and research insight actively\nfuels advancements in technology, fostering a future that is intelligently\nconnected and universally accessible.\n\n## Contributors\n\n\u003ca href=\"https://github.com/YiVal/YiVal/graphs/contributors\"\u003e\n \u003cimg src=\"https://contrib.rocks/image?repo=YiVal/YiVal\" /\u003e\n\u003c/a\u003e \n\u003cp align=\"center\"\u003e\n\u003cbr\u003e\n🌟 YiVal welcomes your contributions! 🌟\u003cp align=\"center\"\u003e\n🥳 Thanks so much to all of our amazing contributors 🥳\u003c/p\u003e\n\n## Paper / Algorithm Implementation\n\n| **Paper** | **Author** | **Topics** | **YiVal Contributor** | **Data Generator** | **Variation Generator** | **Evaluator** | **Selector** | **Enhancer** | **Config** |\n| --------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------- | --------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------- |\n| [Large Language Models Are Human-Level Prompt Engineers](https://arxiv.org/abs/2211.01910) | [Yongchao Zhou](https://arxiv.org/search/cs?searchtype=author\u0026query=Zhou,+Y), [Andrei Ioan Muresanu](https://arxiv.org/search/cs?searchtype=author\u0026query=Muresanu,+A+I), [Ziwen Han](https://arxiv.org/search/cs?searchtype=author\u0026query=Han,+Z) | YiVal Evolver, Auto-Prompting | | [OpenAIPromptDataGenerator](https://github.com/YiVal/YiVal/blob/master/src/yival/data_generators/openai_prompt_data_generator.py) | [OpenAIPromptVariationGenerator](https://github.com/YiVal/YiVal/blob/master/src/yival/variation_generators/openai_prompt_based_variation_generator.py) | [OpenAIPromptEvaluator](https://github.com/YiVal/YiVal/blob/master/src/yival/evaluators/openai_prompt_based_evaluator.py), [OpenAIEloEvaluator](https://github.com/YiVal/YiVal/blob/master/src/yival/evaluators/openai_elo_evaluator.py) | [AHPSelector](https://github.com/YiVal/YiVal/blob/master/src/yival/result_selectors/ahp_selection.py) | [OpenAIPromptBasedCombinationEnhancer](https://github.com/YiVal/YiVal/blob/master/src/yival/enhancers/openai_prompt_based_combination_enhancer.py) | [config](https://github.com/YiVal/YiVal/blob/master/demo/configs/headline_generation_enhance.yml) |\n| [BERTScore: Evaluating Text Generation with BERT](https://arxiv.org/abs/1904.09675) | [Tianyi Zhang](https://arxiv.org/search/cs?searchtype=author\u0026query=Zhang,+T), [Varsha Kishore](https://arxiv.org/search/cs?searchtype=author\u0026query=Kishore,+V), [Felix Wu](https://arxiv.org/search/cs?searchtype=author\u0026query=Wu,+F) | YiVal Evaluator, bertscore, rouge | [@crazycth](https://github.com/crazycth) | - | - | [BertScoreEvaluator](https://github.com/YiVal/YiVal/blob/master/src/yival/evaluators/bertscore_evaluator.py) | - | - | - |\n| [AlpacaEval](https://github.com/tatsu-lab/alpaca_eval) | [Xuechen Li](https://arxiv.org/search/cs?searchtype=author\u0026query=Xuechen%20Li), [Tianyi Zhang](https://arxiv.org/search/cs?searchtype=author\u0026query=Tianyi%20Zhang), [Yann Dubois](https://arxiv.org/search/cs?searchtype=author\u0026query=Yann%20Dubois) et. al | YiVal Evaluator | | - | - | [AlpacaEvalEvaluator](https://github.com/YiVal/YiVal/blob/master/src/yival/evaluators/alpaca_eval_evaluator.py) | - | - | [config](https://github.com/YiVal/YiVal/blob/master/demo/configs/alpaca_eval.yml) |\n| [Chain of Density](https://arxiv.org/pdf/2309.04269.pdf) | [Griffin Adams](https://arxiv.org/search/?query=Griffin+Adam) [Alexander R. Fabbri](https://arxiv.org/search/?query=Alexander+R.+Fabbri) et. al | Prompt Engineering | | - | [ChainOfDensityGenerator](https://github.com/YiVal/YiVal/blob/master/src/yival/variation_generators/chain_of_density_prompt.py) | - | - | - | [config](https://github.com/YiVal/YiVal/blob/master/demo/configs/summary_config.yml) |\n| [Large Language Models as Optimizers](https://arxiv.org/abs/2309.03409) | [Chengrun Yang](https://arxiv.org/search/cs?searchtype=author\u0026query=Yang,+C) [Xuezhi Wang](https://arxiv.org/search/cs?searchtype=author\u0026query=Wang,+X) et. al | Prompt Engineering | [@crazycth](https://github.com/crazycth) | - | - | - | - | [optimize_by_prompt_enhancer](https://github.com/YiVal/YiVal/blob/opro_implement/src/yival/enhancers/optimize_by_prompt_improver.py) | [config](https://github.com/YiVal/YiVal/blob/opro_implement/demo/configs/headline_generation_improve.yml#L174) |\n| [LoRA: Low-Rank Adaptation of Large Language Models](https://arxiv.org/abs/2106.09685) | [Edward J. Hu](https://arxiv.org/search/cs?searchtype=author\u0026query=Hu,+E+J) [Yelong Shen](https://arxiv.org/search/cs?searchtype=author\u0026query=Shen,+Y) et. al | LLM Finetune | [@crazycth](https://github.com/crazycth) | - | - | - | - | [sft_trainer](https://github.com/YiVal/YiVal/blob/add_finetune_module/src/yival/finetune/sft_trainer.py#L40) | [config](https://github.com/YiVal/YiVal/blob/add_finetune_module/src/yival/schemas/trainer_configs.py#L48) |\n\n\u003c!-- --\u003e\n","funding_links":[],"categories":["Prompting libraries \u0026 tools","Python","LLM应用","A01_文本生成_文本对话","LLM Applications","Chatbots \u0026 Virtual Companions","文本生成","Building","开源工具","Agent Categories","Prompting libraries \u0026 tools (in alphabetical order)"],"sub_categories":["LLM 评估工具","大语言对话模型及数据","优化","Prompt Engineering","Prompting","\u003ca name=\"Unclassified\"\u003e\u003c/a\u003eUnclassified"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FYiVal%2FYiVal","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FYiVal%2FYiVal","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FYiVal%2FYiVal/lists"}