https://github.com/whylabs/langkit

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
https://github.com/whylabs/langkit

large-language-models machine-learning nlg nlp observability prompt-engineering prompt-injection

Last synced: about 2 months ago
JSON representation

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

• Host: GitHub
• URL: https://github.com/whylabs/langkit
• Owner: whylabs
• License: apache-2.0
• Created: 2023-04-26T21:46:58.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-05-16T18:38:32.000Z (4 months ago)
• Last Synced: 2024-05-16T19:48:28.657Z (4 months ago)
• Topics: large-language-models, machine-learning, nlg, nlp, observability, prompt-engineering, prompt-injection
• Language: Jupyter Notebook
• Homepage: https://whylabs.ai
• Size: 4.03 MB
• Stars: 727
• Watchers: 14
• Forks: 61
• Open Issues: 29
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-ai-security - langkit - _LangKit is an open-source text metrics toolkit for monitoring language models. The toolkit various security related metrics that can be used to detect attacks_ (Defensive tools and frameworks / Detection)
• awesome-llmops - LangKit - of-the-box LLM telemetry collection library that extracts features and profiles prompts, responses and metadata about how your LLM is performing over time to find problems at scale. |  | (LLMOps / Observability)
• awesome-llm-eval - LangKit
• awesome-open-data-centric-ai - langkit - source toolkit for monitoring Large Language Models (LLMs). |  | <a href="https://github.com/whylabs/langkit/blob/main/LICENSE"><img src="https://img.shields.io/github/license/whylabs/langkit" height="15"/></a> | (Observability and Monitoring)
• Awesome-LLMSecOps - WhyLabs LangKit - 06-12 | (PINT Benchmark scores (by lakera))