Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

awesome-llm-json

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.
https://github.com/imaurer/awesome-llm-json

Last synced: 10 days ago
JSON representation

Autonomous Agents

Autonomous Agent Resources

Blog Articles

Hosted Models

Jupyter Notebooks

Leaderboards

LLM-based Tools

Local LLM Resources

Local LLMs

Local LLM Repositories

  • Open Assistant - A chat-based ChatGPT-like large language model. (2023-04-15, Pythia, LLAMA, Apache 2.0 License)

Local LLM Resources

Local LLM Spaces, Models & Datasets

Local Models

  • Hermes 2 Pro - Mistral 7B - 03-13, Nous Research) is a 7B parameter model that excels at function calling, JSON structured outputs, and general tasks. Trained on an updated OpenHermes 2.5 Dataset and a new function calling dataset, it uses a special system prompt and multi-turn structure. Achieves 91% on function calling and 84% on JSON mode evaluations.
  • Gorilla OpenFunctions v2 - 02-27, Apache 2.0 license, Charlie Cheng-Jie Ji et al.) interprets and executes functions based on JSON Schema Objects, supporting multiple languages and detecting function relevance.
  • NexusRaven-V2 - 12-05, Nexusflow) is a 13B model outperforming GPT-4 in zero-shot function calling by up to 7%, enabling effective use of software tools. Further instruction-tuned on CodeLlama-13B-instruct.
  • Functionary - 08-04, MeetKai) interprets and executes functions based on JSON Schema Objects, supporting various compute requirements and call types. Compatible with OpenAI-python and llama-cpp-python for efficient function execution in JSON generation tasks.
  • C4AI Command R+ - 03-20, CC-BY-NC, Cohere) is a 104B parameter multilingual model with advanced Retrieval Augmented Generation (RAG) and tool use capabilities, optimized for reasoning, summarization, and question answering across 10 languages. Supports quantization for efficient use and demonstrates unique multi-step tool integration for complex task execution.
  • Hugging Face TGI - generation-inference/supported_models).
  • Mistral 7B Instruct v0.3 - 05-22, Apache 2.0) an instruct fine-tuned version of Mistral with added function calling support.

Non-English Models & Datasets

Local LLM Resources

Prompting Tools

Autonomous Agent Resources

Python Libraries

  • DSPy - blocks/8-typed_predictors.md) to leverage Pydantic for enforcing type constraints on inputs and outputs, improving upon string-based fields.
  • FuzzTypes
  • guidance - 2.0) enables constrained generation, interleaving Python logic with LLM calls, reusable functions, and calling external tools. Optimizes prompts for faster generation.
  • LangChain
  • LiteLLM
  • LlamaIndex - defined Pydantic programs for specific output types.
  • Marvin - 2.0) is a lightweight toolkit for building reliable natural language interfaces with self-documenting tools for tasks like entity extraction and multi-modal support.
  • Pydantic
  • SGLang - 2.0) allows specifying JSON schemas using regular expressions or Pydantic models for constrained decoding. Its high-performance runtime accelerates JSON decoding.
  • SynCode - guided generation of Large Language Models (LLMs). It supports CFG for Python, Go, Java, JSON, YAML, and many more.
  • Mirascope
  • Magnetic
  • Formatron - string templates that support regular expressions, context-free grammars, JSON schemas, and Pydantic models. Formatron integrates seamlessly with various model inference libraries.
  • Transformers-cfg - free grammar (CFG) support via an EBNF interface. It enables grammar-constrained generation with minimal changes to existing code of transformers and supports JSON mode and JSON Schema.
  • PydanticAI
  • Outlines - 2.0) facilitates structured text generation using multiple models, Jinja templating, and support for regex patterns, JSON schemas, Pydantic models, and context-free grammars.
  • Instructor

Terminology

Videos