Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-generative-ai-meets-julia-language

Comprehensive guide to generative AI projects and resources in Julia.
https://github.com/svilupp/awesome-generative-ai-meets-julia-language

Last synced: 3 days ago
JSON representation

  • Generative AI Projects and Julia

    • JuliaGenAI Organization - A GitHub organization and a community of Julia developers and researchers working on generative AI.

  • Models

    • Flux.jl - Flux is a machine learning library for Julia that is flexible and allows building complex models. However, at the time of writing, I'm not aware of any Large Language Models (LLMs) that have been implemented and trained in Flux.
    • Transformers.jl - Transformers.jl is a Julia package that provides a high-level API for using pre-trained transformer models. It also allows to download any models from Hugging Face hub with `@hgf_str` macro string.
    • Pickle.jl - Great package for loading Pytorch weights into Julia (if you want to implement models yourself).
    • BytePairEncoding.jl - Pure Julia implementation of Byte Pair Encoding (BPE) algorithm. It's used by Transformers.jl to tokenize text.
    • Llama2.jl - Llama2.jl provides simple code for inference and training of llama2-based language models based on [llama2.c](https://github.com/karpathy/llama2.c). It supports loading quantized weights in GGUF format (`q4_K_S` variant). Other similar projects: [LanguageModels.jl](https://github.com/rai-llc/LanguageModels.jl)
    • Llama.jl - Julia interface to llama.cpp, a C/C++ library for running language models locally. Supports a wide range of models.
    • Whisper.jl - Julia interface to whisper.cpp, a high-performance inference in C/C++ of OpenAI's Whisper automatic speech recognition (ASR) model.

  • API SDKs

    • Vector Databases

      • Pinecone.jl - SDK for [Pinecone.io](https://www.pinecone.io/) vector database.

    • General-purpose DBMS with Vector Index Support

    • Model Providers

      • OpenAI.jl - A community-maintained Julia wrapper to the OpenAI API.

    • Cloud Services Providers

      • GoogleCloud.jl - SDK for Google Cloud. There is an [open PR](https://github.com/JuliaCloud/GoogleCloud.jl/pull/57) to enable Vertex AI endpoints.
      • GoogleGenAI.jl - Unofficial wrapper for the Google Gemini API.

  • Packages

    • General-purpose DBMS with Vector Index Support

      • ReplGPT.jl - Brings ChatGPT interface as a Julia REPL mode.
      • HelpGPT.jl - Calls ChatGPT to explain any errors in Julia code.
      • GenGPT3.jl - A [Gen.jl](https://www.gen.dev/) generative function that wraps the OpenAI API.
      • PromptingTools.jl - Helps with everyday applications of Large Language Models in Julia by wrapping coming APIs, re-using prompts via templates, and enabling easy transition between different model providers (eg, OpenAI, Ollama). (Disclaimer: I'm the author of this package.)
      • LLMTextAnalysis.jl - Leverage Large Language Models to uncover, evaluate, and label themes/concepts/spectra in large document collections. (Disclaimer: I'm the author of this package.)
      • AIHelpMe.jl - Enhanced AI code assistance by leveraging package documentation (Retrieval Augmented Generation). Comes pre-packaged for common Julia packages, but can be used for any package.
      • AIHelpUI.jl - Web-based graphical interface for AIHelpMe.jl built on top of Stipple.jl.
      • ProToPortal.jl - Web-based graphical interface for PromptingTools.jl with extra prompt templates and functionality (Julia code execution and auto-fixing, meta-prompting, auto-critic, speech-to-text entry). Similar to ChatGPT but geared towards Julia.

  • JLL Packages

    • General-purpose DBMS with Vector Index Support

      • JLLs - Julia projects (eg, C/C++). Often they are the first step towards a Julia package with an idiomatic interface.
      • llama_cpp_jll.jl - JLL package for [llama.cpp](https://github.com/ggerganov/llama.cpp), the best interface for quantized llama2-style models.

  • Applications/Products

    • General-purpose DBMS with Vector Index Support

      • GitHub Copilot - Excellent inline suggestions with the help of OpenAI models. It works extremely well with Julia language for repetitive tasks one line at a time, but larger code chunks are rarely correct.
      • Replit - Replit's REPL is powered by an in-house model that supports Julia language.
      • Codeium - Free alternative to GitHub Copilot with extensions for most editors.
      • Genie.jl's
      • Comind - A social network, messaging, and LLM interface built in Julia.
      • JuliaHub AskAI - AskAI is a [JuliaHub's](https://juliahub.com) RAG (Retrieval Augmented Generation) application that allows users to ask questions about the Julia language and its ecosystem. It is free, but you need to be logged in to JuliaHub to use it.
      • Genie UI Assistant - Genie UI Assistant is a GPT-4 powered

  • Benchmarks/Comparisons

    • General-purpose DBMS with Vector Index Support

      • Julia LLM Leaderboard - Comparison of Julia language generation capabilities of various Large Language Models across a range of tasks. Visit if you want help choosing the right model for your application.
      • HumanEval.jl - The Julia version of [openai/human-eval](https://github.com/openai/human-eval). It rewrites the original Python problems into the Julia version and provides evaluation results with several latest LLMs.

  • Waiting Room

    • General-purpose DBMS with Vector Index Support

      • FlashRank.jl - Fast and local document ranking with models that can run on any computer (CPU-based). Based on Python's [FlashRank](https://github.com/PrithivirajDamodaran/FlashRank).
      • SemanticCaches.jl - Smarter caching for GenAI applications with a tiny embedding model - reducing latency, one request at a time.
      • Spehulak.jl - GenAI observability platform for debugging your LLM calls. Fully integrated with PromptingTools.jl.
      • Milvus.jl - A minimal and unofficial implementation of Milvus VectorDB client for Julia.

  • Tutorials/learning

  • Archived Projects

    • General-purpose DBMS with Vector Index Support

      • GPTCodingTools.jl - Code generation tool for Julia language with useful prompt templates and self-healing features (ala OpenAI Code Interpreter). It does work, but development has been abandoned. (Disclaimer: I'm the author of this package.)

  • Noteworthy Mentions

    • Local Deployments

      • LM Studio - A desktop app for hosting and interacting with LLMs locally. It's a great option for those who want to use LLMs without coding. It's free for **personal use**.

    • Generative AI - Previous Generation

      • GenerativeModels.jl - Useful library to train more traditional generative models like VAEs. It's built on top of Flux.jl.
      • Stipple.jl - For building interactive data applications in pure Julia (part of Genie.jl ecosystem). Excellent for building web-based interfaces for GenAI applications.
      • Taro.jl - Powerful parser for various types of documents (interop to Java). Very useful for building Retrieval-Augmented Generation (RAG) applications.

  • Must-Know Python Projects

    • Generative AI - Previous Generation

      • PythonCall.jl
      • HuggingFace Transformers - The most popular library for accessing LLMs and other models. It can be mostly used via Transformers.jl (see above).
      • LangChain - The best option for building applications on top of LLMs (eg, Chains, Agents). It has a lot of adapters for common models, databases, and other services.
      • Llama Index - Similar to LangChain but with a focus on data-centered applications like RAG.
      • Instructor - Simple yet powerful structured extraction framework on top of OpenAI API. Excellent to understand the power of function calling API together with Pydantic.
      • Marvin - Powerful building blocks to quickly build AI applications and expose them via a production-ready API.

  • Other Awesome Lists

    • Generative AI - Previous Generation

Programming Languages
Julia 29 Python 3 Jupyter Notebook 1 JavaScript 1 C 1
Categories
Packages 8 Models 7 Applications/Products 7 API SDKs 7 Must-Know Python Projects 6 Waiting Room 4 Noteworthy Mentions 4 Tutorials/learning 4 JLL Packages 2 Benchmarks/Comparisons 2 Archived Projects 1 Other Awesome Lists 1 Generative AI Projects and Julia 1
Sub Categories
General-purpose DBMS with Vector Index Support 31 Generative AI - Previous Generation 10 Cloud Services Providers 2 Model Providers 1 Vector Databases 1 Local Deployments 1
Keywords
julia 8 generative-ai 4 llm 4 python 3 rag 3 agents 2 openai 2 ai 2 nlp 2 framework 2 machine-learning 2 flux 2 deep-learning 2 data-science 2 julialang 1 full-stack 1 low-code 1 mvc 1 googlecloud 1 cloud-computing 1 wrapper 1 openai-api 1 api-wrapper 1 nearest-neighbor-search 1 approximate-nearest-neighbor-search 1 word-segmentation 1 nlp-machine-learning 1 nlp-library 1 transformer 1 natural-language-processing 1 attention 1 the-human-brain 1 neural-networks 1 large-language-models 1 generative-art 1 awesome-list 1 awesome 1 artificial-intelligence 1 nli 1 gpt 1 chatbots 1 ambient-ai 1 ai-functions 1 validation 1 pydantic-v2 1 openai-functions 1 openai-function-calli 1 vector-database 1 multi-agents 1 llamaindex 1