An open API service indexing awesome lists of open source software.

awesome-data-analysis

πŸš€ 500+ curated resources for Data Analysis & Data Science: Python, SQL, Statistics, ML, AI, Visualization, Cheatsheets, Roadmaps, Interview Prep. For beginners and experts.
https://github.com/pavelgrigoryevds/awesome-data-analysis

Last synced: about 1 month ago
JSON representation

πŸ§ͺ A/B Testing

Tools

πŸ“¦ Additional Python Libraries

Code Quality & Development

  • PandasVet - Code style validator for Pandas.
  • Rich - Rich text and beautiful formatting in the terminal.
  • Pandas-log - Logs pandas operations for data transformation tracking.
  • Icecream - Debugging without using print.
  • Pydeps - Python module dependency graphs.
  • PyForest - Automated Python imports for data science.
  • Black - Uncompromising Python code formatter.
  • Pre-commit - Framework for managing pre-commit hooks.
  • Pylint - Python code static analysis.
  • Mypy - Optional static typing for Python.
  • Complexipy - Blazingly fast cognitive complexity analysis for Python, written in Rust.

Documentation & File Processing

  • Sphinx - Documentation generator.
  • Pdoc - API documentation for Python projects.
  • Mkdocs - Project documentation with Markdown.
  • OpenPyXL - Read/write Excel files.
  • Tablib - Exports data to XLSX, JSON, CSV.
  • PyPDF2 - Reads and writes PDF files.
  • Python-docx - Reads and writes Word documents.
  • CleverCSV - Smart CSV reader for messy data.
  • Xlwings - Integration of Python with Excel.
  • Xmltodict - Converts XML to Python dictionaries.
  • Python-markdownify - Convert HTML to Markdown.
  • MarkItDown - Python tool for converting files and office documents to Markdown.
  • WeasyPrint - Convert HTML to PDF.
  • PyMuPDF - Advanced PDF manipulation library.
  • Camelot - PDF table extraction library.
  • Marker - Fast, high-accuracy PDF and document conversion tool with layout preservation.

Miscellaneous

  • Pytest - Framework for writing small tests.
  • Ftfy - Fixes broken Unicode strings.
  • JmesPath - Queries JSON data (SQL-like for JSON).
  • Glom - Transforms nested data structures.
  • Pampy - Pattern matching for Python dictionaries.
  • Diagrams - Diagrams as code for cloud architecture.
  • Pygorithm - A Python module for learning all major algorithms.
  • UV - An extremely fast Python package installer and resolver.
  • Funcy - Fancy functional tools for Python.
  • Pillow - Image processing library.
  • GitPython - A Python library used to interact with Git repositories.
  • TQDM - Progress bars for loops and operations.
  • Loguru - Python logging made simple.
  • Click - Beautiful command line interfaces.
  • Poetry - Python dependency management and packaging.
  • papermill - Tool for parameterizing and executing Jupyter notebooks programmatically.
  • Python Telegram Bot - Pure Python framework for the Telegram Bot API with async support.

Web & APIs

  • HTTPX - Next-generation HTTP client for Python.
  • FastAPI - Modern web framework for building APIs.
  • Flask - Lightweight Python web framework for building applications and APIs.
  • Typer - Library for building CLI applications.
  • Requests-cache - Persistent caching for requests library.
  • Aiohttp - Asynchronous HTTP client/server framework for asyncio and Python.

🌐 Additional Resources and Tools

Miscellaneous

  • UC Berkeley - Data 8 - Course materials for the Data Science Foundations course.
  • PaddleOCR - Production-ready OCR toolkit with multilingual and document AI support.
  • A collective list of free APIs - A comprehensive list of free APIs for various purposes.
  • arXiv.org - A free distribution service and open-access archive for scholarly articles.
  • Elicit - An AI research assistant that helps automate parts of literature review.
  • 500+ AI/ML/DL/NLP Projects - A massive collection of AI and machine learning projects with code for learning and portfolios.
  • Full Stack Fastapi Template - Full-stack template with FastAPI, React, and PostgreSQL.
  • Kittl - Platform for creating and editing charts and data visualizations.
  • Zasper - High Performace IDE for Jupyter Notebooks.
  • Sketch - Toolkit designed for designers, focusing on their workflow.
  • Growth.Design - A collection of product case studies and behavioral psychology insights for data-driven decision-making.
  • OSSU Computer Science - Path to a free, self-taught education in computer science.
  • Markdown Badges - Collection of badges for GitHub profiles and Markdown files.
  • CS Video Courses - Curated list of free university computer science video courses.
  • Build Your Own X - Tutorials on how to build your own technology from scratch.
  • What Happens When - Technical explanation of what happens when you type a URL and press Enter.
  • Free Certifications - Regularly updated list of free certification courses from top cloud and tech companies.
  • A To Z Resources For Students - Comprehensive list of free resources for students learning programming and tech.
  • Summer Internships - Up-to-date list of summer internships in tech with deadline tracking.
  • Football Analytics - Open learning course and toolkit for football data analysis with Python and R.

🧠 AI Applications & Platforms

Resources

  • Awesome LLM Apps - Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.
  • Awesome Generative AI - A curated list of modern Generative Artificial Intelligence projects and services.
  • Generative AI for Beginners - Course on generative AI for beginners from Microsoft.
  • Awesome AI Agents - A curated list of AI autonomous agents, environments, and frameworks.
  • AI Collection - The Generative AI Landscape - A Collection of Awesome Generative AI Applications.
  • Awesome AI Apps - A collection of projects showcasing RAG, agents, workflows, and other AI use cases.
  • System Prompts and Models - System Prompts, Internal Tools & AI Models from various AI applications and coding tools.
  • Awesome LangChain - Awesome list of tools and projects with the awesome LangChain framework.
  • Awesome AI Tools - A curated list of Artificial Intelligence Top Tools.
  • Awesome LLM Security - A curation of awesome tools, documents and projects about LLM Security.
  • Claude Cookbooks - Official Anthropic examples and recipes for working with Claude AI.
  • AI Agents for Beginners - Microsoft's course on designing and building AI agents.
  • LLM Course - Practical course to master large language models from start to finish.
  • RAG Techniques - Collection of advanced techniques for Retrieval-Augmented Generation.
  • Hands On Large Language Models - Covers LLM fundamentals, prompt engineering, and fine-tuning.
  • AI Engineering Hub - Resources for building, deploying, and maintaining AI systems.
  • Agents Towards Production - Code-first tutorials for building production-grade GenAI agents.
  • LLM Engineer Toolkit - Curated list of 120+ LLM libraries across various categories.
  • GenAI Agents - Repository of AI agent implementations and tutorials.
  • AI Notes - Personal notes and essays on AI and software development.
  • Open LLMs - Comprehensive list of open-source large language models and their capabilities.
  • Prompt Engineering Guide - Guides, papers, and resources for prompt engineering with LLMs.
  • Prompt Engineering - Collection of prompt engineering techniques and strategies.
  • 500 AI Agents Projects - 500+ AI agent projects with code for learning and inspiration.
  • Generative AI - Roadmap and resources for mastering generative AI technologies.
  • Ai Dev Tools Zoomcamp - Free hands-on course on modern tools for building and deploying AI applications.
  • Awesome N8N - Collection of templates, integrations, and resources for the n8n automation platform.
  • Free Llm Api Resources - Up-to-date list of free APIs for accessing large language models (LLMs).

Tools

  • n8n - Workflow automation platform for connecting APIs and services.
  • crewAI - Framework for orchestrating role-playing AI agents.
  • autogen - Framework for building multi-agent conversational systems.
  • AutoGPT - Autonomous AI agent that can complete complex tasks.
  • LangGraph - Framework for building stateful, multi-actor applications with LLMs, with cycles and control flow.
  • LangChain - Framework for developing applications powered by language models.
  • LlamaIndex - Data framework for LLM-based applications with RAG capabilities.
  • openai-python - Official Python library for OpenAI API.
  • openai-agents-python - Official OpenAI framework for building AI agents.
  • ragflow - Open-source RAG (Retrieval-Augmented Generation) workflow platform.
  • firecrawl - Web crawling and data extraction service for AI applications.
  • Fabric - Framework for augmenting humans using AI.
  • gpt-engineer - AI-powered code generation tool.
  • gpt-pilot - AI pair programmer that writes entire applications.
  • tabby - Self-hosted AI coding assistant.
  • OpenLLM - Open platform for operating large language models in production.
  • LocalAI - Self-hosted, local-first AI model deployment platform.
  • dify - Visual LLM application development platform.
  • LLaMA-Factory - Easy-to-use LLM fine-tuning framework.
  • open-webui - Web interface for interacting with various LLMs.
  • ComfyUI - Visual node-based interface for Stable Diffusion.
  • lobe-chat - Modern AI conversation interface.
  • LibreChat - Open-source ChatGPT alternative.
  • quivr - Personal second brain and AI assistant.
  • upscayl - AI-powered image upscaling tool.
  • facefusion - AI face swapping and enhancement tool.
  • DocsGPT - Documentation-based question answering system.
  • Whisper - Robust speech recognition model for transcription and translation.
  • Agents.md - Open source framework for building agentic AI systems.
  • Dyad - Open-source platform for building AI applications with custom API keys.
  • Deep Research - AI-powered research assistant for iterative, deep research on any topic.
  • OpenManus - Open-source platform for building and deploying AI agents.
  • youtu-agent - Multi-modal intelligent agent framework by Tencent Cloud.
  • trae-agent - Tool-using reasoning agent with execution-augmented reasoning.
  • deepagents - LangChain framework for building sophisticated multi-agent systems.
  • mem0 - AI memory system for long-term context and personalized interactions.
  • web-ui - AI-powered browser automation framework for web interaction.
  • unsloth - Library for faster and more memory-efficient LLM fine-tuning.
  • Agent-S - Open agentic framework that autonomously interacts with computer GUIs like a human.
  • Langflow - Powerful visual platform for building and deploying AI-powered agents and workflows.
  • NeMo - Scalable generative AI framework from NVIDIA for LLMs, Multimodal, and Speech AI.
  • Bagel - Open-source unified multimodal model for understanding and generating images.
  • Ollama - Tool for running large language models locally.
  • Mastra - Open-source AI agent platform for building and scaling production-grade autonomous agents.
  • agenticSeek - Framework for building and deploying AI agents with advanced reasoning and tool use.
  • Flowise - Open-source UI visual tool for building custom LLM orchestration flows and AI agents.
  • MetaGPT - Multi-agent framework that simulates roles in a software company to build projects.
  • Local Deep Research - Local AI research assistant that searches web, papers, and documents.
  • Gptme - AI agent CLI that writes code, uses terminal, browses web, and runs locally.
  • Rowboat - Open-source AI coworker that learns from your emails/meetings to automate drafting, prep, and tasks.
  • Personal Ai Infrastructure - Framework for building a personal AI assistant with memory, skills, and learning ability.
  • N8N Workflows - Collection of ready-to-use workflow templates for the n8n automation platform.
  • Skyvern - AI browser automation using LLMs & computer vision. Playwright-compatible SDK + no-code workflows.
  • OpenWork - Open-source desktop alternative to Claude Cowork for running agents, skills, and MCP locally with team collaboration features.
  • Deepcode - AI-powered agent framework for automatic code generation from research papers and text.
  • LocalGPT - Fully private, on-premise document intelligence platform for chatting with your documents using local LLMs.
  • DeepEval - Pytest-style unit testing framework for LLMs. Metrics for RAG, agents, hallucination, summarization, and custom criteria.
  • RAGAS - Evaluation toolkit for LLM apps. Metrics, test generation, and insights for optimizing RAG pipelines and agents.
  • Phoenix - AI observability platform. Tracing, datasets, experiments, and playground for troubleshooting and evaluating LLM apps.
  • WFGY - Open-source debugging infrastructure for RAG and AI agents. Includes 16-problem RAG failure map and TXT stress-test engine.
  • Jaaz - Open-source multimodal creative assistant and privacy-focused alternative to Canva/Manus for local image/video generation.
  • DeepTutor - AI-powered personalized learning assistant with document Q&A, exercise generation, and deep research capabilities.
  • ChatTTS - Generative TTS model optimized for natural, expressive daily dialogue with fine-grained prosody control.
  • NeuTTS - On-device TTS model with instant voice cloning from audio samples..
  • Everything Claude Code - Collection of resources, guides, and tools for effective Claude Code AI assistant use.
  • DeepAnalyze - Agentic LLM for autonomous data science, which can autonomously complete a wide range of data-centric tasks without human intervention.
  • FutureSearch SDK - Python SDK that dispatches parallel web-research agents across

πŸ† Awesome Data Science Repositories

πŸ“‹ Cheatsheets

Data Science & Machine Learning

GoalKicker Programming Notes

Linux & Git