awesome-data-analysis

🚀 500+ curated resources for Data Analysis & Data Science: Python, SQL, Statistics, ML, AI, Visualization, Cheatsheets, Roadmaps, Interview Prep. For beginners and experts.
https://github.com/pavelgrigoryevds/awesome-data-analysis

Last synced: about 20 hours ago
JSON representation

🧪 A/B Testing
- Tools
  - DynamicYield A/B Testing - An online course covering advanced testing and optimization techniques.
  - Evan's Awesome A/B Tools - A/B test calculators.
  - Experimentguide - A practical guide to A/B testing and experimentation from industry leaders.
  - Google's A/B Testing Course - A free Udacity course covering the fundamentals of A/B testing.
  - So You Think You Can Test? - Experience the challenges of A/B testing through this educational simulation.
📦 Additional Python Libraries
- Code Quality & Development
  - PandasVet - Code style validator for Pandas.
  - Rich - Rich text and beautiful formatting in the terminal.
  - Pandas-log - Logs pandas operations for data transformation tracking.
  - Icecream - Debugging without using print.
  - Pydeps - Python module dependency graphs.
  - PyForest - Automated Python imports for data science.
  - Black - Uncompromising Python code formatter.
  - Pre-commit - Framework for managing pre-commit hooks.
  - Pylint - Python code static analysis.
  - Mypy - Optional static typing for Python.
  - Complexipy - Blazingly fast cognitive complexity analysis for Python, written in Rust.
- Documentation & File Processing
  - Sphinx - Documentation generator.
  - Pdoc - API documentation for Python projects.
  - Mkdocs - Project documentation with Markdown.
  - OpenPyXL - Read/write Excel files.
  - Tablib - Exports data to XLSX, JSON, CSV.
  - PyPDF2 - Reads and writes PDF files.
  - Python-docx - Reads and writes Word documents.
  - CleverCSV - Smart CSV reader for messy data.
  - Xlwings - Integration of Python with Excel.
  - Xmltodict - Converts XML to Python dictionaries.
  - Python-markdownify - Convert HTML to Markdown.
  - MarkItDown - Python tool for converting files and office documents to Markdown.
  - WeasyPrint - Convert HTML to PDF.
  - PyMuPDF - Advanced PDF manipulation library.
  - Camelot - PDF table extraction library.
  - Marker - Fast, high-accuracy PDF and document conversion tool with layout preservation.
- Miscellaneous
  - Pytest - Framework for writing small tests.
  - Ftfy - Fixes broken Unicode strings.
  - JmesPath - Queries JSON data (SQL-like for JSON).
  - Glom - Transforms nested data structures.
  - Pampy - Pattern matching for Python dictionaries.
  - Diagrams - Diagrams as code for cloud architecture.
  - Pygorithm - A Python module for learning all major algorithms.
  - UV - An extremely fast Python package installer and resolver.
  - Funcy - Fancy functional tools for Python.
  - Pillow - Image processing library.
  - GitPython - A Python library used to interact with Git repositories.
  - TQDM - Progress bars for loops and operations.
  - Loguru - Python logging made simple.
  - Click - Beautiful command line interfaces.
  - Poetry - Python dependency management and packaging.
  - papermill - Tool for parameterizing and executing Jupyter notebooks programmatically.
  - Python Telegram Bot - Pure Python framework for the Telegram Bot API with async support.
- Web & APIs
  - HTTPX - Next-generation HTTP client for Python.
  - FastAPI - Modern web framework for building APIs.
  - Flask - Lightweight Python web framework for building applications and APIs.
  - Typer - Library for building CLI applications.
  - Requests-cache - Persistent caching for requests library.
  - Aiohttp - Asynchronous HTTP client/server framework for asyncio and Python.
🌐 Additional Resources and Tools
- Miscellaneous
  - UC Berkeley - Data 8 - Course materials for the Data Science Foundations course.
  - PaddleOCR - Production-ready OCR toolkit with multilingual and document AI support.
  - A collective list of free APIs - A comprehensive list of free APIs for various purposes.
  - arXiv.org - A free distribution service and open-access archive for scholarly articles.
  - Elicit - An AI research assistant that helps automate parts of literature review.
  - 500+ AI/ML/DL/NLP Projects - A massive collection of AI and machine learning projects with code for learning and portfolios.
  - Full Stack Fastapi Template - Full-stack template with FastAPI, React, and PostgreSQL.
  - Kittl - Platform for creating and editing charts and data visualizations.
  - Zasper - High Performace IDE for Jupyter Notebooks.
  - Sketch - Toolkit designed for designers, focusing on their workflow.
  - Growth.Design - A collection of product case studies and behavioral psychology insights for data-driven decision-making.
  - OSSU Computer Science - Path to a free, self-taught education in computer science.
  - Markdown Badges - Collection of badges for GitHub profiles and Markdown files.
  - CS Video Courses - Curated list of free university computer science video courses.
  - Build Your Own X - Tutorials on how to build your own technology from scratch.
  - What Happens When - Technical explanation of what happens when you type a URL and press Enter.
  - Free Certifications - Regularly updated list of free certification courses from top cloud and tech companies.
  - A To Z Resources For Students - Comprehensive list of free resources for students learning programming and tech.
  - Summer Internships - Up-to-date list of summer internships in tech with deadline tracking.
  - Football Analytics - Open learning course and toolkit for football data analysis with Python and R.
🧠 AI Applications & Platforms
- Resources
  - Awesome LLM Apps - Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.
  - Awesome Generative AI - A curated list of modern Generative Artificial Intelligence projects and services.
  - Generative AI for Beginners - Course on generative AI for beginners from Microsoft.
  - Awesome AI Agents - A curated list of AI autonomous agents, environments, and frameworks.
  - AI Collection - The Generative AI Landscape - A Collection of Awesome Generative AI Applications.
  - Awesome AI Apps - A collection of projects showcasing RAG, agents, workflows, and other AI use cases.
  - System Prompts and Models - System Prompts, Internal Tools & AI Models from various AI applications and coding tools.
  - Awesome LangChain - Awesome list of tools and projects with the awesome LangChain framework.
  - Awesome AI Tools - A curated list of Artificial Intelligence Top Tools.
  - Awesome LLM Security - A curation of awesome tools, documents and projects about LLM Security.
  - Claude Cookbooks - Official Anthropic examples and recipes for working with Claude AI.
  - AI Agents for Beginners - Microsoft's course on designing and building AI agents.
  - LLM Course - Practical course to master large language models from start to finish.
  - RAG Techniques - Collection of advanced techniques for Retrieval-Augmented Generation.
  - Hands On Large Language Models - Covers LLM fundamentals, prompt engineering, and fine-tuning.
  - AI Engineering Hub - Resources for building, deploying, and maintaining AI systems.
  - Agents Towards Production - Code-first tutorials for building production-grade GenAI agents.
  - LLM Engineer Toolkit - Curated list of 120+ LLM libraries across various categories.
  - GenAI Agents - Repository of AI agent implementations and tutorials.
  - AI Notes - Personal notes and essays on AI and software development.
  - Open LLMs - Comprehensive list of open-source large language models and their capabilities.
  - Prompt Engineering Guide - Guides, papers, and resources for prompt engineering with LLMs.
  - Prompt Engineering - Collection of prompt engineering techniques and strategies.
  - 500 AI Agents Projects - 500+ AI agent projects with code for learning and inspiration.
  - Generative AI - Roadmap and resources for mastering generative AI technologies.
  - Ai Dev Tools Zoomcamp - Free hands-on course on modern tools for building and deploying AI applications.
  - Awesome N8N - Collection of templates, integrations, and resources for the n8n automation platform.
  - Free Llm Api Resources - Up-to-date list of free APIs for accessing large language models (LLMs).
- Tools
  - n8n - Workflow automation platform for connecting APIs and services.
  - crewAI - Framework for orchestrating role-playing AI agents.
  - autogen - Framework for building multi-agent conversational systems.
  - AutoGPT - Autonomous AI agent that can complete complex tasks.
  - LangGraph - Framework for building stateful, multi-actor applications with LLMs, with cycles and control flow.
  - LangChain - Framework for developing applications powered by language models.
  - LlamaIndex - Data framework for LLM-based applications with RAG capabilities.
  - openai-python - Official Python library for OpenAI API.
  - openai-agents-python - Official OpenAI framework for building AI agents.
  - ragflow - Open-source RAG (Retrieval-Augmented Generation) workflow platform.
  - firecrawl - Web crawling and data extraction service for AI applications.
  - Fabric - Framework for augmenting humans using AI.
  - gpt-engineer - AI-powered code generation tool.
  - gpt-pilot - AI pair programmer that writes entire applications.
  - tabby - Self-hosted AI coding assistant.
  - OpenLLM - Open platform for operating large language models in production.
  - LocalAI - Self-hosted, local-first AI model deployment platform.
  - dify - Visual LLM application development platform.
  - LLaMA-Factory - Easy-to-use LLM fine-tuning framework.
  - open-webui - Web interface for interacting with various LLMs.
  - ComfyUI - Visual node-based interface for Stable Diffusion.
  - lobe-chat - Modern AI conversation interface.
  - LibreChat - Open-source ChatGPT alternative.
  - quivr - Personal second brain and AI assistant.
  - upscayl - AI-powered image upscaling tool.
  - facefusion - AI face swapping and enhancement tool.
  - DocsGPT - Documentation-based question answering system.
  - Whisper - Robust speech recognition model for transcription and translation.
  - Agents.md - Open source framework for building agentic AI systems.
  - Dyad - Open-source platform for building AI applications with custom API keys.
  - Deep Research - AI-powered research assistant for iterative, deep research on any topic.
  - OpenManus - Open-source platform for building and deploying AI agents.
  - youtu-agent - Multi-modal intelligent agent framework by Tencent Cloud.
  - trae-agent - Tool-using reasoning agent with execution-augmented reasoning.
  - deepagents - LangChain framework for building sophisticated multi-agent systems.
  - mem0 - AI memory system for long-term context and personalized interactions.
  - web-ui - AI-powered browser automation framework for web interaction.
  - unsloth - Library for faster and more memory-efficient LLM fine-tuning.
  - Agent-S - Open agentic framework that autonomously interacts with computer GUIs like a human.
  - Langflow - Powerful visual platform for building and deploying AI-powered agents and workflows.
  - NeMo - Scalable generative AI framework from NVIDIA for LLMs, Multimodal, and Speech AI.
  - Bagel - Open-source unified multimodal model for understanding and generating images.
  - Ollama - Tool for running large language models locally.
  - Mastra - Open-source AI agent platform for building and scaling production-grade autonomous agents.
  - agenticSeek - Framework for building and deploying AI agents with advanced reasoning and tool use.
  - Flowise - Open-source UI visual tool for building custom LLM orchestration flows and AI agents.
  - MetaGPT - Multi-agent framework that simulates roles in a software company to build projects.
  - Local Deep Research - Local AI research assistant that searches web, papers, and documents.
  - Gptme - AI agent CLI that writes code, uses terminal, browses web, and runs locally.
  - Screenpipe - Local AI that records, searches, and automates tasks based on your screen and audio.
  - Rowboat - Open-source AI coworker that learns from your emails/meetings to automate drafting, prep, and tasks.
  - Everyrow - AI-powered data operations SDK. Semantic deduplication, fuzzy merging, and intelligent ranking for data analysis workflows.
  - Personal Ai Infrastructure - Framework for building a personal AI assistant with memory, skills, and learning ability.
  - N8N Workflows - Collection of ready-to-use workflow templates for the n8n automation platform.
  - Skyvern - AI browser automation using LLMs & computer vision. Playwright-compatible SDK + no-code workflows.
  - OpenWork - Open-source desktop alternative to Claude Cowork for running agents, skills, and MCP locally with team collaboration features.
  - Deepcode - AI-powered agent framework for automatic code generation from research papers and text.
  - LocalGPT - Fully private, on-premise document intelligence platform for chatting with your documents using local LLMs.
  - DeepEval - Pytest-style unit testing framework for LLMs. Metrics for RAG, agents, hallucination, summarization, and custom criteria.
  - RAGAS - Evaluation toolkit for LLM apps. Metrics, test generation, and insights for optimizing RAG pipelines and agents.
  - Phoenix - AI observability platform. Tracing, datasets, experiments, and playground for troubleshooting and evaluating LLM apps.
  - WFGY - Open-source debugging infrastructure for RAG and AI agents. Includes 16-problem RAG failure map and TXT stress-test engine.
  - Jaaz - Open-source multimodal creative assistant and privacy-focused alternative to Canva/Manus for local image/video generation.
  - DeepTutor - AI-powered personalized learning assistant with document Q&A, exercise generation, and deep research capabilities.
  - ChatTTS - Generative TTS model optimized for natural, expressive daily dialogue with fine-grained prosody control.
  - NeuTTS - On-device TTS model with instant voice cloning from audio samples..
  - Everything Claude Code - Collection of resources, guides, and tools for effective Claude Code AI assistant use.
  - DeepAnalyze - Agentic LLM for autonomous data science, which can autonomously complete a wide range of data-centric tasks without human intervention.
  - FutureSearch SDK - Python SDK that dispatches parallel web-research agents across
🏆 Awesome Data Science Repositories
- Awesome Data Science - A curated list of courses, books, tools, and resources for data science.
- Data Science for Beginners - Microsoft's data science curriculum.
- OSSU Data Science - Open Source Society University's self-study path.
- Data Science Best Resources - Carefully curated links for data science resources in one place.
- Data Science Articles from CodeCut - A collection of articles, videos, and code related to data science.
- Data Science Using Python - Resources for data analysis using Python.
📋 Cheatsheets
- Data Science & Machine Learning
  - DS Cheatsheets - List of Data Science Cheatsheets.
  - DS Notes \& Cheatsheets - Cheatsheets for data science, ML, computer science and more.
  - Data Science Cheat Sheets (Math) - Cheat sheets for quick reference in data science mathematics.
  - Pandas Cheat Sheet - Data manipulation with Pandas.
  - PySpark Cheatsheet - Common PySpark patterns.
  - Machine Learning Cheat Sheet - Concise machine learning cheat sheets covering key concepts and equations.
- GoalKicker Programming Notes
  - Python Notes for Professionals - A massive collection of Python concepts, idioms, and best practices for all levels.
  - SQL Notes for Professionals - A definitive guide to SQL syntax, queries, and database interaction concepts.
  - PostgreSQL Notes for Professionals - A professional compendium of knowledge for PostgreSQL administration and development.
  - MySQL Notes for Professionals - Essential reference material for working with the MySQL database management system.
  - Oracle Database Notes for Professionals - A guide to Oracle Database concepts, PL/SQL, and administration tasks.
  - MongoDB Notes for Professionals - A practical guide to working with NoSQL and MongoDB for modern application development.
  - Bash Notes for Professionals - A comprehensive guide to shell scripting and command-line mastery.
  - Git Notes for Professionals - Everything you need to know about version control with Git, from basics to advanced workflows.
  - Linux Notes for Professionals - A deep dive into Linux system administration, commands, and environment management.
  - Microsoft SQL Server Notes for Professionals - A detailed reference for developing and administering MS SQL Server databases.
  - PowerShell Notes for Professionals - A guide to task automation and configuration management using PowerShell.
- Linux & Git
  - Linux Cheatsheet - Linux commands and shortcuts.
  - Bash Awesome Cheatsheets - Bash scripting essentials.
  - Unix Commands Reference - Unix terminal basics.
  - GitHub Cheat Sheet - Git/GitHub workflows and tips.
  - Git Awesome Cheatsheets - Git commands and best practices.

Programming Languages

Python 305 Jupyter Notebook 79 TypeScript 42 Go 32 Java 25 C++ 22 HTML 17 JavaScript 15 Rust 15 C 10

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

awesome-data-analysis

🧪 A/B Testing

Tools

📦 Additional Python Libraries

Code Quality & Development

Documentation & File Processing

Miscellaneous

Web & APIs

🌐 Additional Resources and Tools

Miscellaneous

🧠 AI Applications & Platforms

Resources

Tools

🏆 Awesome Data Science Repositories

📋 Cheatsheets

Data Science & Machine Learning

GoalKicker Programming Notes

Linux & Git