awesome-data-analysis
π 500+ curated resources for Data Analysis & Data Science: Python, SQL, Statistics, ML, AI, Visualization, Cheatsheets, Roadmaps, Interview Prep. For beginners and experts.
https://github.com/pavelgrigoryevds/awesome-data-analysis
Last synced: about 1 month ago
JSON representation
π§ͺ A/B Testing
Tools
- DynamicYield A/B Testing - An online course covering advanced testing and optimization techniques.
- Evan's Awesome A/B Tools - A/B test calculators.
- Experimentguide - A practical guide to A/B testing and experimentation from industry leaders.
- Google's A/B Testing Course - A free Udacity course covering the fundamentals of A/B testing.
- So You Think You Can Test? - Experience the challenges of A/B testing through this educational simulation.
π¦ Additional Python Libraries
Code Quality & Development
- PandasVet - Code style validator for Pandas.
- Rich - Rich text and beautiful formatting in the terminal.
- Pandas-log - Logs pandas operations for data transformation tracking.
- Icecream - Debugging without using print.
- Pydeps - Python module dependency graphs.
- PyForest - Automated Python imports for data science.
- Black - Uncompromising Python code formatter.
- Pre-commit - Framework for managing pre-commit hooks.
- Pylint - Python code static analysis.
- Mypy - Optional static typing for Python.
- Complexipy - Blazingly fast cognitive complexity analysis for Python, written in Rust.
Documentation & File Processing
- Sphinx - Documentation generator.
- Pdoc - API documentation for Python projects.
- Mkdocs - Project documentation with Markdown.
- OpenPyXL - Read/write Excel files.
- Tablib - Exports data to XLSX, JSON, CSV.
- PyPDF2 - Reads and writes PDF files.
- Python-docx - Reads and writes Word documents.
- CleverCSV - Smart CSV reader for messy data.
- Xlwings - Integration of Python with Excel.
- Xmltodict - Converts XML to Python dictionaries.
- Python-markdownify - Convert HTML to Markdown.
- MarkItDown - Python tool for converting files and office documents to Markdown.
- WeasyPrint - Convert HTML to PDF.
- PyMuPDF - Advanced PDF manipulation library.
- Camelot - PDF table extraction library.
- Marker - Fast, high-accuracy PDF and document conversion tool with layout preservation.
Miscellaneous
- Pytest - Framework for writing small tests.
- Ftfy - Fixes broken Unicode strings.
- JmesPath - Queries JSON data (SQL-like for JSON).
- Glom - Transforms nested data structures.
- Pampy - Pattern matching for Python dictionaries.
- Diagrams - Diagrams as code for cloud architecture.
- Pygorithm - A Python module for learning all major algorithms.
- UV - An extremely fast Python package installer and resolver.
- Funcy - Fancy functional tools for Python.
- Pillow - Image processing library.
- GitPython - A Python library used to interact with Git repositories.
- TQDM - Progress bars for loops and operations.
- Loguru - Python logging made simple.
- Click - Beautiful command line interfaces.
- Poetry - Python dependency management and packaging.
- papermill - Tool for parameterizing and executing Jupyter notebooks programmatically.
- Python Telegram Bot - Pure Python framework for the Telegram Bot API with async support.
Web & APIs
- HTTPX - Next-generation HTTP client for Python.
- FastAPI - Modern web framework for building APIs.
- Flask - Lightweight Python web framework for building applications and APIs.
- Typer - Library for building CLI applications.
- Requests-cache - Persistent caching for requests library.
- Aiohttp - Asynchronous HTTP client/server framework for asyncio and Python.
π Additional Resources and Tools
Miscellaneous
- UC Berkeley - Data 8 - Course materials for the Data Science Foundations course.
- PaddleOCR - Production-ready OCR toolkit with multilingual and document AI support.
- A collective list of free APIs - A comprehensive list of free APIs for various purposes.
- arXiv.org - A free distribution service and open-access archive for scholarly articles.
- Elicit - An AI research assistant that helps automate parts of literature review.
- 500+ AI/ML/DL/NLP Projects - A massive collection of AI and machine learning projects with code for learning and portfolios.
- Full Stack Fastapi Template - Full-stack template with FastAPI, React, and PostgreSQL.
- Kittl - Platform for creating and editing charts and data visualizations.
- Zasper - High Performace IDE for Jupyter Notebooks.
- Sketch - Toolkit designed for designers, focusing on their workflow.
- Growth.Design - A collection of product case studies and behavioral psychology insights for data-driven decision-making.
- OSSU Computer Science - Path to a free, self-taught education in computer science.
- Markdown Badges - Collection of badges for GitHub profiles and Markdown files.
- CS Video Courses - Curated list of free university computer science video courses.
- Build Your Own X - Tutorials on how to build your own technology from scratch.
- What Happens When - Technical explanation of what happens when you type a URL and press Enter.
- Free Certifications - Regularly updated list of free certification courses from top cloud and tech companies.
- A To Z Resources For Students - Comprehensive list of free resources for students learning programming and tech.
- Summer Internships - Up-to-date list of summer internships in tech with deadline tracking.
- Football Analytics - Open learning course and toolkit for football data analysis with Python and R.
π§ AI Applications & Platforms
Resources
- Awesome LLM Apps - Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.
- Awesome Generative AI - A curated list of modern Generative Artificial Intelligence projects and services.
- Generative AI for Beginners - Course on generative AI for beginners from Microsoft.
- Awesome AI Agents - A curated list of AI autonomous agents, environments, and frameworks.
- AI Collection - The Generative AI Landscape - A Collection of Awesome Generative AI Applications.
- Awesome AI Apps - A collection of projects showcasing RAG, agents, workflows, and other AI use cases.
- System Prompts and Models - System Prompts, Internal Tools & AI Models from various AI applications and coding tools.
- Awesome LangChain - Awesome list of tools and projects with the awesome LangChain framework.
- Awesome AI Tools - A curated list of Artificial Intelligence Top Tools.
- Awesome LLM Security - A curation of awesome tools, documents and projects about LLM Security.
- Claude Cookbooks - Official Anthropic examples and recipes for working with Claude AI.
- AI Agents for Beginners - Microsoft's course on designing and building AI agents.
- LLM Course - Practical course to master large language models from start to finish.
- RAG Techniques - Collection of advanced techniques for Retrieval-Augmented Generation.
- Hands On Large Language Models - Covers LLM fundamentals, prompt engineering, and fine-tuning.
- AI Engineering Hub - Resources for building, deploying, and maintaining AI systems.
- Agents Towards Production - Code-first tutorials for building production-grade GenAI agents.
- LLM Engineer Toolkit - Curated list of 120+ LLM libraries across various categories.
- GenAI Agents - Repository of AI agent implementations and tutorials.
- AI Notes - Personal notes and essays on AI and software development.
- Open LLMs - Comprehensive list of open-source large language models and their capabilities.
- Prompt Engineering Guide - Guides, papers, and resources for prompt engineering with LLMs.
- Prompt Engineering - Collection of prompt engineering techniques and strategies.
- 500 AI Agents Projects - 500+ AI agent projects with code for learning and inspiration.
- Generative AI - Roadmap and resources for mastering generative AI technologies.
- Ai Dev Tools Zoomcamp - Free hands-on course on modern tools for building and deploying AI applications.
- Awesome N8N - Collection of templates, integrations, and resources for the n8n automation platform.
- Free Llm Api Resources - Up-to-date list of free APIs for accessing large language models (LLMs).
Tools
- n8n - Workflow automation platform for connecting APIs and services.
- crewAI - Framework for orchestrating role-playing AI agents.
- autogen - Framework for building multi-agent conversational systems.
- AutoGPT - Autonomous AI agent that can complete complex tasks.
- LangGraph - Framework for building stateful, multi-actor applications with LLMs, with cycles and control flow.
- LangChain - Framework for developing applications powered by language models.
- LlamaIndex - Data framework for LLM-based applications with RAG capabilities.
- openai-python - Official Python library for OpenAI API.
- openai-agents-python - Official OpenAI framework for building AI agents.
- ragflow - Open-source RAG (Retrieval-Augmented Generation) workflow platform.
- firecrawl - Web crawling and data extraction service for AI applications.
- Fabric - Framework for augmenting humans using AI.
- gpt-engineer - AI-powered code generation tool.
- gpt-pilot - AI pair programmer that writes entire applications.
- tabby - Self-hosted AI coding assistant.
- OpenLLM - Open platform for operating large language models in production.
- LocalAI - Self-hosted, local-first AI model deployment platform.
- dify - Visual LLM application development platform.
- LLaMA-Factory - Easy-to-use LLM fine-tuning framework.
- open-webui - Web interface for interacting with various LLMs.
- ComfyUI - Visual node-based interface for Stable Diffusion.
- lobe-chat - Modern AI conversation interface.
- LibreChat - Open-source ChatGPT alternative.
- quivr - Personal second brain and AI assistant.
- upscayl - AI-powered image upscaling tool.
- facefusion - AI face swapping and enhancement tool.
- DocsGPT - Documentation-based question answering system.
- Whisper - Robust speech recognition model for transcription and translation.
- Agents.md - Open source framework for building agentic AI systems.
- Dyad - Open-source platform for building AI applications with custom API keys.
- Deep Research - AI-powered research assistant for iterative, deep research on any topic.
- OpenManus - Open-source platform for building and deploying AI agents.
- youtu-agent - Multi-modal intelligent agent framework by Tencent Cloud.
- trae-agent - Tool-using reasoning agent with execution-augmented reasoning.
- deepagents - LangChain framework for building sophisticated multi-agent systems.
- mem0 - AI memory system for long-term context and personalized interactions.
- web-ui - AI-powered browser automation framework for web interaction.
- unsloth - Library for faster and more memory-efficient LLM fine-tuning.
- Agent-S - Open agentic framework that autonomously interacts with computer GUIs like a human.
- Langflow - Powerful visual platform for building and deploying AI-powered agents and workflows.
- NeMo - Scalable generative AI framework from NVIDIA for LLMs, Multimodal, and Speech AI.
- Bagel - Open-source unified multimodal model for understanding and generating images.
- Ollama - Tool for running large language models locally.
- Mastra - Open-source AI agent platform for building and scaling production-grade autonomous agents.
- agenticSeek - Framework for building and deploying AI agents with advanced reasoning and tool use.
- Flowise - Open-source UI visual tool for building custom LLM orchestration flows and AI agents.
- MetaGPT - Multi-agent framework that simulates roles in a software company to build projects.
- Local Deep Research - Local AI research assistant that searches web, papers, and documents.
- Gptme - AI agent CLI that writes code, uses terminal, browses web, and runs locally.
- Rowboat - Open-source AI coworker that learns from your emails/meetings to automate drafting, prep, and tasks.
- Personal Ai Infrastructure - Framework for building a personal AI assistant with memory, skills, and learning ability.
- N8N Workflows - Collection of ready-to-use workflow templates for the n8n automation platform.
- Skyvern - AI browser automation using LLMs & computer vision. Playwright-compatible SDK + no-code workflows.
- OpenWork - Open-source desktop alternative to Claude Cowork for running agents, skills, and MCP locally with team collaboration features.
- Deepcode - AI-powered agent framework for automatic code generation from research papers and text.
- LocalGPT - Fully private, on-premise document intelligence platform for chatting with your documents using local LLMs.
- DeepEval - Pytest-style unit testing framework for LLMs. Metrics for RAG, agents, hallucination, summarization, and custom criteria.
- RAGAS - Evaluation toolkit for LLM apps. Metrics, test generation, and insights for optimizing RAG pipelines and agents.
- Phoenix - AI observability platform. Tracing, datasets, experiments, and playground for troubleshooting and evaluating LLM apps.
- WFGY - Open-source debugging infrastructure for RAG and AI agents. Includes 16-problem RAG failure map and TXT stress-test engine.
- Jaaz - Open-source multimodal creative assistant and privacy-focused alternative to Canva/Manus for local image/video generation.
- DeepTutor - AI-powered personalized learning assistant with document Q&A, exercise generation, and deep research capabilities.
- ChatTTS - Generative TTS model optimized for natural, expressive daily dialogue with fine-grained prosody control.
- NeuTTS - On-device TTS model with instant voice cloning from audio samples..
- Everything Claude Code - Collection of resources, guides, and tools for effective Claude Code AI assistant use.
- DeepAnalyze - Agentic LLM for autonomous data science, which can autonomously complete a wide range of data-centric tasks without human intervention.
- FutureSearch SDK - Python SDK that dispatches parallel web-research agents across
π Awesome Data Science Repositories
- Awesome Data Science - A curated list of courses, books, tools, and resources for data science.
- Data Science for Beginners - Microsoft's data science curriculum.
- OSSU Data Science - Open Source Society University's self-study path.
- Data Science Best Resources - Carefully curated links for data science resources in one place.
- Data Science Articles from CodeCut - A collection of articles, videos, and code related to data science.
- Data Science Using Python - Resources for data analysis using Python.
π Cheatsheets
Data Science & Machine Learning
- DS Cheatsheets - List of Data Science Cheatsheets.
- DS Notes \& Cheatsheets - Cheatsheets for data science, ML, computer science and more.
- Data Science Cheat Sheets (Math) - Cheat sheets for quick reference in data science mathematics.
- Pandas Cheat Sheet - Data manipulation with Pandas.
- PySpark Cheatsheet - Common PySpark patterns.
- Machine Learning Cheat Sheet - Concise machine learning cheat sheets covering key concepts and equations.
GoalKicker Programming Notes
- Python Notes for Professionals - A massive collection of Python concepts, idioms, and best practices for all levels.
- SQL Notes for Professionals - A definitive guide to SQL syntax, queries, and database interaction concepts.
- PostgreSQL Notes for Professionals - A professional compendium of knowledge for PostgreSQL administration and development.
- MySQL Notes for Professionals - Essential reference material for working with the MySQL database management system.
- Oracle Database Notes for Professionals - A guide to Oracle Database concepts, PL/SQL, and administration tasks.
- MongoDB Notes for Professionals - A practical guide to working with NoSQL and MongoDB for modern application development.
- Bash Notes for Professionals - A comprehensive guide to shell scripting and command-line mastery.
- Git Notes for Professionals - Everything you need to know about version control with Git, from basics to advanced workflows.
- Linux Notes for Professionals - A deep dive into Linux system administration, commands, and environment management.
- Microsoft SQL Server Notes for Professionals - A detailed reference for developing and administering MS SQL Server databases.
- PowerShell Notes for Professionals - A guide to task automation and configuration management using PowerShell.
Linux & Git
- Linux Cheatsheet - Linux commands and shortcuts.
- Bash Awesome Cheatsheets - Bash scripting essentials.
- Unix Commands Reference - Unix terminal basics.
- GitHub Cheat Sheet - Git/GitHub workflows and tips.
- Git Awesome Cheatsheets - Git commands and best practices.
- Git and Git Flow Cheat Sheet - Branching strategies.
- Linux Bash Commands - Comprehensive list of Linux/Bash commands for developers and sysadmins.