{"id":28972527,"url":"https://github.com/vikas-kashyap97/market-intelligence-agent","last_synced_at":"2026-05-20T14:38:05.889Z","repository":{"id":299966956,"uuid":"1004491892","full_name":"vikas-kashyap97/Market-Intelligence-Agent","owner":"vikas-kashyap97","description":"An AI-powered Market Intelligence Agent that analyzes live market data, extracts insights using LLMs, generates strategic recommendations, and visualizes trends with interactive charts — built with Streamlit, LangChain, Firecrawl, and Plotly.","archived":false,"fork":false,"pushed_at":"2025-06-27T17:15:38.000Z","size":99,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-06-27T18:27:41.900Z","etag":null,"topics":["agents","ai","aiworkflow","database","firecrawl","google","groq","llm","newsapi","notion","plotly","tavily"],"latest_commit_sha":null,"homepage":"https://market-int-agent.streamlit.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/vikas-kashyap97.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-06-18T17:52:35.000Z","updated_at":"2025-06-27T17:15:41.000Z","dependencies_parsed_at":"2025-06-19T07:32:50.607Z","dependency_job_id":"49698393-4b83-4ad1-96ef-e89951a8fca3","html_url":"https://github.com/vikas-kashyap97/Market-Intelligence-Agent","commit_stats":null,"previous_names":["vikas-kashyap97/market-intelligence-agent"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/vikas-kashyap97/Market-Intelligence-Agent","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vikas-kashyap97%2FMarket-Intelligence-Agent","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vikas-kashyap97%2FMarket-Intelligence-Agent/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vikas-kashyap97%2FMarket-Intelligence-Agent/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vikas-kashyap97%2FMarket-Intelligence-Agent/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/vikas-kashyap97","download_url":"https://codeload.github.com/vikas-kashyap97/Market-Intelligence-Agent/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vikas-kashyap97%2FMarket-Intelligence-Agent/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263982976,"owners_count":23539431,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agents","ai","aiworkflow","database","firecrawl","google","groq","llm","newsapi","notion","plotly","tavily"],"created_at":"2025-06-24T11:06:46.142Z","updated_at":"2026-05-20T14:38:05.879Z","avatar_url":"https://github.com/vikas-kashyap97.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🚀 Market Intelligence Agent v2.0\n\nLet me introduce a production-ready, advanced market intelligence platform powered by multi-agent AI workflows, real-time data integration, and interactive dashboards using Streamlit that automate the end-to-end process of data aggregation, insight generation, and decision support for strategic business planning.\n\n## 🌟 New Features in v2.0\n\n### 🔥 Real-Time Data Integration\n- **Firecrawl.dev**: Advanced web scraping and content extraction\n- **NewsData.io**: Real-time news aggregation and filtering\n- **Enhanced Search**: Intelligent content discovery and processing\n\n### 🤖 Multi-Agent AI Workflow\n- **Reader Agent**: Data collection and processing\n- **Analyst Agent**: Trend analysis and opportunity identification\n- **Strategist Agent**: Strategic recommendations and planning\n- **Formatter Agent**: Report generation and export\n\n\n### 📊 Interactive Dashboard\n- **Plotly Visualizations**: Dynamic, interactive charts\n- **Real-time Updates**: Live data refresh and filtering\n- **Export Options**: PDF, DOCX, JSON, and Notion integration\n\n### 🧠 AI Assistant\n- **Groq-Powered**: Fast LLaMA3 inference for instant responses\n- **Context-Aware**: Understands your analysis data\n- **Persistent Memory**: Conversation history and learning\n- **Smart Suggestions**: Relevant prompts and actions\n\n## 🛠️ Technology Stack\n\n| Component | Technology |\n|-----------|------------|\n| **Frontend** | Streamlit + Plotly + Custom Components |\n| **AI Workflow** | LangGraph + Multi-Agent Architecture |\n| **LLMs** | Google Gemini 2.0 + Groq LLaMA3 |\n| **Data Sources** | Firecrawl + NewsData.io + Tavily |\n| **Visualization** | Plotly + Matplotlib + Seaborn |\n| **Export** | ReportLab + python-docx + Notion API |\n| **Database** | SQLite + FAISS Vector Store |\n\n## 📦 Installation \u0026 Setup\n\n### 1. Clone Repository\n\\`\\`\\`bash\ngit clone \u003crepository-url\u003e\ncd market_intel_streamlit_app\n\\`\\`\\`\n\n### 2. Install Dependencies\n\\`\\`\\`bash\npip install -r requirements.txt\n\\`\\`\\`\n\n### 3. Environment Configuration\n\\`\\`\\`bash\ncp .env.example .env\n\\`\\`\\`\n\nEdit `.env` with your API keys:\n\\`\\`\\`env\n# Core APIs (Required)\nGOOGLE_API_KEY=your_google_api_key_here\n\nTAVILY_API_KEY=your_tavily_api_key_here\n\nFIRECRAWL_API_KEY=your_firecrawl_api_key_here\n\nNEWSDATA_IO_KEY=your_newsdata_io_key_here\n\nGROQ_API_KEY=your_groq_api_key_here\n\n# Optional\nNOTION_API_KEY=your_notion_api_key_here\n\\`\\`\\`\n\n### 4. API Key Setup Guide\n\n#### 🔑 Required API Keys\n\n**Google Gemini API**\n1. Visit [Google AI Studio](https://makersuite.google.com/app/apikey)\n2. Create new API key\n3. Copy to `.env` file\n\n**Tavily Search API**\n1. Visit [Tavily](https://tavily.com)\n2. Sign up and get API key\n3. Copy to `.env` file\n\n**Firecrawl API**\n1. Visit [Firecrawl.dev](https://firecrawl.dev)\n2. Sign up for account\n3. Get API key from dashboard\n4. Copy to `.env` file\n\n**NewsData.io API**\n1. Visit [NewsData.io](https://newsdata.io)\n2. Create account\n3. Get API key\n4. Copy to `.env` file\n\n**Groq API**\n1. Visit [Groq](https://groq.com)\n2. Sign up for account\n3. Get API key\n4. Copy to `.env` file\n\n## 🚀 Running the Application\n\n\\`\\`\\`bash\nstreamlit run app.py\n\\`\\`\\`\n\nThe application will open at `http://localhost:8501`\n\n## 🎯 Feature Walkthrough\n\n### 🏠 Home Tab - Multi-Agent Analysis\n- **Enhanced Input**: Query, market domain, and specific questions\n- **Advanced Options**: Data source selection and analysis depth\n- **Real-time Progress**: Live agent status and workflow tracking\n- **Quick Actions**: Direct navigation to results\n\n### 📊 Dashboard Tab - Interactive Analytics\n- **Dynamic Charts**: Plotly-powered interactive visualizations\n- **Filtering**: Real-time data filtering and exploration\n- **Multiple Views**: Trends, opportunities, strategy, and timeline\n- **Export Options**: Chart and data export functionality\n\n### 📄 Report Tab - Comprehensive Analysis\n- **Structured Reports**: AI-generated markdown reports\n- **Multiple Formats**: PDF, DOCX, and Notion export\n- **Chart Integration**: Embedded visualizations\n- **Download Options**: Complete analysis packages\n\n### 🤖 Assistant Tab - AI-Powered Chat\n- **Context-Aware**: Understands your current analysis\n- **Fast Responses**: Groq-powered instant inference\n- **Smart Suggestions**: Pre-built prompts and actions\n- **Persistent Memory**: Conversation history and learning\n\n### 📚 History Tab - Analysis Management\n- **Session Management**: Load and manage previous analyses\n- **Bulk Operations**: Export and delete multiple analyses\n- **Search \u0026 Filter**: Find specific analyses quickly\n- **Analytics**: Usage statistics and insights\n\n## 🔧 Architecture Overview\n\n### Multi-Agent Workflow\n\\`\\`\\`\nInput → Reader Agent → Analyst Agent → Strategist Agent → Formatter Agent → Output\n         ↓              ↓               ↓                  ↓\n    Data Collection  Analysis      Strategy Planning   Report Generation\n    - Web Scraping   - Trends      - Recommendations   - Charts\n    - News APIs      - Opportunities - Action Plans    - Exports\n    - Content Filter - Competitive  - Risk Assessment  - Dashboards\n\\`\\`\\`\n\n### Data Flow\n1. **Collection**: Reader Agent gathers data from multiple sources\n2. **Analysis**: Analyst Agent processes data and extracts insights\n3. **Strategy**: Strategist Agent generates recommendations and plans\n4. **Formatting**: Formatter Agent creates reports and visualizations\n5. **Interaction**: Assistant provides ongoing support and Q\u0026A\n\n## 🔍 Usage Examples\n\n### Basic Market Analysis\n1. Enter query: \"AI trends in healthcare\"\n2. Select domain: \"Healthcare\"\n3. Click \"Run Multi-Agent Analysis\"\n4. Explore results in Dashboard and Report tabs\n\n### Advanced Analysis with Assistant\n1. Complete basic analysis\n2. Go to Assistant tab\n3. Ask: \"What are the key risks in my analysis?\"\n4. Follow up: \"How can I validate these opportunities?\"\n\n### Export and Sharing\n1. Navigate to Report tab\n2. Choose export format (PDF/DOCX)\n3. Download comprehensive report\n4. Share with stakeholders\n\n## 🚀 Advanced Features\n\n### Custom Agent Configuration\n- Modify agent behavior in `core/agents/`\n- Adjust analysis depth and focus areas\n- Configure data source priorities\n\n### Integration Extensions\n- Add new data sources in `core/integrations/`\n- Implement custom export formats\n- Extend chart generation capabilities\n\n### Dashboard Customization\n- Modify visualizations in `components/ui_dashboard.py`\n- Add new chart types and filters\n- Customize metrics and KPIs\n\n## 🔧 Troubleshooting\n\n### Common Issues\n\n**API Key Errors**\n- Verify all required API keys are set in `.env`\n- Check API key validity and quotas\n- Ensure proper formatting (no extra spaces)\n\n**Import Errors**\n- Run `pip install -r requirements.txt`\n- Check Python version compatibility (3.8+)\n- Verify virtual environment activation\n\n**Performance Issues**\n- Reduce analysis depth for faster results\n- Limit data sources for quicker processing\n- Check internet connection for API calls\n\n**Chart Generation Failures**\n- Ensure sufficient data for visualization\n- Check Plotly and Matplotlib installations\n- Verify output directory permissions\n\n### Debug Mode\nEnable debug logging by setting in `.env`:\n\\`\\`\\`env\nLOG_LEVEL=DEBUG\n\\`\\`\\`\n\n## 🤝 Contributing\n\n1. Fork the repository\n2. Create feature branch: `git checkout -b feature/amazing-feature`\n3. Commit changes: `git commit -m 'Add amazing feature'`\n4. Push to branch: `git push origin feature/amazing-feature`\n5. Open Pull Request\n\n## 📄 License\n\nThis project is licensed under the MIT License - see the LICENSE file for details.\n\n## 🙏 Acknowledgments\n\n- **Google Gemini** for advanced language understanding\n- **Groq** for fast inference capabilities\n- **Firecrawl** for intelligent web scraping\n- **NewsData.io** for real-time news aggregation\n- **Streamlit** for the amazing web framework\n- **Plotly** for interactive visualizations\n- **LangChain** for AI workflow orchestration\n\n## 📞 Support\n\nFor support, questions, or feature requests:\n- Create an issue on GitHub\n- Check the troubleshooting section\n- Review the documentation\n\n## 📄 License\n\nThis project is licensed under the MIT License - see the [MIT License](LICENSE) file for details.\n\n---\n\n\n\n**🚀 Market Intelligence Agent v2.0** - Transforming market research with AI-powered multi-agent workflows.\n\\`\\`\\`\n\u003c/markdown\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvikas-kashyap97%2Fmarket-intelligence-agent","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvikas-kashyap97%2Fmarket-intelligence-agent","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvikas-kashyap97%2Fmarket-intelligence-agent/lists"}