{"id":16780085,"url":"https://github.com/hk669/research-agent","last_synced_at":"2026-05-09T18:34:27.172Z","repository":{"id":226063130,"uuid":"767640903","full_name":"Hk669/research-agent","owner":"Hk669","description":"research agent, which helps fetch and summarize the articles from internet ","archived":false,"fork":false,"pushed_at":"2024-03-06T06:42:43.000Z","size":1100,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-16T20:12:39.974Z","etag":null,"topics":["agent","ai","langchain","research-agent","streamlit"],"latest_commit_sha":null,"homepage":"https://research-agent-669.streamlit.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Hk669.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-05T16:49:56.000Z","updated_at":"2025-01-03T06:13:03.000Z","dependencies_parsed_at":"2024-11-22T20:38:27.717Z","dependency_job_id":null,"html_url":"https://github.com/Hk669/research-agent","commit_stats":null,"previous_names":["hk669/research-agent"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Hk669/research-agent","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hk669%2Fresearch-agent","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hk669%2Fresearch-agent/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hk669%2Fresearch-agent/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hk669%2Fresearch-agent/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Hk669","download_url":"https://codeload.github.com/Hk669/research-agent/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hk669%2Fresearch-agent/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32831039,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-08T08:22:46.396Z","status":"online","status_checked_at":"2026-05-09T02:00:06.633Z","response_time":123,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agent","ai","langchain","research-agent","streamlit"],"created_at":"2024-10-13T07:33:59.606Z","updated_at":"2026-05-09T18:34:27.139Z","avatar_url":"https://github.com/Hk669.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n\nhttps://github.com/Hk669/research-agent/assets/96101829/d1938a0a-9c8f-43b1-9c34-bfd137d73775\n\n# Research Agent\n\nThe Research Agent is an AI-powered tool designed to assist users in conducting research by \nsearching for information, finding relevant articles, and summarizing them automatically. This tool \nutilizes advanced natural language processing (NLP) techniques and web scraping to provide users \nwith concise summaries of relevant articles on their chosen topics.\n\n\n## Features\n\n### 1. Search Functionality\nUsers can enter their research query into the search bar provided in the Streamlit app. The Research \nAgent then utilizes the Google SERPER API to perform a search query and retrieve relevant articles \nbased on the user's input.\n\n### 2. Article Preview\nOnce the search results are obtained, the Research Agent displays a list of relevant articles along \nwith their titles and URLs. Additionally, it uses the Linkpreview library to fetch a preview of each \narticle, including the title, description, and thumbnail image (if available), providing users with \na quick overview of each article's content.\n\n### 3. Summarization\nAfter selecting an article from the list, users can click on the URL to view the full article. The \nResearch Agent then uses Selenium to scrape the text content of the article from the webpage. Once \nthe text content is obtained, it applies recursive character text splitting to break down the \narticle into smaller chunks suitable for processing.\n\n### 4. Automatic Summarization\nUsing Langchain and OpenAI's GPT-3.5 model, the Research Agent generates a concise summary of the \nrticle's content. This summary is presented to the user within the Streamlit app, allowing them to \nquickly grasp the main points of the article without having to read through the entire text.\n\n## Installation\n\n1. Clone the repository:\n\n```bash\ngit clone https://github.com/Hk669/research-agent.git\ncd research-agent\n```\n\n2. Install dependencies:\n\n```bash\npip install -r requirements.txt\n```\n\n3. Set up environment variables:\n\nCreate a `.env` file in the root directory and add your SERPER and OpenAI API keys:\n\n```\nSERPER=your_serper_api_key\nAPI_KEY=your_openai_api_key\n```\n\n## Usage\n\n1. Run the Streamlit app:\n\n```bash\nstreamlit run agent.py\n```\n\n2. Enter your query in the text input field and click the \"Search\" button.\n\n3. The app will display a list of relevant articles along with their titles and URLs.\n\n4. Click on the URL to view the full article.\n\n5. The app will generate a concise summary of the articles.\n\n## Technologies Used\n\n- Python\n- Streamlit\n- Selenium\n- Langchain\n- Linkpreview\n\n\n## License\n\nThis project is licensed under the [MIT License](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhk669%2Fresearch-agent","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhk669%2Fresearch-agent","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhk669%2Fresearch-agent/lists"}