{"id":18745651,"url":"https://github.com/scrapegraphai/scrapegraph-demo","last_synced_at":"2025-04-04T06:09:21.707Z","repository":{"id":223708419,"uuid":"760342922","full_name":"ScrapeGraphAI/Scrapegraph-demo","owner":"ScrapeGraphAI","description":"Streamlit demo of Scrapegraph-ai for GPT4-hackaton","archived":false,"fork":false,"pushed_at":"2025-04-02T21:15:32.000Z","size":2058,"stargazers_count":98,"open_issues_count":0,"forks_count":127,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-04-03T05:42:50.144Z","etag":null,"topics":["llm","openai-hackathon","rag","streamlit"],"latest_commit_sha":null,"homepage":"https://scrapegraph-ai-demo.streamlit.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ScrapeGraphAI.png","metadata":{"files":{"readme":"Readme.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"custom":["https://www.paypal.me/MarcoVinciguerra00"]}},"created_at":"2024-02-20T08:42:05.000Z","updated_at":"2025-04-02T21:15:35.000Z","dependencies_parsed_at":"2024-03-15T22:26:13.263Z","dependency_job_id":"903e829d-6e14-43e7-b866-b1c96877084f","html_url":"https://github.com/ScrapeGraphAI/Scrapegraph-demo","commit_stats":{"total_commits":357,"total_committers":8,"mean_commits":44.625,"dds":"0.18487394957983194","last_synced_commit":"9fe3363ee9f6e48d4d9f5f89ac7ae9e9dd5121b0"},"previous_names":["vincigit00/hackaton","vincigit00/scrapegraph-lablabai-hackathon","scrapegraphai/scrapegraph-lablabai-hackathon","scrapegraphai/scrapegraph-demo"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScrapeGraphAI%2FScrapegraph-demo","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScrapeGraphAI%2FScrapegraph-demo/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScrapeGraphAI%2FScrapegraph-demo/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScrapeGraphAI%2FScrapegraph-demo/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ScrapeGraphAI","download_url":"https://codeload.github.com/ScrapeGraphAI/Scrapegraph-demo/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247128752,"owners_count":20888235,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["llm","openai-hackathon","rag","streamlit"],"created_at":"2024-11-07T16:19:01.039Z","updated_at":"2025-04-04T06:09:21.685Z","avatar_url":"https://github.com/ScrapeGraphAI.png","language":"Python","readme":"# 🕷️ ScrapeGraphAI: You Only Scrape Once\n\nScrapeGraphAI is a *web scraping* python library based on LangChain which uses LLM and direct graph logic to create scraping pipelines.\nJust say which information you want to extract and the library will do it for you!\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/VinciGit00/Scrapegraph-LabLabAI-Hackathon/blob/main/docs/scrapegraphai_logo.png\" alt=\"Scrapegraph-ai Logo\" style=\"width: 30%;\"\u003e\n\u003c/p\u003e\n\n## 🔗 ScrapeGraph API \u0026 SDKs\nIf you are looking for a quick solution to integrate ScrapeGraph in your system, check out our powerful API [here!](https://dashboard.scrapegraphai.com/login)\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://raw.githubusercontent.com/VinciGit00/Scrapegraph-ai/main/docs/assets/api-banner.png\" alt=\"ScrapeGraph API Banner\" style=\"width: 70%;\"\u003e\n\u003c/p\u003e\n\nWe offer SDKs in both Python and Node.js, making it easy to integrate into your projects. Check them out below:\n\n| SDK       | Language | GitHub Link                                                                 |\n|-----------|----------|-----------------------------------------------------------------------------|\n| Python SDK | Python   | [scrapegraph-py](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-py) |\n| Node.js SDK | Node.js  | [scrapegraph-js](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-js) |\n\n## Official Demo for Scrapegraph-ai Library \nThis repo is a streamlit demo/trial for the offcial Github Library Scrapegraph-ai.\n\nLink of the developed library for the hackathon Github repo:\n\n[![My Skills](https://skillicons.dev/icons?i=github)](https://github.com/VinciGit00/Scrapegraph-ai)\n\nOfficial streamlit demo:\n\n[![My Skills](https://skillicons.dev/icons?i=react)](https://scrapegraph-demo-demo.streamlit.app)\n\n## Example of output with TruLens\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/VinciGit00/Scrapegraph-LabLabAI-Hackathon/blob/main/assets/Trulens.png\" alt=\"Scrapegraph-ai Logo\" style=\"width: 60%;\"\u003e\n\u003c/p\u003e\n\n## Local execution\nIs it possible to run in local this project using python with the command on your terminal with:\n\n\n```bash\nstreamlit run main.py\n```\n\n## 🤝 Contributing\n\nScrapegraph-ai is [MIT LICENSED](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/LICENSE).\n\nContributions are welcome! Please check out the todos below, and feel free to open a pull request.\n\nFor more information, please see the [contributing guidelines](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/CONTRIBUTING.md).\n\nJoin our Discord server to discuss with us improvements and give us suggestions!\n\n[![My Skills](https://skillicons.dev/icons?i=discord)](https://discord.gg/gkxQDAjfeX)\n\nYou can also follow all the updates on linkedin!\n\n[![My Skills](https://skillicons.dev/icons?i=linkedin)](https://www.linkedin.com/company/scrapegraphai/)\n\n\n## Contributors\n[![Contributors](https://contrib.rocks/image?repo=VinciGit00/Scrapegraph-ai)](https://github.com/VinciGit00/Scrapegraph-ai/graphs/contributors)\n\n## Authors\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/VinciGit00/Scrapegraph-LabLabAI-Hackathon/blob/main/docs/logo_authors.png\" alt=\"Authors Logos\"\u003e\n\u003c/p\u003e\n\n|                    | Contact Info         |\n|--------------------|----------------------|\n| Marco Vinciguerra  | [![Linkedin Badge](https://img.shields.io/badge/-Linkedin-blue?style=flat\u0026logo=Linkedin\u0026logoColor=white)](https://www.linkedin.com/in/marco-vinciguerra-7ba365242/)    |\n| Marco Perini       | [![Linkedin Badge](https://img.shields.io/badge/-Linkedin-blue?style=flat\u0026logo=Linkedin\u0026logoColor=white)](https://www.linkedin.com/in/perinim/)   |\n| Lorenzo Padoan     | [![Linkedin Badge](https://img.shields.io/badge/-Linkedin-blue?style=flat\u0026logo=Linkedin\u0026logoColor=white)](https://www.linkedin.com/in/lorenzo-padoan-4521a2154/)  |\n\n## Acknowledgements\n\n- We would like to thank all the contributors to the project and the open-source community for their support.\n- ScrapeGraphAI is meant to be used for data exploration and research purposes only. We are not responsible for any misuse of the library.\n","funding_links":["https://www.paypal.me/MarcoVinciguerra00"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fscrapegraphai%2Fscrapegraph-demo","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fscrapegraphai%2Fscrapegraph-demo","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fscrapegraphai%2Fscrapegraph-demo/lists"}