{"id":21232270,"url":"https://github.com/danibcorr/wattpad-mate","last_synced_at":"2026-01-05T06:50:02.119Z","repository":{"id":274157252,"uuid":"912506821","full_name":"danibcorr/wattpad-mate","owner":"danibcorr","description":"📚 A tool to explore Wattpad, gather insights, and engage with users for meaningful interactions.","archived":false,"fork":false,"pushed_at":"2025-01-25T09:41:25.000Z","size":851,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-25T10:24:16.560Z","etag":null,"topics":["beautifulsoup","python","scraping","streamlit","wattpad"],"latest_commit_sha":null,"homepage":"https://wattpad-mate.streamlit.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/danibcorr.png","metadata":{},"created_at":"2025-01-05T19:01:28.000Z","updated_at":"2025-01-25T09:41:28.000Z","dependencies_parsed_at":null,"dependency_job_id":"1b1080af-b07a-4d1b-b1bc-10439d1615f1","html_url":"https://github.com/danibcorr/wattpad-mate","commit_stats":null,"previous_names":["danibcorr/wattpad-mate"],"tags_count":null,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danibcorr%2Fwattpad-mate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danibcorr%2Fwattpad-mate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danibcorr%2Fwattpad-mate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danibcorr%2Fwattpad-mate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/danibcorr","download_url":"https://codeload.github.com/danibcorr/wattpad-mate/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245294705,"owners_count":20591898,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","python","scraping","streamlit","wattpad"],"created_at":"2024-11-20T23:50:18.553Z","updated_at":"2026-01-05T06:50:02.093Z","avatar_url":"https://github.com/danibcorr.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# **📚 Wattpad Mate**\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"images/app_image.png\" alt=\"Project interface\"/\u003e\n\u003c/p\u003e\n\nWelcome to **Wattpad Mate**! This tool helps you connect with users who share similar interests on Wattpad.\n\n## **📋 What is Wattpad Mate?**\n\nWattpad Mate is a handy Streamlit app that extracts data from Wattpad pages. It filters results based on visits and votes, then displays them in a Pandas data frame. You can view a list of top-voted users by category and interact with them directly through their profiles. Remember, this project is for educational purposes only and does not store any user data.\n\n## **🕹️ Usage**\n\n1. **Clone the Repository:** Start by cloning this repository. Make sure you have Docker installed on your machine to deploy this project.\n\n2. **Set Up with Docker:** After cloning, launch the Docker Compose file with the command `docker compose up`. Docker will automatically set up the container and install all necessary libraries.\n\n3. **Access the App:** Once the program is running, check your IP address. The service will be available on port 8501. Go to the app's web interface and enter the URL of the Wattpad page you want to scrape. Set your filters for minimum and maximum views and votes.\n\n4. **Start Scraping:** Click the \"Start Scraping\" button to begin. The app will process the data and show you the results in a Pandas data frame.\n\n## **🔧 Technologies**\n\n- **Streamlit:** For creating and deploying the web app.\n- **Docker:** To containerize the project.\n- **Poetry:** For managing project dependencies.\n- **Black:** To automatically format and clean up Python code.\n- **Pandas \u0026 NumPy:** For ETL (Extract, Transform, Load) processes of Wattpad data.\n- **BeautifulSoup \u0026 Selenium:** For scraping data from Wattpad, as there is no API available.\n- **Loguru:** For logging and managing application logs.\n- **pytest:** For testing the application.\n- **GitHub Actions:** Automates workflows and CI/CD processes.\n  \n## **⚠️ Note**\n\nThis app is meant for educational use only. It does not store user data and should not be used to scrape data from Wattpad without their explicit permission. Please respect Wattpad’s terms of service and use this tool responsibly. We disclaim any responsibility for misuse or unauthorized data scraping.\n\nEnjoy exploring Wattpad and connecting with like-minded users!","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanibcorr%2Fwattpad-mate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdanibcorr%2Fwattpad-mate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanibcorr%2Fwattpad-mate/lists"}