{"id":25096425,"url":"https://github.com/aksherwal/editnpress","last_synced_at":"2026-04-29T19:34:13.519Z","repository":{"id":226954019,"uuid":"769645883","full_name":"Aksherwal/EditNPress","owner":"Aksherwal","description":"This project is a flask based web app which scrapes the news text from a news website and clean it, analyse it and show filtered text without any ads.","archived":false,"fork":false,"pushed_at":"2025-12-06T07:02:54.000Z","size":7572,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-12-10T00:49:41.816Z","etag":null,"topics":["beautifulsoup4","flask","html-css-javascript","nltk","text-processing","textcleaning","webscraping"],"latest_commit_sha":null,"homepage":"https://editnpress.onrender.com/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Aksherwal.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-03-09T16:55:00.000Z","updated_at":"2025-12-06T07:02:50.000Z","dependencies_parsed_at":null,"dependency_job_id":"b986cf68-d6f1-4edb-948f-cdf1d46e2881","html_url":"https://github.com/Aksherwal/EditNPress","commit_stats":null,"previous_names":["aksherwal/editnpress"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Aksherwal/EditNPress","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Aksherwal%2FEditNPress","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Aksherwal%2FEditNPress/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Aksherwal%2FEditNPress/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Aksherwal%2FEditNPress/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Aksherwal","download_url":"https://codeload.github.com/Aksherwal/EditNPress/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Aksherwal%2FEditNPress/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32441272,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-29T18:12:22.909Z","status":"ssl_error","status_checked_at":"2026-04-29T18:11:33.322Z","response_time":110,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","flask","html-css-javascript","nltk","text-processing","textcleaning","webscraping"],"created_at":"2025-02-07T16:34:09.061Z","updated_at":"2026-04-29T19:34:13.496Z","avatar_url":"https://github.com/Aksherwal.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n# EditNpress - News Content Extraction and Analysis\n\nEditNpress is a web application that allows users to extract and analyze news content from the Indian Express website. It provides a simple interface for users to input a news article URL, which is then processed, cleaned, and stored in a PostgreSQL database. The application also provides various metrics and visualizations related to the news content.\n\n### Live Demo\n[Click Here](https://editnpress.onrender.com/)\n## Features\n\n1. **URL Validation**: The application checks the validity of the input URL and ensures that it is from the Indian Express website.\n2. **Text Cleaning**: The application uses Natural Language Processing (NLP) techniques to clean the extracted text, removing unnecessary elements such as HTML tags, advertisements, and formatting.\n3. **Content Analysis**: The application provides various metrics about the news content, including word count, sentence count, stop words count, and the most frequent words.\n4. **Part-of-Speech (POS) Tagging**: The application uses the Universal POS Tagging scheme to analyze the part-of-speech tags in the news content.\n5. **Data Storage**: The application stores the processed news content in a PostgreSQL database, allowing for easy retrieval and analysis.\n6. **Admin Dashboard**: The application provides an admin dashboard where authorized users can view the entire history of processed news content and clear the database if necessary.\n7. **Authentication**: The application uses Google OAuth 2.0 for user authentication, allowing for secure access to the admin dashboard.\n\n## Technologies Used\n\n- **Backend**: Flask (Python web framework), PostgreSQL (database), Authlib (Google OAuth 2.0 integration)\n- **Frontend**: HTML, CSS, JavaScript\n- **NLP**: NLTK (Natural Language Toolkit)\n- **Web Scraping**: BeautifulSoup, urllib\n\n## Installation and Setup\n\n1. Clone the repository:\n```\ngit clone https://github.com/Aksherwal/EditNPress.git\n```\n2. Create a virtual environment and activate it:\n```\npython -m venv env\nsource env/bin/activate\n```\n3. Install the required dependencies:\n```\npip install -r requirements.txt\n```\n4. Set up the PostgreSQL database:\n   - Install and configure PostgreSQL on your system.\n   - Create a new database and user for the application.\n   - Update the database connection details in the `main.py` file.\n5. Set up the Google OAuth 2.0 credentials:\n   - Create a new Google Cloud project and enable the Google OAuth 2.0 API.\n   - Obtain the client ID and client secret and update them in the `main.py` file.\n6. Run the application:\n```\npython main.py\n```\n7. Access the application in your web browser at `http://localhost:5000`.\n\n## Usage\n\n1. Visit the home page and enter the URL of the news article you want to analyze.\n2. The application will process the content, store it in the database, and display the results.\n3. To access the admin dashboard, click on the \"Admin\" link and log in using the pre-defined admin credentials.\n4. In the admin dashboard, you can view the full history of processed news content and clear the database if necessary.\n\n## Contributing\n\nIf you find any issues or have suggestions for improvements, please feel free to create a new issue or submit a pull request. Contributions are always welcome!\n\n## License\n\nThis project is licensed under the [MIT License](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faksherwal%2Feditnpress","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faksherwal%2Feditnpress","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faksherwal%2Feditnpress/lists"}