{"id":22381036,"url":"https://github.com/t-mohamed-shafeek/piipit","last_synced_at":"2026-04-07T07:43:51.707Z","repository":{"id":266511131,"uuid":"870855287","full_name":"T-Mohamed-Shafeek/piipit","owner":"T-Mohamed-Shafeek","description":"piipit is a Hybrid PII Detection and Management Full-Stack Web Application built using my novel approach of multi-layered detection mechanism for more Accurate Detection of Personally Identifiable Information (PII) and Reduced Latency.","archived":false,"fork":false,"pushed_at":"2024-12-04T16:00:25.000Z","size":3053,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-27T02:42:52.283Z","etag":null,"topics":["css","detection","flask","full-stack-web-development","fullstack-development","gemini","html","java","llama3","llm","management","masking","pattern-matching","python","react","redaction","sqlalchemy","ui"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/T-Mohamed-Shafeek.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-10T19:39:20.000Z","updated_at":"2025-02-12T03:27:20.000Z","dependencies_parsed_at":"2024-12-04T17:18:49.242Z","dependency_job_id":"17abc5e8-470e-4ddd-8c39-bb51abcf5215","html_url":"https://github.com/T-Mohamed-Shafeek/piipit","commit_stats":null,"previous_names":["t-mohamed-shafeek/piipit"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/T-Mohamed-Shafeek/piipit","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/T-Mohamed-Shafeek%2Fpiipit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/T-Mohamed-Shafeek%2Fpiipit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/T-Mohamed-Shafeek%2Fpiipit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/T-Mohamed-Shafeek%2Fpiipit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/T-Mohamed-Shafeek","download_url":"https://codeload.github.com/T-Mohamed-Shafeek/piipit/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/T-Mohamed-Shafeek%2Fpiipit/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":272941054,"owners_count":25019030,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-31T02:00:09.071Z","response_time":79,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["css","detection","flask","full-stack-web-development","fullstack-development","gemini","html","java","llama3","llm","management","masking","pattern-matching","python","react","redaction","sqlalchemy","ui"],"created_at":"2024-12-05T00:07:06.158Z","updated_at":"2025-12-30T20:06:32.329Z","avatar_url":"https://github.com/T-Mohamed-Shafeek.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# piipit - A Hybrid PII Detection and Management Application\n\n## Project Overview\nThe Hybrid PII Detection and Management application is designed to identify and protect Personally Identifiable Information (PII) embedded in various data and document formats, including images. This application focuses specifically on government-issued documents such as Aadhaar, PAN, Driving License, Passport, MHA ID, and Credit Cards.\n\n## Key Features\n- **Multi-Format PII Detection:** Supports PDF, DOCX, TXT, CSV, and image formats.\n- **Government Document Focus:** Specializes in detecting PII in Indian government-issued documents.\n- **Alerting System:** Notifies users and data processors about the presence of PII.\n- **Pattern Matching and Context-Based Detection:** Uses regex for strong/structured PII and NLP for weak/unstructured PII.\n- **Redaction and Masking:** Provides tools to redact or mask detected PII.\n- **Secure Data Management:** Ensures secure user authentication and data handling.\n\n## Current Status\nThe project is currently 90% complete, with ongoing development in UI and feature enhancements. Testing, bug fixing, and validation processes are in progress.\n\n## Future Plans\n- Finalize the remaining features and UI improvements.\n- Conduct thorough testing and validation.\n- Prepare for potential open-source release in the future.\n\n## Technologies Used\n- **Frontend:** React.js, Chakra UI\n- **Backend:** Python, Flask Framework\n- **AI/ML:** LangChain, Groq API, Llama3.1 for NLP tasks\n- **File Processing:** PyPDF2, python-docx, Pillow, easyocr\n\n## Contact\nFor inquiries or collaboration opportunities, please reach out to me at shafeeubaidah@gmail.com.\n\n## License\nThis project is currently not open-source. Please check back later for updates on licensing and potential open-source release.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ft-mohamed-shafeek%2Fpiipit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ft-mohamed-shafeek%2Fpiipit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ft-mohamed-shafeek%2Fpiipit/lists"}