{"id":31649333,"url":"https://github.com/subhadipsinha722133/duplicate-question-nlp","last_synced_at":"2025-10-07T07:42:24.309Z","repository":{"id":310821142,"uuid":"1041348330","full_name":"subhadipsinha722133/Duplicate-Question-NLP","owner":"subhadipsinha722133","description":"The \"Duplicate Question Pairs\" task in Natural Language Processing (NLP) involves determining whether two questions have the same meaning, even if they are phrased differently. The goal is to identify semantic equivalence, not just word-for-word similarity.","archived":false,"fork":false,"pushed_at":"2025-09-19T09:59:26.000Z","size":2785,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-09-19T11:48:37.250Z","etag":null,"topics":["deep-learning","keras","nlp-machine-learning","sklearn","tensorflow"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/subhadipsinha722133.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-08-20T11:02:14.000Z","updated_at":"2025-09-19T09:59:30.000Z","dependencies_parsed_at":"2025-08-20T13:33:20.730Z","dependency_job_id":null,"html_url":"https://github.com/subhadipsinha722133/Duplicate-Question-NLP","commit_stats":null,"previous_names":["subhadipsinha722133/duplicate-question-nlp"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/subhadipsinha722133/Duplicate-Question-NLP","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/subhadipsinha722133%2FDuplicate-Question-NLP","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/subhadipsinha722133%2FDuplicate-Question-NLP/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/subhadipsinha722133%2FDuplicate-Question-NLP/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/subhadipsinha722133%2FDuplicate-Question-NLP/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/subhadipsinha722133","download_url":"https://codeload.github.com/subhadipsinha722133/Duplicate-Question-NLP/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/subhadipsinha722133%2FDuplicate-Question-NLP/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278740831,"owners_count":26037480,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-07T02:00:06.786Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","keras","nlp-machine-learning","sklearn","tensorflow"],"created_at":"2025-10-07T07:42:18.815Z","updated_at":"2025-10-07T07:42:24.296Z","avatar_url":"https://github.com/subhadipsinha722133.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Duplicate-Question-NLP\nThe \"Duplicate Question Pairs\" task in Natural Language Processing (NLP) involves determining whether two questions have the same meaning, even if they are phrased differently. The goal is to identify semantic equivalence, not just word-for-word similarity.\n![Project Sample] ( https://drive.google.com/file/d/1Kh53CAixypLCEINCyBtOMUJV8abLAMGp/view?usp=drive_link )\n\n## Project Features\n\n- **Semantic Equivalence Detection:** Uses NLP models to determine if a pair of questions are duplicates.\n- **Jupyter Notebook Implementation:** Main workflow and experiments are provided as notebooks.\n- **Preprocessing Pipelines:** Includes text cleaning, tokenization, and feature engineering.\n- **Model Training \u0026 Evaluation:** Covers various machine learning models for duplicate detection.\n\n## Main Files to Highlight\n\n- `data/`: Contains datasets used for training and evaluation.\n- `notebooks/`: Jupyter Notebooks for data exploration, preprocessing, model training, and analysis.\n- `requirements.txt`: List of Python dependencies.\n- `README.md`: Project overview and instructions.\n\n## Setup \u0026 Usage Instructions\n\n1. **Clone the Repository**\n   ```bash\n   git clone https://github.com/subhadipsinha722133/Duplicate-Question-NLP.git\n   cd Duplicate-Question-NLP\n   ```\n\n2. **Install Dependencies**\n   ```bash\n   pip install -r requirements.txt\n   ```\n\n3. **Run Jupyter Notebooks**\n   ```bash\n   jupyter notebook\n   ```\n   - Open any notebook in the `notebooks/` directory to get started.\n\n## Dataset \u0026 Model Details\n\n- **Dataset:** Commonly uses the Quora Question Pairs dataset (or similar) for training and evaluation. Please place your dataset in the `data/` folder.\n- **Models:** Implements models such as Logistic Regression, Random Forest, and advanced NLP models (e.g., TF-IDF, word embeddings).\n- **Evaluation Metrics:** Accuracy, Precision, Recall, F1 Score.\n\n## Author \u0026 Contact\n\n- **Author:** Subhadip Sinha\n- **GitHub:** [subhadipsinha722133](https://github.com/subhadipsinha722133)\n- **Email:** [sinhasunhadip34@gmail.com]\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsubhadipsinha722133%2Fduplicate-question-nlp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsubhadipsinha722133%2Fduplicate-question-nlp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsubhadipsinha722133%2Fduplicate-question-nlp/lists"}