{"id":20377578,"url":"https://github.com/reshalfahsi/neural-machine-translation","last_synced_at":"2025-03-04T21:44:26.462Z","repository":{"id":188422452,"uuid":"678716188","full_name":"reshalfahsi/neural-machine-translation","owner":"reshalfahsi","description":"English-To-German Neural Machine Translation Using Transformer","archived":false,"fork":false,"pushed_at":"2023-08-17T00:14:51.000Z","size":360,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-15T07:14:44.044Z","etag":null,"topics":["machine-translation","multi30k","natural-language-processing","neural-machine-translation","nlp","pytorch-lightning","text-processing","transformer"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/reshalfahsi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-08-15T07:46:32.000Z","updated_at":"2024-04-23T21:27:58.000Z","dependencies_parsed_at":"2025-01-15T06:37:40.336Z","dependency_job_id":"05a55415-bd91-426e-bd90-bcfcee70e8e6","html_url":"https://github.com/reshalfahsi/neural-machine-translation","commit_stats":null,"previous_names":["reshalfahsi/neural-machine-translation"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reshalfahsi%2Fneural-machine-translation","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reshalfahsi%2Fneural-machine-translation/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reshalfahsi%2Fneural-machine-translation/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reshalfahsi%2Fneural-machine-translation/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/reshalfahsi","download_url":"https://codeload.github.com/reshalfahsi/neural-machine-translation/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241928532,"owners_count":20043821,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["machine-translation","multi30k","natural-language-processing","neural-machine-translation","nlp","pytorch-lightning","text-processing","transformer"],"created_at":"2024-11-15T01:45:40.053Z","updated_at":"2025-03-04T21:44:26.440Z","avatar_url":"https://github.com/reshalfahsi.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# English-To-German Neural Machine Translation Using Transformer\n\n\n \u003cdiv align=\"center\"\u003e\n    \u003ca href=\"https://colab.research.google.com/github/reshalfahsi/neural-machine-translation/blob/master/EN_DE_Neural_Machine_Translation.ipynb\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"colab\"\u003e\u003c/a\u003e\n    \u003cbr /\u003e\n \u003c/div\u003e\n\n\nNeural Machine Translation (NMT) is a family model or an approach to solving machine translation problems through an artificial neural network, typically deep learning. In other words, the model is dispatched to translate a sequence of words from the source language to the target language. In this case, the source language would be English and the target would be German. To fabricate the model, the Transformer layers are leveraged. The NMT model is trained on the Multi30K dataset. The model is then assessed on a subset of the dataset, which is the Flickr 2016 test dataset.\n\n\n## Experiment\n\n\nFollow this [link](https://github.com/reshalfahsi/neural-machine-translation/blob/master/EN-DE_Neural_Machine_Translation.ipynb) to play along and explore the NMT model.\n\n\n## Result\n\n## Quantitative Result\n\nThe performance of the model in terms of cross-entropy loss and translation edit rate (TER) on the test dataset.\n\nMetrics | Score |\n------------ | ------------- |\nLoss | 1.951 |\nTER | 0.811 |\n\n\n## Loss Curve\n\n\u003cp align=\"center\"\u003e \u003cimg src=\"https://github.com/reshalfahsi/neural-machine-translation/blob/master/assets/loss_curve.png\" alt=\"loss_curve\" \u003e \u003cbr /\u003e Loss of training and validation versus the epochs. \u003c/p\u003e\n\n## Qualitative Result\n\nHere, the NMT model's qualitative performance is associated with the Transformer's attention maps.\n\n\u003cp align=\"center\"\u003e \u003cimg src=\"https://github.com/reshalfahsi/neural-machine-translation/blob/master/assets/qualitative_result.png\" alt=\"qualitative_result\"\u003e \u003cbr /\u003e The attention maps from each of the Transformer's heads. Almost every corresponding word pair (English-German) at each head pays attention mutually. \u003c/p\u003e\n\n\n## Credit\n\n- [Language Translation With TorchText](https://pytorch.org/tutorials/beginner/torchtext_translation_tutorial.html)\n- [6 - Attention is All You Need Notebook Tutorial](https://github.com/bentrevett/pytorch-seq2seq/blob/master/6%20-%20Attention%20is%20All%20You%20Need.ipynb)\n- [Multi30K Dataset](https://github.com/multi30k/dataset)\n- [Attention Is All You Need](https://arxiv.org/abs/1706.03762)\n- [Self-Attention and Positional Encoding](https://d2l.ai/chapter_attention-mechanisms-and-transformers/self-attention-and-positional-encoding.html)\n- [PyTorch Lightning](https://lightning.ai/docs/pytorch/latest/)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Freshalfahsi%2Fneural-machine-translation","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Freshalfahsi%2Fneural-machine-translation","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Freshalfahsi%2Fneural-machine-translation/lists"}