{"id":20521297,"url":"https://github.com/asiff00/text-generation-with-tensorflow-from-scratch","last_synced_at":"2026-04-21T10:03:03.698Z","repository":{"id":228072430,"uuid":"773085969","full_name":"asiff00/Text-Generation-with-TensorFlow-from-Scratch","owner":"asiff00","description":"Text Generation with TensorFlow from Scratch","archived":false,"fork":false,"pushed_at":"2024-03-16T18:04:47.000Z","size":15,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-16T10:36:23.449Z","etag":null,"topics":["fundamentals","jupyter-notebook","llm","machine-learning","natural-language-processing","nlp","python","scratch","tensorflow","text-generation"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/asiff00.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-16T17:52:35.000Z","updated_at":"2024-03-16T18:07:23.000Z","dependencies_parsed_at":null,"dependency_job_id":"062d88f4-7cf2-478a-a421-fb2063e01763","html_url":"https://github.com/asiff00/Text-Generation-with-TensorFlow-from-Scratch","commit_stats":null,"previous_names":["himisir/text-generation-with-tensorflow-nlp-rnn","asiff00/text-generation-with-tensorflow-from-scratch"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asiff00%2FText-Generation-with-TensorFlow-from-Scratch","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asiff00%2FText-Generation-with-TensorFlow-from-Scratch/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asiff00%2FText-Generation-with-TensorFlow-from-Scratch/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asiff00%2FText-Generation-with-TensorFlow-from-Scratch/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/asiff00","download_url":"https://codeload.github.com/asiff00/Text-Generation-with-TensorFlow-from-Scratch/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":242125686,"owners_count":20075775,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["fundamentals","jupyter-notebook","llm","machine-learning","natural-language-processing","nlp","python","scratch","tensorflow","text-generation"],"created_at":"2024-11-15T22:28:02.950Z","updated_at":"2026-04-21T10:03:03.660Z","avatar_url":"https://github.com/asiff00.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\nText Generation with TensorFlow from Scratch: Understanding the Basics\n==================================================================================================================\n\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://www.kaggle.com/code/asif00/text-generation-with-tensorflow-nlp-rnn) [![TensorFlow](https://img.shields.io/badge/TensorFlow-%23FF6F00.svg?style=for-the-badge\u0026logo=TensorFlow\u0026logoColor=white)](https://www.tensorflow.org/) [![Jupyter Notebook](https://img.shields.io/badge/jupyter-%23FA0F00.svg?style=for-the-badge\u0026logo=jupyter\u0026logoColor=white)](https://jupyter.org/) [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n\nLarge language models have come a long way. Modern LLMs can generate almost anything that is humanly possible, and even things that aren't. However, at their core, they are text generators that predict the next likely words in a sequence. This notebook covers the very fundamental concepts of text generation, from corpus to tokenization, embeddings, padding, N-grams, and finally, generating text.\n\nConcepts Covered\n----------------\n\n* **Corpus**: A large collection of text that the model is trained on.\n* **Tokenization**: The process of breaking down text into smaller pieces, or 'tokens', that the model can understand.\n* **Embeddings**: A crucial step that transforms tokens into numerical vectors, allowing the model to capture semantic relationships between words.\n* **Padding**: A technique used to ensure that all sequences in a batch have the same length, making it easier for the model to process them.\n* **N-grams**: Sequences of 'n' items from a given sample of text, which are used to predict the next word in a sequence.\n* **Text Generation**: The process of using a trained model to generate new text.\n\nSimplified Explanations\n-----------------------\n\nEach of these concepts is explained in a simple and easy-to-understand manner. The goal of this notebook is to provide a clear understanding of the basics of text generation.\n\nBuilt with TensorFlow\n---------------------\n\nThis notebook uses TensorFlow for its easy-to-understand nature. TensorFlow is a popular open-source machine learning framework that makes it easy to build and deploy machine learning models.\n\nRun the Code in Kaggle\n----------------------\n\nYou can run the code in this notebook on Kaggle at the following link: [Text Generation with TensorFlow NLP RNN](https://www.kaggle.com/code/asif00/text-generation-with-tensorflow-nlp-rnn)\n\nHappy Learning!\n---------------\n\nI hope this notebook helps you understand the concepts of text generation better. Enjoy learning!\n\nLicense\n-------\n\nThis project is licensed under the MIT License - see the [LICENSE](https://opensource.org/licenses/MIT) file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fasiff00%2Ftext-generation-with-tensorflow-from-scratch","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fasiff00%2Ftext-generation-with-tensorflow-from-scratch","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fasiff00%2Ftext-generation-with-tensorflow-from-scratch/lists"}