{"id":24562956,"url":"https://github.com/nicolay-r/nlp-thirdgate","last_synced_at":"2025-03-16T23:14:50.974Z","repository":{"id":273099256,"uuid":"918655354","full_name":"nicolay-r/nlp-thirdgate","owner":"nicolay-r","description":"A hub of third-party providers and tutorials to help you instantly apply various NLP techniques.","archived":false,"fork":false,"pushed_at":"2025-03-11T16:07:26.000Z","size":134,"stargazers_count":4,"open_issues_count":3,"forks_count":2,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-11T17:24:25.628Z","etag":null,"topics":["api","hub","nlp","openrouter-api","providers","python","replicate-api","third-party","third-party-api","translations"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nicolay-r.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-18T14:09:53.000Z","updated_at":"2025-03-11T16:07:29.000Z","dependencies_parsed_at":"2025-01-18T17:33:55.196Z","dependency_job_id":"9a210c72-6293-4a91-a094-28bffa8e6474","html_url":"https://github.com/nicolay-r/nlp-thirdgate","commit_stats":null,"previous_names":["nicolay-r/nlp-thirdgate"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolay-r%2Fnlp-thirdgate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolay-r%2Fnlp-thirdgate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolay-r%2Fnlp-thirdgate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nicolay-r%2Fnlp-thirdgate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nicolay-r","download_url":"https://codeload.github.com/nicolay-r/nlp-thirdgate/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243945611,"owners_count":20372897,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","hub","nlp","openrouter-api","providers","python","replicate-api","third-party","third-party-api","translations"],"created_at":"2025-01-23T09:19:38.567Z","updated_at":"2025-03-16T23:14:50.969Z","avatar_url":"https://github.com/nicolay-r.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# nlp-thirdgate [![twitter](https://img.shields.io/twitter/url/https/shields.io.svg?style=social)](https://x.com/nicolayr_/status/1900911458197623268)\n[![twitter](https://img.shields.io/twitter/url/https/shields.io.svg?style=social)](https://x.com/nicolayr_/status/1900911458197623268)\n\n\u003cp align=\"center\"\u003e\n    \u003cimg src=\"logo.png\"/\u003e\n\u003c/p\u003e\n\nA hub of [**third-party NLP providers**](#third-party-providers) and tutorials to help you instantly handle your [**data iterator**](#data-iterators) with [no-string dependency apps](#no-string-apps).\n\nThe purpose is of this project is to share **Third-party providers** that could be combined into a single [**pipeline**](#pipeline-formation).\n\n# Third-Party Providers\n\n* **LLM / [Mistral.AI](llm/mistralai_150.py)** [[🤖 models]](https://docs.mistral.ai/getting-started/models/models_overview/)\n* **LLM / [OpenRouter.AI](llm/open_router.py)** [[🤖 models]](https://openrouter.ai/models)\n* **LLM / [Replicate.IO](llm/replicate_104.py)** [[🤖 models]](https://replicate.com/pricing#language-models)\n    * DeepSeek-R1\n    * LLaMA-3-70B-Instruct\n    * LLaMA-3-8B-Instruct\n* **LLM / OpenAI**:\n    * [ChatGPT](llm/openai_156.py)\n    * [Qwen-2.5-Max](https://github.com/nicolay-r/nlp-thirdgate/blob/master/tutorials/llm_qwen_25_max_chat.sh)\n    * [o1](llm/openai_o1.py)\n* **LLM / Transformers**:\n    * DeepSeek-R1-distill-7b [[📙 qwen-notebook]](tutorials/llm_deep_seek_7b_distill_qwen2.ipynb)\n      [[📙 llama3-notebook]](tutorials/llm_deep_seek_7b_distill_llama3.ipynb)\n    * [LLaMA-3](llm/transformers_llama.py)\n    * [Qwen-2](llm/transformers_qwen2.py)\n    * [Phi-4](llm/transformers_phi4.py)\n    * [Gemma-3](llm/transformers_gemma3.py) [[📙 notebook]](tutorials/llm_gemma_3.ipynb)\n    * [Flan-T5](llm/transformers_flan_t5.py)\n    * [Mistral](llm/transformers_mistral.py)\n* **NER / [DeepPavlov](ner/dp_130.py)** [[📙 notebook]](tutorials/ner_deeppavlov_130.ipynb)\n* **NER / [Flair](ner/flair_0151.py)** [[bash-script]](tutorials/ner_flair_0151.sh) [[🤖 models]](https://huggingface.co/flair)\n* **NER / [Spacy](ner/spacy_383.py)** [[bash-script]](tutorials/ner_spacy_383.sh) [[🤖 models]](https://huggingface.co/spacy)\n* **Translation / [GoogleTranslator](text-translation/googletrans_310a.py)** [[📙 notebook]](tutorials/translate_texts_with_spans_via_googletrans.ipynb)\n\n\n# Data Iterators\n\nIn this project we consider that each provider represent a wrapper over third-party app to handle iterator of data.\nWe consider `dict` python type for representing each record of the data.\n\n# Pipeline Formation\n\nIf you wish to use several [third-party providers](#third-party-providers) all together for a \n[data-iterators](#data-iterators), it is recommented to adopt [`AREkit` framework](https://github.com/nicolay-r/AREkit) as a no-string solution for deploying pipeline that support batching mode.\n\n# No-string Application\n\n* [bulk-chain](https://github.com/nicolay-r/bulk-chain) -- framework for reasoning over your tabular data rows with any provided LLM\n* [bulk-ner](https://github.com/nicolay-r/bulk-ner) -- framework for a quick third-party models binding for entities extraction from cells of long tabular data\n* [bulk-translate](https://github.com/nicolay-r/bulk-translate) --  framework for translation of a massive stream of texts with native support of pre-annotated fixed-spans that are invariant for translator.\n* [AREkit pipelines](https://github.com/nicolay-r/AREkit) -- toolkit for handling your textual data iterators with various NLP providers\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnicolay-r%2Fnlp-thirdgate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnicolay-r%2Fnlp-thirdgate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnicolay-r%2Fnlp-thirdgate/lists"}