Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/gmihaila/ml_things
This is where I put things I find useful that speed up my work with Machine Learning. Ever looked in your old projects to reuse those cool functions you created before? Well, this repo is designed to be a Python Library of functions I created in my previous project that can be reused. I also share some Notebooks Tutorials and Python Code Snippets.
https://github.com/gmihaila/ml_things
google-colab machine-learning nlp nlp-machine-learning notebooks python-snippets pytorch snippets transformer
Last synced: about 1 month ago
JSON representation
This is where I put things I find useful that speed up my work with Machine Learning. Ever looked in your old projects to reuse those cool functions you created before? Well, this repo is designed to be a Python Library of functions I created in my previous project that can be reused. I also share some Notebooks Tutorials and Python Code Snippets.
- Host: GitHub
- URL: https://github.com/gmihaila/ml_things
- Owner: gmihaila
- License: apache-2.0
- Created: 2018-05-26T17:41:22.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2022-04-06T22:56:22.000Z (over 2 years ago)
- Last Synced: 2024-09-27T13:41:03.653Z (about 1 month ago)
- Topics: google-colab, machine-learning, nlp, nlp-machine-learning, notebooks, python-snippets, pytorch, snippets, transformer
- Language: Jupyter Notebook
- Homepage: https://gmihaila.github.io
- Size: 78.2 MB
- Stars: 252
- Watchers: 8
- Forks: 61
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Machine Learning Things
[](https://app.circleci.com/pipelines/github/gmihaila/ml_things)
[]()
[](https://opensource.org/licenses/Apache-2.0)
[]()
[](https://gmihaila.github.io/ml_things/)
[](https://github.com/gmihaila/ml_things/actions/workflows/pages/pages-build-deployment)
**Machine Learning Things** is a lightweight python library that contains functions and code snippets that
I use in my everyday research with Machine Learning, Deep Learning, NLP.
I created this repo because I was tired of always looking up same code from older projects and I wanted to gain some experience in building a Python library.
By making this available to everyone it gives me easy access to code I use frequently and it can help others in their machine learning work.
If you find any bugs or something doesn't make sense please feel free to open an issue.
That is not all! This library also contains Python code snippets and notebooks that speed up my Machine Learning workflow.
**Note:**
* **Update:** `Feb 5, 2022` Thank you all again for your support and kindness! This package is available on pypi now! `pip install ml-things`
* **Update:** `July 16, 2021` Thank you all for your support and kindness! As I promissed I will move this repo to pip install modules.
* If I reach 100 stars I will release the first official version and add it to the pip install modules!
# Table of contents
* **[ML_things](https://github.com/gmihaila/ml_things#ml_things)**:
* **[Installation](https://github.com/gmihaila/ml_things#installation)** Details on how to install **ml_things**.
* **[Array Functions](https://github.com/gmihaila/ml_things#array-functions)** Details on the **ml_things** array related functions:
* [pad_array](https://github.com/gmihaila/ml_things#pad_array-source)
* [batch_array](https://github.com/gmihaila/ml_things#batch_array-source)
* **[Plot Functions](https://github.com/gmihaila/ml_things#plot-functions)** Details on the **ml_things** plot related functions:
* [plot_array](https://github.com/gmihaila/ml_things#plot_array-source)
* [plot_dict](https://github.com/gmihaila/ml_things#plot_dict-source)
* [plot_confusion_matrix](https://github.com/gmihaila/ml_things#plot_confusion_matrix-source)
* **[Text Functions](https://github.com/gmihaila/ml_things#text-functions)** Details on the **ml_things** text related functions:
* [clean_text](https://github.com/gmihaila/ml_things#clean_text-source)
* **[Web Related](https://github.com/gmihaila/ml_things#web-related)** Details on the **ml_things** web related functions:
* [download_from](https://github.com/gmihaila/ml_things#download_from-source)
* **[Snippets](https://github.com/gmihaila/ml_things#snippets)**: Curated list of Python snippets I frequently use.
* **[Comments](https://github.com/gmihaila/ml_things#comments)**: Sample on how I like to comment my code. It is still a work in progress.
* **[Notebooks Tutorials](https://github.com/gmihaila/ml_things#notebooks-tutorials)**: Machine learning projects that I converted to tutorials and posted online.
* **[Final Note](https://github.com/gmihaila/ml_things#final-note)**: Being grateful.
# ML_things
## Installation
This repo is tested with Python 3.6+.
It's always good practice to install `ml_things` in a [virtual environment](https://docs.python.org/3/library/venv.html). If you guidance on using Python's virtual environments you can check out the user guide [here](https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/).
You can install `ml_things` with pip from GitHub:
```bash
pip install git+https://github.com/gmihaila/ml_things
```
Or from pypi:
```bash
pip install ml-things
```
## Functions
All function implemented in the **ml_things** module.
### Array Functions
Array manipulation related function that can be useful when working with machine learning.
#### pad_array [[source]](https://github.com/gmihaila/ml_things/blob/master/src/ml_things/array_functions.py#L21)
Pad variable length array to a fixed numpy array. It can handle single arrays [1,2,3] or nested arrays [[1,2],[3]].
By default it will padd zeros to the maximum length of row detected:
```python
>>> from ml_things import pad_array
>>> pad_array(variable_length_array=[[1,2],[3],[4,5,6]])
array([[1., 2., 0.],
[3., 0., 0.],
[4., 5., 6.]])
```
It can also pad to a custom size and with cusotm values:
```python
>>> pad_array(variable_length_array=[[1,2],[3],[4,5,6]], fixed_length=5, pad_value=99)
array([[ 1., 2., 99., 99., 99.],
[ 3., 99., 99., 99., 99.],
[ 4., 5., 6., 99., 99.]])
```
#### batch_array [[source]](https://github.com/gmihaila/ml_things/blob/master/src/ml_things/array_functions.py#L120)
Split a list into batches/chunks. Last batch size is remaining of list values.
**Note:** *This is also called chunking. I call it batches since I use it more in ML.*
The last batch will be the reamining values:
```python
>>> from ml_things import batch_array
>>> batch_array(list_values=[1,2,3,4,5,6,7,8,8,9,8,6,5,4,6], batch_size=4)
[[1, 2, 3, 4], [5, 6, 7, 8], [8, 9, 8, 6], [5, 4, 6]]
```
### Plot Functions
Plot related function that can be useful when working with machine learning.
#### plot_array [[source]](https://github.com/gmihaila/ml_things/blob/master/src/ml_things/plot_functions.py#L29)
Create plot from a single array of values.
All arguments are optimized for quick plots. Change the `magnify` arguments to vary the size of the plot:
```python
>>> from ml_things import plot_array
>>> plot_array([1,3,5,3,7,5,8,10], path='plot_array.png', magnify=0.1, use_title='A Random Plot', start_step=0.3, step_size=0.1, points_values=True, use_ylabel='Thid', use_xlabel='This')
```
#### plot_dict [[source]](https://github.com/gmihaila/ml_things/blob/master/src/ml_things/plot_functions.py#L275)
Create plot from a single array of values.
All arguments are optimized for quick plots. Change the `magnify` arguments to vary the size of the plot:
```python
>>> from ml_things import plot_dict
>>> plot_dict({'train_acc':[1,3,5,3,7,5,8,10],
'valid_acc':[4,8,9]}, use_linestyles=['-', '--'], magnify=0.1,
start_step=0.3, step_size=0.1,path='plot_dict.png', points_values=[True, False], use_title='Title')
```
#### plot_confusion_matrix [[source]](https://github.com/gmihaila/ml_things/blob/master/src/ml_things/plot_functions.py#L529)
This function prints and plots the confusion matrix. Normalization can be applied by setting `normalize=True`.
All arguments are optimized for quick plots. Change the `magnify` arguments to vary the size of the plot:
```python
>>> from ml_things import plot_confusion_matrix
>>> plot_confusion_matrix(y_true=[1,0,1,1,0,1], y_pred=[0,1,1,1,0,1], magnify=0.1, use_title='My Confusion Matrix', path='plot_confusion_matrix.png');
Confusion matrix, without normalization
array([[1, 1],
[1, 3]])
```
### Text Functions
Text related function that can be useful when working with machine learning.
#### clean_text [[source]](https://github.com/gmihaila/ml_things/blob/master/src/ml_things/text_functions.py#L22)
Clean text using various techniques:
```python
>>> from ml_things import clean_text
>>> clean_text("ThIs is $$$%. \t\t\n \\ so dirtyyy$$ text :'(. omg!!!", full_clean=True)
'this is so dirtyyy text omg'
```
### Web Related
Web related function that can be useful when working with machine learning.
#### download_from [[source]](https://github.com/gmihaila/ml_things/blob/master/src/ml_things/web_related.py#L21)
Download file from url. It will return the path of the downloaded file:
```python
>>> from ml_things import download_from
>>> download_from(url='https://raw.githubusercontent.com/gmihaila/ml_things/master/setup.py', path='.')
'./setup.py'
```
# Snippets
This is a very large variety of Python snippets without a certain theme. I put them in the most frequently used ones while keeping a logical order.
I like to have them as simple and as efficient as possible.
| Name | Description |
|:-|:-|
| [Read FIle](https://gmihaila.github.io/useful/useful/#read-file) | One liner to read any file.
| [Write File](https://gmihaila.github.io/useful/useful/#write-file) | One liner to write a string to a file.
| [Debug](https://gmihaila.github.io/useful/useful/#debug) | Start debugging after this line.
| [Pip Install GitHub](https://gmihaila.github.io/useful/useful/#pip-install-github) | Install library directly from GitHub using `pip`.
| [Parse Argument](https://gmihaila.github.io/useful/useful/#parse-argument) | Parse arguments given when running a `.py` file.
| [Doctest](https://gmihaila.github.io/useful/useful/#doctest) | How to run a simple unittesc using function documentaiton. Useful when need to do unittest inside notebook.
| [Fix Text](https://gmihaila.github.io/useful/useful/#fix-text) | Since text data is always messy, I always use it. It is great in fixing any bad Unicode.
| [Current Date](https://gmihaila.github.io/useful/useful/#current-date) | How to get current date in Python. I use this when need to name log files.
| [Current Time](https://gmihaila.github.io/useful/useful/#current-time) | Get current time in Python.
| [Remove Punctuation](https://gmihaila.github.io/useful/useful/#remove-punctuation) | The fastest way to remove punctuation in Python3.
| [PyTorch-Dataset](https://gmihaila.github.io/useful/useful/#dataset) | Code sample on how to create a PyTorch Dataset.
| [PyTorch-Device](https://gmihaila.github.io/useful/useful/#pytorch-device) | How to setup device in PyTorch to detect if GPU is available.
# Comments
These are a few snippets of how I like to comment my code. I saw a lot of different ways of how people comment their code. One thing is for sure: *any comment is better than no comment*.
I try to follow as much as I can the [PEP 8 — the Style Guide for Python Code](https://pep8.org/#code-lay-out).
When I comment a function or class:
```python
# required import for variables type declaration
from typing import List, Optional, Tuple, Dict
def my_function(function_argument: str, another_argument: Optional[List[int]] = None,
another_argument_: bool = True) -> Dict[str, int]
r"""Function/Class main comment.
More details with enough spacing to make it easy to follow.
Arguments:
function_argument (:obj:`str`):
A function argument description.
another_argument (:obj:`List[int]`, `optional`):
This argument is optional and it will have a None value attributed inside the function.
another_argument_ (:obj:`bool`, `optional`, defaults to :obj:`True`):
This argument is optional and it has a default value.
The variable name has `_` to avoid conflict with similar name.
Returns:
:obj:`Dict[str: int]`: The function returns a dicitonary with string keys and int values.
A class will not have a return of course.
"""
# make sure we keep out promise and return the variable type we described.
return {'argument': function_argument}
```
# Notebooks Tutorials
This is where I keep notebooks of some previous projects which I turnned them into small tutorials. A lot of times I use them as basis for starting a new project.
All of the notebooks are in **Google Colab**. Never heard of Google Colab? :scream_cat: You have to check out the [Overview of Colaboratory](https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwiD1aD06trrAhVRXK0KHRC4DgQQjBAwBHoECAYQBA&url=https%3A%2F%2Fcolab.research.google.com%2Fnotebooks%2Fbasic_features_overview.ipynb&usg=AOvVaw0gXOkR6JGGFlwsxrkuYm7F), [Introduction to Colab and Python](https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwiD1aD06trrAhVRXK0KHRC4DgQQjBAwA3oECAYQCg&url=https%3A%2F%2Fcolab.research.google.com%2Fgithub%2Ftensorflow%2Fexamples%2Fblob%2Fmaster%2Fcourses%2Fudacity_intro_to_tensorflow_for_deep_learning%2Fl01c01_introduction_to_colab_and_python.ipynb&usg=AOvVaw2pr-crqP30RHfDs7hjKNnc) and what I think is a great medium article about it [to configure Google Colab Like a Pro](https://medium.com/@robertbracco1/configuring-google-colab-like-a-pro-d61c253f7573).
If you check the `/ml_things/notebooks/` a lot of them are not listed here because they are not in a 'polished' form yet. These are the notebooks that are good enough to share with everyone:
| Name | Description | Links |
|:- |:- |:- |
| **:grapes: Better Batches with PyTorchText BucketIterator** | *How to use PyTorchText BucketIterator to sort text data for better batching.* |[](https://colab.research.google.com/github/gmihaila/ml_things/blob/master/notebooks/pytorch/pytorchtext_bucketiterator.ipynb) [](https://github.com/gmihaila/ml_things/blob/master/notebooks/pytorch/pytorchtext_bucketiterator.ipynb) [](https://www.dropbox.com/s/7gyq6qup6y43z9b/pytorchtext_bucketiterator.ipynb?dl=1) [](https://gmihaila.medium.com/better-batches-with-pytorchtext-bucketiterator-12804a545e2a) [](https://gmihaila.github.io/tutorial_notebooks/pytorchtext_bucketiterator/) |
| **:dog: Pretrain Transformers Models in PyTorch using Hugging Face Transformers** | *Pretrain 67 transformers models on your custom dataset.* |[](https://colab.research.google.com/github/gmihaila/ml_things/blob/master/notebooks/pytorch/pretrain_transformers_pytorch.ipynb) [](https://github.com/gmihaila/ml_things/blob/master/notebooks/pytorch/pretrain_transformers_pytorch.ipynb) [](https://www.dropbox.com/s/rkq79hwzhqa6x8k/pretrain_transformers_pytorch.ipynb?dl=1) [](https://gmihaila.medium.com/pretrain-transformers-models-in-pytorch-using-transformers-ecaaec00fbaa) [](https://gmihaila.github.io/tutorial_notebooks/pretrain_transformers_pytorch/) |
| **:violin: Fine-tune Transformers in PyTorch using Hugging Face Transformers** | *Complete tutorial on how to fine-tune 73 transformer models for text classification — no code changes necessary!* |[](https://colab.research.google.com/github/gmihaila/ml_things/blob/master/notebooks/pytorch/finetune_transformers_pytorch.ipynb) [](https://github.com/gmihaila/ml_things/blob/master/notebooks/pytorch/finetune_transformers_pytorch.ipynb) [](https://www.dropbox.com/s/tsqicfqgt8v87ae/finetune_transformers_pytorch.ipynb?dl=1) [](https://medium.com/@gmihaila/fine-tune-transformers-in-pytorch-using-transformers-57b40450635) [](https://gmihaila.github.io/tutorial_notebooks/finetune_transformers_pytorch/)|
| **⚙️ Bert Inner Workings in PyTorch using Hugging Face Transformers** | *Complete tutorial on how an input flows through Bert.* |[](https://colab.research.google.com/github/gmihaila/ml_things/blob/master/notebooks/pytorch/bert_inner_workings.ipynb) [](https://github.com/gmihaila/ml_things/blob/master/notebooks/pytorch/bert_inner_workings.ipynb) [](https://www.dropbox.com/s/jeftyo6cebfkma2/bert_inner_workings.ipynb?dl=1) [](https://gmihaila.medium.com/%EF%B8%8F-bert-inner-workings-1c3054cd1591) [](https://gmihaila.github.io/tutorial_notebooks/bert_inner_workings/)|
| **🎱 GPT2 For Text Classification using Hugging Face 🤗 Transformers** | *Complete tutorial on how to use GPT2 for text classification.* |[](https://colab.research.google.com/github/gmihaila/ml_things/blob/master/notebooks/pytorch/gpt2_finetune_classification.ipynb) [](https://github.com/gmihaila/ml_things/blob/master/notebooks/pytorch/gpt2_finetune_classification.ipynb) [](https://www.dropbox.com/s/6t6kvlewoabwxqw/gpt2_finetune_classification.ipynb?dl=1) [](https://gmihaila.medium.com/gpt2-for-text-classification-using-hugging-face-transformers-574555451832) [](https://gmihaila.github.io/tutorial_notebooks/gpt2_finetune_classification/)|
# Final Note
Thank you for checking out my repo. I am a perfectionist so I will do a lot of changes when it comes to small details.
If you see something wrong please let me know by opening an
**[issue on my ml_things](https://github.com/gmihaila/ml_things/issues/new/choose)** GitHub repository!
A lot of tutorials out there are mostly a one-time thing and are not being maintained. I plan on keeping my
tutorials up to date as much as I can.
## **Contact** 🎣
🦊 GitHub: [gmihaila](https://github.com/gmihaila)
🌐 Website: [gmihaila.github.io](https://gmihaila.github.io/)
👔 LinkedIn: [mihailageorge](https://medium.com/r/?url=https%3A%2F%2Fwww.linkedin.com%2Fin%2Fmihailageorge)
📬 Email: [[email protected]](mailto:[email protected]?subject=GitHub%20Website)