https://github.com/alextanhongpin/data-science-learn
Things I learn about data science
https://github.com/alextanhongpin/data-science-learn
clustering data-science machine-learning naive-bayes python statistic
Last synced: about 1 year ago
JSON representation
Things I learn about data science
- Host: GitHub
- URL: https://github.com/alextanhongpin/data-science-learn
- Owner: alextanhongpin
- Created: 2019-05-19T13:27:01.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2023-09-27T01:17:00.000Z (almost 3 years ago)
- Last Synced: 2025-03-24T16:37:46.354Z (over 1 year ago)
- Topics: clustering, data-science, machine-learning, naive-bayes, python, statistic
- Language: Roff
- Size: 8.02 MB
- Stars: 4
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Data Science Learn
Learn basic data science through trial and error.
## Starting the Juptyer Notebook
Runs a Jupyter Notebook in a Docker container with persistent volume.
```bash
$ docker run -p 8888:8888 -v $PWD:/home/jovyan/work jupyter/base-notebook
```
## References
Mathematics for machine learning:
https://mml-book.github.io/book/mml-book.pdf
## Running tests in jupyter notebook/jupyter lab
```python
if __name__ == '__main__':
unittest.main(argv=['first-arg-is-ignored'], exit=False)
```
## Jupyterlab error starting kernel
```bash
$ python -m ipykernel install --user
```
## Jupyterlab shortcuts rename file
`Command + r` for renaming:
```json
{
"shortcuts": [
{
"command": "docmanager:rename",
"keys": [
"Accel R"
],
"selector": "body"
}
]
}
```
## Jupyter running command with python variables
```py
name = 'john doe'
!echo {name}
```
## Jupyter right way of installing modules
Bad:
```python
!pip3 install module
```
Good:
```python
import sys
!{sys.executable} -m pip install spacy
!{sys.executable} -m spacy download en_core_web_sm
```
## Installing Jupytext
Allows the notebook to be saved as markdown:
```bash
$ brew install jupyterlab
$ pip install jupytext
$ jupyter labextension install jupyterlab-jupytext
```
## Add code formatting for Jupyter
https://jupyterlab-code-formatter.readthedocs.io/en/latest/
# Git
https://www.wrighters.io/version-control-for-jupyter-notebooks/
### recommendation with dbscan
https://www.datacamp.com/community/tutorials/dbscan-macroscopic-investigation-python
## Fetching CSV data from Github using Jupyter
Useful for Google Colab/Kaggle:
```
!mkdir data
!ls data
!curl -L https://github.com/alextanhongpin/blueprints-for-text-analytics-python/blob/master/data/abcnews-date-text.csv.gz?raw=true -o data/abcnews-date-text.csv.gz
import pandas as pd
```
## Jupyterlab Plot
```
!pip install ipympl
%matplotlib widget
```
Alternative, which is better:
```
import matplotlib.pyplot as plt
plt.rcParams["figure.figsize"] = (20, 10)
```
## Upgrade all pip modules
```bash
$ pip3 list --outdated --format=freeze | grep -v '^\-e' | cut -d = -f 1 | xargs -n1 pip3 install -U
```