{"id":20178814,"url":"https://github.com/drsnowbird/tensorflow-python3-jupyter","last_synced_at":"2025-04-10T04:44:59.048Z","repository":{"id":90087615,"uuid":"95848505","full_name":"DrSnowbird/tensorflow-python3-jupyter","owner":"DrSnowbird","description":"tensorflow-python3-jupyter","archived":false,"fork":false,"pushed_at":"2022-10-10T15:22:46.000Z","size":2902,"stargazers_count":8,"open_issues_count":0,"forks_count":3,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-24T06:02:34.517Z","etag":null,"topics":["docker","docker-compose","hadoop","jupyter","jupyter-notebook","machine-learning","python","spark","tensorflow","tensorflow-board","tensorflow-tutorials","topic-modeling"],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DrSnowbird.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-06-30T04:26:35.000Z","updated_at":"2022-09-04T15:00:44.000Z","dependencies_parsed_at":"2023-03-02T23:00:16.157Z","dependency_job_id":null,"html_url":"https://github.com/DrSnowbird/tensorflow-python3-jupyter","commit_stats":null,"previous_names":[],"tags_count":10,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DrSnowbird%2Ftensorflow-python3-jupyter","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DrSnowbird%2Ftensorflow-python3-jupyter/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DrSnowbird%2Ftensorflow-python3-jupyter/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DrSnowbird%2Ftensorflow-python3-jupyter/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DrSnowbird","download_url":"https://codeload.github.com/DrSnowbird/tensorflow-python3-jupyter/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248161236,"owners_count":21057552,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker","docker-compose","hadoop","jupyter","jupyter-notebook","machine-learning","python","spark","tensorflow","tensorflow-board","tensorflow-tutorials","topic-modeling"],"created_at":"2024-11-14T02:23:36.741Z","updated_at":"2025-04-10T04:44:59.039Z","avatar_url":"https://github.com/DrSnowbird.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# GPU/CUDA Supported: Tensorflow + Python3 + Jupyter + PySpark + Spark 3.0 + Hadoop 3.2\n\n# * (**NEW**) `Auto detect \u0026 enable GPU/CUDA` [see CUDA Detection in Notebook](https://github.com/DrSnowbird/tensorflow-python3-jupyter/blob/master/doc/PyTorch-GPU-CUDA-Detection.png) into Container and Jupyter Notebook!\n# * (*New*) Added R Kernel support.\n\n# NOTE: The latest update supported `HTTPS` for Jupyter Notebook to increase security:\n* Launch the **Tensorflow-Python3-Jupyter server** (`http://\u003cip\u003e:28888/` - **default** or `https://\u003cip\u003e:28888/`) -- To change HTTPS or HTTP, see next paragraph \n  * Remember to ***\".env\"*** setup for using HTTPS since the default is HTTP (again!)\n* Launch the **Tensorboard Web GUI server** (`http://\u003cip\u003e:26006/` as default)\n\n## To disable/enable HTTPS for Jupyter Notebook\nJust edit the `.env` file's entry \"ENABLE_HTTPS\".\nThe following changes back to `HTTP` instead of `HTTPS`.\n```\n## -- true to enable HTTPS; false to disable HTTPS:\nENABLE_HTTPS=false\n#ENABLE_HTTPS=true\n```\n# Zeppelin Notebooks as alternative to Jupyter Notebooks\nWe also provide Zeppelin notebook [openkbs/docker-spark-bde2020-zeppelin](https://cloud.docker.com/u/openkbs/repository/docker/openkbs/docker-spark-bde2020-zeppelin). If you want Scala/Java Spark ML/Mlib etc, you might try that as well. In all, we support both Zeppelin Notebooks and Jupyter Notebooks technologies for both Spark Scala/Java and Python/PySpark data science users' needs.\n\n# Components:\n* Jupyter\n  * ONNX and runtime\n  * Tensorflow and examples\n* [Java openkbs/jdk-mvn-py3 - see README.md](https://github.com/DrSnowbird/jdk-mvn-py3/blob/master/README.md)\n* [Base Container Image: openkbs/jdk-mvn-py3](https://github.com/DrSnowbird/jdk-mvn-py3)\n* [Base Container Image: openkbs/jdk-mvn-py3-x11](https://github.com/DrSnowbird/jdk-mvn-py3-x11)\n* [Base Components: OpenJDK, Python 3, PIP, Node/NPM, Gradle, Maven, etc.](https://github.com/DrSnowbird/jdk-mvn-py3#components) \n\n## Run (GPU/Nvidia - Auto Enable)\n* To run GPU/Nvidia, you need to install the `Nvidia Driver` in your `HOST machine` first and then install `nvidia-docker2`.\n* Please refer to [`Nvidia Container Toolkit`](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#docker) documentation for how to install properly\n* You also need to setup environment variables once you have successfully install `Nvidia driver` and `Nvidia-docker2` Container Toolkit `before you run Docker` (trying to use nvidia-docker2). \nIt's recommended to setup in your HOST VM or Machine's user account's `.bashrc` profile.\n```\nexport PATH=/usr/local/cuda/bin${PATH:+:${PATH}}\nexport LD_LIBRARY_PATH=/usr/local/cuda/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}\n\n./run.sh -g\nor, let it auto check and use Nvidia GPU if available:\n./run.sh\n```\n\n## Run (If choose only CPU!)\n* It will download 'yolov5s.pt' on-the-fly to use if not existing.\n\n```\n./run.sh\nor, explicitly disable GPU to use CPU.\n./run.sh -c\n```\n\n\n# Run (using docker-compose)\n\n```\ndocker pull openkbs/tensorflow-python3-jupyter\ndocker-compose up -d\n```\nOnce it is up, you can access it with:\n* The default Jupyter password is (unless you change it in `.env` file): `ChangeMe!`\n```\nhttp://\u003cIP_Address\u003e:28888/ (Juypter Notebook)  -- if you disable HTTPS\nhttps://\u003cIP_Address\u003e:28888/ (Juypter Notebook)  -- if you enable HTTPS\nhttp://\u003cIP_Address\u003e:26006/ (Jupyter Tensorboard)\n```\nWhere `\u003cIP_Address\u003e` will be:\n- If running locally: `localhost`, `0.0.0.0`, `127.0.0.1`, or host's IP address.\n- If running with Openshift: then find out the domain name that OpenShift has created for this container.\n\n# How to change the default password?\nEdit the ./docker-run.env file, say, to change to MyNewPassword!\n```\n#### Don't use any quote to enclose the password since it (quotes) will be treated as part of the value!\nPASSWORD=StrongPassword\n```\n\n# What if I need more Python/PIP packages?\n1. Enter the Container\n```\n./shell.sh\n```\n2. Install the new Python/PIP package, e.g.,\n```\nsudo python3 -m pip install \u003cpackage\u003e\nor \nsudo pip install \u003cpackage\u003e\ne.g.\n    sudo pip install nose\n    sudo pip install IPython\n    sudo pip install pyGtk\n    sudo pip install Scrapy\n    . . . etc.\n```\nIf you are using OpenShift / Origin Contaier Platform, you can use the Web UI to enter the `Container's Console` and then run the above Python package installation.\n\n3. Or, you can add your packages into the file below and restart \"./run.sh\" your Container. It will install additional packages in the file, \"./requirements-extra.txt\", for you.\n```\n# Bert pre-trained model\npytorch-pretrained-bert\n```\n\n# (Other way) to install more packages - Inside Jupyter Notebook\n```\n# Install a pip package in the current Jupyter kernel\nimport sys\n!{sys.executable} -m pip install \u003cpackage\u003e\ne.g.\n    import sys\n    !{sys.executable} -m pip install numpy\n```\n\n# Problems in Login\nFew reasons that your login password might not work:\n1. You have multiple place set password and they are inconsistent: just search \"***password***\" and \"***PASSWORD***\" for all the files in the folder - basically, `docker-compose.yml, docker-run.sh, run-sh (if you modify it)`  files are key sources for setting up password for login.\n2. It might be your Chrome or browsers auto feed old password as cache. To solve this problem, \nyou just launch a new `incognito windows` and then type URL as usuall:\n```\nhttp://\u003cip\u003e:28888/  (if you disable HTTPS, i.e., you want HTTP://...)\nor\nhttps://\u003cip\u003e:28888/  (if you enable HTTPS, i.e., you want HTTPS://...)\n```\n# Resources \u0026 References\n* [ONNX AI](https://onnx.ai/)\n* [TnesorFlow Tutorials](https://www.tensorflow.org/tutorials)\n* [Jupyter Notebook](https://jupyter.org/)\n* [TensorFlow](https://www.tensorflow.org/)\n* [scikit-learn](http://scikit-learn.org/stable/)\n* [pandas](http://pandas.pydata.org/)\n* [matplotlib](https://matplotlib.org/)\n* [numpy](http://www.numpy.org/)\n* [scipy](https://www.scipy.org/)\n* [Pillow](https://pillow.readthedocs.io/en/4.1.x/)\n* [Python 2 and 3](https://www.python.org/)\n* [Gensim - Topic Modeling for Humans](https://radimrehurek.com/gensim/)\n* [Text Analytics for Beginners using NLTK](https://www.datacamp.com/community/tutorials/text-analytics-beginners-nltk)\n* [spaCy Notebooks](https://github.com/explosion/spacy-notebooks)\n* [spaCy models for training](https://spacy.io/usage/training)\n* [R Studio in Jupyter](https://dzone.com/articles/using-r-on-jupyternbspnotebook)\n* [IRKernel for Jupyter](https://irkernel.github.io/installation/)\n\nNote: the jupyter notebooks are only based on Python 3 kernels as default.\n\n# See Also - docker-based IDE\n* [openkbs/docker-spark-bde2020-zeppelin](https://cloud.docker.com/u/openkbs/repository/docker/openkbs/docker-spark-bde2020-zeppelin): Spark (Scala/Java) Cluster with Spark ML/MLlib + Hadoop (HDFS)\n* [ONNX and Run-time environment](https://hub.docker.com/repository/docker/openkbs/onnx-ecosystem)\n* [openkbs/atom-docker](https://hub.docker.com/r/openkbs/atom-docker/)\n* [openkbs/eclipse-oxygen-docker](https://hub.docker.com/r/openkbs/eclipse-oxygen-docker/)\n* [openkbs/eclipse-photon-docker](https://hub.docker.com/r/openkbs/eclipse-photon-docker/)\n* [openkbs/eclipse-photon-vnc-docker](https://hub.docker.com/r/openkbs/eclipse-photon-vnc-docker/)\n* [openkbs/intellj-docker](https://hub.docker.com/r/openkbs/intellij-docker/)\n* [openkbs/intellj-vnc-docker](https://hub.docker.com/r/openkbs/intellij-vnc-docker/)\n* [openkbs/knime-docker](https://hub.docker.com/r/openkbs/knime-docker/)\n* [openkbs/knime-vnc-docker](https://hub.docker.com/r/openkbs/knime-vnc-docker/)\n* [openkbs/netbeans10-docker](https://hub.docker.com/r/openkbs/netbeans10-docker/)\n* [openkbs/netbeans](https://hub.docker.com/r/openkbs/netbeans/)\n* [openkbs/papyrus-sysml-docker](https://hub.docker.com/r/openkbs/papyrus-sysml-docker/)\n* [openkbs/pycharm-docker](https://hub.docker.com/r/openkbs/pycharm-docker/)\n* [openkbs/rapidminer-docker](https://cloud.docker.com/u/openkbs/repository/docker/openkbs/rapidminer-docker)\n* [openkbs/scala-ide-docker](https://hub.docker.com/r/openkbs/scala-ide-docker/)\n* [openkbs/sublime-docker](https://hub.docker.com/r/openkbs/sublime-docker/)\n* [openkbs/webstorm-docker](https://hub.docker.com/r/openkbs/webstorm-docker/)\n* [openkbs/webstorm-vnc-docker](https://hub.docker.com/r/openkbs/webstorm-vnc-docker/)\n\n# Python Packages List\nYou can use either\n```\nimport sys\n!{sys.executable} -m pip list\n```\nor\n```\ndeveloper@cace1316ae93:~$ pip freeze\nabsl-py==0.10.0\nappdirs==1.4.4\nargon2-cffi==20.1.0\nasn1crypto==0.24.0\nastunparse==1.6.3\nasync-generator==1.10\nattrs==20.2.0\nbackcall==0.2.0\nbeautifulsoup4==4.6.0\nbleach==3.2.1\nblis==0.4.1\ncachetools==4.1.1\ncatalogue==1.0.0\ncertifi==2020.6.20\ncffi==1.14.3\nchardet==3.0.4\nclick==7.1.2\ncloudpickle==1.6.0\ncryptography==2.1.4\ncycler==0.10.0\ncymem==2.0.3\ndecorator==4.4.2\ndefusedxml==0.6.0\ndistlib==0.3.1\nentrypoints==0.3\nfilelock==3.0.12\nfindspark==1.4.2\nfire==0.3.1\nFlask==1.1.2\nfuncy==1.15\nfuture==0.18.2\ngast==0.3.3\ngensim==3.8.3\ngoogle-auth==1.22.1\ngoogle-auth-oauthlib==0.4.1\ngoogle-pasta==0.2.0\ngrpcio==1.32.0\nh5py==2.10.0\nhtml5lib==0.999999999\nhttpie==2.2.0\nhyperopt==0.2.5\nidna==2.10\nimportlib-metadata==2.0.0\nimportlib-resources==3.0.0\niniconfig==1.1.1\nipaddress==1.0.23\nipykernel==5.3.4\nipython==7.16.1\nipython-genutils==0.2.0\nipywidgets==7.5.1\nitsdangerous==1.1.0\nj2cli==0.3.10\njedi==0.17.2\nJinja2==2.11.2\njoblib==0.17.0\njson-lines==0.5.0\njsonschema==3.2.0\njupyter==1.0.0\njupyter-client==6.1.7\njupyter-console==6.2.0\njupyter-core==4.6.3\njupyterlab-pygments==0.1.2\nKeras==2.4.3\nKeras-Preprocessing==1.1.2\nkeras2onnx==1.7.0\nkeyring==10.6.0\nkeyrings.alt==3.0\nkiwisolver==1.2.0\nlangdetect==1.0.8\nlxml==4.2.1\nMarkdown==3.3.2\nMarkupSafe==1.1.1\nmatplotlib==3.3.2\nmistune==0.8.4\nmurmurhash==1.0.2\nnbclient==0.5.1\nnbconvert==6.0.7\nnbformat==5.0.8\nnest-asyncio==1.4.1\nnetworkx==2.5\nnltk==3.5\nnotebook==6.1.4\nnumexpr==2.7.1\nnumpy==1.19.2\noauthlib==3.1.0\nolefile==0.45.1\nonnx==1.7.0\nonnxconverter-common==1.7.0\nonnxmltools==1.7.0\nonnxruntime==1.5.2\nopt-einsum==3.3.0\npackaging==20.4\npanda==0.3.1\npandas==1.1.3\npandasql==0.7.3\npandocfilters==1.4.2\nparso==0.7.1\npbr==5.5.0\npexpect==4.8.0\npickleshare==0.7.5\nPillow==8.0.0\npkgconfig==1.5.1\nplac==1.1.3\npluggy==0.13.1\npreshed==3.0.2\nprometheus-client==0.8.0\nprompt-toolkit==3.0.8\nprotobuf==3.13.0\nptyprocess==0.6.0\npy==1.9.0\npy4j==0.10.9\npyasn1==0.4.8\npyasn1-modules==0.2.8\npycparser==2.20\npycrypto==2.6.1\nPygments==2.7.1\npygobject==3.26.1\npyLDAvis==2.1.2\npyparsing==2.4.7\npyrsistent==0.17.3\npyspark==3.0.1\npytest==6.1.1\npython-apt==1.6.5+ubuntu0.3\npython-dateutil==2.8.1\npython-git==2018.2.1\npytz==2020.1\npyxdg==0.25\nPyYAML==5.3.1\npyzmq==19.0.2\nqtconsole==4.7.7\nQtPy==1.9.0\nregex==2020.10.15\nrequests==2.24.0\nrequests-oauthlib==1.3.0\nrsa==4.6\nscikit-learn==0.23.2\nscipy==1.5.3\nseaborn==0.11.0\nSecretStorage==2.3.1\nSend2Trash==1.5.0\nsix==1.15.0\nskl2onnx==1.7.0\nsmart-open==3.0.0\nspacy==2.3.2\nSQLAlchemy==1.3.20\nsrsly==1.0.2\nstevedore==3.2.2\ntables==3.4.2\ntensorboard==2.3.0\ntensorboard-plugin-wit==1.7.0\ntensorflow==2.3.1\ntensorflow-estimator==2.3.0\ntermcolor==1.1.0\nterminado==0.9.1\ntestpath==0.4.4\ntf2onnx==1.7.1\nthinc==7.4.1\nthreadpoolctl==2.1.0\ntoml==0.10.1\ntorch==1.6.0\ntornado==6.0.4\ntqdm==4.50.2\ntraitlets==4.3.3\ntyping-extensions==3.7.4.3\nunattended-upgrades==0.1\nurllib3==1.25.11\nvirtualenv==20.0.35\nvirtualenv-clone==0.5.4\nvirtualenvwrapper==4.8.4\nwasabi==0.8.0\nwcwidth==0.2.5\nwebencodings==0.5.1\nWerkzeug==1.0.1\nwidgetsnbextension==3.5.1\nwrapt==1.12.1\nyml2json==1.1.3\nzipp==3.3.1\n```\n\n# Releases information\nSee [Release information](https://github.com/DrSnowbird/jdk-mvn-py3#releases-information)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdrsnowbird%2Ftensorflow-python3-jupyter","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdrsnowbird%2Ftensorflow-python3-jupyter","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdrsnowbird%2Ftensorflow-python3-jupyter/lists"}