{"id":20305490,"url":"https://github.com/sicara/pycon-2022-dvc-streamlit","last_synced_at":"2025-04-11T14:51:27.667Z","repository":{"id":41205260,"uuid":"479460585","full_name":"sicara/pycon-2022-dvc-streamlit","owner":"sicara","description":"PyCon Talks 2022 by Antoine Toubhans ","archived":false,"fork":false,"pushed_at":"2022-07-08T06:26:53.000Z","size":7998,"stargazers_count":23,"open_issues_count":0,"forks_count":7,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-25T11:01:42.966Z","etag":null,"topics":["dvc","mlops","streamlit"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sicara.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-04-08T16:20:10.000Z","updated_at":"2024-06-05T16:20:24.000Z","dependencies_parsed_at":"2022-09-13T10:01:22.004Z","dependency_job_id":null,"html_url":"https://github.com/sicara/pycon-2022-dvc-streamlit","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sicara%2Fpycon-2022-dvc-streamlit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sicara%2Fpycon-2022-dvc-streamlit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sicara%2Fpycon-2022-dvc-streamlit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sicara%2Fpycon-2022-dvc-streamlit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sicara","download_url":"https://codeload.github.com/sicara/pycon-2022-dvc-streamlit/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248424824,"owners_count":21101240,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dvc","mlops","streamlit"],"created_at":"2024-11-14T17:08:37.884Z","updated_at":"2025-04-11T14:51:27.645Z","avatar_url":"https://github.com/sicara.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"Flexible ML Experiment Tracking System\nfor Python Coders\nwith DVC and Streamlit\n===\n\n![PyConDE](./images/pyconde_official.png)\n\nThis repo provides the slides and the materials\nfor [the talk I gave at PyConDE/PyDataBerlin 2022](https://2022.pycon.de/program/WADNGC/), on Tuesday April 12nd.\n\n# 🎤 Watch the slides\n\nI've made the slides with [Streamlit](https://streamlit.io/),\nso you need to run some `pip install` before you can see the slides :).\n\n### 1️⃣ Requirements\n\nIt works with python 3.9.10 on my laptop.\nIt should be working with python \u003e=3.6, but I have not tested it though.\n\n### 2️⃣ Installation\n\n```bash\npip install -r requirements.txt\npre-commit install  # You can skip this if you don't intend to make new commits\n```\n\n\n### 3️⃣ Pull the data\n\n```bash\ndvc pull -R .\ndvc exp pull origin -A\n```\n\n### 4️⃣ Start the presentation\n\nJust run:\n\n```bash\nstreamlit run st_talk_slides.py\n```\n\nYou should see the first slide with the title:\n![title slide](./images/title-slide.png)\n\nFrom there, you can navigate through the slides with the menu in the left sidebar.\nPlease [open an issue](https://github.com/sicara/pycon-2022-dvc-streamlit/issues/new) if you got trouble with the slides 🙏.\n\n# 🧑‍💻 About the code\n\nI've made the slides with [Streamlit](https://streamlit.io/) for several reasons:\n- to show the code and its execution in the slides, to avoid switching to a web browser during the presentation\n- to make the slide more interactive\n- because the talk was about Streamlit, kind of inception 🌀\n\nI used [streamlit-book](https://streamlit-book.readthedocs.io) for the page layout.\nMany thanks [sebastiandres](https://github.com/sebastiandres) for the awesome work 🙏 👍.\n\n### 📂 Project Structure\n\n| Path | Description |\n| ------ | ----------- |\n| st_talk_slides.py | The main Streamlit script for the slides. |\n| ./code_samples | Code samples that were run \"as is\" in the slides. |\n| ./images | The images of the slides. |\n| ./src | Source code for the training pipeline: no streamlit here, only Python and DVC |\n| ./utils | Utility functions for the slides e.g, display HTML and CSS, command line in Streamlit etc |\n\n### 🧪 Running new experiments\n\n- 1️⃣ Add experiments in the queue. For instance, if you want to change the train seed:\n```bash\ndvc exp run --set-params train.seed=0106 --queue\n```\n➡️ you can look at available parameters in the [params.yaml file here](./src/params.yaml)\n\n- 2️⃣ Run the experiments that are in the queue:\n```bash\ndvc exp run --run-all\n```\n\n- 3️⃣ Check the results:\n```bash\ndvc exp show\n```\n\n- 4️⃣ Save the experiments to the remote git server and data storage (requires forking this repo \u0026 setting up your own dvc remote):\n```bash\ngit push\ndvc exp push origin --rev HEAD\n```\n\n\u003e ⚠️ **A note on DVC remote storage**:\n\u003e remote storage is [the Sicara's public s3 bucket](s3://public-sicara/dvc-remotes/pycon-2022-dvc-streamlit)\n\u003e (see [dvc config file](./.dvc/config)).\n\u003e By default, you have permission to read (`dvc pull`) but you cannot write (`dvc push`).\n\u003e If you want to run experiments and save your result with `dvc push`,\n\u003e consider adding [your own dvc remote](https://dvc.org/doc/command-reference/remote/add).\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsicara%2Fpycon-2022-dvc-streamlit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsicara%2Fpycon-2022-dvc-streamlit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsicara%2Fpycon-2022-dvc-streamlit/lists"}