{"id":20772961,"url":"https://github.com/determined-ai/determined-examples","last_synced_at":"2025-04-30T15:05:48.863Z","repository":{"id":103635858,"uuid":"301875637","full_name":"determined-ai/determined-examples","owner":"determined-ai","description":"Example ML projects that use the Determined library.","archived":false,"fork":false,"pushed_at":"2024-09-11T17:59:51.000Z","size":2863,"stargazers_count":29,"open_issues_count":4,"forks_count":2,"subscribers_count":31,"default_branch":"main","last_synced_at":"2025-03-30T17:11:15.211Z","etag":null,"topics":["deep-learning","distributed-training","hyperparameter-tuning","keras","machine-learning","ml-infrastructure","pytorch","tensorflow"],"latest_commit_sha":null,"homepage":"https://github.com/determined-ai/determined","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/determined-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-10-06T23:06:47.000Z","updated_at":"2025-03-11T04:14:02.000Z","dependencies_parsed_at":"2024-03-08T18:28:52.614Z","dependency_job_id":"c8d49e7d-9656-4646-b35f-8765835b172a","html_url":"https://github.com/determined-ai/determined-examples","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/determined-ai%2Fdetermined-examples","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/determined-ai%2Fdetermined-examples/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/determined-ai%2Fdetermined-examples/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/determined-ai%2Fdetermined-examples/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/determined-ai","download_url":"https://codeload.github.com/determined-ai/determined-examples/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251726714,"owners_count":21633861,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","distributed-training","hyperparameter-tuning","keras","machine-learning","ml-infrastructure","pytorch","tensorflow"],"created_at":"2024-11-17T12:23:43.575Z","updated_at":"2025-04-30T15:05:48.764Z","avatar_url":"https://github.com/determined-ai.png","language":"Python","readme":"# Determined As-is Examples\n\nThis repository contains a variety of Determined examples that are not actively maintained by the Determined team.\n\n## Tutorials\n\n| Example                                                       | Dataset          | Framework             |\n|:-------------------------------------------------------------:|:----------------:|:---------------------:|\n| [fashion\\_mnist\\_tf\\_keras](tutorials/fashion_mnist_tf_keras) | Fashion MNIST    | TensorFlow (tf.keras) |\n\n## Blog posts\n| Example                                 | Description                                                                  |\n|:---------------------------------------:|:----------------------------------------------------------------------------:|\n| [Activation Memory: Part 2](blog/act-mem-2) | Measuring activation memory in PyTorch. |\n| [LLM Finetuning](blog/llm-finetuning) | Finetuning TinyLlama-1.1B on Text-to-SQL. |\n| [LLM Finetuning 2](blog/llm-finetuning-2) | Finetuning Mistral-7B on Text-to-SQL using LoRA and DeepSpeed. |\n| [LLM Finetuning 3](blog/llm-finetuning-3) | Finetuning Gemma-2B using DPO. |\n| [LoRA Parameters](blog/lora-parameters) | Finding the best LoRA parameters. |\n| [Python SDK demo](blog/python_sdk_demo) | Example usage of the Determined Python SDK to run and administer experiments. |\n| [Tensor Parallelism](blog/tp) | Profiling tensor parallelism in PyTorch. |\n\n## Computer Vision\n\n| Example                                                                      | Dataset                      | Framework                                |\n|:----------------------------------------------------------------------------:|:----------------------------:|:----------------------------------------:|\n| [cifar10\\_pytorch](computer_vision/cifar10_pytorch)                          | CIFAR-10                     | PyTorch                                  |\n| [cifar10\\_pytorch\\_inference](computer_vision/cifar10_pytorch_inference)     | CIFAR-10                     | PyTorch                                  |\n| [cifar10\\_tf\\_keras](computer_vision/cifar10_tf_keras)                       | CIFAR-10                     | TensorFlow (tf.keras)                    |\n| [fasterrcnn\\_coco\\_pytorch](computer_vision/fasterrcnn_coco_pytorch)         | Penn-Fudan Dataset           | PyTorch                                  |\n| [mmdetection](model_hub/mmdetection)                  | COCO                         | PyTorch                                  |\n| [detr\\_coco\\_pytorch](computer_vision/detr_coco_pytorch)                     | COCO                         | PyTorch                                  |\n| [deformabledetr\\_coco\\_pytorch](computer_vision/deformabledetr_coco_pytorch) | COCO                         | PyTorch                                  |\n| [iris\\_tf\\_keras](computer_vision/iris_tf_keras)                             | Iris Dataset                 | TensorFlow (tf.keras)                    |\n| [unets\\_tf\\_keras](computer_vision/unets_tf_keras)                           | Oxford-IIIT Pet Dataset      | TensorFlow (tf.keras)                    |\n| [efficientdet\\_pytorch](computer_vision/efficientdet_pytorch)                | COCO                         | PyTorch                                  |\n| [byol\\_pytorch](computer_vision/byol_pytorch)                                | CIFAR-10 / STL-10 / ImageNet | PyTorch                                  |\n| [deepspeed\\_cifar10_cpu_offloading](deepspeed/cifar10_cpu_offloading)        | CIFAR-10                     | PyTorch (DeepSpeed)                      |\n\n## Natural Language Processing (NLP)\n\n| Example                                            | Dataset    | Framework |\n|:--------------------------------------------------:|:----------:|:---------:|\n| [albert\\_squad\\_pytorch](nlp/albert_squad_pytorch) | SQuAD      | PyTorch   |\n| [bert\\_glue\\_pytorch](nlp/bert_glue_pytorch)       | GLUE       | PyTorch   |\n| [word\\_language\\_model](nlp/word_language_model)   | WikiText-2 | PyTorch   |\n\n## HP Search Benchmarks\n\n| Example                                                                         | Dataset               | Framework |\n|:-------------------------------------------------------------------------------:|:---------------------:|:---------:|\n| [darts\\_cifar10\\_pytorch](hp_search_benchmarks/darts_cifar10_pytorch)           | CIFAR-10              | PyTorch   |\n| [darts\\_penntreebank\\_pytorch](hp_search_benchmarks/darts_penntreebank_pytorch) | Penn Treebank Dataset | PyTorch   |\n\n## Neural Architecture Search (NAS)\n\n| Example                            | Dataset | Framework |\n|:---------------------------------:|:-------:|:---------:|\n| [gaea\\_pytorch](nas/gaea_pytorch) | DARTS   | PyTorch   |\n\n## Meta Learning\n\n| Example                                                                | Dataset  | Framework |\n|:----------------------------------------------------------------------:|:--------:|:---------:|\n| [protonet\\_omniglot\\_pytorch](meta_learning/protonet_omniglot_pytorch) | Omniglot | PyTorch   |\n\n## Generative Adversarial Networks (GAN)\n\n| Example                                       | Dataset          | Framework             |\n|:----------------------------------------------|:----------------:|:---------------------:|\n| [dc\\_gan\\_tf\\_keras](gan/dcgan_tf_keras)      | MNIST            | TensorFlow (tf.keras) |\n| [gan\\_mnist\\_pytorch](gan/gan_mnist_pytorch)  | MNIST            | PyTorch               |\n| [deepspeed\\_dcgan](deepspeed/deepspeed_dcgan) | MNIST / CIFAR-10 | PyTorch (DeepSpeed)   |\n| [pix2pix\\_tf\\_keras](gan/pix2pix_tf_keras)    | pix2pix          | TensorFlow (tf.keras) |\n| [cyclegan](gan/cyclegan)                      | monet2photo      | PyTorch               |\n\n## Custom Reducers\n\n| Example                                                                    | Dataset | Framework  |\n|:--------------------------------------------------------------------------:|:-------:|:----------:|\n| [custom\\_reducers\\_mnist\\_pytorch](features/custom_reducers_mnist_pytorch) | MNIST   | PyTorch    |\n\n## HP Search Constraints\n\n| Example                                                                  | Dataset | Framework  |\n|:------------------------------------------------------------------------:|:-------:|:----------:|\n| [hp\\_constraints\\_mnist\\_pytorch](features/hp_constraints_mnist_pytorch) | MNIST   | PyTorch    |\n\n## Custom Search Method\n\n| Example                                                                  | Dataset | Framework  |\n|:------------------------------------------------------------------------:|:-------:|:----------:|\n| [asha\\_search\\_method](custom_search_method/asha_search_method)          | MNIST   | PyTorch    |\n\n## Fully Sharded Data Parallel\n\n| Example                                                                  | Framework  |\n|:------------------------------------------------------------------------:|:----------:|\n| [minimal\\_fsdp](fsdp/minimal_fsdp)          | PyTorch    |\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdetermined-ai%2Fdetermined-examples","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdetermined-ai%2Fdetermined-examples","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdetermined-ai%2Fdetermined-examples/lists"}