Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/scifm/summer-school-2024

Last synced: 4 months ago
JSON representation

Host: GitHub
URL: https://github.com/scifm/summer-school-2024
Owner: scifm
License: apache-2.0
Created: 2024-07-08T14:26:47.000Z (8 months ago)
Default Branch: main
Last Pushed: 2024-07-26T01:07:33.000Z (7 months ago)
Last Synced: 2024-08-01T16:45:31.076Z (7 months ago)
Language: Jupyter Notebook
Size: 28 MB
Stars: 22
Watchers: 0
Forks: 4
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        # SciFM Summer School 2024

### Tutorial 2: Tokenization

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/omics.ipynb) Omics

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/ChemicalData.ipynb) Chemical Data

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/Training_Tokenizers.ipynb) Training Tokenizers

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/Byte_Pair_Encoding_tokenization.ipynb) Byte Pair Encoding tokenization

### Tutorial 3: Model Architectures

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/GenSLM_Downstream.ipynb) GenSLM

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/ViT_SciFM.ipynb) Vision Transformer

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/tonyzyl/DiffusionReconstruct/blob/master/demo.ipynb) Diffusion Models

- [![Static Badge](https://img.shields.io/badge/GitHub-Source_Code-blue?logo=GitHub)](https://github.com/camlab-ethz/poseidon) Poseidon: Efficient Models for PDEs

- [![Static Badge](https://img.shields.io/badge/GitHub-Source_Code-blue?logo=GitHub)](https://github.com/neuraloperator/neuraloperator/tree/main) NeuralOperators

- [![Pluto.jl Notebook](https://img.shields.io/badge/Pluto.jl-Neural_Scaling_Laws-blue?logo=Julia)](https://scifm.ai/summer-school-2024/neural_scaling_laws.html) Neural Scaling Laws

## Tutorial 4

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/SciFMRAGTutorial.ipynb) Retrieval Augmented Generation

- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/scifm/summer-school-2024/blob/main/protein_gene_dpo.ipynb) Fine-Tuning and Preferences

## Tutorial 5: Programming Novel AI Accelerators for Scientific Computing

[![Static Badge](https://img.shields.io/badge/GitHub-Source_Code-blue?logo=GitHub)](https://github.com/argonne-lcf/summer-school-2024)

Slides, tutorials, and code for the session are available on ALCF's repo linked above. Tutorials for the accelerators in the [ALCF AI Testbed](https://docs.alcf.anl.gov/ai-testbed/getting-started/) are below:

- [LLMs on Polaris](https://samforeman.me/talks/llms-on-polaris)

- [Cerebras](https://github.com/argonne-lcf/summer-school-2024/blob/main/Cerebras/README.md)  

- [SambaNova](https://github.com/argonne-lcf/summer-school-2024/blob/main/SambaNova/README.md)                                    

- [Graphcore](https://github.com/argonne-lcf/summer-school-2024/blob/main/Graphcore/README.md)  

- [Groq](https://github.com/argonne-lcf/summer-school-2024/blob/main/Groq/README.md)

- [NVIDIA]([./](https://github.com/argonne-lcf/summer-school-2024/blob/main/)Nvidia/README.md)

## Tutorial 6: Advanced Privacy-Preserving Federated Learning Framework

[![Static Badge](https://img.shields.io/badge/GitHub-Source_Code-blue?logo=GitHub)](https://github.com/APPFL/appfl-scifm)