https://github.com/murrellgroup/lowranklayers.jl

https://github.com/murrellgroup/lowranklayers.jl

Last synced: 10 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/murrellgroup/lowranklayers.jl
• Owner: MurrellGroup
• License: mit
• Created: 2024-11-25T23:53:28.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-05-28T12:24:35.000Z (about 1 year ago)
• Last Synced: 2025-06-02T11:54:01.547Z (12 months ago)
• Language: Julia
• Homepage:
• Size: 225 KB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# LowRankLayers

[![Stable](https://img.shields.io/badge/docs-stable-blue.svg)](https://MurrellGroup.github.io/LowRankLayers.jl/stable/)

[![Dev](https://img.shields.io/badge/docs-dev-blue.svg)](https://MurrellGroup.github.io/LowRankLayers.jl/dev/)

[![Build Status](https://github.com/MurrellGroup/LowRankLayers.jl/actions/workflows/CI.yml/badge.svg?branch=main)](https://github.com/MurrellGroup/LowRankLayers.jl/actions/workflows/CI.yml?query=branch%3Amain)

[![Coverage](https://codecov.io/gh/MurrellGroup/LowRankLayers.jl/branch/main/graph/badge.svg)](https://codecov.io/gh/MurrellGroup/LowRankLayers.jl)

This package provides a simple implementation of Low-Rank Adaptations (LoRAs) for Flux layers.

## Usage

```julia

using Flux, LowRankLayers

dense_layer = Dense(10 => 5)

lora_layer = LoRADense(dense_layer, 3) # hidden_dim = 3

```