https://github.com/rksm/llamafile-with-nix

https://github.com/rksm/llamafile-with-nix

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/rksm/llamafile-with-nix
• Owner: rksm
• Created: 2024-05-01T18:24:49.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-05-01T18:43:17.000Z (8 months ago)
• Last Synced: 2024-10-12T10:25:14.535Z (3 months ago)
• Language: Just
• Size: 2.93 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# llamafile and nix that uses nvidia/cuda

Just posting this as it took me a while to get it working. This is as of 2024-05-01.

My nixos nvidia setup is:

``` nix

hardware.opengl = {

  enable = true;

  driSupport = true;

  driSupport32Bit = true;

};

services.xserver.videoDrivers = [ "nvidia" ];

hardware.nvidia = {

  modesetting.enable = true;

  open = false;

  package = config.boot.kernelPackages.nvidiaPackages.production;

};

```