https://github.com/eddumelendez/spring-ai-nvidia

Spring AI example testing against NVIDIA NIM provided by Testcontainers
https://github.com/eddumelendez/spring-ai-nvidia

docker nvidia nvidia-nim spring-ai spring-boot testcontainers

Last synced: about 2 months ago
JSON representation

Spring AI example testing against NVIDIA NIM provided by Testcontainers

• Host: GitHub
• URL: https://github.com/eddumelendez/spring-ai-nvidia
• Owner: eddumelendez
• Created: 2024-09-12T23:57:58.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-09-12T23:58:17.000Z (5 months ago)
• Last Synced: 2024-12-22T03:12:39.971Z (about 2 months ago)
• Topics: docker, nvidia, nvidia-nim, spring-ai, spring-boot, testcontainers
• Language: Java
• Homepage:
• Size: 9.77 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Spring AI NVIDIA

Spring AI example tested against NVIDIA NIM container provided by Testcontainers.

1. Create an NVIDIA account and generate `NGC_API_KEY`. Follow the following steps https://docs.nvidia.com/nim/large-language-models/latest/getting-started.html#option-2-from-ngc

2. Run the application

```bash

./mvnw spring-boot:test-run

```

3. Watch NVIDIA container logs

```bash

docker logs -f $(docker ps --format "{{.ID}}" --filter ancestor="nvcr.io/nim/meta/llama3-8b-instruct:1.0.0")

```

4. Perform a request against the Spring app

```bash

http :8080/chat

```