https://github.com/raviriley/code-spot

CalHacks 10 monorepo for Spotter - won best use of Hume AI
https://github.com/raviriley/code-spot

bark boston-dynamics-spot bunjs calhacks10 flask gpt-4 humeai nextjs shadcn-ui

Last synced: 3 days ago
JSON representation

CalHacks 10 monorepo for Spotter - won best use of Hume AI

• Host: GitHub
• URL: https://github.com/raviriley/code-spot
• Owner: raviriley
• Created: 2023-10-29T13:24:37.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-03-20T16:53:01.000Z (7 months ago)
• Last Synced: 2024-09-25T19:41:36.527Z (8 days ago)
• Topics: bark, boston-dynamics-spot, bunjs, calhacks10, flask, gpt-4, humeai, nextjs, shadcn-ui
• Language: Python
• Homepage: https://devpost.com/software/spotter-revolutionizing-disaster-relief
• Size: 3.13 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# CalHacks 10 monorepo

> The spot for our code for running spotter on [Spot](https://bostondynamics.com/products/spot/)

**backend**: web server for multilingual, multimodal AI processing

- REST API written in Python using Flask

- [Poetry](https://python-poetry.org/) for dependency management

- [Hume AI](https://hume.ai/)

- [GPT-4](https://openai.com/research/gpt-4)

- [Bark](https://github.com/suno-ai/bark)

**spotter**: frontend that enables easy robot control and shows the robot's camera and data feed

- serves data and object recognition from AI backend

- makes requests to robot control backend based on keyboard and mouse inputs

- [Bun](https://bun.sh/)

- [Next.js](https://nextjs.org/)

- [shadcn-ui](https://ui.shadcn.com/) components

**robot-control-server**: web server that enables remote control of the robot

- REST API written in Python using Flask

- Boston Dynamics SDK

----

## Press

- Demo

  - https://www.youtube.com/watch?v=f8duOCsi8As

  - https://devpost.com/software/spotter-revolutionizing-disaster-relief

  - https://www.instagram.com/p/Czmc3bqy5Gq/

- LinkedIn

  - https://www.linkedin.com/feed/update/urn:li:activity:7126407430812356608/

  - https://www.linkedin.com/posts/sutardjacenter_calhacks-ucberkeley-spot-activity-7126599039646629889-RRhp

- Twitter

  - https://twitter.com/ravi_riley/status/1721648835670503774

  - https://twitter.com/JayadityaSethi/status/1720578125556502914

----

## Running the stack:

First, clone this repo. If you don't have access to a Spot, you can still demo the entire frontend and AI part of the app locally, as long as you provide your OpenAI and Hume.ai API keys as an environment variables.

### backend

1. install Poetry

2. `poetry install`

3. `poetry run dev` to start the backend

### frontend

1. install Bun

2. `bun install`

3. `bun dev` to start the frontend

### robot server

1. connect to Spot's wifi network

2. run `python3 python/examples/wasd_server/app.py` and replace the hostname `192.168.80.3` with your Spot's IP

3. enter the `admin` username & password, or the equivalent credentials for your Spot

4. send requests to control endpoints manually or via the frontend