https://github.com/testdriverai/testdriver-pubnub-2
TestDriver Test
https://github.com/testdriverai/testdriver-pubnub-2
Last synced: about 1 month ago
JSON representation
TestDriver Test
- Host: GitHub
- URL: https://github.com/testdriverai/testdriver-pubnub-2
- Owner: testdriverai
- Created: 2024-03-12T01:49:24.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-03-12T01:12:19.000Z (almost 2 years ago)
- Last Synced: 2025-03-16T02:49:39.779Z (11 months ago)
- Size: 0 Bytes
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# TestDriver - Web Quickstart
TestDriver is an AI QA Agent for GitHub. TestDriver allows you to run UI tests on your software using plaintext prompts. Every TestDriver test spawns an ephemeral VM and uploads the results to [Dashcam](https://dashcam.io) for easy debugging.
# Getting Help
TestDriver is made by [Dashcam](https://dashcam.io). Please [join the Dashcam discord for support and questions](https://discord.gg/6TUKZdfCze).
# Getting Started
## Fork This Template Repository
This template repository has the recommended settings for testing websites in Google Chrome with TestDriver. Begin by forking this template repository. Make the repository public or invite the Dashcam staff into your private repository so we can better support you.
## Add your prompt to the GitHub Action
Dashcam is powered by [our TestDriver GitHub Action](https://github.com/dashcamio/testdriver), there are more details there outlining how TestDriver works. Add your test steps to the `.github/workflows/pr.yml` file under `prompt`.
```yml
name: TestDriver.ai
jobs:
test:
name: "TestDriver"
runs-on: ubuntu-latest
steps:
- uses: dashcamio/testdriver@main
id: testdriver
with:
prompt: |
1. navigate to youtube.com in google chrome
1. search for cat videos
1. click the first one
```
### Tips on Prompting
The best way to write your prompt is to open an incognito window and perform the test acttions yourself. Write down each step you take.
1. Every step should be a single action
2. Steps are short and clear. The more information, the more likely TestDriver will be confused.
3. TestDriver works great with text, icons, shapes, and colors. It doesn't work as well with precise positioning (100px above, next to, etc).
## Test Results
TestDriver reports it's results within the GitHub actions interface.
Once you click `Details` you can view the AI-generated test summary and Dashcam results under `Summary`. Click "View Recording" or click on the thumbnail to launch the Dashcam interface.
## Test Replay
### AI Logs
You may need to select `CLI` under `APP` to view the TestDriver AI logs (marked in yellow). You'll see your prompt is fed to the AI one step at a time. Whenever the `>` appears, that is input to the AI.
You'll see the AI execute code (marked in green) that it has generated to accomplish your task.
As you play the video, the logs will playback in real time. Past logs are 100% opacity and future logs are reduced opacity. You can click on any timestamp to navigate to the point in the video where those logs were produced.
### Chrome Logs
The Chrome console logs and network requests recorded from the test are available under the "Chrome" tab.
## Building your application for development
If you do not already have deploy previews from something like Vercel or Netlify, you may build your application for testing on the machine at run time. Note that TestDriver will clone the repository and branch from which it is run.
In order to build your application, modify [the `.testdriver/prerun.sh` script](https://github.com/dashcamio/testdriver-web/blob/main/.testdriver/prerun.sh) to include your build steps. Fore example, you may add `npm build` here.
Note that currently causing an exception within `prerun.sh` may cause the test to silently fail.
# Roadmap
- [x] Mac Support
- [ ] Windows Support (5 minutes faster and 10x scale)
- [ ] Account Linking
- [ ] Publish to your own Dashcam.io Account
- [ ] Choose Dashcam Project to upload to
- [ ] Publish GitHub action into the store
- [ ] Streaming results
- [ ] Streaming Video
- [ ] Streaming Logs
- [ ] TestDriver Model V2
- [ ] Interface updates
- [ ] Auto-focus AI logs in Dashcam.io
- [ ] Test Reporting and Analyitcs Dashboard