Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/smartdevicelink/sdl_atf_test_scripts

Test scripts for sdl_atf
https://github.com/smartdevicelink/sdl_atf_test_scripts

Last synced: 4 days ago
JSON representation

Test scripts for sdl_atf

Awesome Lists containing this project

README

        

[![Build Status](https://travis-ci.org/smartdevicelink/sdl_atf_test_scripts.svg?branch=master)](https://travis-ci.org/smartdevicelink/sdl_atf_test_scripts)

# Automated Test Framework (ATF) scripts
This repository contains ATF scripts and data to run it.

## Coverage
|Functionality |Status |Notes |
|:---|:---|:---|
|Smoke Test | 100% | Common mobile APIs check |
|Mobile API Protocol | 95% | |
|HMI API | 5% | |
|App Resumption | 10% | |
|SDL 4.0 | 100% | |
|UTF-8 Check | 100% | |
|Safety feature active | 100% | |
|Audio/Video Streaming | 20% | Planned |
|Policies | Not Covered | Planned |
|Heartbeat | Not Covered | Needs new ATF functionality |
|SecurityService | Not Covered | Needs new ATF functionality |
|Start/End Service | Not Covered | Planned |
|Transport | Not Covered | |

## Manual usage:

* [Setup SDL](https://github.com/smartdevicelink/sdl_core).
* Later the SDL sources destination directory is referenced as ``
* [Setup ATF](https://github.com/smartdevicelink/sdl_atf).
* Later the ATF sources destination directory is referenced as ``
* Later the ATF build destination directory is referenced as ``
* Clone [sdl_atf_test_scripts](https://github.com/smartdevicelink/sdl_atf)
* Later the atf test scripts destination directory is referenced as ``

```bash
git clone https://github.com/smartdevicelink/sdl_atf_test_scripts
```

* Create symlinks in the build `bin` directory to certain directories in ``:

```bash
cd /bin
ln -s /files
ln -s /test_sets
ln -s /test_scripts
ln -s /user_modules
```

* In your `/modules/configuration/base_config.lua`
* Include the path to your local SDL Core binary (ex. `/bin/`):
```lua
--- Define path to SDL binary
-- Example: "/home/user/sdl_build/bin"
config.pathToSDL = "/home/user/sdl_build/bin"
```

* Include the path to your local SDL Core Source directory (ex. `/`):
```lua
--- Define path to SDL source
-- Example: "/home/user/sdl_core"
config.pathToSDLSource = ""
```
ATF will use the provided path to derive the location of the MOBILE_API.xml and HMI_API.xml files within the directory.

* Instead of including the path to your local SDL Core Source directory, you can alternatively include the paths to your local directories containing the HMI_API and MOBILE_API files:

```lua
--- Define path to SDL MOBILE interface
-- Example: "/home/user/sdl_core/tools/rpc_spec"
config.pathToSDLMobileInterface = "/home/user/sdl_core/tools/rpc_spec"
--- Define path to SDL HMI interface
-- Example: "/home/user/sdl_core/src/components/interfaces"
config.pathToSDLHMIInterface = "/home/user/sdl_core/src/components/interfaces"
```
**NOTE:** If both `pathToSDLSource` and `pathToSDLMobileInterface`/`pathToSDLHMIInterface` are defined in the config file, the paths provided in `pathToSDLMobileInterface`/`pathToSDLHMIInterface` will override the paths derived from `pathToSDLSource`.

* Run ATF.

_Mandatory options:_
* Pass path to test script as first command line parameter
```
cd /bin
./start.sh ./test_scripts/Smoke/API/021_Speak_PositiveCase_SUCCESS.lua
```

You can get additional help of usage ATF:
```
./start.sh --help
```

#### Known Issues
- Some test cases are failed due to known SDL issues. List of failed test cases available in KnownIssues.md
- For testing different application types (NAVI, MEDIA, etc...) you need to modify your ```/modules/config.lua``` after *prepare* step