https://github.com/seafloor-geodesy/gnatss-test-data
Repository to host test data for GNATSS software
https://github.com/seafloor-geodesy/gnatss-test-data
data testing
Last synced: 3 months ago
JSON representation
Repository to host test data for GNATSS software
- Host: GitHub
- URL: https://github.com/seafloor-geodesy/gnatss-test-data
- Owner: seafloor-geodesy
- License: bsd-3-clause
- Created: 2024-05-17T00:05:40.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-05-17T18:34:24.000Z (about 2 years ago)
- Last Synced: 2024-05-18T01:31:24.834Z (about 2 years ago)
- Topics: data, testing
- Homepage:
- Size: 4.88 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# gnatss-test-data
This repository is used to host test data for the GNATSS software.
The data is in a zip file hosted as a release asset in this repository.
See [Releases](https://github.com/seafloor-geodesy/gnatss-test-data/releases).
## Directory Structure
The zip file contains the following directory structure:
```console
2022
├── NCL1
│ ├── 208
│ │ ├── GPS_PPP
│ │ │ ├── GPS_POS_FREED
│ │ │ ├── kin_2022208_3296
│ │ │ └── SFG100XXX_R_20222081500_01D_01S_MO.pos
│ │ ├── WG_20220727
│ │ │ ├── RPH_TWTT
│ │ │ ├── pxp_tt
│ │ │ └── pxp_tt_j2k
│ │ └── posfilter
│ │ └── POS_FREED_TRANS_TWTT
│ ├── 209
│ │ ├── GPS_PPP
│ │ │ ├── GPS_POS_FREED
│ │ │ ├── kin_2022209_3296
│ │ │ └── SFG100XXX_R_20222090000_01D_01S_MO.pos
│ │ ├── WG_20220728
│ │ │ ├── RPH_TWTT
│ │ │ ├── pxp_tt
│ │ │ └── pxp_tt_j2k
│ │ └── posfilter
│ │ └── POS_FREED_TRANS_TWTT
│ ├── 210
│ │ ├── GPS_PPP
│ │ │ ├── GPS_POS_FREED
│ │ │ ├── kin_2022210_3296
│ │ │ └── SFG100XXX_R_20222100000_01D_01S_MO.pos
│ │ ├── WG_20220729
│ │ │ ├── RPH_TWTT
│ │ │ ├── pxp_tt
│ │ │ └── pxp_tt_j2k
│ │ └── posfilter
│ │ └── POS_FREED_TRANS_TWTT
│ ├── NOV
│ │ ├── NCL1_INSPVAA.dat
│ │ └── NCL1_INSSTDEVA.dat
│ ├── ctd
│ │ └── CTD_NCL1_Ch_Mi
│ ├── deletns.dat
│ └── quality_control.csv
├── NCL1_parsed
│ ├── 208
│ │ ├── GPS_PPP
│ │ │ ├── GPS_POS_FREED
│ │ │ └── sfg12080.pos
│ │ └── WG_20220727
│ │ └── *.tar.gz
│ ├── 209
│ │ ├── GPS_PPP
│ │ │ ├── GPS_POS_FREED
│ │ │ └── sfg12090.pos
│ │ └── WG_20220728
│ │ └── *.tar.gz
│ └── 210
│ ├── GPS_PPP
│ │ ├── GPS_POS_FREED
│ │ └── sfg12100.pos
│ └── WG_20220729
│ └── *.tar.gz
└── targz_test_files
└── *.tar.gz
```
- `2022/NCL1`: The `2022` directory is the top level directory,
with `NCL1` being the station name and a subdirectory of the year.
- `208,209,210`: The `208`, `209`, and `210` directories are the day of the year.
- `GPS_PPP`: The `GPS_PPP` directory contains the GNSS data available in three formats:
- `GPS_POS_FREED`: Legacy text-column format
- `kin_*`: [PRIDE PPP-AR](https://github.com/PrideLab/PRIDE-PPPAR) kin file
- `*.pos`: [CSRS-PPP](https://webapp.csrs-scrs.nrcan-rncan.gc.ca/geod/tools-outils/ppp.php?locale=en) .pos file
- `WG_*`: The `WG_*` directory contains the roll pitch heading (`RPH_TWTT`) and travel times data (`pxp_tt_*`).
- `posfilter`: The `posfilter` directory contains the GNSS data after kalman filtering, spline interpolation, and rotation from the Fortran and Shell scripts.
- `NOV`: The `NOV` directory contains the `INS` data.
- `NCL1_INSPVAA.dat`: The `NCL1_INSPVAA.dat` file contains the INS Position, Velocity and Attitude data. See Novatel [`INSPVA`](https://docs.novatel.com/OEM7/Content/SPAN_Logs/INSPVA.htm).
- `NCL1_INSSTDEVA.dat`: The `NCL1_INSSTDEVA.dat` file contains the INS PVA standard deviations data. See Novatel [`INSSTDEV`](https://docs.novatel.com/OEM7/Content/SPAN_Logs/INSSTDEV.htm).
- `ctd`: The `ctd` directory contains the `CTD` data.
- `deletns.dat`: The `deletns.dat` file contains the deletions data from the Fortran software.
- `quality_control.csv`: The `quality_control.csv` file contains the quality control human generated data for GNATSS.
- `2022/NCL1_parsed`: A site directory containing the data telemetered back to shore from the wave glider in real time for QC purposes. These data are sampled at a reduced frequency, and include:
- `208,209,210`: The `208`, `209`, and `210` directories are the day of the year.
- `GPS_PPP`: The `GPS_PPP` directory contains the GNSS data available in two formats:
- `GPS_POS_FREED`: Legacy text-column format
- `*.pos`: [CSRS-PPP](https://webapp.csrs-scrs.nrcan-rncan.gc.ca/geod/tools-outils/ppp.php?locale=en) .pos file
- `WG_*`: The `WG_*` directory contains the raw files telemetered from the wave glider. These files are stored in a `tar.gz` format.
- `2022/targz_test_files`: A directory containing a small number of QC files telemetered to shore from an SV-3 Wave Glider during data collection, stored in a `tar.gz` format. There is one file collected each year from the years 2021-2025.
## Usage
The most direct way to use the data is using [`gnatss`](https://github.com/seafloor-geodesy/gnatss).
Within the `utilities` module there is a `testing` module that contains a function called `download_test_data`.
This function will download the test data from this repository and extract it to the specified `tests/data` directory or one that you specify.
```python
from gnatss.utilities.testing import download_test_data
# This will download the test data to the default directory
# of ${current working directory}/tests/data and unzip it.
download_test_data(unzip=True)
```
## License
This repository is licensed under the BSD 3-Clause License, see [LICENSE](LICENSE).