https://github.com/ekspla/read-symbian-sportstracker-file
This python script describes how you can read symbian (Nokia) Sports Tracker log files (W*.dat) in binary format. You can use this code to convert from DAT file to GPX file.
https://github.com/ekspla/read-symbian-sportstracker-file
dat gps gpx nokia python3 scsu sports-tracker symbian
Last synced: 6 months ago
JSON representation
This python script describes how you can read symbian (Nokia) Sports Tracker log files (W*.dat) in binary format. You can use this code to convert from DAT file to GPX file.
- Host: GitHub
- URL: https://github.com/ekspla/read-symbian-sportstracker-file
- Owner: ekspla
- License: lgpl-2.1
- Created: 2020-09-24T05:39:16.000Z (about 5 years ago)
- Default Branch: master
- Last Pushed: 2025-03-14T01:07:10.000Z (7 months ago)
- Last Synced: 2025-03-25T03:42:04.286Z (7 months ago)
- Topics: dat, gps, gpx, nokia, python3, scsu, sports-tracker, symbian
- Language: Python
- Homepage:
- Size: 6.41 MB
- Stars: 4
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Read-Symbian-SportsTracker-file -- How to read binary dat files.
This python script, `convert_nst_files_to_gpx.py`, describes how you can read **symbian (Nokia) Sports Tracker files (W\*.dat and R\*.dat)**
stored in your phone as **binary format**. You can use this code, as it is, to **convert from dat to gpx**. The code depends on
[lxml](https://pypi.org/project/lxml/) with a fallback to built-in ElementTree. For performance reasons, **use of lxml is highly recommended.**
The code was tested with > 1000 of track log files copied from my Nokia phone equipped with GPS receiver, never tested with heart-rate
sensor, though...
There is still a few unknown part in the track logs. So, your [feedback](https://github.com/ekspla/Read-Symbian-SportsTracker-file/issues)
is welcomed.
## How to use
Install from [PyPI](https://pypi.org/project/symbian-sports-tracker/)
```Shell
pip install symbian-sports-tracker
```
alternatively from github as follows:
```Shell
pip install "git+https://github.com/ekspla/Read-Symbian-SportsTracker-file.git@pip_install"
```
or simply download/copy the \*.py files to an appropriate directory from the
[master branch](https://github.com/ekspla/Read-Symbian-SportsTracker-file) in github.
Now you can run
```Shell
convert_nst_files_to_gpx input_filename.dat > output_filename.gpx
```
where *input_filename.dat* is the name of the track or route file.
The reference and test files (see below), that are not included in the package of PyPI, can be obtained from
[github](https://github.com/ekspla/Read-Symbian-SportsTracker-file).
## Detailed explanation
This package consists of five \*.py files. `nst.py`, `scsu.py` and `mini_gpx.py`are pure library modules while
`convert_nst_files_to_gpx.py` and `convert_nst_rec_to_gpx.py` are scripts using the modules.
`convert_nst_files_to_gpx.py` works also for track/route files created by **the old Nokia Sports Tracker**, whose format is
a bit different from the new version released from [Sports Tracking Technologies Ltd](http://www.sports-tracker.com/).
For details, please see the codes. (1-byte instead of 2-byte long header, start address of trackpoint is different, etc.)
The version number of the file is stored as WORD at 0x0008.
- Track log files of the old Nokia SportsTracker (ver0): version < 10000.
- Track/Route files of the old Nokia SportsTracker (ver1): 10000 <= version < 20000.
- Track log files of Symbian SportsTracker (ver2): 20000 <= version.
The track reading function was tested for the old and the new NST versions of 9991-9998, 10102 and 20001-20002, while
the route reading one was tested for version of 11400.
The file formats of symbian are completely different from those of Android and iOS.
These codes are **not based on reverse engineering of the app** itself, but on careful analysis of the track log files.
**Non ASCII** (non-alphanumeric) **characters** contained in the track log files that are encoded by
[SCSU](https://www.unicode.org/reports/tr6/tr6-4.html) are read by using an external module, `scsu.py`.
This is a ported version of [Czyborra's decoder written in C](http://czyborra.com/scsu/), `references/scsu.c`.
(Characters of Arabic, Bengali, Chinese, German, Hindi, Japanese, Portuguese, Punjabi, Russian, Spanish and surrogate pairs
were tested, see `test_scsu/`.)
## Files in the phone
There are files as followings in the directory named **_drive_name_:\SportsTracker\\** (old version) or **_drive_name_:\SportsTracker2\\**
(new version). _Drive_name_ (C, D, E, etc.) depends on where you installed the app (phone memory, sd card, etc.).
- `config.dat`: contains a lot of **personal data**, including _id--name_ lookup tables of user and activity, etc.
- `W*.dat`: **track log** files in binary format. The file formats of **the new and the old versions** are slightly different each other as
mentioned before. [A fetched sample file (the old format)](https://www.elektroda.pl/rtvforum/topic1416097.html),
[another one (the new format)](https://sourceforge.net/p/gpsbabel/mailman/message/26219411/) and the converted gpx files are in `references/`.
- `R*.dat`: **route** files of **the old version** in binary format. The file format, though it lacks for timestamps, is very similar to that of
track log of the old version NST.
- `Rec*.tmp`: **temporal track log files** we see on application crash. More example is needed, yet [a file useful to test was obtained from
the internet](https://forum.allnokia.ru/viewtopic.php?t=65299&start=210). The file format seems to be very simple, see
`references/Rec211109168_dump.txt` (a hex dump file with comments), `convert_nst_rec_to_gpx.py` (the script) and
`references/Rec211109168.gpx` (the converted gpx file) for details.
## Limitation
- Units other than Metrics (km and km/h), such as Imperial (mi and mph) and Nautical (nm and kn), were not tested.
## Note added for the users of www.sports-tracker.com
- Its gpx handling code seems very faulty.
- The time format should be **YYYY-MM-DDThh:mm:ss\[.SSS]\[+-HH:MM]**. Use of **Z** as UTC timezone is **not allowed**. The resolution should be milliseconds (**microseconds not allowed**).
You have to modify as followings:
in format_time() of mini_gpx.py, delete `.replace('+00:00', 'Z')` to use +00:00 as UTC.
``` python
return datetime.isoformat()
```
in store_trackpt() of nst.py, add `round( , 3)` to remove microseconds.
``` python
time=dt_from_timestamp(round(tp.unix_time, 3), dt.timezone.utc),
```
## TODO
- A few unknown field in the track points.
- Support for heart rate in track log files of the new version (example files needed).
## License
This software is released under the LGPL v2.1 License.
## Reference
- [Sports Tracker - Wikipedia](https://en.wikipedia.org/wiki/Sports_Tracker)
- [Standard Compression Scheme for Unicode - Wikipedia](https://en.wikipedia.org/wiki/Standard_Compression_Scheme_for_Unicode)
- [A Standard Compression Scheme for Unicode - Unicode Technical Standard #6](https://www.unicode.org/reports/tr6/tr6-4.html)
- [The SCSU charset -- Roman Czyborra's decoder](http://czyborra.com/scsu/)