{"id":18726917,"url":"https://github.com/pytroll/fcidecomp","last_synced_at":"2025-10-03T17:08:22.873Z","repository":{"id":220115917,"uuid":"750787574","full_name":"pytroll/fcidecomp","owner":"pytroll","description":"This is an fork to open for contributions from the community to the FCIDECOMP","archived":false,"fork":false,"pushed_at":"2024-01-31T12:26:11.000Z","size":22012,"stargazers_count":2,"open_issues_count":2,"forks_count":0,"subscribers_count":5,"default_branch":"main","last_synced_at":"2025-05-19T19:19:14.785Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://gitlab.eumetsat.int/open-source/data-tailor-plugins/fcidecomp","language":"C","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pytroll.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGES.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":"AUTHORS.txt","dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-01-31T10:16:49.000Z","updated_at":"2024-10-15T22:20:23.000Z","dependencies_parsed_at":"2024-12-28T13:32:24.903Z","dependency_job_id":"9e63c616-5228-497a-9243-70ac24dadc3a","html_url":"https://github.com/pytroll/fcidecomp","commit_stats":null,"previous_names":["pytroll/fcidecomp"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/pytroll/fcidecomp","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pytroll%2Ffcidecomp","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pytroll%2Ffcidecomp/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pytroll%2Ffcidecomp/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pytroll%2Ffcidecomp/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pytroll","download_url":"https://codeload.github.com/pytroll/fcidecomp/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pytroll%2Ffcidecomp/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278196448,"owners_count":25946326,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-03T02:00:06.070Z","response_time":53,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-07T14:15:53.885Z","updated_at":"2025-10-03T17:08:22.845Z","avatar_url":"https://github.com/pytroll.png","language":"C","funding_links":[],"categories":[],"sub_categories":[],"readme":"# EUMETSAT ``fcidecomp`` software\n\nThe ``fcidecomp`` software enables decompression of near real-time spectral imagery data from the EUMETSAT Meteosat Third Generation (MTG) FCI instrument that are disseminated in compressed format (JPEG-LS netCDF). The decompression of files is possible via source code, netCDF-C and netCDF-Java based softwares, and various Python libraries\n\n## Supported platforms and installation\n\nThe ``fcidecomp`` software can be installed on:\n\n- Linux CentOS 7 64-bit\n- RockyLinux 8 64-bit (also from source code)\n- Linux Ubuntu 18.04 LTS 64-bit\n- Linux Ubuntu 20.04 LTS 64-bit (also from source code)\n- Windows 10 64-bit\n- Windows 10 32-bit\n\n## Installing the ``fcidecomp`` software\n\nInstallation procedures are described in the INSTALL file.\n\n## Testing the ``fcidecomp`` software (only for the conda-based installation)\n\nA set of Python unit tests is present to ensure the installed software works correctly. They should be run within the\nConda environment in which the software has been installed.\n\n### Prerequisites\n\n- `pytest`, installed in the Conda environment in which the software has been installed as described\n[here](https://anaconda.org/anaconda/pytest)\n\nAlso, the tests depend on the presence of a set of test data, which can be downloaded\n[here](\u003chttps://gitlab.eumetsat.int/data-tailor/epct-test-data/-/tree/development/MTG/MTGFCIL1\u003e).\nTest files should be placed in a directories tree structured as follows (replace $EPCT_TEST_DATA_DIR\nwith any chosen name):\n\n```BASH\n|_$EPCT_TEST_DATA_DIR\n  |_MTG\n    |_MTGFCIL1\n      |_\u003ctest_file_1\u003e\n      |_\u003ctest_file_2\u003e\n      |_ ...\n```\n\nOnce this is done, the environment variable `EPCT_TEST_DATA_DIR` should be set to the full path to the\n`$EPCT_TEST_DATA_DIR` directory.\n\n### Running the tests\n\nTests can be executed running the following command from within the root directory of the ``fcidecomp`` software repository:\n\n    pytest -vv tests\n\n## Using the ``fcidecomp`` software\n\nThe ``fcidecomp`` decompression library can be used in different ways, described in the following sections.\n\n### Use with netCDF4-C tools\n\n### Prerequisites\nTo use ``fcidecomp`` with ``netCDF4-C``-based tools (e.g. ``nccopy``), two prerequisites are needed:\n\n- the tools must be installed\n- the ``HDF5_PLUGIN_PATH`` environment variable must be set as described in the `INSTALL` file.\n\nIf using the conda installation, simply activate the environment created above and the prerequisites are met.\n\nIf the package has been installed from the source code, set the environment variable and install the\nrelevant package (``netcdf-4.7.0`` on RockyLinux 8, ``netcdf-bin`` on Ubuntu Linux 20.04).\n\n### Example with ``nccopy``\n\nOnce the prerequisites above are met, netCDF4-C tools should be automatically configured to decompress JPEG-LS\ncompressed netCDF files. As an example, to decompress a file using `nccopy`, run the following line:\n\n    nccopy -F none $PATH_TO_COMPRESSED_FILE $PATH_TO_DECOMPRESSED_FILE\n\nwhere:\n\n- `$PATH_TO_COMPRESSED_FILE` is the path to the JPEG-LS compressed file\n- `$PATH_TO_DECOMPRESSED_FILE` is the path where the decompressed file should be saved\n\n### Use with `h5py`-based Python libraries (conda install only)\n\nOnce the `fcidecomp` Conda package is installed and the Conda environment in which it is installed is activated,\nuse of the ``fcidecomp`` decompression libraries should be automatically enabled for `h5py`-based Python libraries.\n\nTo ensure the ``fcidecomp`` filter is loaded, in a Python shell execute:\n\n    import fcidecomp\n\nNow every `h5py`-based Python library, such as `xarray`, will be able to open and read JPEG-LS compressed files without\nfurther steps.\n\n### Use with netCDF-Java based tools\n\nWith netCDF-Java versions greater than 5.5.2, it is possible to open JPEG-LS compressed netCDFs with netCDF-Java based\ntools, such as toolsUI and Panoply, instructing netCDF-Java to use the netCDF-C library for reading purposes.\nTo enable this feature:\n\n1. if ``fcidecomp`` has been installed from the source, install the netCDF4 library package (``netcdf-4.7.0``\n   on RockyLinux 8, ``libnetcdf-c++4`` on UbuntuLinux 20..04)\n2. ensure the file `$HOME/.unidata/nj22Config.xml` exists (if it doesn't, it should be created) and\n   that it contains the following lines:\n\n        \u003cnj22Config\u003e\n          \u003cNetcdf4Clibrary\u003e\n            \u003clibraryPath\u003e$PATH_TO_NETCDF_LIB_DIR\u003c/libraryPath\u003e\n            \u003clibraryName\u003enetcdf\u003c/libraryName\u003e\n            \u003cuseForReading\u003etrue\u003c/useForReading\u003e\n          \u003c/Netcdf4Clibrary\u003e\n        \u003c/nj22Config\u003e\n\n    where `$PATH_TO_NETCDF_LIB_DIR` is the path to the directory containing the `netcdf4` library, which:\n\n    - in Linux (conda install), corresponds to `$PATH_TO_CONDA_ENV/lib`\n      with `$PATH_TO_CONDA_ENV` equal to the path to the `conda` environment in which `fcidecomp` is installed.\n    - in Windows (conda install), corresponds to `$PATH_TO_CONDA_ENV\\Library\\lib`\n      with `$PATH_TO_CONDA_ENV` equal to the path to the `conda` environment in which `fcidecomp` is installed.\n    - in RockyLinux (install from source), corresponds to `/usr/lib64`\n    - in Ubuntu 20.04 (install from source), corresponds to `/usr/lib/x86_64-linux-gnu/`\n\nTested with ToolsUI 5.5.3 on Windows, Panoply 5.1.1 on Linux (known as not working for Panoply for that version in Windows due to a\nPanoply issue).\n\n\nInventory Notices\n-----------------\n\nLicenses and copyright information for software dependencies up to version 2.0.0\nis documented within the ``inventory`` folder.\n\nFiles listed under `inventory/items/data_proprietary.ABOUT` are licensed under EUMETSAT Proprietary license.\n\n#### Dependencies\nThe following dependencies are not included in the package but are required and they will be downloaded at build or compilation time:\n* component name, version, SPDX license id, copyright, home_url, comments\n* charls, 2.1.0, BSD 3-Clause, - , https://github.com/team-charls/charls, - .\n* hdf5, 1.10.*, BSD 3-Clause, - , https://www.h5py.org/, - .\n* h5py, 2.* and 3.6.0, BSD 3-Clause, - , https://www.h5py.org/, - .\n* python, 3.8.16, see https://docs.python.org/3/license.html, - , https://www.python.org/, - .\n* zlib, 1.2.13, zlib (http://zlib.net/zlib_license.html), - , https://zlib.net/, - .\n* libnetcdf, 4.8.1, MIT , - , https://www.unidata.ucar.edu/software/netcdf/, - .\n* libssh2, 1.10.0, - , see https://www.libssh2.org/license.html , https://www.libssh2.org/, - .\n* netcdf4, 1.6.2, -, - , https://unidata.github.io/netcdf4-python/, - .\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpytroll%2Ffcidecomp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpytroll%2Ffcidecomp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpytroll%2Ffcidecomp/lists"}