{"id":26055810,"url":"https://github.com/ncar/kcor-pipeline","last_synced_at":"2026-01-29T05:39:43.785Z","repository":{"id":34341038,"uuid":"38261770","full_name":"NCAR/kcor-pipeline","owner":"NCAR","description":"Pipeline code for KCor","archived":false,"fork":false,"pushed_at":"2025-03-07T21:36:13.000Z","size":23381,"stargazers_count":3,"open_issues_count":79,"forks_count":2,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-03-07T22:27:14.748Z","etag":null,"topics":["hao","idl","kcor","mlso","pipeline"],"latest_commit_sha":null,"homepage":null,"language":"IDL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/NCAR.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2015-06-29T17:49:05.000Z","updated_at":"2025-03-07T21:36:17.000Z","dependencies_parsed_at":"2023-11-07T04:15:09.993Z","dependency_job_id":"41a0c25f-3769-47e1-a344-aec79336498b","html_url":"https://github.com/NCAR/kcor-pipeline","commit_stats":null,"previous_names":[],"tags_count":229,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NCAR%2Fkcor-pipeline","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NCAR%2Fkcor-pipeline/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NCAR%2Fkcor-pipeline/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NCAR%2Fkcor-pipeline/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/NCAR","download_url":"https://codeload.github.com/NCAR/kcor-pipeline/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":242533879,"owners_count":20144974,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["hao","idl","kcor","mlso","pipeline"],"created_at":"2025-03-08T10:22:02.781Z","updated_at":"2026-01-29T05:39:43.756Z","avatar_url":"https://github.com/NCAR.png","language":"IDL","funding_links":[],"categories":[],"sub_categories":[],"readme":"# KCor Pipeline\n\nThe COronal Solar Magnetism Observatory (COSMO) K-coronagraph (K-Cor) is one of three proposed instruments in the COSMO facility suite. It is specifically designed to study the formation and dynamics of coronal mass ejections and the evolution of the density structure of the low corona. The K-Cor records the polarization brightness (pB) formed by Thomson scattering of photospheric light by coronal free electrons. The National Center for Atmospheric Research (NCAR), via the National Science Foundation (NSF), provided full funding for the COSMO K-Cor, which was deployed to the Mauna Loa Solar Observatory (MLSO) in Hawaii in September 2013, replacing the aging MLSO Mk4 K-coronameter.\n\nThis pipeline produces level 1 and level 2 data products from the raw data from the instrument. The level 1 product contains polarization brightness (pB) images of the corona and sky, pB of the sky only, and total intensity, while the level 2 product contains pB images with sky polarization removed.\n\nThere is a near real-time component of the pipeline which produces fully calibrated level 2 pB images along with an end-of-day component which produces averages, differences, and many engineering products.\n\n\n## Requirements\n\n* IDL 8 or later\n* cmake 3.1.3 or later\n* MySQL developer installation\n* Python 2.7+ (including 3.x) in order to run command line utility script including the simulators, the production pipeline does not strictly require Python\n\n\n## Installation\n\nTo build the KCor pipeline code, your system must have IDL, the MySQL client development package, and CMake 3.1.3 or later. Make sure these are installed on your system before continuing.\n\nThese instructions will work on Linux and Mac systems. It should be possible to install the KCor pipeline on Windows systems, but it is not described here.\n\n### Configuring for your system\n\nTo configure the KCor pipeline for your system, do the following from the top-level of the pipeline source code (change the location of your IDL installation and the location where you want the pipeline to your needs):\n\n    cd kcor-pipeline\n    mkdir build\n    cmake \\\n      -DCMAKE_INSTALL_PREFIX:PATH=~/software/kcor-pipeline \\\n      -DIDL_ROOT_DIR:PATH=/opt/share/idl8.5/idl85 \\\n    ..\n\nThere are example configuration scripts, `linux_configure.sh` and `mac_configure.sh`, in the pipeline source code that are more detailed examples of the above configuration command.\n\n### Build and install\n\nNext, to build and install the KCor pipeline, run:\n\n    cd build\n    make install\n\n\n## Run the KCor pipeline\n\n### Config file\n\nThe options of the pipeline are specified via a configuration file. See the configuration specification file `kcor.spec.cfg` in the `config` directory of the distribution for all the options and their documentation. The filename of the config file must match the pattern `kcor.[NAME].cfg` with a name such as \"production\", \"latest\", or \"geometry-fix\". These configuration files must be placed in the `config/` directory.\n\nAll files with the `cfg` extension in the `config` directory will be copied into the installation during a `make install`.\n\n### Process a day\n\nFor example, to process the data from 20220712 with the `kcor.latest.cfg` configuration file use the `kcor` utility script in the `bin/` directory of the installation:\n\n    kcor process -f latest 20220712\n\nCreating the configuration file, in this case `kcor.latest.cfg`, is the main work in running the pipeline.\n\n\n## Code for KCor pipeline\n\n### Directories\n\n* *analysis* for routines to perform various analyses of KCor data\n* *bin* for shell and Python scripts\n* *cmake* for CMake modules\n* *cme_detection* for code for the automated CME detection pipeline\n* *config* for configuration files\n* *gen* for non-KCor-specific MLSO IDL routines used in the KCor pipeline\n* *hv* for helioviewer specific IDL code\n* *lib* for 3rd party IDL routines used in KCor pipeline\n* *observing* for KCor-related observing code\n* *resources* for data files such as color tables used in KCor pipeline\n* *scripts* for various scripts to be run on processed data\n* *src* for KCor pipeline IDL code\n* *ssw* for SSW IDL routines used in KCor pipeline\n* *stream* for code to remove aerosols in real-time from stream data\n* *unit* for unit tests\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fncar%2Fkcor-pipeline","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fncar%2Fkcor-pipeline","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fncar%2Fkcor-pipeline/lists"}