{"id":15914376,"url":"https://github.com/bbengfort/solar-tempest","last_synced_at":"2025-04-03T03:26:29.204Z","repository":{"id":69222773,"uuid":"143917935","full_name":"bbengfort/solar-tempest","owner":"bbengfort","description":"Predict solar weather by observing the earth's magnetosphere.","archived":false,"fork":false,"pushed_at":"2018-08-08T17:09:30.000Z","size":19395,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-02-08T17:28:40.933Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bbengfort.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-08-07T19:27:11.000Z","updated_at":"2018-08-08T17:09:31.000Z","dependencies_parsed_at":"2023-04-20T17:35:05.964Z","dependency_job_id":null,"html_url":"https://github.com/bbengfort/solar-tempest","commit_stats":{"total_commits":5,"total_committers":1,"mean_commits":5.0,"dds":0.0,"last_synced_commit":"c21b5bf2716f752cb823bac2f01b6531f248dc66"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bbengfort%2Fsolar-tempest","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bbengfort%2Fsolar-tempest/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bbengfort%2Fsolar-tempest/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bbengfort%2Fsolar-tempest/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bbengfort","download_url":"https://codeload.github.com/bbengfort/solar-tempest/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246930060,"owners_count":20856535,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-06T17:02:01.109Z","updated_at":"2025-04-03T03:26:29.182Z","avatar_url":"https://github.com/bbengfort.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Solar Tempest\n\n**Predict solar weather by observing the earth's magnetosphere.**\n\nThis package contains sample USGS data in `fixtures/sample`, organized as compressed IAGA 2002 data files in `\u003cOBSERVATORY\u003e/OneSecond/` directories. This data structure can be read with the utilities in the `iaga` package, particularly the `DataFile` and `GlobalData` objects.\n\nYou can use the `DataFile` object to read a single compressed [IAGA 2002](https://www.ngdc.noaa.gov/IAGA/vdat/IAGA2002/iaga2002format.html) data file without decompressing the file to disk as follows:\n\n```python\nimport json\nfrom iaga import Datafile\n\n# Use the context manager to ensure memory is cleaned up when done\nwith DataFile(\"fixtures/sample/HON/OneSecond/hon20140407vsec.sec.gz\") as f:\n    # Print meta data from header of data file\n    print(json.dumps(f.meta))\n\n    # Print the field names described in the file\n    print(f.fields)\n\n    # Loop over all the parsed records, which are numpy arrays\n    for record in f:\n        # Do something with record\n```\n\nThe `GlobalData` utility manages the data directory as a whole, opening data files sorted by the date specified in their file name so that all data is read in chronological order.\n\n```python\nfrom iaga import GlobalData\n\ndata = GlobalData(\"fixtures/sample\")\n\n# Show the observatories (directories) being managed\nprint(data.observatories)\n\n# Print the field names describing the record\nprint(data.fields)\n\n# Loop over all joined records, which are numpy arrays\n# Note that the records rows should be ordered by timestamp\n# The record columns should be HDZF records for each observatory, ordered\n# by the observatory name (alphabetically)\nfor record in data:\n    # Do something with record\n```\n\n## Benchmark\n\nThis implementation is _memory efficient_, though unfortunately not time efficient. The memory performance for a global read of 14 observatories worth of data is as follows:\n\n![Memory Performance](fixtures/memory_benchmark.png)\n\nAs you can see, the memory usage never really goes above 250MB and drops as each file is opened and closed.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbbengfort%2Fsolar-tempest","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbbengfort%2Fsolar-tempest","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbbengfort%2Fsolar-tempest/lists"}