{"id":14981223,"url":"https://github.com/typpo/asterank","last_synced_at":"2025-07-22T10:35:11.012Z","repository":{"id":1022356,"uuid":"4144488","full_name":"typpo/asterank","owner":"typpo","description":"asteroid database, interactive visualizations, and discovery tools","archived":false,"fork":false,"pushed_at":"2023-05-01T19:35:51.000Z","size":174117,"stargazers_count":334,"open_issues_count":39,"forks_count":69,"subscribers_count":30,"default_branch":"master","last_synced_at":"2025-03-29T22:06:54.379Z","etag":null,"topics":["asteroid","space","three-js","webgl"],"latest_commit_sha":null,"homepage":"http://asterank.com","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/typpo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2012-04-26T05:07:42.000Z","updated_at":"2025-03-16T00:50:03.000Z","dependencies_parsed_at":"2023-02-17T15:46:23.864Z","dependency_job_id":"78fd9525-fc4e-40c1-9959-e0d1f87b435c","html_url":"https://github.com/typpo/asterank","commit_stats":{"total_commits":1411,"total_committers":12,"mean_commits":"117.58333333333333","dds":"0.20623671155209067","last_synced_commit":"91a34b3a138c3f0f8727b1eb823d526979aae3ce"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/typpo%2Fasterank","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/typpo%2Fasterank/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/typpo%2Fasterank/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/typpo%2Fasterank/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/typpo","download_url":"https://codeload.github.com/typpo/asterank/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247411234,"owners_count":20934653,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["asteroid","space","three-js","webgl"],"created_at":"2024-09-24T14:03:10.158Z","updated_at":"2025-04-05T23:08:22.944Z","avatar_url":"https://github.com/typpo.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Asterank\n\nAsterank (www.asterank.com) is a space development platform.  It supports calculations over the entire set of known asteroids and provides APIs and visualizations for many data sources, including NASA/JPL Horizons, NASA SkyMorph/NEAT and SDSS sky surveys, the Kepler Project, and the Minor Planet Center.\n\nThe main purpose of Asterank is to make space-related data readily accessible to the public.  Another goal of the site is to educate and inspire by demonstrating the importance of asteroid discovery and exploration.  Using publicly available data and scientific papers, the project evaluates the economic prospects of mining nearly 600,000 cataloged asteroids.  In addition, Asterank is the basis of a crowdsourced asteroid discovery citizen science initiative.\n\nAsterank has been featured by BBC News, Popular Science, and other media.\n\n## The basics\n\nAsterank is configured to run with virtualenv.  Virtual environment setup:\n\n  1. Install python and python virtualenv dependencies, eg. on ubuntu:\n\n    ```\n    sudo apt-get install python python-virtualenv\n    ```\n\n  2. Enter the Asterank directory.  Then, create the virtual environment and install packages:\n\n    ```\n    virtualenv  venv\n    source venv/bin/activate\n    pip install -r requirements.txt\n    ```\n\n  3. The web app requires mongodb.  `sudo apt-get install mongodb`.\n\n  4. The image pipeline requires some paths in `/var/asterank`.  Set them up like so:\n\n     ```\n     mkdir -p /var/asterank/neat_binary_store\n     mkdir -p /var/asterank/neat_binary_cache\n     mkdir -p /var/asterank/skymorph_store\n     mkdir -p /var/asterank/skymorph_cache\n     ```\n\n  5. The main app is a Flask web application.  You should be able to run it now.\n\n    ```\n    ./app.py\n    ```\n\nYou'll quickly notice that there's no data.  Continue reading for instructions on how to import data.\n\n## The data pipeline\n\nThe `data/pipeline` folder contains the scrapers used to aggregate and build the database and associated APIs.\n\n### SBDB setup\n\nThe SBDB is too large to include in this repo, and downloading it takes some time.  Download http://www.ianww.com/latest_fulldb.csv to `data/pipeline/static/`, or produce your own database by going to http://ssd.jpl.nasa.gov/sbdb_query.cgi and downloading all attributes for all objects in CSV format.\n\n### Running the pipeline\n\nPipeline tasks are folders in the `pipeline/run` directory and are executed in increasing lexical order.  Tasks with the same numeric prefix may be run in parallel.\n\nTo execute the pipeline, simply run `./pipeline`.  To execute a specific task, run eg. `./pipeline 00_mytask`, where 00\\_mytask matches a directory.  In order to run Asterank, you at least need to run steps `00_deltav` and `10_sbdb`.\n\n## The sky survey/discovery process\n\n### NEAT\n\nSky survey data is scraped from NEAT.  The process is generally three steps per asteroid:\n\n  1. Collect asteroid observations and group them into nearby observations (within ~30 min of one another).\n\n  2. Fetch images corresponding to each image group.\n\n  3. Compute/extract astrometry from the image.  We use the open-source library available at [astrometry.net](http://astrometry.net).\n\nNote that sky survey data depends on redis: `sudo apt-get install redis-server`.\n\nAll this happens in `v2/stackblink`.  In `data/astrometry` there are scripts available to help you bootstrap your astrometry setup.\n\n### SDSS\n\nSDSS setup:\n\n  1. `cd sdss`\n  2. `cat stripe_82 | ./load_data.sh`\n  3. `./process_images.sh`\n\n## How to collaborate\n\n  1. Fork this repository\n  2. Make changes\n  3. Create a pull request on github\n\nIf you think you might like to contribute, feel free to contact me! ianw\\_asterank at ianww.com.\n\n## Notes and Todo\n\nSee [github issues](https://github.com/typpo/asterank/issues?state=open).\n\n## License (MIT)\n\nCopyright (C) 2012 by Ian Webster (asterank.com)\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in\nall copies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN\nTHE SOFTWARE.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftyppo%2Fasterank","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftyppo%2Fasterank","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftyppo%2Fasterank/lists"}