{"id":18762640,"url":"https://github.com/deephyper/deephyper-spack-packages","last_synced_at":"2026-02-27T06:14:49.490Z","repository":{"id":104962396,"uuid":"595542792","full_name":"deephyper/deephyper-spack-packages","owner":"deephyper","description":"Spack packages to use DeepHyper.","archived":false,"fork":false,"pushed_at":"2025-01-13T02:59:24.000Z","size":46,"stargazers_count":1,"open_issues_count":1,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-13T03:31:42.489Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/deephyper.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-01-31T09:51:45.000Z","updated_at":"2024-12-16T15:30:24.000Z","dependencies_parsed_at":null,"dependency_job_id":"a2c93a01-1d35-4db1-873a-fa0dad539fe1","html_url":"https://github.com/deephyper/deephyper-spack-packages","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deephyper%2Fdeephyper-spack-packages","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deephyper%2Fdeephyper-spack-packages/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deephyper%2Fdeephyper-spack-packages/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deephyper%2Fdeephyper-spack-packages/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/deephyper","download_url":"https://codeload.github.com/deephyper/deephyper-spack-packages/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239661219,"owners_count":19676402,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-07T18:22:33.853Z","updated_at":"2025-12-05T10:30:19.105Z","avatar_url":"https://github.com/deephyper.png","language":"Python","readme":"# DeepHyper Spack Packages\n\n## Overview\n\nThis repository contains a collection of [Spack](https://spack.io) packages to manage the building of DeepHyper from source. Start by installing Spack on your system:\n\n```bash\ngit clone -c feature.manyFiles=true https://github.com/spack/spack.git\n. ./spack/share/spack/setup-env.sh \n```\n\nSpack is quite recent and evolving quickly. Many packages are regularly updated. Therefore it can sometimes be useful to checkout the `develop` branch of Spack (`git checkout develop`) in case of issue to see if a fix has already been provided but not yet released.\n\nNow should have access to the `spack` command. If you need spack to be loaded for any new session of your shell then you can add `. $PATH_TO_SPACK/spack/share/spack/setup-env.sh` to your `~/.bashrc` (or any other shell configuration). Once Spack is installed and loaded. Download the DeepHyper Spack packages and add them to your Spack installer:\n\n\n```bash\ngit clone https://github.com/deephyper/deephyper-spack-packages.git\nspack repo add deephyper-spack-packages\n```\n\nAfter adding the `deephyper-spack-packages` to your Spack installer, create a Spack environment for deephyper:\n\n```bash\nspack env create deephyper\nspack env activate deephyper\n```\n\nYou are now ready to install DeepHyper. DeepHyper provides different set of features which not necessary for all users. By default, DeepHyper's installation only brings the basic hyperparameter optimization algorithm with Bayesian optimization and allow parallelism with a centralized scheme (1-manager, n-workers) through basic multi-thread or multi-processing pools.\n\n```\nspack add py-deephyper\nspack install\n```\n\nOther features can be installed with the following variants:\n\nVariants for Machine Learning Features\n```bash\nspack add py-deephyper +jax-cpu # Jax support\nspack add py-deephyper +torch # PyTorch support\n\n# All ML Features\nspack add py-deephyper +jax-cpu+torch\n```\n\nVariants for Storage and Parallel Backends\n```bash\nspack add py-deephyper +mpi # MPI support for MPICommEvaluator\nspack add py-deephyper +ray # Ray support for RayEvaluator\nspack add py-deephyper +redis # Redis/RedisJSON/py-redis support for RedisStorage and Distributed Search\n\n# Common storage/parallel features and pairings\nspack add py-deephyper +ray+redis\nspack add py-deephyper +mpi+redis\n\n```\n\nAdd Dev tools\n```bash\nspack add py-deephyper +dev\n```\n\nFor versions and branches of DeepHyper it is possible to either build from the github repository branches or to build from a release published on pypi.\n\n```bash\nspack add py-deephyper@master # from master branch on Github\nspack add py-deephyper@develop # from develop branch on Github\nspack add py-deephyper # from pypi\nspack add py-deephyper@0.9.3 # version 0.9.3 from pypi\n```\n\nThe `info` command can help retrieve more information about the possible variants and versions which can be installed.\n\n```bash\nspack info py-deephyper\n```\n\n## Accessing Shared Site Packages\n\nSometimes the HPC facility can provide already compiled/installed packages. Spack can reuse these packages by defining a new `upstream` configuration. After cloning the Spack repository and activating the Spack environment (the command `spack` should now be available in your shell) add a new upstream configuration in the YAML file `$SPACK_ROOT/etc/spack/upstream.yaml` (`$SPACK_ROOT` should be available in your environment after activation of Spack).\n\nAt the Argonne Leadership Computing Facility (ALCF), Spack packages are provided at the `/soft/spack/root/opt/spack` location. Therefore we can edit the `upstream.yaml` file such as:\n\n\n```yaml\nupstreams: \n    alcf-spack: \n        install_tree: /soft/spack/root/opt/spack\n```\n\nMore information about [Chaining Spack Installations](https://spack.readthedocs.io/en/latest/chain.html#using-multiple-upstream-spack-instances).\n\n## Spack and Conda\n\n```\nspack add miniconda3\n```\n\nfor mac with arm64 use the `conda-forge` channel!\n```\nconda install -c conda-forge ...\n```\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeephyper%2Fdeephyper-spack-packages","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdeephyper%2Fdeephyper-spack-packages","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeephyper%2Fdeephyper-spack-packages/lists"}