{"id":13684999,"url":"https://github.com/maximumstock/poe-stash-indexer","last_synced_at":"2025-05-01T00:34:06.632Z","repository":{"id":37003301,"uuid":"268379206","full_name":"maximumstock/poe-stash-indexer","owner":"maximumstock","description":"An indexer for Path of Exile's Public Stash Tab API and additional tooling","archived":false,"fork":false,"pushed_at":"2025-04-25T08:32:39.000Z","size":14361,"stargazers_count":17,"open_issues_count":7,"forks_count":5,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-25T11:58:49.895Z","etag":null,"topics":["indexer","pathofexile","poe","public-stash-api","stash-tabs"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/maximumstock.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-05-31T23:04:08.000Z","updated_at":"2025-04-16T08:37:12.000Z","dependencies_parsed_at":"2024-05-23T09:50:03.480Z","dependency_job_id":"6c84cb8a-af76-48b3-9a45-95f9c5628cd3","html_url":"https://github.com/maximumstock/poe-stash-indexer","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maximumstock%2Fpoe-stash-indexer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maximumstock%2Fpoe-stash-indexer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maximumstock%2Fpoe-stash-indexer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/maximumstock%2Fpoe-stash-indexer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/maximumstock","download_url":"https://codeload.github.com/maximumstock/poe-stash-indexer/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251803604,"owners_count":21646456,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["indexer","pathofexile","poe","public-stash-api","stash-tabs"],"created_at":"2024-08-02T14:00:41.877Z","updated_at":"2025-05-01T00:34:06.626Z","avatar_url":"https://github.com/maximumstock.png","language":"Rust","funding_links":[],"categories":["Development"],"sub_categories":["Libraries"],"readme":"![Continuous Integration](https://github.com/maximumstock/poe-stash-indexer/workflows/Continuous%20Integration/badge.svg)\n\n# poe-stash-indexer\n\nThis project aims to build tooling to gather data from Path of Exile's\n[Public Stash Tab API](https://www.pathofexile.com/developer/docs/reference#publicstashes)\n(see also the older [community wiki documentation](https://pathofexile.gamepedia.com/Public_stash_tab_API)).\n\nThe main component in this project is the [indexer](crates/indexer/README.md) application.\nIt offers an easy way to consume the [Public Stash Tab API river](https://www.pathofexile.com/developer/docs/reference#publicstashes) and flush it data sinks like RabbitMQ or S3 for further processing.\n\nMore on the installation \u0026 usage in the dedicated [documentation](./crates/indexer/README.md).\n\n## Project Structure\n\n```bash\n├── Makefile\n├── README.md       # you are here\n├── crates\n│   ├── indexer     # the main application\n│   ├── stash-api   # an internal library that `indexer` uses below are some internal prototypes, you can ignore for now\n│   ├── stash-differ\n│   ├── trade-api\n│   ├── trade-common\n├── notes           # some notes for myself\n├── infra           # internal scripts, CI parts and documentation for my own `indexer` deployment\n└── shell.nix\n```\n\n## Local Dev Environment\n\nIf you are using `nix`, just run `nix-shell` and enjoy all dependencies being installed.\n\nFrom there you can setup the respective crate application you want to run via environment variables however you see fit.\nSee the [indexer README.md](./crates/indexer/README.md) for more information on what environment variables to set.\n\n### Example Docker Setup\n\nThere are a couple different applications in this umbrella project of which only `indexer` is as of now relevant for users.\nAs an example, there is [`infra/docker-compose.yaml`](./docker-compose.yaml) defines a setup of `indexer` and some of the other prototypes.\nFeel free to use or copy any of it.\n\n- `indexer` - setup of the `indexer` service to start fetching and feed the data stream into a RabbitMQ instance\n- `rabbitmq` - a RabbitMQ instance for `indexer` to ingest new `Stash` batches into to test the RabbmitMQ sink\n- setup of the `trade-ingest` \u0026 `trade-api` services to consume above stream and expose it via its REST-like API, respectively\n- `trade-store` - a PostgreSQL instance for `trade-ingest` to ingest into and `trade-api` to read data from\n- `otel-collector` - an [OTLP setup](https://github.com/open-telemetry/opentelemetry-rust) (integrating with New Relic) to investigate metrics of the `indexer`, `trade-ingest`, `trade-api`\n- `reverse-proxy` - exposes a reverse proxy setup via nginx to easily access all services (see below)\n\nHere is a list of services in this local development setup and and their credentials (`username`:`password`):\n\n- [Trade API](http://trade.localhost:8888) (public)\n- [RabbitMQ Control Panel](http://rabbitmq.localhost:8888) (Basic Auth: `poe:poe`)\n- [Jaeger Dashboard](http://jaeger.localhost:8888) (public)\n\nFor testing the PostgreSQL `indexer` sink, you can run something like:\n\n`docker run --name pg-poe -e POSTGRES_PASSWORD=poe -e POSTGRES_USER=poe -e POSTGRES_DB=poe -p 5432:5432 postgres:latest`\n\nand connect to `pg://poe:poe@127.0.0.1:5432/poe`.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmaximumstock%2Fpoe-stash-indexer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmaximumstock%2Fpoe-stash-indexer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmaximumstock%2Fpoe-stash-indexer/lists"}