An open API service indexing awesome lists of open source software.

https://github.com/astrolabsoftware/fink-filters

Define your filters to create your alert stream in Fink!
https://github.com/astrolabsoftware/fink-filters

astronomy broker extension pyspark python

Last synced: 4 months ago
JSON representation

Define your filters to create your alert stream in Fink!

Awesome Lists containing this project

README

          

[![pypi](https://img.shields.io/pypi/v/fink-filters.svg)](https://pypi.python.org/pypi/fink-filters)
[![Sentinel ZTF](https://github.com/astrolabsoftware/fink-filters/actions/workflows/run_test_ztf.yml/badge.svg)](https://github.com/astrolabsoftware/fink-filters/actions/workflows/run_test_ztf.yml)
[![Sentinel Rubin](https://github.com/astrolabsoftware/fink-filters/actions/workflows/run_test_rubin.yml/badge.svg)](https://github.com/astrolabsoftware/fink-filters/actions/workflows/run_test_rubin.yml)
[![PEP8](https://github.com/astrolabsoftware/fink-filters/workflows/PEP8/badge.svg)](https://github.com/astrolabsoftware/fink-filters/actions?query=workflow%3APEP8)
[![codecov](https://codecov.io/gh/astrolabsoftware/fink-filters/branch/master/graph/badge.svg)](https://codecov.io/gh/astrolabsoftware/fink-filters)

# Fink filters

This repository contains filters used to flag particular parts of the full stream to be distributed to Fink users. More information about available topics and how to create your filter at [https://fink-broker.readthedocs.io/en/latest/science/filters](https://fink-broker.readthedocs.io/en/latest/science/filters/).

## Installation

If you want to install the package (broker deployment), you can just pip it:

```bash
pip install fink_filters --upgrade
```

## Taxonomy

There are two types of filters: filters that run on the live stream, and filters that are applied after the observing night (e.g. because they need to aggregate data before, or compute statistics). For each survey, the first kind can be found in the folder `livestream`.

## Rubin

For Rubin, 1 filter = 1 class = 1 HBase table (query). The name of the filter is also the same name for the class, and the same name for the Kafka topic.

### Test data

Testing the filters & blocks require science data. Fire a Fink container, process data inside, and transfer it here (`datatest` folder).