Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/edgarrmondragon/tap-criteo
Singer tap for Criteo, built with the Meltano SDK
https://github.com/edgarrmondragon/tap-criteo
singer-io singer-tap
Last synced: 22 days ago
JSON representation
Singer tap for Criteo, built with the Meltano SDK
- Host: GitHub
- URL: https://github.com/edgarrmondragon/tap-criteo
- Owner: edgarrmondragon
- Created: 2021-07-21T05:43:50.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2024-09-16T19:51:32.000Z (about 2 months ago)
- Last Synced: 2024-09-17T01:09:24.183Z (about 2 months ago)
- Topics: singer-io, singer-tap
- Language: Python
- Homepage:
- Size: 197 KB
- Stars: 0
- Watchers: 2
- Forks: 1
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# tap-criteo
`tap-criteo` is a Singer tap for Criteo.
Built with the Meltano [SDK](https://gitlab.com/meltano/sdk) for Singer Taps.
## Installation
```bash
pipx install git+https://github.com/edgarrmondragon/tap-criteo.git
```
## Configuration
### Accepted Config Options
A full list of supported settings and capabilities for this tap is available by running:
```bash
tap-criteo --about
```
### Source Authentication and Authorization
## Usage
You can easily run `tap-criteo` by itself or in a pipeline using [Meltano](www.meltano.com).
### Executing the Tap Directly
```bash
tap-criteo --version
tap-criteo --help
tap-criteo --config CONFIG --discover > ./catalog.json
```
## Developer Resources
### Initialize your Development Environment
```bash
pipx install poetry
poetry install
```
### Create and Run Tests
Create tests within the `tap_criteo/tests` subfolder and
then run:
```bash
poetry run pytest
```
You can also test the `tap-criteo` CLI interface directly using `poetry run`:
```bash
poetry run tap-criteo --help
```
### Testing with [Meltano](https://www.meltano.com)
_**Note:** This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios._
Install Meltano (if you haven't already) and any needed plugins:
```bash
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-criteo
meltano install
```
Now you can test and orchestrate using Meltano:
```bash
# Test invocation:
meltano invoke tap-criteo --version
# OR run a test `elt` pipeline:
meltano elt tap-criteo target-jsonl
```
### SDK Dev Guide
See the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to
develop your own taps and targets.