{"id":19307403,"url":"https://github.com/artefactory/artefactory-connectors-kit","last_synced_at":"2025-04-22T12:36:34.784Z","repository":{"id":39828767,"uuid":"252426464","full_name":"artefactory/artefactory-connectors-kit","owner":"artefactory","description":"ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.","archived":false,"fork":false,"pushed_at":"2023-10-03T04:39:09.000Z","size":68492,"stargazers_count":42,"open_issues_count":31,"forks_count":6,"subscribers_count":6,"default_branch":"dev","last_synced_at":"2025-04-02T00:01:42.323Z","etag":null,"topics":["adobe-analytics","amazon-s3","api","confluence","dcm","dv360","facebook","google-ads","google-analytics","google-cloud-storage","google-sheets","mysql","mytarget","radarly","salesforce","search-console","the-trade-desk","twitter","yandex"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"lgpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/artefactory.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-04-02T10:39:01.000Z","updated_at":"2024-08-12T03:59:59.000Z","dependencies_parsed_at":"2024-11-10T00:10:53.284Z","dependency_job_id":null,"html_url":"https://github.com/artefactory/artefactory-connectors-kit","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/artefactory%2Fartefactory-connectors-kit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/artefactory%2Fartefactory-connectors-kit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/artefactory%2Fartefactory-connectors-kit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/artefactory%2Fartefactory-connectors-kit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/artefactory","download_url":"https://codeload.github.com/artefactory/artefactory-connectors-kit/tar.gz/refs/heads/dev","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250242082,"owners_count":21398063,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["adobe-analytics","amazon-s3","api","confluence","dcm","dv360","facebook","google-ads","google-analytics","google-cloud-storage","google-sheets","mysql","mytarget","radarly","salesforce","search-console","the-trade-desk","twitter","yandex"],"created_at":"2024-11-10T00:10:48.998Z","updated_at":"2025-04-22T12:36:34.157Z","avatar_url":"https://github.com/artefactory.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Artefactory Connectors Kit\n\n**ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.**\n\nAs of now, the most common output format of data loaded by the application is .njson (i.e. a file of n lines, where each line is a json-like dictionary).\n\nOfficial documentation is available [here](https://artefactory.github.io/artefactory-connectors-kit/).\n\n---\n\n## Philosophy\n\nThe application is composed of **3 main components** (*implemented as Python classes*). When combined, these components act as an E(T)L pipeline, allowing you to stream data from a source to the destination of your choice:\n\n- [Readers](ack/readers) are reading data from an API source, and transform it into a stream object.\n- [Streams](ack/streams) (*transparent to the end-user*) are local objects used by writers to process individual records collected from the source.\n- [Writers](ack/writers) are writing the output stream object to the destination of your choice.\n\n## Why not Airbyte ?\n\n[Airbyte](https://github.com/airbytehq/airbyte) is an open source project that has a mission to make data integration pipelines a commodity.\nWe love this project and would probably not encourage using ACK to connect data that could be already connected with Airbyte.\nYou can still use ACK if some of your data has no connector available in Airbyte yet.\nThe list of connectors unavailable in Airbyte will most certainly decrease over time following the introduction of the [Python Connector Development Kit](https://github.com/airbytehq/airbyte/tree/master/airbyte-cdk/python).\n\n## Available connectors\n\nAs of now, the application is offering the following Readers \u0026 Writers:\n \n### Readers\n\n- **Analytics**\n    - Adobe Analytics 1.4\n    - Adobe Analytics 2.0\n    - Google Analytics (available in Airbyte)\n- **Advertising - Adserver**\n    - Google Campaign Manager\n- **Advertising - DSP**\n    - Google Display \u0026 Video 360\n    - The Trade Desk\n- **Advertising - Search**\n    - Google Ads (available in Airbyte)\n    - Google Search Ads 360\n    - Google Search Console\n    - Yandex Campaign\n    - Yandex Statistics\n- **Advertising - Social**\n    - Facebook Marketing (available in Airbyte)\n    - MyTarget\n    - Radarly\n    - Twitter Ads\n- **Affiliates**\n    - AWIN Advertiser\n- **CRM**\n    - SalesForce (available in Airbyte)\n- **Databases**\n    - MySQL (available in Airbyte)\n- **DevTools**\n    - Confluence\n- **Files (.csv, .njson)**\n    - Amazon S3\n    - Google Cloud Storage\n    - Google Sheets (available in Airbyte)\n\n### Writers\n\n- **Data Warehouses**\n    - Google BigQuery (available in Airbyte)\n- **Debugging**\n    - Console\n- **Files (.njson)**\n    - Amazon S3\n    - Google Cloud Storage\n    - Azure Blob Storage\n    - Local file (available in Airbyte)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fartefactory%2Fartefactory-connectors-kit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fartefactory%2Fartefactory-connectors-kit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fartefactory%2Fartefactory-connectors-kit/lists"}