Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/robinnoiret/importcsv_zendeskbigquery
This project involves developing a Python script to import csv export from Zendesk to BigQuery. It is not intended for recurring use, but to enable an initial dump of historical data.
https://github.com/robinnoiret/importcsv_zendeskbigquery
bigquery connector export-csvfile json zendesk
Last synced: about 1 month ago
JSON representation
This project involves developing a Python script to import csv export from Zendesk to BigQuery. It is not intended for recurring use, but to enable an initial dump of historical data.
- Host: GitHub
- URL: https://github.com/robinnoiret/importcsv_zendeskbigquery
- Owner: RobinNoiret
- Created: 2024-05-17T08:01:50.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2024-06-13T14:50:51.000Z (5 months ago)
- Last Synced: 2024-10-13T01:22:22.239Z (about 1 month ago)
- Topics: bigquery, connector, export-csvfile, json, zendesk
- Language: Python
- Homepage: https://robinnoiret.fr/
- Size: 106 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Zendesk to BigQuery Sync 🔄
## Project Description 📰
Zendesk to BigQuery Sync is a Python application designed to **efficiently import Zendesk historical data into Google BigQuery**. This project was created to address the slow import process of an existing connector. It includes different codes that complement each other to make the complete solution work.
This project is currently under development. Find the documentation [here](https://github.com/RobinNoiret/Connector_ZendeskBigQuery/blob/b54cd2f845c11ae0e6f3511d9cc095f576bae0e1/Documentation/Documentation.md).
## Prerequisites ⚠
The project requires the following Python libraries:
- json
- csv
- pandas
- google.cloud
- os
### Installation Instructions
To install the necessary dependencies, run the following commands:
```bash
pip install pandas
pip install google.cloud-bigquery
```
## Usage Instructions 💻
Make sure to locate the script file using the cd command in the terminal.
1. Open the script file and enter your information directly in the code (variables section).
```python
# Add your project ID, dataset ID, and table name
project_id = "your_projectID"
dataset_id = "your_datasetID"
table_name = "your_tablename"
os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = r'Your_credential_path'
```
2. Run the script: ` python connectorZendeskBigQuery.py `
## Configuration ⚙
Currently, the project supports only one authentication method. Additional authentication methods are planned for future development. Actualy, only local credentials work.
More informations :
- Authentification Overview : [click here](https://cloud.google.com/bigquery/docs/authentication?hl=fr)
- First step with Authentification : [click here](https://cloud.google.com/bigquery/docs/authentication?hl=fr)
- Installation G-Cloud CLI : [click here](https://cloud.google.com/sdk/docs/install?hl=fr)
## Troubleshooting 🔨
- Ensure all required libraries are installed.
- Verify your variables in the program
- Verify your Big Query account permissions (Writing rights required)
- Check your internet connection 😂
## Contribution 🤝
Contributions are welcome! Feel free to open an issue or submit a pull request if you have suggestions for improvement or are experiencing problems.
## Contact
Robin Noiret - [email protected]
Project Link: [click here](https://github.com/RobinNoiret/Connector_ZendeskBigQuery)