Projects in Awesome Lists tagged with data-synchronization
A curated list of projects in awesome lists tagged with data-synchronization .
https://github.com/rudderlabs/rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
bigquery cdp customer-data customer-data-lake customer-data-pipeline customer-data-platform data-engineering data-integration data-pipeline data-synchronization data-warehouse elt etl event-streaming privacy redshift segment-alternative snowflake warehouse-management warehouse-native
Last synced: 13 May 2025
https://github.com/bytedance/bitsail
BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.
big-data data-integration data-lake data-pipeline data-synchronization flink high-performance real-time
Last synced: 15 May 2025
https://github.com/CondensationDS/Condensation
Condensation is an open-source data system for building cloud applications while keeping the ownership of data.
data-ownership data-security data-synchronization database-systems distributed-database offline-first privacy
Last synced: 21 Apr 2025
https://github.com/vuestorefront/mage2vuestorefront
Magento to Vue-storefront datapump - synchronizes Products, Categories and Product-to-category links between your Magento2 API and NoSQL database of vue-storefront
backend data-synchronization elasticsearch kue magento magento2 mongodb mongodb-sync multi-process nosql redis
Last synced: 05 Apr 2025
https://github.com/DivanteLtd/mage2vuestorefront
Magento to Vue-storefront datapump - synchronizes Products, Categories and Product-to-category links between your Magento2 API and NoSQL database of vue-storefront
backend data-synchronization elasticsearch kue magento magento2 mongodb mongodb-sync multi-process nosql redis
Last synced: 28 Jan 2025
https://github.com/openintegrationhub/openintegrationhub
Open Integration Hub
data-synchronization framework integration integration-flow javascript nodejs openintegrationhub
Last synced: 04 May 2025
https://github.com/networktocode/diffsync
A utility library for comparing and synchronizing different datasets.
data-synchronization diffsync etl extract-transform-load python source-of-truth synchronization
Last synced: 15 May 2025
https://github.com/rudderlabs/rudder-sdk-js
JavaScript SDK for RudderStack - the Customer Data Platform for Developers.
analytics cdp customer-data customer-data-pipeline customer-data-platform data-synchronization hacktoberfest javascript marketing-analytics marketing-automation product-analytics product-personalization rudderstack sdk segment-alternative web
Last synced: 14 May 2025
https://github.com/zeiss-digital-innovation/synchronizefx
JavaFX data-binding between JVMs over the network
data-synchronization javafx javafx-library
Last synced: 10 Apr 2025
https://github.com/shirosaidev/saisoku
Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.
data-pipeline data-synchronization data-transfer directory-transfer file-transfer luigi luigi-pipeline orchestration-framework pipeline python rclone s3 scheduling sync sync-directories tornado transfer-files transfer-server
Last synced: 14 Apr 2025
https://github.com/dpaulino/diffsync
A .NET Standard 2.0 library to help with object synchronization, such as determining object differences, applying patches, and merging changes.
csharp data-synchronization dotnet sync
Last synced: 29 Apr 2025
https://github.com/umbrellio/table_sync
DB Table synchronization between microservices based on Model's event system and RabbitMQ messaging
data-synchronization database-synchronization event-driven-architecture micro-services table-synchronization
Last synced: 05 Apr 2025
https://github.com/shayonj/branch_base
Turn your Git Repository into a SQLite Database
analytics data-synchronization git ruby sqlite sqlite3
Last synced: 21 Mar 2025
https://github.com/gmierz/pupil-lib
Event extraction library for Pupil Labs eye tracker data.
analysis command-line data-synchronization epoch event event-based event-related eye-tracker eye-tracking lab-streaming-layer lsl markers module pupil-labs pupillometry python research tool trial trial-extraction
Last synced: 14 Apr 2025
https://github.com/ladeiko/OneWaySynchronizer
The simplest abstraction to synchronize local data with remote source. For iOS, wirtten in swift.
data-synchronization ios swift
Last synced: 04 Dec 2024
https://github.com/slurmulon/gooey
:cactus: Hierarchical PubSub data synchronization solution for ES6
data-synchronization pubsub spa state-synchronization
Last synced: 24 Mar 2025
https://github.com/rudderlabs/rudder-sdk-rust
Rust SDK for RudderStack - Open-source, warehouse-first Customer Data Pipeline and Segment-alternative. It collects and routes clickstream data and builds your customer data lake on your data warehouse.
analytics cdp customer-data customer-data-pipeline customer-data-platform data-synchronization market-analytics product-analytics rudderstack rust rust-lang sdk segment-alternative
Last synced: 25 Apr 2025
https://github.com/gmierz/pupil-lib-matlab
Pupil Data Epoch Extraction Library
academic data-synchronization epoching eye eye-tracking labstreaminglayer lsl multi-modal pupil-labs trial
Last synced: 06 Apr 2025
https://github.com/armbian/armbian.github.io
Armbian Linux artefacts and data exchange website
api automation cdn-support ci-cd content data-exchange data-integration data-sharing data-synchronization database jira-sync json xml yaml
Last synced: 13 Apr 2025
https://github.com/gustavohennig/simpledatabasereplicator
Simple Database Replicator is a very simple database data synchronizer, it loads a bunch of rows from source and destination, compares, and insert or update in the destination what is different.
data-synchronization database database-replication database-replicator replicator
Last synced: 28 Apr 2025
https://github.com/ebadier/neurospectriggerbox-unity
Unity plugin to use the MMBT-S Trigger Box from Neurospec AG
csharp data-synchronization parallel-port plugin serial-port trigger unity
Last synced: 06 Mar 2025
https://github.com/advisors-excel-llc/aeconnect
Synchronize Doctrine Entities to and from one or more Salesforce Orgs
data-sync data-synchronization doctrine-orm salesforce salesforce-api salesforce-rest-api symfony-bundle
Last synced: 19 Jun 2025
https://github.com/lostclus/aiosafeconsumer
Safely consume and process data.
consumers data-synchronization elasticsearch kafka message-bus message-queue microservices mongodb redis
Last synced: 12 Apr 2025
https://github.com/ryanlevee/vendor-assignment-automation
Automated System for Monitoring and Updating Vendor Assignments in SQL Databases
api-integration async asynchronous asynchronous-programming asyncio automation data-processing data-synchronization data-transformation database error-handling logging object-oriented-programming oop python soap software-design sql vendor-management xml
Last synced: 08 May 2025
https://github.com/devpro/cygnus
Cygnus is a free open source data synchronization tool
data-synchronization mongodb rest-api sqlserver
Last synced: 28 Feb 2025
https://github.com/jinsyin/datalink
⚡ 数据集成 | DataLink is a lightweight data integration framework build on top of DataX, Spark and Flink
batch big-data bigdata cdc data data-collection data-exchange data-integration data-pipeline data-synchronization datalink etl flink flink-cdc framework integration pipeline spark streaming
Last synced: 13 Apr 2025
https://github.com/navneetlal/duplisync
A service to synchronize duplicated data across different collections in NoSQL databases
data-management data-synchronization database duplicate-data mongodb nodejs nosql synchronization
Last synced: 14 May 2025
https://github.com/colinhunt/elm-googlerealtime-example
Example of using the google realtime API with Elm
collaborative-editing data-synchronization elm-lang google-api google-drive google-realtime-api live-demo sync-data web-application
Last synced: 14 Mar 2025
https://github.com/erman999/data-synchronizer
Data Synchronizer is a Node.js Electron application that synchronizes MySQL/MariaDB data from client to server using Socket.io for data transfer.
data data-synchronization database electron javascript mariadb mysql nodejs socket-io
Last synced: 30 Mar 2025
https://github.com/csirmaz/algebraic-reconciler
How to Syncronize Many Filesystems in Near Linear Time? Prototype code for a data synchronizer introduced in https://arxiv.org/abs/2302.09666 (Python)
cloud conflict-resolution data-synchronization filesystem synchronization
Last synced: 12 Apr 2025
https://github.com/joaooliveirapro/xmlsyncgo
📄🔄🐹 xmlsyncgo is a Go tool for synchronizing job data between a remote XML file (via SFTP) and a local database. It efficiently handles additions, updates, and removals of jobs, tracking changes and providing statistics. Ideal for automating data synchronization tasks.
automation data-management-platform data-synchronization go golang sftp synchronization xml xml-parser xml-processing
Last synced: 20 Feb 2025
https://github.com/buession/buession-canal
阿里巴巴 canal 客户端
canal canal-client data-sync data-synchronization
Last synced: 02 Apr 2025
https://github.com/djaustin/tractor-beam
Continuous synchronisation of spreadsheet data to Redis
data-synchronization golang redis
Last synced: 04 Mar 2025
https://github.com/robotstudio/datalore
Data Interface Abstraction Library
data-interface data-sync data-synchronization database database-connection-wrapper datalore db
Last synced: 16 Dec 2024
https://github.com/pocketsync/pocketsync_flutter
Flutter SDK for pocketsync.dev
dart data-synchronization flutter sqlite
Last synced: 25 Feb 2025
https://github.com/mutua1/xmlsyncgo
📄🔄🐹 xmlsyncgo is a Go tool for synchronizing job data between a remote XML file (via SFTP) and a local database. It efficiently handles additions, updates, and removals of jobs, tracking changes and providing statistics. Ideal for automating data synchronization tasks.
automation data-management-platform data-synchronization go sftp synchronization xml xml-parser xml-processing
Last synced: 04 Mar 2025
https://github.com/lostclus/django-kafka-streamer
Stream data from Django application to Apache Kafka
data-synchronization django kafka message-bus message-queue microservices straming
Last synced: 04 May 2025
https://github.com/mentalfaculty/blog
Views and Opinions of Drew McCormack (@drewmccormack)
core-data data-sync data-synchronization ios-swift macos swiftui sync synchronization
Last synced: 18 Mar 2025
https://github.com/coslynx/fitness-tracker-social-mvp
Project: Track your fitness progress online with a simple goal-setting and tracking tool. Created at https://coslynx.com
api-integration code-generation data-synchronization developer-tools devops fitness-community fitness-tracker goal-setting machine-learning mvp mvp-development next-js postgresql progress-tracking react server-side-rendering social-features software-development typescript user-authentication
Last synced: 07 Apr 2025