https://github.com/betofigueiredo/go-integrator

Example of integrating different applications for data exchange
https://github.com/betofigueiredo/go-integrator

fastapi fiber go python

Last synced: about 2 months ago
JSON representation

Example of integrating different applications for data exchange

• Host: GitHub
• URL: https://github.com/betofigueiredo/go-integrator
• Owner: betofigueiredo
• License: mit
• Created: 2024-10-18T18:27:17.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-10-29T19:15:38.000Z (over 1 year ago)
• Last Synced: 2025-04-05T16:13:05.486Z (about 1 year ago)
• Topics: fastapi, fiber, go, python
• Language: Python
• Homepage:
• Size: 4.83 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
Go Integrator



  Example of integrating different applications for data exchange.

  


  (work in progress)

  



  



Video explanation (link)









Integration steps


🔹Request users list from API

      Concurrently, in chunks of 1000




🔹Map all users ID’s

      Save in a map, using mutex to handle async r/w




🔹Request additional info for each user

      Concurrently, in chunks to prevent API overflow




🔹Save additional info in the map

      Also using mutex to handle async r/w




🔹Send users data

      After processed, send to any selected external service






API




  

  

  



  Endpoint: /users

  


  

  



  Endpoint: /users/{user_id}

  


  

  






Integrator




  

  

  



  Endpoint: /get-users

  


  

  






Usage




Start all services:

```zsh

❯ make up

```




Load your database with some data using K6:

```zsh

❯ k6 run k6/seed-test.js

```




Call Integrator endpoint to fetch data from API:

```zsh

❯ curl http://localhost:3002/get-users

```