https://github.com/dotslash/cloudsync

2 way sync between Google Cloud Storage and laptop
https://github.com/dotslash/cloudsync

Last synced: 9 months ago
JSON representation

2 way sync between Google Cloud Storage and laptop

• Host: GitHub
• URL: https://github.com/dotslash/cloudsync
• Owner: dotslash
• License: mit
• Created: 2022-05-29T08:16:09.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2022-06-06T05:20:17.000Z (about 4 years ago)
• Last Synced: 2025-06-22T03:40:38.673Z (about 1 year ago)
• Language: Go
• Size: 7.5 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
2 way sync between Google Cloud Storage (the s3 equivalent for GCP) and a local machine. There are probably other tools

that do similar things. Im doing it for fun.

### Current state of things and what's next

This is a loop forever that step1) 2 syncs data from local machine and gcs. step2) sleep 30 secs. This works more or

less, except that there are atleast a few things to improve

* While a making GCP apis once in 30 secs is okay, it seems wrong. Dont have a good explanation yet

* No pagination. I think the GCP SDK i use takes care of that, if the directory is large, i will hold it all in memory.

  Is this okay?

* If i start the sync process, it plays safe and removed files will be added back. I can save the last scan state on

  disk to avoid this.

* No unit or integration tests. The only testing i did was to sync this repo by using the code here to GCS

    - `go run *go -remote=gs:///cloudsync -local=$PWD`

* support gitignore. E.g in my testing i would have liked to skip the .git directory and .idea directory

  

* Support trash

* Support recovering from an earlier state. Is it possible to give a simple experience? - Something like "give me state

  of things as of  from the cloud". Maybe that's too much.

 Should we do blobstore operations in parallel?

* Should we do local file operations in parallel?

There might be more things to do.