https://github.com/sudiptab2100/wild-storage
Use YouTube as Infinite Cloud Storage
https://github.com/sudiptab2100/wild-storage
cpp ctypes ctypes-bindings ctypes-wrapper infinite-storage infinite-storage-glitch isg opencv opencv-python python python3 storage terminal wild-storage youtube youtube-storage
Last synced: 7 months ago
JSON representation
Use YouTube as Infinite Cloud Storage
- Host: GitHub
- URL: https://github.com/sudiptab2100/wild-storage
- Owner: sudiptab2100
- License: apache-2.0
- Created: 2023-02-23T14:30:28.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-04-07T14:30:38.000Z (about 1 year ago)
- Last Synced: 2024-04-07T23:27:46.402Z (about 1 year ago)
- Topics: cpp, ctypes, ctypes-bindings, ctypes-wrapper, infinite-storage, infinite-storage-glitch, isg, opencv, opencv-python, python, python3, storage, terminal, wild-storage, youtube, youtube-storage
- Language: Python
- Homepage: https://github.com/sudiptab2100/Wild-Storage
- Size: 58.2 MB
- Stars: 52
- Watchers: 1
- Forks: 10
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Wild-Storage
Wild-Storage lets you use YouTube as a Infinite Cloud Storage. It embeds any files(Images, Videos, Documents, etc) into a video. The video can be uploaded to YouTube and the file can be retrieved from the video. A expansion & compression technique is used to defeat YouTube's compression algorithm. The file can be retrieved from the video without any loss of data.
## Demo Video ([YouTube Link](https://youtu.be/NbeWh011qjs))
## ~~Virtual Environment Set Up~~ ❌ (... Not Required Now)
### Create Virtual Environment
```console
python3 -m venv env
```
### Activate Virtual Environment
```console
source env/bin/activate
```
### Install Required Packages
```console
pip install -r requirements.txt
```
## ~~Compile C++ Library & Generate Python Bindings~~ ❌ (... Not Required Now)
```console
g++ -fPIC -shared DataProccessing/cLibs/helper.cpp -o DataProccessing/cLibs/c_lib.so
```
## Wild-Storage CLI App ✅
### Make the script executable
```console
chmod +x cli_app
```
### Run CLI App
Make sure ```GCC``` compiler, ```Python 3```, ```pip```, Python ```venv``` is installed. \
Now open terminal in the project directory and run the following command to complete the necessary setup and run the app.
```console
./cli_app
```
## How to Use? ✅
Wait for the app to start.
### Create video from files
- Copy all your files into ```\data\input``` directory
- Select ```Encode file to video``` option on the app
- Wait for the process to complete
- Generated video (```op.mp4```) & Metadata (```metadata.json```) will be available in ```\data\generated``` directory
- Upload the video to YouTube and copy-paste the contents of ```metadata.json``` in description of the video
- Make sure the uploaded video is ```public``` / ```unlisted```
### Retrieve files from video
- Select ```Decode file from video``` option on the app
- Enter the youtube video url (Make sure the uploaded video is ```public``` / ```unlisted```)
- Wait for the process to complete
- The files will be available in ```\data\retrieved``` directory
### Cleaning up
- Select ```Clean``` option on the app to clean data directory
### Reload Time
- Select ```Reload time``` option to set the time to wait before reloading the app
### Exit
- Select ```Exit``` option on the app to exit
## Use Dockerized CLI App ✅ ✅
You just need to have ```Docker``` installed on your system.
### Build Docker Image
```console
docker build -t wild-storage .
```
### Run Docker Container
```console
docker run -it wild-storage
```
### Run Dockerized CLI App
```console
./cli_app
```
### Copy Input Files from Host to Container
You can copy files from host to container using the following command. You can copy folders and files.
```console
docker cp :app/data/input
```
### Copy Output Files from Container to Host
The video and metadata files can be copied from container to host using the following command.
```console
docker cp :app/data/generated
```
### Copy Retrieved Files from Container to Host
The retrieved files can be copied from container to host using the following command.
```console
docker cp :app/data/retrieved
```
## DataProcessing Working
### Embed File Into Video
### Retrieve File From Video
## Expansion And Compression
## Python Wrapped C++ Library
Wild-Storage was a complete Python Implementation. Beign a very slow interpreted language it was taking too much time to process files. Later I moved some heavy task codebase to C++ and wrapped those in Python using [ctypes](https://docs.python.org/3/library/ctypes.html). This helped to process the files ~3x faster.
## Features
- Parallel Processing using multiple CPU cores is supported now.
- C++ Library is used for heavy tasks to make the process faster.
## Credits
This project is inspired by [Infinite-Storage-Glitch](https://github.com/DvorakDwarf/Infinite-Storage-Glitch) which is a Rust implementation. I liked the concept and tried to implement in my favourite language Python. The working of both may not be same.