https://github.com/mustaddon/distributedfilestorage

.NET Distributed file storage
https://github.com/mustaddon/distributedfilestorage

blob-storage csharp database dotnet dotnet-core file-storage filestorage storage

Last synced: 7 months ago
JSON representation

.NET Distributed file storage

• Host: GitHub
• URL: https://github.com/mustaddon/distributedfilestorage
• Owner: mustaddon
• License: mit
• Created: 2021-10-03T14:31:47.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2024-11-22T06:06:37.000Z (12 months ago)
• Last Synced: 2025-04-13T01:08:23.220Z (7 months ago)
• Topics: blob-storage, csharp, database, dotnet, dotnet-core, file-storage, filestorage, storage
• Language: C#
• Homepage:
• Size: 87.9 KB
• Stars: 11
• Watchers: 2
• Forks: 5
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# DistributedFileStorage [![NuGet version](https://badge.fury.io/nu/DistributedFileStorage.svg)](http://badge.fury.io/nu/DistributedFileStorage)

Distributed file storage

## Features

* Storing metadata in the database (SQL/NoSQL)

* Storing files in the file system

* Deduplication of files by content

* Distributed storage (multiple disks)

## Example: Simple console app

```

dotnet new console --name "DfsExample"

cd DfsExample

dotnet add package DistributedFileStorage.EntityFrameworkCore

dotnet add package Microsoft.EntityFrameworkCore.SqlServer

```

program.cs:

```C#

using DistributedFileStorage;

using Microsoft.EntityFrameworkCore;

using Microsoft.Extensions.DependencyInjection;

// add services to the container

var services = new ServiceCollection()

    .AddDfsEfc(options =>

    {

        // add database provider 

        options.Database.ContextConfigurator = (db) => db.UseSqlServer("Data Source=(localdb)\\MSSQLLocalDB;Initial Catalog=DfsDatabase;Integrated Security=True;Persist Security Info=False;Pooling=False;MultipleActiveResultSets=False;Connect Timeout=60;Encrypt=False;TrustServerCertificate=False");

        // add path construction algorithm 

        var rnd = new Random();

        options.FileStorage.PathBuilder = (fileId) => Path.GetFullPath($@"_dfs\fake_disk_{rnd.Next(1, 3)}\{DateTime.Now:yyyy\\MM\\dd}\{fileId}");

    })

    .BuildServiceProvider();

var dfs = services.GetRequiredService>();

// upload

using var uploadFile = new MemoryStream(System.Text.Encoding.UTF8.GetBytes("test text"));

var fileId = await dfs.Add(uploadFile, $"example.txt", "my metadata");

// get info

var fileInfo = await dfs.GetInfo(fileId);

Console.WriteLine(Newtonsoft.Json.JsonConvert.SerializeObject(fileInfo));

// download 

using var downloadFile = File.Create("example.txt");

await foreach (var chunk in dfs.GetContent(fileId))

    await downloadFile.WriteAsync(chunk);

```

[More examples...](https://github.com/mustaddon/DistributedFileStorage/tree/main/Examples/)