{"id":28184093,"url":"https://github.com/usausa/data-toolkit","last_synced_at":"2025-12-25T18:03:23.197Z","repository":{"id":253624479,"uuid":"839118415","full_name":"usausa/data-toolkit","owner":"usausa","description":"🐱Data helper library.","archived":false,"fork":false,"pushed_at":"2025-04-16T00:51:39.000Z","size":110,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-16T02:03:09.730Z","etag":null,"topics":["bulk-copy","bulk-loader","bulkcopy","bulkloader"],"latest_commit_sha":null,"homepage":"","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/usausa.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-08-07T02:25:35.000Z","updated_at":"2025-04-16T01:41:20.000Z","dependencies_parsed_at":"2024-08-18T09:44:27.265Z","dependency_job_id":"692f621e-c5b6-4d53-8662-8e50c6e00b02","html_url":"https://github.com/usausa/data-toolkit","commit_stats":null,"previous_names":["usausa/mapping-data-reader","usausa/data-reader-adapter","usausa/data-toolkit"],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/usausa%2Fdata-toolkit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/usausa%2Fdata-toolkit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/usausa%2Fdata-toolkit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/usausa%2Fdata-toolkit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/usausa","download_url":"https://codeload.github.com/usausa/data-toolkit/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254470982,"owners_count":22076587,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bulk-copy","bulk-loader","bulkcopy","bulkloader"],"created_at":"2025-05-16T05:12:06.692Z","updated_at":"2025-12-25T18:03:22.831Z","avatar_url":"https://github.com/usausa.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Mofucat.DataToolkit\n\n[![NuGet](https://img.shields.io/nuget/v/Mofucat.DataToolkit.svg)](https://www.nuget.org/packages/Mofucat.DataToolkit)\n\n## ObjectDataReader\n\n```csharp\n// Source\nvar list = new List\u003cData\u003e\n[\n    new() { Id = 1, Value = \"Name-1\" },\n    new() { Id = 2 }\n];\n\n// ObjectDataReader\nusing var reader = new ObjectDataReader\u003cData\u003e(list);\n\n// BulkCopy\nawait using var con = new SqlConnection(ConnectionString);\nawait con.OpenAsync();\nusing var loader = new SqlBulkCopy(con);\nloader.DestinationTableName = \"Data\";\nawait loader.WriteToServerAsync(reader);\n```\n\n## MappingDataReader\n\n```csharp\n// Source\nvar csvReader = ...\n\n// MappingReader \nvar option = new MappingDataReaderOption();\noption.AddColumn(\"Col1\");\noption.AddColumn(\"Col3\");\noption.AddColumn\u003cstring, bool\u003e(\"Col5\", Boolean.Parse);\nusing var reader = new MappingDataReader(option, csvReader);\n\n// BulkCopy\nawait using var con = new SqlConnection(ConnectionString);\nawait con.OpenAsync();\nusing var loader = new SqlBulkCopy(con);\nloader.DestinationTableName = \"Data\";\nawait loader.WriteToServerAsync(reader);\n```\n\n# Mofucat.DataToolkit.Avro\n\n[![NuGet](https://img.shields.io/nuget/v/Mofucat.DataToolkit.Avro.svg)](https://www.nuget.org/packages/Mofucat.DataToolkit.Avro)\n\n## AvroDataReader\n\n```csharp\n// AvroDataReader\nusing var reader = new AvroDataReader(File.OpenRead(\"data.avro\"));\n\n// BulkCopy\nawait using var con = new SqlConnection(ConnectionString);\nawait con.OpenAsync();\nusing var loader = new SqlBulkCopy(con);\nloader.DestinationTableName = \"Data\";\nawait loader.WriteToServerAsync(reader);\n```\n\n## AvroDataExporter\n\n```csharp\nawait using var con = new SqlConnection(ConnectionString);\n\n// AvroDataExporter\nvar exporter = new AvroDataExporter(con)\n{\n    Name = \"Data\",\n    Codec = new SnappyCodec()\n};\n\nawait exporter.ExportAsync(File.OpenWrite($\"data-{id}.avro\"), $\"SELECT * FROM Data WHERE Id = {id}\");\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fusausa%2Fdata-toolkit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fusausa%2Fdata-toolkit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fusausa%2Fdata-toolkit/lists"}