https://github.com/xqrzd/kudu-client-net
.NET/C# client for Apache Kudu
https://github.com/xqrzd/kudu-client-net
apache-kudu big-data csharp dotnet kudu
Last synced: 5 months ago
JSON representation
.NET/C# client for Apache Kudu
- Host: GitHub
- URL: https://github.com/xqrzd/kudu-client-net
- Owner: xqrzd
- License: apache-2.0
- Created: 2018-09-23T22:54:14.000Z (almost 8 years ago)
- Default Branch: main
- Last Pushed: 2023-07-27T23:49:33.000Z (almost 3 years ago)
- Last Synced: 2025-11-30T13:07:04.480Z (7 months ago)
- Topics: apache-kudu, big-data, csharp, dotnet, kudu
- Language: C#
- Homepage: https://kudu.apache.org
- Size: 1.87 MB
- Stars: 14
- Watchers: 2
- Forks: 7
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# .NET Client for Apache Kudu
## Package
You can get the package on Nuget: https://www.nuget.org/packages/Knet.Kudu.Client
## Supported Kudu Versions
This library supports Apache Kudu 1.3 and newer. The newest version of this library
should always be used, regardless of the Apache Kudu version.
This client tries to maintain feature parity with the official C++ and Java clients.
## Quickstart
### Docker
Follow the [Apache Kudu Quickstart](https://kudu.apache.org/docs/quickstart.html) guide to get Kudu running in Docker.
### Create a Client
```csharp
KuduClient client = KuduClient.NewBuilder("localhost:7051,localhost:7151,localhost:7251")
.Build();
```
> Note: KuduClient is intended to be a singleton. It is inefficient to create multiple clients.
### Create a Table
```csharp
var tableBuilder = new TableBuilder("twitter_firehose")
.AddColumn("tweet_id", KuduType.Int64, opt => opt.Key(true))
.AddColumn("user_name", KuduType.String)
.AddColumn("created_at", KuduType.UnixtimeMicros)
.AddColumn("text", KuduType.String);
await client.CreateTableAsync(tableBuilder);
```
See more table options in the [wiki](https://github.com/xqrzd/kudu-client-net/wiki/Create-Table).
### Open a Table
```csharp
KuduTable table = await client.OpenTableAsync("twitter_firehose");
```
> Note: This table can be cached and reused concurrently. It simply stores the table schema.
### Insert Data
```csharp
var rows = Enumerable.Range(0, 100).Select(i =>
{
var row = table.NewInsert();
row.SetInt64("tweet_id", i);
row.SetString("user_name", $"user_{i}");
row.SetDateTime("created_at", DateTime.UtcNow);
row.SetString("text", $"sample tweet {i}");
return row;
});
await client.WriteAsync(rows);
```
### Query Data
```csharp
KuduScanner scanner = client.NewScanBuilder(table)
.SetProjectedColumns("tweet_id", "user_name", "created_at")
.Build();
await foreach (ResultSet resultSet in scanner)
{
Console.WriteLine($"Received {resultSet.Count} rows");
foreach (RowResult row in resultSet)
{
var tweetId = row.GetInt64("tweet_id");
var userName = row.GetString("user_name");
var createdAtUtc = row.GetDateTime("created_at");
Console.WriteLine($"tweet_id: {tweetId}, user_name: {userName}, created_at: {createdAtUtc}");
}
}
```
This client includes a simple object mapper,
```csharp
record Tweet(long TweetId, string Username, DateTime CreatedAt);
var tweets = await scanner.ScanToListAsync();
```