https://github.com/fal-ai/fal-teller

An Apache Arrow native dynamic storage proxy layer for query engines.
https://github.com/fal-ai/fal-teller

Last synced: about 11 hours ago
JSON representation

An Apache Arrow native dynamic storage proxy layer for query engines.

• Host: GitHub
• URL: https://github.com/fal-ai/fal-teller
• Owner: fal-ai
• Created: 2022-09-30T17:05:58.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2022-10-03T16:41:33.000Z (about 2 years ago)
• Last Synced: 2024-05-01T15:17:44.313Z (8 months ago)
• Language: Python
• Homepage:
• Size: 31.3 KB
• Stars: 6
• Watchers: 9
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Fal Teller

![image](https://user-images.githubusercontent.com/47358913/193630260-556469b7-163a-4035-bcd4-4c77cd7f5a0f.png)

An [Apache Arrow](https://arrow.apache.org) native dynamic storage proxy layer for query engines.

Features:

- [Arrow Flight](https://arrow.apache.org/docs/format/Flight.html) based server, for maximized performance.

- Unbuferred data streams for reading and writing.

- An inngestion layer through teleport.

- Built-in support for authentication and profile management.

- A simple (read/write orianted) client to operate on Pandas level without

  bearing the complexity of Flight.

- Ease of extensibility through plugins for different providers.