{"id":16200220,"url":"https://github.com/mobarski/tkv","last_synced_at":"2026-04-09T08:03:52.298Z","repository":{"id":152846891,"uuid":"499593003","full_name":"mobarski/tkv","owner":"mobarski","description":"Table-Key-Value adapter for various db-engines: SQLite, Redis, MongoDB, Snowflake, DuckDB, ...","archived":false,"fork":false,"pushed_at":"2022-06-15T21:29:52.000Z","size":81,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-02-13T19:51:19.387Z","etag":null,"topics":["duckdb","key-value","mongodb","redis","snowflake","sqlite"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mobarski.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-06-03T17:18:26.000Z","updated_at":"2024-01-15T10:52:12.000Z","dependencies_parsed_at":null,"dependency_job_id":"f62f01d9-e4c7-4f52-8d05-358e838255d7","html_url":"https://github.com/mobarski/tkv","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mobarski%2Ftkv","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mobarski%2Ftkv/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mobarski%2Ftkv/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mobarski%2Ftkv/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mobarski","download_url":"https://codeload.github.com/mobarski/tkv/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247704514,"owners_count":20982292,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["duckdb","key-value","mongodb","redis","snowflake","sqlite"],"created_at":"2024-10-10T09:29:35.254Z","updated_at":"2025-11-06T21:03:32.729Z","avatar_url":"https://github.com/mobarski.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# TKV\n\n**Warning**: this is pre-alpha code - anything can change without a warning.\n\n# Quickstart\n\n**Basics**:\n```python\nimport tkv_sqlite\n\ndb = tkv_sqlite.connect('my_file.sqlite')\n\n# simple usage\ndb.put('my_table', 'foo', 'hello')\nx = db.get('my_table', 'foo') # x = 'hello'\n\n# table object\ntab = db.table('my_table')\nx = tab.get('foo')     # x = 'hello'\ny = tab.get('bar', -1) # y = -1\nz = tab.count()        # z = 1\n\n# document store\ntab.put('my_doc', {'foo':'hello', 'bar':1.23, 'baz':[1,2,3]})\nx = tab.get('my_doc')['foo'] # x = 'hello'\n``` \n\n**Connecting to other db engines:**\n```python\nimport tkv_redis\ndb = tkv_redis.connect(host='127.0.0.1')\n\nimport tkv_mongo\ndb = tkv_mongo.connect('127.0.0.1', db='tkv')\n```\n\n**Other operations:**\n```python\ndb.put_items('my_table', [('foo',1),('bar',2)])\n\ndb.keys('my_table')   # -\u003e iter(['bar', 'foo'])\ndb.items('my_table')  # -\u003e iter([('bar',2), ('foo',1)])\ndb.values('my_table') # -\u003e iter([2,1])\n\ndb.put_many('my_table', ['baz','qux'], [3,4])\nvals = db.get_many('my_table', ['foo','qux','xyzzy'], -1) # vals = [1, 4, -1]\n\ndb.delete('my_table', 'foo')\ndb.drop('my_table')\n```\n\n**Scan operations:**\n```python\ntab = db.table('xyz')\n# ------ x y z \u003c-------- key part name\n# ------ 0 1 2 \u003c-------- key part index\ntab.put('A/1/1', 'foo')\ntab.put('A/1/2', 'bar')\ntab.put('A/2/1', 'baz')\ntab.put('B/2/4', 'qux')\ntab.put('B/3/6', '...')\n\ntab.scan_keys('A/1/*') # -\u003e iter(['A/1/1', 'A/1/2'])\ntab.scan_values('A/*') # -\u003e iter(['foo', 'bar, 'baz'])\ntab.scan_items('B/*')  # -\u003e iter([('B/2/4','qux'), ('B/3/6','...')])\n\n```\n\n**Partition by key fragment:**\n```python\t\nkeys = db.keys('xyz')\nfor x,keys_x in db.group_keys(keys, 0):        # key part index=0 (x)\n    print(x, *keys_x)\n    for y,keys_y in db.group_keys(keys_x, 1):  # key part index=1 (y)\n        print(y, *keys_y)\n\n# prints:\n#   A A/1/1 A/1/2 A/2/1\n#   1 A/1/1 A/1/2\n#   2 A/2/1\n#   B B/2/4 B/3/6\n#   2 B/2/4\n#   3 B/3/6\n```\n\n**Advanced usage - custom serializer/deserializer**:\n```python\nimport pickle\n\ndb = tkv_sqlite.connect('my_pickle_db.sqlite',\n    dumps = pickle.dumps,\n    loads = pickle.loads,\n)\n\na = set(\"abcd\")\nb = set(\"axcy\")\n\ntab = db.table('foo')\ntab.put('a', a)\ntab.put('b', b)\n\nx = a \u0026 b                       # x = {'c', 'a'}\ny = tab.get('a') \u0026 tab.get('b') # y = {'c', 'a'}\n\n```\n\n**Advanced usage - table specific serializer/deserializer:**\n```python\nimport cloudpickle\n\ntab = db.table('my_functions',\n    dumps = cloudpickle.dumps,\n    loads = cloudpickle.loads,\n)\n\ntab.put('foo', lambda x:x*2)\nx = tab.get('foo')(21) # x = 42\n```\n\n# Download and Install\n\nInstall the latest version with:\n```\npip install git+https://github.com/mobarski/tkv\n```\n\nThere are no hard dependencies other than the Python standard library.\n\n**Important:** db connectors are not defined as package dependencies.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmobarski%2Ftkv","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmobarski%2Ftkv","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmobarski%2Ftkv/lists"}