https://github.com/alexcg1/executor_tensor_deleter

Reduce the size of Jina indexes by removing tensors
https://github.com/alexcg1/executor_tensor_deleter

Last synced: 16 days ago
JSON representation

Reduce the size of Jina indexes by removing tensors

• Host: GitHub
• URL: https://github.com/alexcg1/executor_tensor_deleter
• Owner: alexcg1
• Created: 2022-03-16T12:58:14.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-03-16T12:58:55.000Z (over 2 years ago)
• Last Synced: 2024-10-16T03:41:25.031Z (about 1 month ago)
• Language: Python
• Size: 1.95 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# TensorDeleter

After creating embeddings you may no longer require a Document's tensor. This Executor simply sets `doc.tensor` to `None`, thus reducing storage space for indexed data.

## Usage

#### via Docker image (recommended)

```python

from jina import Flow

	

f = Flow().add(uses='jinahub+docker://TensorDeleter')

```

#### via source code

```python

from jina import Flow

	

f = Flow().add(uses='jinahub://TensorDeleter')

```

- To override `__init__` args & kwargs, use `.add(..., uses_with: {'key': 'value'})`

- To override class metas, use `.add(..., uses_metas: {'key': 'value})`