https://github.com/mrseanryan/csfy
Train a simple text classifier and predict labels - supports ONNX output for performance, language-neutral
https://github.com/mrseanryan/csfy
classification-model classifier classifier-model ml ml-training
Last synced: 7 months ago
JSON representation
Train a simple text classifier and predict labels - supports ONNX output for performance, language-neutral
- Host: GitHub
- URL: https://github.com/mrseanryan/csfy
- Owner: mrseanryan
- License: mit
- Created: 2024-06-07T15:50:04.000Z (over 1 year ago)
- Default Branch: master
- Last Pushed: 2024-06-24T15:37:18.000Z (over 1 year ago)
- Last Synced: 2025-05-18T21:35:09.554Z (10 months ago)
- Topics: classification-model, classifier, classifier-model, ml, ml-training
- Language: Python
- Homepage: https://medium.com/p/9fd7003000fc
- Size: 142 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 4
-
Metadata Files:
- Readme: README.gpu.md
- License: LICENSE
Awesome Lists containing this project
README
### Using GPU with the local model
If you have an NVIDIA graphics card, then you can run part or all of the model (depending on the card's RAM) on the GPU,
which has much higher level of parallelism than the typical CPU.
Required:
- latest NVIDIA graphic driver
- up to date version of CUDA
#### Tip: if you get errors when running the model, like this:
```
>> Cuda error: no kernel image is available for execution on the device
```
Then recommend to build ctransformers locally.
This is actually quite simple:
```
pip3 uninstall ctransformers
pip3 install ctransformers --no-binary ctransformers # use --no-binary to force a local build. This ensures that the local version of CUDA and NVIDIA graphics driver will be used.
```
You can tweak the settings in `config.py`.
# More details
## local via ctransformers
- [ctransformers](https://github.com/marella/ctransformers).
## local via pytorch
- [pytorch](https://pytorch.org/get-started/locally/)
- [Building pytorch from scratch](https://github.com/pytorch/pytorch#from-source)