https://github.com/natlibfi/fintoai-data-kauno

DVC pipeline for KAUNO projects of Finto AI
https://github.com/natlibfi/fintoai-data-kauno

annif dvc dvc-pipeline glam subject-indexing text-classification

Last synced: 6 months ago
JSON representation

DVC pipeline for KAUNO projects of Finto AI

• Host: GitHub
• URL: https://github.com/natlibfi/fintoai-data-kauno
• Owner: NatLibFi
• License: cc0-1.0
• Created: 2022-08-08T11:40:59.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2024-12-13T09:46:27.000Z (over 1 year ago)
• Last Synced: 2025-03-14T22:13:34.175Z (about 1 year ago)
• Topics: annif, dvc, dvc-pipeline, glam, subject-indexing, text-classification
• Language: Shell
• Homepage: https://ai.finto.fi
• Size: 3.91 MB
• Stars: 0
• Watchers: 4
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# FintoAI-data-KAUNO

Configurations for maintaining the Annif projects with KAUNO vocabulary used at [Finto AI service](ai.finto.fi/).

The projects are trained and evaluated using a [DVC (Data Version Control) pipeline](https://dvc.org/doc/start/data-management/data-pipelines) defined in [dvc.yaml](/dvc.yaml).

The pipeline takes care of 

1. installing Annif in a venv,

2. loading the vocabulary,

3. training the projects,

4. evaluating the projects.

When the necessary vocabulary and training corpora are in place the pipeline can be run using the command

    dvc repro

    

For more information about using DVC with Annif projects see the [DVC exercise of Annif tutorial](https://github.com/NatLibFi/Annif-tutorial/blob/master/exercises/OPT_dvc.md).