https://github.com/veldhub/veld_data__eltec_conllu_stats

Data velds encapsulating statistics on conllu data.
https://github.com/veldhub/veld_data__eltec_conllu_stats

analysis conllu nlp statistics

Last synced: 5 months ago
JSON representation

Data velds encapsulating statistics on conllu data.

• Host: GitHub
• URL: https://github.com/veldhub/veld_data__eltec_conllu_stats
• Owner: veldhub
• License: mit
• Created: 2024-12-04T13:59:50.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-01-20T19:30:31.000Z (over 1 year ago)
• Last Synced: 2025-05-30T10:12:51.091Z (about 1 year ago)
• Topics: analysis, conllu, nlp, statistics
• Homepage:
• Size: 111 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# ![veld chain](https://raw.githubusercontent.com/veldhub/.github/refs/heads/main/images/symbol_V_letter.png) veld_data__eltec_conllu_stats

Statistics on conllu data inferenced with udpipe on eltec corpora.

This repo and its data is the output of this chain veld repo: 

https://github.com/veldhub/veld_chain__eltec_udpipe_inference

## statistics

### count_token

Simply counting the token for each file (token definition: https://universaldependencies.org/format.html)

### count_lemma_total

Simply counting the unique lemmas (lemma definition: https://universaldependencies.org/format.html)

### count_lemma_normalized_by_token

Taking `count_lemma_total` and dividing it by `count_token` so that this lemma count is respective to the overall token count.

### count_pos

For each part-of-speech tag, count its occurrence (pos definition: https://universaldependencies.org/u/pos/index.html)

### count_feat

For each feature tag, count its occurence (feature definition: https://universaldependencies.org/u/feat/index.html)