home edit page issue tracker

This page pertains to UD version 2.

Metadata harmonisation: align spoken-data fields with UniDive naming conventions

Back to Bokota ChibErgIS · Back to index

Repo: https://github.com/UniversalDependencies/UD_Bokota-ChibErgIS

Cross-posting from the UniDive WG1 T1.5 (spoken language guidelines) metadata harmonisation review. We compared UD_Bokota-ChibErgIS’s current CoNLL-U metadata against the proposed naming conventions (see also the full treebank status table). This is a suggestion for maintainers to review - feel free to push back on anything that doesn’t fit the corpus.

1. Document-level (naming conventions)

Field Suggestion
no newdoc id exists at all (0 occurrences across 406 sentences) - but the 54 distinct sound_url values (e.g. SAB-TXT-AN-00000-01.WAV) already identify document boundaries; could # newdoc id be derived from the recording basename and set once per document?
sound_url currently repeated on every sentence - move to document level once newdoc id exists

2. Sentence-level (naming conventions)

Field Suggestion
text_ortho rename to text_orthographic
morphemic_text rename to text_morphemic
sent_timecode split into sound_alignment_begin, sound_alignment_end, and duration

3. Token-level (naming conventions)

Field Suggestion
AlignBegin rename to WordAlignmentBegin
AlignEnd rename to WordAlignmentEnd

This issue was prepared as part of the UniDive WG1 T1.5 spoken language guidelines effort. Happy to help implement these changes ourselves if that’s easier than doing it on your end - just let us know.