Metadata harmonisation: align spoken-data fields with UniDive naming conventions
Back to Swedish_Sign_Language SSLC · Back to index
Repo: https://github.com/UniversalDependencies/UD_Swedish_Sign_Language-SSLC
Cross-posting from the UniDive WG1 T1.5 (spoken language guidelines) metadata harmonisation review. We compared UD_Swedish_Sign_Language-SSLC’s current CoNLL-U metadata against the proposed naming conventions (see also the full treebank status table). This is a suggestion for maintainers to review - feel free to push back on anything that doesn’t fit the corpus. The comparison was carried out semi-automatically with the help of Claude (Anthropic); errors or misunderstandings are possible, so please double-check anything unclear.
1. Document-level (naming conventions)
No document_id exists, but it can be derived directly from the sent_id prefix: sent_id follows <doc-id>:<start>:<end> (e.g. SSLC01_104:1:2), with 6 distinct document ids (SSLC01_104, SSLC01_320, SSLC01_391, SSLC02_331, SSLC02_332, SSLC02_409).
| Field | Suggestion |
|---|---|
| — | derive # document_id from the sent_id prefix (everything before the first :) |
Implementation notes
- Needs a small script: derive
# document_idfrom thesent_idprefix using the already-written helper scriptworkgroups/spoken-data/scripts/harmonize_metadata.py:python3 workgroups/spoken-data/scripts/harmonize_metadata.py derive-document-id \ UD_Swedish_Sign_Language-SSLC --pattern '^(?P<doc>[^:]+):.*$' --writeVerified against the local clone (
swl_sslc-ud-test.conllu, dry-run): correctly derives all 6 documents (SSLC01_104,SSLC01_320,SSLC01_391,SSLC02_331,SSLC02_332,SSLC02_409) with no unmatchedsent_ids.
This issue was prepared as part of the UniDive WG1 T1.5 spoken language guidelines effort. Happy to help implement these changes ourselves if that’s easier than doing it on your end - just let us know.