CoolFace
Datasetpublic

unimorph/universal_morphologies

The Universal Morphology (UniMorph) project is a collaborative effort to improve how NLP handles complex morphology in the world’s languages. The goal of UniMorph is to annotate morphological data in a universal schema that allows an inflected word from any language to be defined by its lexical meaning, typically carried by the lemma, and by a rendering of its inflectional form in terms of a bundle of morphological features from our schema. The specification of the schema is described in Sylak-Glassman (2016).

sourceHugging Facecc-by-sa-3.0updated 3y agoView on Hugging Face
20likes329downloads
README.md47832 linesDownload Raw Back to root
1---2annotations_creators:3- expert-generated4language_creators:5- found6language:7- ady8- ang9- ar10- arn11- ast12- az13- ba14- be15- bg16- bn17- bo18- br19- ca20- ckb21- crh22- cs23- csb24- cu25- cy26- da27- de28- dsb29- el30- en31- es32- et33- eu34- fa35- fi36- fo37- fr38- frm39- fro40- frr41- fur42- fy43- ga44- gal45- gd46- gmh47- gml48- got49- grc50- gv51- hai52- he53- hi54- hu55- hy56- is57- it58- izh59- ka60- kbd61- kjh62- kk63- kl64- klr65- kmr66- kn67- krl68- kw69- la70- liv71- lld72- lt73- lud74- lv75- mk76- mt77- mwf78- nap79- nb80- nds81- nl82- nn83- nv84- oc85- olo86- osx87- pl88- ps89- pt90- qu91- ro92- ru93- sa94- sga95- sh96- sl97- sme98- sq99- sv100- swc101- syc102- te103- tg104- tk105- tr106- tt107- uk108- ur109- uz110- vec111- vep112- vot113- xcl114- xno115- yi116- zu117license:118- cc-by-sa-3.0119multilinguality:120- monolingual121size_categories:122- 10K<n<100K123- 1K<n<10K124- n<1K125source_datasets:126- original127task_categories:128- token-classification129- text-classification130task_ids:131- multi-class-classification132- multi-label-classification133paperswithcode_id: null134pretty_name: UniversalMorphologies135tags:136- morphology137dataset_info:138- config_name: ady139  features:140  - name: lemma141    dtype: string142  - name: forms143    sequence:144    - name: word145      dtype: string146    - name: Aktionsart147      sequence:148        class_label:149          names:150            0: STAT151            1: DYN152            2: TEL153            3: ATEL154            4: PCT155            5: DUR156            6: ACH157            7: ACCMP158            8: SEMEL159            9: ACTY160    - name: Animacy161      sequence:162        class_label:163          names:164            0: ANIM165            1: INAN166            2: HUM167            3: NHUM168    - name: Argument_Marking169      sequence:170        class_label:171          names:172            0: ARGNO1S173            1: ARGNO2S174            2: ARGNO3S175            3: ARGNO1P176            4: ARGNO2P177            5: ARGNO3P178            6: ARGAC1S179            7: ARGAC2S180            8: ARGAC3S181            9: ARGAC1P182            10: ARGAC2P183            11: ARGAC3P184            12: ARGAB1S185            13: ARGAB2S186            14: ARGAB3S187            15: ARGAB1P188            16: ARGAB2P189            17: ARGAB3P190            18: ARGER1S191            19: ARGER2S192            20: ARGER3S193            21: ARGER1P194            22: ARGER2P195            23: ARGER3P196            24: ARGDA1S197            25: ARGDA2S198            26: ARGDA3S199            27: ARGDA1P200            28: ARGDA2P201            29: ARGDA3P202            30: ARGBE1S203            31: ARGBE2S204            32: ARGBE3S205            33: ARGBE1P206            34: ARGBE2P207            35: ARGBE3P208    - name: Aspect209      sequence:210        class_label:211          names:212            0: IPFV213            1: PFV214            2: PRF215            3: PROG216            4: PROSP217            5: ITER218            6: HAB219    - name: Case220      sequence:221        class_label:222          names:223            0: NOM224            1: ACC225            2: ERG226            3: ABS227            4: NOMS228            5: DAT229            6: BEN230            7: PRP231            8: GEN232            9: REL233            10: PRT234            11: INS235            12: COM236            13: VOC237            14: COMPV238            15: EQTV239            16: PRIV240            17: PROPR241            18: AVR242            19: FRML243            20: TRANS244            21: BYWAY245            22: INTER246            23: AT247            24: POST248            25: IN249            26: CIRC250            27: ANTE251            28: APUD252            29: 'ON'253            30: ONHR254            31: ONVR255            32: SUB256            33: REM257            34: PROXM258            35: ESS259            36: ALL260            37: ABL261            38: APPRX262            39: TERM263    - name: Comparison264      sequence:265        class_label:266          names:267            0: CMPR268            1: SPRL269            2: AB270            3: RL271            4: EQT272    - name: Definiteness273      sequence:274        class_label:275          names:276            0: DEF277            1: INDF278            2: SPEC279            3: NSPEC280    - name: Deixis281      sequence:282        class_label:283          names:284            0: PROX285            1: MED286            2: REMT287            3: REF1288            4: REF2289            5: NOREF290            6: PHOR291            7: VIS292            8: NVIS293            9: ABV294            10: EVEN295            11: BEL296    - name: Evidentiality297      sequence:298        class_label:299          names:300            0: FH301            1: DRCT302            2: SEN303            3: VISU304            4: NVSEN305            5: AUD306            6: NFH307            7: QUOT308            8: RPRT309            9: HRSY310            10: INFER311            11: ASSUM312    - name: Finiteness313      sequence:314        class_label:315          names:316            0: FIN317            1: NFIN318    - name: Gender319      sequence:320        class_label:321          names:322            0: MASC323            1: FEM324            2: NEUT325            3: NAKH1326            4: NAKH2327            5: NAKH3328            6: NAKH4329            7: NAKH5330            8: NAKH6331            9: NAKH7332            10: NAKH8333            11: BANTU1334            12: BANTU2335            13: BANTU3336            14: BANTU4337            15: BANTU5338            16: BANTU6339            17: BANTU7340            18: BANTU8341            19: BANTU9342            20: BANTU10343            21: BANTU11344            22: BANTU12345            23: BANTU13346            24: BANTU14347            25: BANTU15348            26: BANTU16349            27: BANTU17350            28: BANTU18351            29: BANTU19352            30: BANTU20353            31: BANTU21354            32: BANTU22355            33: BANTU23356    - name: Information_Structure357      sequence:358        class_label:359          names:360            0: TOP361            1: FOC362    - name: Interrogativity363      sequence:364        class_label:365          names:366            0: DECL367            1: INT368    - name: Language_Specific369      sequence:370        class_label:371          names:372            0: LGSPEC1373            1: LGSPEC2374            2: LGSPEC3375            3: LGSPEC4376            4: LGSPEC5377            5: LGSPEC6378            6: LGSPEC7379            7: LGSPEC8380            8: LGSPEC9381            9: LGSPEC10382    - name: Mood383      sequence:384        class_label:385          names:386            0: IND387            1: SBJV388            2: REAL389            3: IRR390            4: AUPRP391            5: AUNPRP392            6: IMP393            7: COND394            8: PURP395            9: INTEN396            10: POT397            11: LKLY398            12: ADM399            13: OBLIG400            14: DEB401            15: PERM402            16: DED403            17: SIM404            18: OPT405    - name: Number406      sequence:407        class_label:408          names:409            0: SG410            1: PL411            2: GRPL412            3: DU413            4: TRI414            5: PAUC415            6: GRPAUC416            7: INVN417    - name: Part_Of_Speech418      sequence:419        class_label:420          names:421            0: N422            1: PROPN423            2: ADJ424            3: PRO425            4: CLF426            5: ART427            6: DET428            7: V429            8: ADV430            9: AUX431            10: V.PTCP432            11: V.MSDR433            12: V.CVB434            13: ADP435            14: COMP436            15: CONJ437            16: NUM438            17: PART439            18: INTJ440    - name: Person441      sequence:442        class_label:443          names:444            0: '0'445            1: '1'446            2: '2'447            3: '3'448            4: '4'449            5: INCL450            6: EXCL451            7: PRX452            8: OBV453    - name: Polarity454      sequence:455        class_label:456          names:457            0: POS458            1: NEG459    - name: Politeness460      sequence:461        class_label:462          names:463            0: INFM464            1: FORM465            2: ELEV466            3: HUMB467            4: POL468            5: AVOID469            6: LOW470            7: HIGH471            8: STELEV472            9: STSUPR473            10: LIT474            11: FOREG475            12: COL476    - name: Possession477      sequence:478        class_label:479          names:480            0: ALN481            1: NALN482            2: PSS1S483            3: PSS2S484            4: PSS2SF485            5: PSS2SM486            6: PSS2SINFM487            7: PSS2SFORM488            8: PSS3S489            9: PSS3SF490            10: PSS3SM491            11: PSS1D492            12: PSS1DI493            13: PSS1DE494            14: PSS2D495            15: PSS2DM496            16: PSS2DF497            17: PSS3D498            18: PSS3DF499            19: PSS3DM500            20: PSS1P501            21: PSS1PI502            22: PSS1PE503            23: PSS2P504            24: PSS2PF505            25: PSS2PM506            26: PSS3PF507            27: PSS3PM508    - name: Switch_Reference509      sequence:510        class_label:511          names:512            0: SS513            1: SSADV514            2: DS515            3: DSADV516            4: OR517            5: SIMMA518            6: SEQMA519            7: LOG520    - name: Tense521      sequence:522        class_label:523          names:524            0: PRS525            1: PST526            2: FUT527            3: IMMED528            4: HOD529            5: 1DAY530            6: RCT531            7: RMT532    - name: Valency533      sequence:534        class_label:535          names:536            0: IMPRS537            1: INTR538            2: TR539            3: DITR540            4: REFL541            5: RECP542            6: CAUS543            7: APPL544    - name: Voice545      sequence:546        class_label:547          names:548            0: ACT549            1: MID550            2: PASS551            3: ANTIP552            4: DIR553            5: INV554            6: AGFOC555            7: PFOC556            8: LFOC557            9: BFOC558            10: ACFOC559            11: IFOC560            12: CFOC561    - name: Other562      sequence: string563  splits:564  - name: train565    num_bytes: 3428235566    num_examples: 1666567  download_size: 1008487568  dataset_size: 3428235569- config_name: ang570  features:571  - name: lemma572    dtype: string573  - name: forms574    sequence:575    - name: word576      dtype: string577    - name: Aktionsart578      sequence:579        class_label:580          names:581            0: STAT582            1: DYN583            2: TEL584            3: ATEL585            4: PCT586            5: DUR587            6: ACH588            7: ACCMP589            8: SEMEL590            9: ACTY591    - name: Animacy592      sequence:593        class_label:594          names:595            0: ANIM596            1: INAN597            2: HUM598            3: NHUM599    - name: Argument_Marking600      sequence:601        class_label:602          names:603            0: ARGNO1S604            1: ARGNO2S605            2: ARGNO3S606            3: ARGNO1P607            4: ARGNO2P608            5: ARGNO3P609            6: ARGAC1S610            7: ARGAC2S611            8: ARGAC3S612            9: ARGAC1P613            10: ARGAC2P614            11: ARGAC3P615            12: ARGAB1S616            13: ARGAB2S617            14: ARGAB3S618            15: ARGAB1P619            16: ARGAB2P620            17: ARGAB3P621            18: ARGER1S622            19: ARGER2S623            20: ARGER3S624            21: ARGER1P625            22: ARGER2P626            23: ARGER3P627            24: ARGDA1S628            25: ARGDA2S629            26: ARGDA3S630            27: ARGDA1P631            28: ARGDA2P632            29: ARGDA3P633            30: ARGBE1S634            31: ARGBE2S635            32: ARGBE3S636            33: ARGBE1P637            34: ARGBE2P638            35: ARGBE3P639    - name: Aspect640      sequence:641        class_label:642          names:643            0: IPFV644            1: PFV645            2: PRF646            3: PROG647            4: PROSP648            5: ITER649            6: HAB650    - name: Case651      sequence:652        class_label:653          names:654            0: NOM655            1: ACC656            2: ERG657            3: ABS658            4: NOMS659            5: DAT660            6: BEN661            7: PRP662            8: GEN663            9: REL664            10: PRT665            11: INS666            12: COM667            13: VOC668            14: COMPV669            15: EQTV670            16: PRIV671            17: PROPR672            18: AVR673            19: FRML674            20: TRANS675            21: BYWAY676            22: INTER677            23: AT678            24: POST679            25: IN680            26: CIRC681            27: ANTE682            28: APUD683            29: 'ON'684            30: ONHR685            31: ONVR686            32: SUB687            33: REM688            34: PROXM689            35: ESS690            36: ALL691            37: ABL692            38: APPRX693            39: TERM694    - name: Comparison695      sequence:696        class_label:697          names:698            0: CMPR699            1: SPRL700            2: AB701            3: RL702            4: EQT703    - name: Definiteness704      sequence:705        class_label:706          names:707            0: DEF708            1: INDF709            2: SPEC710            3: NSPEC711    - name: Deixis712      sequence:713        class_label:714          names:715            0: PROX716            1: MED717            2: REMT718            3: REF1719            4: REF2720            5: NOREF721            6: PHOR722            7: VIS723            8: NVIS724            9: ABV725            10: EVEN726            11: BEL727    - name: Evidentiality728      sequence:729        class_label:730          names:731            0: FH732            1: DRCT733            2: SEN734            3: VISU735            4: NVSEN736            5: AUD737            6: NFH738            7: QUOT739            8: RPRT740            9: HRSY741            10: INFER742            11: ASSUM743    - name: Finiteness744      sequence:745        class_label:746          names:747            0: FIN748            1: NFIN749    - name: Gender750      sequence:751        class_label:752          names:753            0: MASC754            1: FEM755            2: NEUT756            3: NAKH1757            4: NAKH2758            5: NAKH3759            6: NAKH4760            7: NAKH5761            8: NAKH6762            9: NAKH7763            10: NAKH8764            11: BANTU1765            12: BANTU2766            13: BANTU3767            14: BANTU4768            15: BANTU5769            16: BANTU6770            17: BANTU7771            18: BANTU8772            19: BANTU9773            20: BANTU10774            21: BANTU11775            22: BANTU12776            23: BANTU13777            24: BANTU14778            25: BANTU15779            26: BANTU16780            27: BANTU17781            28: BANTU18782            29: BANTU19783            30: BANTU20784            31: BANTU21785            32: BANTU22786            33: BANTU23787    - name: Information_Structure788      sequence:789        class_label:790          names:791            0: TOP792            1: FOC793    - name: Interrogativity794      sequence:795        class_label:796          names:797            0: DECL798            1: INT799    - name: Language_Specific800      sequence:801        class_label:802          names:803            0: LGSPEC1804            1: LGSPEC2805            2: LGSPEC3806            3: LGSPEC4807            4: LGSPEC5808            5: LGSPEC6809            6: LGSPEC7810            7: LGSPEC8811            8: LGSPEC9812            9: LGSPEC10813    - name: Mood814      sequence:815        class_label:816          names:817            0: IND818            1: SBJV819            2: REAL820            3: IRR821            4: AUPRP822            5: AUNPRP823            6: IMP824            7: COND825            8: PURP826            9: INTEN827            10: POT828            11: LKLY829            12: ADM830            13: OBLIG831            14: DEB832            15: PERM833            16: DED834            17: SIM835            18: OPT836    - name: Number837      sequence:838        class_label:839          names:840            0: SG841            1: PL842            2: GRPL843            3: DU844            4: TRI845            5: PAUC846            6: GRPAUC847            7: INVN848    - name: Part_Of_Speech849      sequence:850        class_label:851          names:852            0: N853            1: PROPN854            2: ADJ855            3: PRO856            4: CLF857            5: ART858            6: DET859            7: V860            8: ADV861            9: AUX862            10: V.PTCP863            11: V.MSDR864            12: V.CVB865            13: ADP866            14: COMP867            15: CONJ868            16: NUM869            17: PART870            18: INTJ871    - name: Person872      sequence:873        class_label:874          names:875            0: '0'876            1: '1'877            2: '2'878            3: '3'879            4: '4'880            5: INCL881            6: EXCL882            7: PRX883            8: OBV884    - name: Polarity885      sequence:886        class_label:887          names:888            0: POS889            1: NEG890    - name: Politeness891      sequence:892        class_label:893          names:894            0: INFM895            1: FORM896            2: ELEV897            3: HUMB898            4: POL899            5: AVOID900            6: LOW901            7: HIGH902            8: STELEV903            9: STSUPR904            10: LIT905            11: FOREG906            12: COL907    - name: Possession908      sequence:909        class_label:910          names:911            0: ALN912            1: NALN913            2: PSS1S914            3: PSS2S915            4: PSS2SF916            5: PSS2SM917            6: PSS2SINFM918            7: PSS2SFORM919            8: PSS3S920            9: PSS3SF921            10: PSS3SM922            11: PSS1D923            12: PSS1DI924            13: PSS1DE925            14: PSS2D926            15: PSS2DM927            16: PSS2DF928            17: PSS3D929            18: PSS3DF930            19: PSS3DM931            20: PSS1P932            21: PSS1PI933            22: PSS1PE934            23: PSS2P935            24: PSS2PF936            25: PSS2PM937            26: PSS3PF938            27: PSS3PM939    - name: Switch_Reference940      sequence:941        class_label:942          names:943            0: SS944            1: SSADV945            2: DS946            3: DSADV947            4: OR948            5: SIMMA949            6: SEQMA950            7: LOG951    - name: Tense952      sequence:953        class_label:954          names:955            0: PRS956            1: PST957            2: FUT958            3: IMMED959            4: HOD960            5: 1DAY961            6: RCT962            7: RMT963    - name: Valency964      sequence:965        class_label:966          names:967            0: IMPRS968            1: INTR969            2: TR970            3: DITR971            4: REFL972            5: RECP973            6: CAUS974            7: APPL975    - name: Voice976      sequence:977        class_label:978          names:979            0: ACT980            1: MID981            2: PASS982            3: ANTIP983            4: DIR984            5: INV985            6: AGFOC986            7: PFOC987            8: LFOC988            9: BFOC989            10: ACFOC990            11: IFOC991            12: CFOC992    - name: Other993      sequence: string994  splits:995  - name: train996    num_bytes: 6569844997    num_examples: 1867998  download_size: 1435972999  dataset_size: 65698441000- config_name: ara1001  features:1002  - name: lemma1003    dtype: string1004  - name: forms1005    sequence:1006    - name: word1007      dtype: string1008    - name: Aktionsart1009      sequence:1010        class_label:1011          names:1012            0: STAT1013            1: DYN1014            2: TEL1015            3: ATEL1016            4: PCT1017            5: DUR1018            6: ACH1019            7: ACCMP1020            8: SEMEL1021            9: ACTY1022    - name: Animacy1023      sequence:1024        class_label:1025          names:1026            0: ANIM1027            1: INAN1028            2: HUM1029            3: NHUM1030    - name: Argument_Marking1031      sequence:1032        class_label:1033          names:1034            0: ARGNO1S1035            1: ARGNO2S1036            2: ARGNO3S1037            3: ARGNO1P1038            4: ARGNO2P1039            5: ARGNO3P1040            6: ARGAC1S1041            7: ARGAC2S1042            8: ARGAC3S1043            9: ARGAC1P1044            10: ARGAC2P1045            11: ARGAC3P1046            12: ARGAB1S1047            13: ARGAB2S1048            14: ARGAB3S1049            15: ARGAB1P1050            16: ARGAB2P1051            17: ARGAB3P1052            18: ARGER1S1053            19: ARGER2S1054            20: ARGER3S1055            21: ARGER1P1056            22: ARGER2P1057            23: ARGER3P1058            24: ARGDA1S1059            25: ARGDA2S1060            26: ARGDA3S1061            27: ARGDA1P1062            28: ARGDA2P1063            29: ARGDA3P1064            30: ARGBE1S1065            31: ARGBE2S1066            32: ARGBE3S1067            33: ARGBE1P1068            34: ARGBE2P1069            35: ARGBE3P1070    - name: Aspect1071      sequence:1072        class_label:1073          names:1074            0: IPFV1075            1: PFV1076            2: PRF1077            3: PROG1078            4: PROSP1079            5: ITER1080            6: HAB1081    - name: Case1082      sequence:1083        class_label:1084          names:1085            0: NOM1086            1: ACC1087            2: ERG1088            3: ABS1089            4: NOMS1090            5: DAT1091            6: BEN1092            7: PRP1093            8: GEN1094            9: REL1095            10: PRT1096            11: INS1097            12: COM1098            13: VOC1099            14: COMPV1100            15: EQTV1101            16: PRIV1102            17: PROPR1103            18: AVR1104            19: FRML1105            20: TRANS1106            21: BYWAY1107            22: INTER1108            23: AT1109            24: POST1110            25: IN1111            26: CIRC1112            27: ANTE1113            28: APUD1114            29: 'ON'1115            30: ONHR1116            31: ONVR1117            32: SUB1118            33: REM1119            34: PROXM1120            35: ESS1121            36: ALL1122            37: ABL1123            38: APPRX1124            39: TERM1125    - name: Comparison1126      sequence:1127        class_label:1128          names:1129            0: CMPR1130            1: SPRL1131            2: AB1132            3: RL1133            4: EQT1134    - name: Definiteness1135      sequence:1136        class_label:1137          names:1138            0: DEF1139            1: INDF1140            2: SPEC1141            3: NSPEC1142    - name: Deixis1143      sequence:1144        class_label:1145          names:1146            0: PROX1147            1: MED1148            2: REMT1149            3: REF11150            4: REF21151            5: NOREF1152            6: PHOR1153            7: VIS1154            8: NVIS1155            9: ABV1156            10: EVEN1157            11: BEL1158    - name: Evidentiality1159      sequence:1160        class_label:1161          names:1162            0: FH1163            1: DRCT1164            2: SEN1165            3: VISU1166            4: NVSEN1167            5: AUD1168            6: NFH1169            7: QUOT1170            8: RPRT1171            9: HRSY1172            10: INFER1173            11: ASSUM1174    - name: Finiteness1175      sequence:1176        class_label:1177          names:1178            0: FIN1179            1: NFIN1180    - name: Gender1181      sequence:1182        class_label:1183          names:1184            0: MASC1185            1: FEM1186            2: NEUT1187            3: NAKH11188            4: NAKH21189            5: NAKH31190            6: NAKH41191            7: NAKH51192            8: NAKH61193            9: NAKH71194            10: NAKH81195            11: BANTU11196            12: BANTU21197            13: BANTU31198            14: BANTU41199            15: BANTU51200            16: BANTU6

Showing the first 1,200 of 47832 lines. Download the file for the rest.