CoolFace
Datasetpublic

lingvanex/lingvanex_test_references

LTR LTR -- Lingvanex Test References for MT Evaluation from English into a total of 30 target languages for a big variety of cases. TEST CASES Parameter Description Length Sentences from 1 to 100 words. Domain Medicine (12%), Automobile (11%), Finance (8%) Tokenizer Jupiter is 1.000.000 km far. Ask Mr. Johnson for training Tags I want to eat and swim Capitalisation (Case) HELLO my Dear frIEND Different languages in one text (Up to 3… See the full description on the dataset page: https://huggingface.co/datasets/lingvanex/lingvanex_test_references.

sourceHugging Facecc-by-nc-sa-4.0updated 3y agoView on Hugging Face
2likes86downloads
Dataset Card

LTR

LTR -- Lingvanex Test References for MT Evaluation from English into a total of 30 target languages for a big variety of cases.

TEST CASES

ParameterDescription
LengthSentences from 1 to 100 words.
DomainMedicine (12%), Automobile (11%), Finance (8%)
TokenizerJupiter is 1.000.000 km far. Ask Mr. Johnson for training
TagsI want to eat <tag> and swim
Capitalisation (Case)HELLO my Dear frIEND
Different languages in one text (Up to 3 languages)I see "Купалинка" performance near the theater.
StylingHello Dude!
Errors (Grammar, OCR)I neet (need) to buy a kat (cat)
AbbreviationsThe model was named 15.BVcX-10
Named EntitiesLet’s go to New York city
IdiomsA piece of cake. Once in a blue moon’
Formulas (Math, Physics, Chemistry)Cr2(SO4)3 + CO2 + H2O + K2SO4 + KNO3
Romanian numbersIt was in MCMXVII year
Unicode Special Characters№%&*/#

Updates

Data package has been released on 11/18/2023. Enjoy!

License

The LTR data set is released under the CC BY-SA 4.0 license.

How to Cite

@inproceedings{
    title = "{LTR} Lingvanex Test References for {MT} Evaluation",
    author = "Aliaksei Rudak",
    url = "https://lingvanex.com",
    Year = "2023"
}