cloverx-id/xone-repository-parallel-en-id-corpus
We are currently developing new version of LMSE translation scoring model and processing additional data sources. We estimate the dataset will expand, with significantly improved quality.(Delayed..) A score of 55% and above indicates high-quality translation pairs, even if the first version of the model we developed gave them such a score. We will try to release a newer model in the future with better quality and consistently fast scoring speeds, and release it to the public once we decide… See the full description on the dataset page: https://huggingface.co/datasets/cloverx-id/xone-repository-parallel-en-id-corpus.
Rename batch: dropped-00671.parquet to dropped-00678.parquet (8 files)
Rename batch: dropped-00651.parquet to dropped-00670.parquet (20 files)
Rename batch: dropped-00631.parquet to dropped-00650.parquet (20 files)
Rename batch: dropped-00611.parquet to dropped-00630.parquet (20 files)
Rename batch: dropped-00591.parquet to dropped-00610.parquet (20 files)
Rename batch: dropped-00571.parquet to dropped-00590.parquet (20 files)
Rename batch: dropped-00551.parquet to dropped-00570.parquet (20 files)
Rename batch: dropped-00531.parquet to dropped-00550.parquet (20 files)
Rename batch: dropped-00511.parquet to dropped-00530.parquet (20 files)
Rename batch: dropped-00491.parquet to dropped-00510.parquet (20 files)
Rename batch: dropped-00471.parquet to dropped-00490.parquet (20 files)
Rename batch: dropped-00451.parquet to dropped-00470.parquet (20 files)
Rename batch: dropped-00431.parquet to dropped-00450.parquet (20 files)
Rename batch: dropped-00411.parquet to dropped-00430.parquet (20 files)
Rename batch: dropped-00391.parquet to dropped-00410.parquet (20 files)
Curate shard: train-00292.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00291.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00290.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00289.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00288.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00287.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00286.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00285.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00284.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00283.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00282.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00281.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00280.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00279.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00278.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00277.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00276.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00275.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00274.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00273.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00272.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00271.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00270.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00269.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00268.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00267.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00266.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00265.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00264.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00263.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00262.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00261.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00260.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00259.parquet synced to progress/ & drop_by_filter/
Curate shard: train-00258.parquet synced to progress/ & drop_by_filter/