Datasetpublic

Lego-MT/Parallel_Dataset

Dataset Sources Paper: LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation Link: https://aclanthology.org/2025.findings-acl.1200.pdf Repository: https://github.com/CONE-MT/CONE

sourceHugging Facemitupdated 1y agoView on Hugging Face

0likes755downloads

root

file.gitattributes2 KBdownload

fileaa.jsonl1.5 MBdownload

fileab.jsonl1.9 MBdownload

fileace.jsonl1.1 MBdownload

fileacm.jsonl6 KBdownload

fileacu.jsonl4.0 MBdownload

fileady.jsonl1 KBdownload

fileae.jsonl20 KBdownload

fileaf.jsonl2.5 MBdownload

fileafb.jsonl9 KBdownload

fileafh.jsonl7 KBdownload

fileagr.jsonl3.7 MBdownload

fileain.jsonl38 KBdownload

fileak.jsonl1.9 MBdownload

fileake.jsonl3.8 MBdownload

fileakl.jsonl2 KBdownload

filealn.jsonl2 KBdownload

fileam.jsonl3.2 MBdownload

fileamu.jsonl4.3 MBdownload

filean.jsonl1.6 MBdownload

fileang.jsonl1.1 MBdownload

fileaoz.jsonl2 KBdownload

fileapc.jsonl4 KBdownload

filear.jsonl2.6 MBdownload

filearq.jsonl2.8 MBdownload

fileary.jsonl17 KBdownload

filearz.jsonl2.7 MBdownload

fileas.jsonl1.8 MBdownload

filease.jsonl1.3 MBdownload

fileast.jsonl2.8 MBdownload

fileav.jsonl1.1 MBdownload

fileavk.jsonl224 KBdownload

fileawa.jsonl29 KBdownload

fileay.jsonl2.9 MBdownload

fileaz.jsonl2.5 MBdownload

fileazb.jsonl1.5 MBdownload

fileba.jsonl2.6 MBdownload

filebal.jsonl318 KBdownload

filebar.jsonl2.1 MBdownload

filebe.jsonl3.2 MBdownload

filebem.jsonl1.1 MBdownload

fileber.jsonl1.3 MBdownload

filebg.jsonl2.4 MBdownload

filebh.jsonl464 KBdownload

filebho.jsonl299 KBdownload

filebi.jsonl1.2 MBdownload

filebjn.jsonl2 KBdownload

filebm.jsonl972 KBdownload

filebn.jsonl2.7 MBdownload

filebnt.jsonl238 KBdownload

filebo.jsonl2.0 MBdownload

filebom.jsonl5 KBdownload

filebr.jsonl1.3 MBdownload

filebrx.jsonl280 KBdownload

filebs.jsonl1.4 MBdownload

filebsn.jsonl4.5 MBdownload

filebua.jsonl267 KBdownload

filebug.jsonl293 KBdownload

filebvy.jsonl2 KBdownload

filebxr.jsonl71 KBdownload

filebzt.jsonl131 KBdownload

fileca.jsonl2.4 MBdownload

filecak.jsonl4.4 MBdownload

filecb.jsonl1.1 MBdownload

filecbk.jsonl261 KBdownload

filecdo.jsonl4 KBdownload

filece.jsonl1.2 MBdownload

fileceb.jsonl2.8 MBdownload

filech.jsonl3.2 MBdownload

filecho.jsonl40 KBdownload

filechq.jsonl5.2 MBdownload

filechr.jsonl4.2 MBdownload

filecjp.jsonl3.7 MBdownload

fileckb.jsonl1.4 MBdownload

filecku.jsonl124 KBdownload

filecmn.jsonl1.1 MBdownload

filecnh.jsonl390 KBdownload

filecni.jsonl4.0 MBdownload

fileco.jsonl888 KBdownload

filecop.jsonl4.7 MBdownload

filecr.jsonl34 KBdownload

filecrh.jsonl1.4 MBdownload

filecrp.jsonl3.6 MBdownload

filecs.jsonl2.0 MBdownload

filecsb.jsonl1.4 MBdownload

filecu.jsonl324 KBdownload

filecv.jsonl1.0 MBdownload

filecx.jsonl3.7 MBdownload

filecy.jsonl2.1 MBdownload

filecycl.jsonl7 KBdownload

fileda.jsonl2.4 MBdownload

filede.jsonl2.5 MBdownload

filedik.jsonl3.4 MBdownload

filedin.jsonl848 KBdownload

filedje.jsonl3.5 MBdownload

filedjk.jsonl3.8 MBdownload

filedng.jsonl2 KBdownload

filedop.jsonl3.9 MBdownload

filedrt.jsonl5 KBdownload

filedsb.jsonl810 KBdownload

filedtp.jsonl239 KBdownload

filedv.jsonl5.0 MBdownload

filedws.jsonl5 KBdownload

filedz.jsonl1.8 MBdownload

fileee.jsonl3.6 MBdownload

fileefi.jsonl635 KBdownload

fileegl.jsonl34 KBdownload

fileel.jsonl2.6 MBdownload

fileen.jsonl2.5 MBdownload

fileenm.jsonl82 KBdownload

fileeo.jsonl2.1 MBdownload

filees.jsonl2.5 MBdownload

fileet.jsonl2.2 MBdownload

fileeu.jsonl1.8 MBdownload

fileevn.jsonl10 KBdownload

fileext.jsonl6 KBdownload

filefa.jsonl2.3 MBdownload

fileff.jsonl1.1 MBdownload

filefi.jsonl2.1 MBdownload

filefil.jsonl2.4 MBdownload

filefj.jsonl558 KBdownload

filefkv.jsonl65 KBdownload

filefo.jsonl1.8 MBdownload

filefr.jsonl2.6 MBdownload

filefrm.jsonl92 KBdownload

filefro.jsonl5 KBdownload

filefrp.jsonl1.1 MBdownload

filefrr.jsonl49 KBdownload

filefur.jsonl1.4 MBdownload

filefuv.jsonl846 KBdownload

filefy.jsonl1.6 MBdownload

filega.jsonl2.8 MBdownload

filegan.jsonl2 KBdownload

filegbi.jsonl4.2 MBdownload

filegbm.jsonl4 KBdownload

filegcf.jsonl109 KBdownload

filegd.jsonl1.6 MBdownload

filegil.jsonl1 KBdownload

filegl.jsonl1.9 MBdownload

filegn.jsonl1.4 MBdownload

filegom.jsonl2.6 MBdownload

filegos.jsonl364 KBdownload

filegot.jsonl34 KBdownload

filegr.jsonl931 KBdownload

filegrc.jsonl179 KBdownload

filegsw.jsonl26 KBdownload

filegu.jsonl2.8 MBdownload

filegv.jsonl2.4 MBdownload

fileha.jsonl2.6 MBdownload

filehai.jsonl280 KBdownload

filehak.jsonl4 KBdownload

filehaw.jsonl55 KBdownload

filehbo.jsonl25 KBdownload

filehbs.jsonl4.0 MBdownload

filehe.jsonl1.8 MBdownload

filehi.jsonl3.3 MBdownload

filehif.jsonl4 KBdownload

filehil.jsonl263 KBdownload

filehne.jsonl1.5 MBdownload

fileho.jsonl7 KBdownload

filehoc.jsonl54 KBdownload

filehr.jsonl1.7 MBdownload

filehrx.jsonl64 KBdownload

filehsb.jsonl1.4 MBdownload

fileht.jsonl2.8 MBdownload

filehu.jsonl2.1 MBdownload

filehup.jsonl39 KBdownload

filehus.jsonl9 KBdownload

filehy.jsonl3.4 MBdownload

fileia.jsonl1.3 MBdownload

fileiba.jsonl6 KBdownload

fileid.jsonl2.1 MBdownload

fileie.jsonl1.3 MBdownload

fileig.jsonl3.1 MBdownload

fileik.jsonl72 KBdownload

fileike.jsonl3 KBdownload

fileilo.jsonl1.7 MBdownload

fileinh.jsonl3.0 MBdownload

fileio.jsonl1.1 MBdownload

fileiro.jsonl5 KBdownload

fileis.jsonl2.1 MBdownload

fileit.jsonl2.4 MBdownload

fileiu.jsonl830 KBdownload

fileizh.jsonl1 KBdownload

fileja.jsonl2.0 MBdownload

filejak.jsonl4.0 MBdownload

filejam.jsonl3 KBdownload

filejbo.jsonl1.1 MBdownload

filejiv.jsonl3.6 MBdownload

filejp.jsonl4.1 MBdownload

filejv.jsonl1.2 MBdownload

fileka.jsonl3.8 MBdownload

filekab.jsonl3.1 MBdownload

filekam.jsonl882 Bdownload

filekbh.jsonl4.3 MBdownload

filekek.jsonl4.0 MBdownload

filekg.jsonl1.2 MBdownload

filekha.jsonl150 KBdownload

filekik.jsonl32 KBdownload

filekj.jsonl839 KBdownload

filekjh.jsonl2 KBdownload

filekk.jsonl2.7 MBdownload

filekl.jsonl1.5 MBdownload

filekm.jsonl2.8 MBdownload

filekmr.jsonl86 KBdownload

filekn.jsonl3.8 MBdownload

fileko.jsonl2.1 MBdownload

filekoi.jsonl1 KBdownload

filekr.jsonl1.8 MBdownload

filekrl.jsonl33 KBdownload

fileks.jsonl1.5 MBdownload

fileksh.jsonl364 KBdownload

fileku.jsonl3.1 MBdownload

filekv.jsonl8 KBdownload

filekw.jsonl1.2 MBdownload

fileky.jsonl3.0 MBdownload

filekzj.jsonl221 KBdownload

filela.jsonl2.0 MBdownload

filelad.jsonl535 KBdownload

filelb.jsonl3.7 MBdownload

fileldn.jsonl17 KBdownload

filelfn.jsonl1.4 MBdownload

filelg.jsonl1.3 MBdownload

fileli.jsonl1.3 MBdownload

filelij.jsonl218 KBdownload

fileliv.jsonl3 KBdownload

filelkt.jsonl3 KBdownload

filelld.jsonl1.2 MBdownload

filelmo.jsonl2.4 MBdownload

fileln.jsonl1.2 MBdownload

filelo.jsonl2.6 MBdownload

filelt.jsonl2.6 MBdownload

fileltg.jsonl1.5 MBdownload

fileluo.jsonl14 KBdownload

filelut.jsonl7 KBdownload

fileluy.jsonl19 KBdownload

filelv.jsonl2.9 MBdownload

filelzh.jsonl52 KBdownload

filemad.jsonl473 KBdownload

filemai.jsonl1.5 MBdownload

filemam.jsonl3.9 MBdownload

filemax.jsonl42 KBdownload

filemfe.jsonl1.9 MBdownload

filemg.jsonl2.9 MBdownload

filemgm.jsonl4 KBdownload

filemh.jsonl20 KBdownload

filemhr.jsonl1.4 MBdownload

filemi.jsonl3.1 MBdownload

filemic.jsonl1008 Bdownload

filemik.jsonl2 KBdownload

filemin.jsonl10 KBdownload

filemiq.jsonl872 KBdownload

filemk.jsonl2.4 MBdownload

fileml.jsonl3.2 MBdownload

filemn.jsonl2.9 MBdownload

filemnw.jsonl104 KBdownload

filemo.jsonl4 KBdownload

filemoh.jsonl10 KBdownload

filemos.jsonl276 KBdownload

filemr.jsonl3.5 MBdownload

filems.jsonl2.1 MBdownload

filemt.jsonl3.5 MBdownload

filemus.jsonl1.2 MBdownload

filemvv.jsonl819 Bdownload

filemwl.jsonl3.5 MBdownload

filemww.jsonl7 KBdownload

filemy.jsonl4.0 MBdownload

filemyv.jsonl2 KBdownload

filena.jsonl2 KBdownload

filenah.jsonl23 KBdownload

filenan.jsonl1.3 MBdownload

filenap.jsonl369 KBdownload

filenb.jsonl2.3 MBdownload

filench.jsonl8 KBdownload

filends.jsonl1.5 MBdownload

filene.jsonl3.9 MBdownload

filengt.jsonl2 KBdownload

filengu.jsonl4 KBdownload

filenhg.jsonl4.0 MBdownload

fileniu.jsonl2 KBdownload

filenl.jsonl2.3 MBdownload

filenlv.jsonl2 KBdownload

filenn.jsonl1.5 MBdownload

fileno.jsonl2.1 MBdownload

filenog.jsonl9 KBdownload

filenon.jsonl3 KBdownload

filenov.jsonl87 KBdownload

filenpi.jsonl12 KBdownload

filenr.jsonl129 KBdownload

filens.jsonl1.1 MBdownload

filenso.jsonl1.5 MBdownload

filenst.jsonl80 KBdownload

filenus.jsonl842 KBdownload

filenv.jsonl41 KBdownload

fileny.jsonl3.1 MBdownload

fileoc.jsonl1.4 MBdownload

fileofs.jsonl1 KBdownload

fileojb.jsonl4.8 MBdownload

fileom.jsonl1.2 MBdownload

fileood.jsonl2 KBdownload

fileor.jsonl1.8 MBdownload

fileorv.jsonl195 KBdownload

fileos.jsonl1.3 MBdownload

fileosp.jsonldownload

fileota.jsonl122 KBdownload

filepa.jsonl2.4 MBdownload

filepag.jsonl5 KBdownload

filepam.jsonl293 KBdownload

filepap.jsonl1.1 MBdownload

filepau.jsonl3 KBdownload

filepcd.jsonl28 KBdownload

filepck.jsonl3.5 MBdownload

filepdc.jsonl7 KBdownload

filepes.jsonl4.0 MBdownload

filephn.jsonl5 KBdownload

filepi.jsonl301 KBdownload

filepl.jsonl2.1 MBdownload

fileplt.jsonl3.7 MBdownload

filepms.jsonl921 KBdownload

filepmy.jsonl677 KBdownload

filepnb.jsonl106 KBdownload

filepot.jsonl3.4 MBdownload

fileppk.jsonl3.8 MBdownload

fileppl.jsonl3 KBdownload

fileprg.jsonl59 KBdownload

fileprs.jsonl2.8 MBdownload

fileps.jsonl2.6 MBdownload

filept.jsonl2.2 MBdownload

fileqa.jsonl87 KBdownload

fileqd.jsonl195 KBdownload

filequ.jsonl1.0 MBdownload

filequc.jsonl4.1 MBdownload

fileque.jsonl190 KBdownload

filequw.jsonl3.4 MBdownload

filequz.jsonl3 KBdownload

fileqya.jsonl18 KBdownload

filerap.jsonl2 KBdownload

fileREADME.md423 Bdownload

filerif.jsonl6 KBdownload

filerm.jsonl2.6 MBdownload

filern.jsonl711 KBdownload

filero.jsonl2.1 MBdownload

filerom.jsonl3.5 MBdownload

fileru.jsonl2.9 MBdownload

filerue.jsonl19 KBdownload

filerup.jsonl904 KBdownload

filerw.jsonl1.7 MBdownload

filery.jsonl1.4 MBdownload

filesa.jsonl1.3 MBdownload

filesah.jsonl141 KBdownload

filesat.jsonl22 KBdownload

filesc.jsonl1.3 MBdownload

filescn.jsonl2.0 MBdownload

filesco.jsonl1.4 MBdownload

filesd.jsonl2.8 MBdownload

filesdh.jsonl5 KBdownload

filese.jsonl1.2 MBdownload

filesg.jsonl7 KBdownload

filesgn.jsonl132 KBdownload

filesgs.jsonl4 KBdownload

filesh.jsonl3.0 MBdownload

fileshi.jsonl3.4 MBdownload

fileshn.jsonl1.4 MBdownload

fileshs.jsonl1022 KBdownload

fileshy.jsonl2 KBdownload

filesi.jsonl2.7 MBdownload

filesimple.jsonl285 KBdownload

filesjn.jsonl24 KBdownload

filesk.jsonl2.4 MBdownload

filesl.jsonl2.1 MBdownload

filesm.jsonl8 KBdownload

filesma.jsonl4 KBdownload

filesml.jsonl213 KBdownload

filesn.jsonl3.4 MBdownload

fileso.jsonl2.9 MBdownload

filesq.jsonl2.1 MBdownload

filesr.jsonl1.8 MBdownload

filess.jsonl2.7 MBdownload

filest.jsonl1.9 MBdownload

filestq.jsonl10 KBdownload

filesu.jsonl2.9 MBdownload

filesux.jsonl17 KBdownload

filesv.jsonl2.2 MBdownload

filesw.jsonl2.3 MBdownload

fileswg.jsonl237 KBdownload

fileswh.jsonl66 KBdownload

filesyr.jsonl3.4 MBdownload

filesz.jsonl2 KBdownload

fileszl.jsonl1.3 MBdownload

fileta.jsonl2.9 MBdownload

filetc.jsonl990 KBdownload

filete.jsonl4.1 MBdownload

filetet.jsonl1.5 MBdownload

filetg.jsonl2.7 MBdownload

fileth.jsonl2.3 MBdownload

filethv.jsonl4 KBdownload

fileti.jsonl2.2 MBdownload

filetk.jsonl1.3 MBdownload

filetl.jsonl2.2 MBdownload

filetlh.jsonl1.5 MBdownload

filetly.jsonl4 KBdownload

filetmh.jsonl3.4 MBdownload

filetmp.jsonl1.4 MBdownload

filetmr.jsonl41 KBdownload

filetn.jsonl970 KBdownload

fileto.jsonl224 KBdownload

filetoki.jsonl1.3 MBdownload

filetpi.jsonl9 KBdownload

filetpw.jsonl8 KBdownload

filetr.jsonl1.8 MBdownload

filetrv.jsonl196 KBdownload

filets.jsonl1.4 MBdownload

filett.jsonl3.2 MBdownload

filetvl.jsonl1 KBdownload

filetw.jsonl92 KBdownload

filety.jsonl2 KBdownload

filetz.jsonl11 KBdownload

filetzl.jsonl123 KBdownload

fileudm.jsonl8 KBdownload

fileug.jsonl3.9 MBdownload

fileuk.jsonl3.0 MBdownload

fileumb.jsonl12 KBdownload

fileur.jsonl3.0 MBdownload

fileusp.jsonl4.0 MBdownload

fileuz.jsonl2.2 MBdownload

fileve.jsonl1.4 MBdownload

filevec.jsonl1.3 MBdownload

filevi.jsonl2.4 MBdownload

filevls.jsonl79 KBdownload

filevo.jsonl462 KBdownload

filewa.jsonl1.3 MBdownload

filewae.jsonl1.1 MBdownload

filewal.jsonl3.5 MBdownload

filewar.jsonl162 KBdownload

filewo.jsonl2.1 MBdownload

filewuu.jsonl1.3 MBdownload

filexal.jsonl390 KBdownload

filexh.jsonl2.5 MBdownload

filexmf.jsonl44 KBdownload

fileyaq.jsonl11 KBdownload

fileyi.jsonl2.1 MBdownload

fileyo.jsonl3.1 MBdownload

fileyue.jsonl813 Bdownload

filezam.jsonl286 KBdownload

fileze.jsonl1.4 MBdownload

filezgh.jsonl11 KBdownload

filezh.jsonl2.2 MBdownload

filezhs.jsonl1.6 MBdownload

filezht.jsonl1.6 MBdownload

filezhtrad.jsonl1.5 MBdownload

filezhtw.jsonl1.3 MBdownload

filezhyue.jsonl2.1 MBdownload

filezlm.jsonl12 KBdownload

filezsm.jsonl303 KBdownload

filezu.jsonl3.1 MBdownload

filezz.jsonl7 KBdownload

filezza.jsonl1.0 MBdownload

Lego-MT/Parallel_Dataset · main · files are served by the source, never re-hosted here