kunishou/J-ResearchCorpus
J-ResearchCorpus Update: 2024/3/16言語処理学会第30回年次大会(NLP2024)を含む、論文 1,343 本のデータを追加 2024/2/25言語処理学会誌「自然言語処理」のうち CC-BY-4.0 で公開されている論文 360 本のデータを追加 概要 CC-BY-* ライセンスで公開されている日本語論文や学会誌等から抜粋した高品質なテキストのデータセットです。言語モデルの事前学習や RAG 等でご活用下さい。 今後も CC-BY-* ライセンスの日本語論文があれば追加する予定です。 データ説明 filename : 該当データのファイル名 text ： 日本語論文から抽出したテキストデータ category : データソース license : ライセンス credit : クレジット データソース・ライセンス テキスト総文字数 : 約 3,900 万文字 data source num… See the full description on the dataset page: https://huggingface.co/datasets/kunishou/J-ResearchCorpus.
32199
1*.7z filter=lfs diff=lfs merge=lfs -text2*.arrow filter=lfs diff=lfs merge=lfs -text3*.bin filter=lfs diff=lfs merge=lfs -text4*.bz2 filter=lfs diff=lfs merge=lfs -text5*.ckpt filter=lfs diff=lfs merge=lfs -text6*.ftz filter=lfs diff=lfs merge=lfs -text7*.gz filter=lfs diff=lfs merge=lfs -text8*.h5 filter=lfs diff=lfs merge=lfs -text9*.joblib filter=lfs diff=lfs merge=lfs -text10*.lfs.* filter=lfs diff=lfs merge=lfs -text11*.lz4 filter=lfs diff=lfs merge=lfs -text12*.mlmodel filter=lfs diff=lfs merge=lfs -text13*.model filter=lfs diff=lfs merge=lfs -text14*.msgpack filter=lfs diff=lfs merge=lfs -text15*.npy filter=lfs diff=lfs merge=lfs -text16*.npz filter=lfs diff=lfs merge=lfs -text17*.onnx filter=lfs diff=lfs merge=lfs -text18*.ot filter=lfs diff=lfs merge=lfs -text19*.parquet filter=lfs diff=lfs merge=lfs -text20*.pb filter=lfs diff=lfs merge=lfs -text21*.pickle filter=lfs diff=lfs merge=lfs -text22*.pkl filter=lfs diff=lfs merge=lfs -text23*.pt filter=lfs diff=lfs merge=lfs -text24*.pth filter=lfs diff=lfs merge=lfs -text25*.rar filter=lfs diff=lfs merge=lfs -text26*.safetensors filter=lfs diff=lfs merge=lfs -text27saved_model/**/* filter=lfs diff=lfs merge=lfs -text28*.tar.* filter=lfs diff=lfs merge=lfs -text29*.tar filter=lfs diff=lfs merge=lfs -text30*.tflite filter=lfs diff=lfs merge=lfs -text31*.tgz filter=lfs diff=lfs merge=lfs -text32*.wasm filter=lfs diff=lfs merge=lfs -text33*.xz filter=lfs diff=lfs merge=lfs -text34*.zip filter=lfs diff=lfs merge=lfs -text35*.zst filter=lfs diff=lfs merge=lfs -text36*tfevents* filter=lfs diff=lfs merge=lfs -text37# Audio files - uncompressed38*.pcm filter=lfs diff=lfs merge=lfs -text39*.sam filter=lfs diff=lfs merge=lfs -text40*.raw filter=lfs diff=lfs merge=lfs -text41# Audio files - compressed42*.aac filter=lfs diff=lfs merge=lfs -text43*.flac filter=lfs diff=lfs merge=lfs -text44*.mp3 filter=lfs diff=lfs merge=lfs -text45*.ogg filter=lfs diff=lfs merge=lfs -text46*.wav filter=lfs diff=lfs merge=lfs -text47# Image files - uncompressed48*.bmp filter=lfs diff=lfs merge=lfs -text49*.gif filter=lfs diff=lfs merge=lfs -text50*.png filter=lfs diff=lfs merge=lfs -text51*.tiff filter=lfs diff=lfs merge=lfs -text52# Image files - compressed53*.jpg filter=lfs diff=lfs merge=lfs -text54*.jpeg filter=lfs diff=lfs merge=lfs -text55*.webp filter=lfs diff=lfs merge=lfs -text56j_researchcorpus_20240212.jsonl filter=lfs diff=lfs merge=lfs -text57j_researchcorpus_20240215.jsonl filter=lfs diff=lfs merge=lfs -text58j_researchcorpus_20240220.jsonl filter=lfs diff=lfs merge=lfs -text59j_researchcorpus_20240224.jsonl filter=lfs diff=lfs merge=lfs -text60j_researchcorpus_20240225.jsonl filter=lfs diff=lfs merge=lfs -text61j_researchcorpus_20240306.jsonl filter=lfs diff=lfs merge=lfs -text62j_researchcorpus_20240316.jsonl filter=lfs diff=lfs merge=lfs -text63