CoolFace
Datasetpublicgated

bigcode/stack-dedup-alt-comments

Dataset Description This is the Python, Java and JavaScript subsets of The Stack (v1.1) after cleaning* and agressive deduplication from stack-dedup-alt-decontaminate with filtering on comment to code ratio with minimum of 0.01 and maximum of 0.8. The additional comments filtering removes 26.5% of the dataset's volume which goes from 215GB of text to 170GB. (*) cleaning: near deduplication + PII redaction + line length & percentage of alphanumeric characters filtering + data… See the full description on the dataset page: https://huggingface.co/datasets/bigcode/stack-dedup-alt-comments.

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes290downloads
../
filetrain-00000-of-00136.parquet440.9 MBdownload
filetrain-00001-of-00136.parquet436.1 MBdownload
filetrain-00002-of-00136.parquet433.2 MBdownload
filetrain-00003-of-00136.parquet433.6 MBdownload
filetrain-00004-of-00136.parquet435.5 MBdownload
filetrain-00005-of-00136.parquet434.2 MBdownload
filetrain-00006-of-00136.parquet439.2 MBdownload
filetrain-00007-of-00136.parquet436.8 MBdownload
filetrain-00008-of-00136.parquet429.5 MBdownload
filetrain-00009-of-00136.parquet434.9 MBdownload
filetrain-00010-of-00136.parquet434.3 MBdownload
filetrain-00011-of-00136.parquet433.5 MBdownload
filetrain-00012-of-00136.parquet427.3 MBdownload
filetrain-00013-of-00136.parquet429.8 MBdownload
filetrain-00014-of-00136.parquet429.7 MBdownload
filetrain-00015-of-00136.parquet429.1 MBdownload
filetrain-00016-of-00136.parquet426.8 MBdownload
filetrain-00017-of-00136.parquet428.2 MBdownload
filetrain-00018-of-00136.parquet424.3 MBdownload
filetrain-00019-of-00136.parquet425.7 MBdownload
filetrain-00020-of-00136.parquet428.4 MBdownload
filetrain-00021-of-00136.parquet427.4 MBdownload
filetrain-00022-of-00136.parquet428.3 MBdownload
filetrain-00023-of-00136.parquet422.1 MBdownload
filetrain-00024-of-00136.parquet426.0 MBdownload
filetrain-00025-of-00136.parquet425.6 MBdownload
filetrain-00026-of-00136.parquet425.7 MBdownload
filetrain-00027-of-00136.parquet428.5 MBdownload
filetrain-00028-of-00136.parquet421.9 MBdownload
filetrain-00029-of-00136.parquet426.6 MBdownload
filetrain-00030-of-00136.parquet422.3 MBdownload
filetrain-00031-of-00136.parquet421.1 MBdownload
filetrain-00032-of-00136.parquet421.1 MBdownload
filetrain-00033-of-00136.parquet424.5 MBdownload
filetrain-00034-of-00136.parquet420.2 MBdownload
filetrain-00035-of-00136.parquet420.8 MBdownload
filetrain-00036-of-00136.parquet421.1 MBdownload
filetrain-00037-of-00136.parquet419.6 MBdownload
filetrain-00038-of-00136.parquet418.7 MBdownload
filetrain-00039-of-00136.parquet417.6 MBdownload
filetrain-00040-of-00136.parquet419.8 MBdownload
filetrain-00041-of-00136.parquet420.5 MBdownload
filetrain-00042-of-00136.parquet417.9 MBdownload
filetrain-00043-of-00136.parquet416.8 MBdownload
filetrain-00044-of-00136.parquet417.2 MBdownload
filetrain-00045-of-00136.parquet419.3 MBdownload
filetrain-00046-of-00136.parquet416.1 MBdownload
filetrain-00047-of-00136.parquet413.2 MBdownload
filetrain-00048-of-00136.parquet414.6 MBdownload
filetrain-00049-of-00136.parquet415.3 MBdownload
filetrain-00050-of-00136.parquet411.5 MBdownload
filetrain-00051-of-00136.parquet417.5 MBdownload
filetrain-00052-of-00136.parquet418.1 MBdownload
filetrain-00053-of-00136.parquet411.6 MBdownload
filetrain-00054-of-00136.parquet415.6 MBdownload
filetrain-00055-of-00136.parquet414.3 MBdownload
filetrain-00056-of-00136.parquet409.2 MBdownload
filetrain-00057-of-00136.parquet428.9 MBdownload
filetrain-00058-of-00136.parquet438.4 MBdownload
filetrain-00059-of-00136.parquet429.7 MBdownload
filetrain-00060-of-00136.parquet432.4 MBdownload
filetrain-00061-of-00136.parquet429.7 MBdownload
filetrain-00062-of-00136.parquet416.9 MBdownload
filetrain-00063-of-00136.parquet416.1 MBdownload
filetrain-00064-of-00136.parquet426.4 MBdownload
filetrain-00065-of-00136.parquet430.6 MBdownload
filetrain-00066-of-00136.parquet424.4 MBdownload
filetrain-00067-of-00136.parquet423.5 MBdownload
filetrain-00068-of-00136.parquet417.7 MBdownload
filetrain-00069-of-00136.parquet411.2 MBdownload
filetrain-00070-of-00136.parquet420.3 MBdownload
filetrain-00071-of-00136.parquet422.0 MBdownload
filetrain-00072-of-00136.parquet409.7 MBdownload
filetrain-00073-of-00136.parquet411.5 MBdownload
filetrain-00074-of-00136.parquet415.7 MBdownload
filetrain-00075-of-00136.parquet412.0 MBdownload
filetrain-00076-of-00136.parquet405.2 MBdownload
filetrain-00077-of-00136.parquet408.3 MBdownload
filetrain-00078-of-00136.parquet407.0 MBdownload
filetrain-00079-of-00136.parquet406.6 MBdownload
filetrain-00080-of-00136.parquet410.9 MBdownload
filetrain-00081-of-00136.parquet408.3 MBdownload
filetrain-00082-of-00136.parquet408.4 MBdownload
filetrain-00083-of-00136.parquet407.9 MBdownload
filetrain-00084-of-00136.parquet394.7 MBdownload
filetrain-00085-of-00136.parquet405.1 MBdownload
filetrain-00086-of-00136.parquet404.8 MBdownload
filetrain-00087-of-00136.parquet398.8 MBdownload
filetrain-00088-of-00136.parquet404.7 MBdownload
filetrain-00089-of-00136.parquet404.1 MBdownload
filetrain-00090-of-00136.parquet405.0 MBdownload
filetrain-00091-of-00136.parquet404.8 MBdownload
filetrain-00092-of-00136.parquet401.8 MBdownload
filetrain-00093-of-00136.parquet396.8 MBdownload
filetrain-00094-of-00136.parquet395.8 MBdownload
filetrain-00095-of-00136.parquet399.4 MBdownload
filetrain-00096-of-00136.parquet393.9 MBdownload
filetrain-00097-of-00136.parquet519.5 MBdownload
filetrain-00098-of-00136.parquet539.8 MBdownload
filetrain-00099-of-00136.parquet539.9 MBdownload
filetrain-00100-of-00136.parquet529.7 MBdownload
filetrain-00101-of-00136.parquet536.9 MBdownload
filetrain-00102-of-00136.parquet520.9 MBdownload
filetrain-00103-of-00136.parquet532.0 MBdownload
filetrain-00104-of-00136.parquet517.7 MBdownload
filetrain-00105-of-00136.parquet527.6 MBdownload
filetrain-00106-of-00136.parquet515.9 MBdownload
filetrain-00107-of-00136.parquet519.3 MBdownload
filetrain-00108-of-00136.parquet524.7 MBdownload
filetrain-00109-of-00136.parquet519.9 MBdownload
filetrain-00110-of-00136.parquet512.4 MBdownload
filetrain-00111-of-00136.parquet514.9 MBdownload
filetrain-00112-of-00136.parquet511.7 MBdownload
filetrain-00113-of-00136.parquet511.8 MBdownload
filetrain-00114-of-00136.parquet504.3 MBdownload
filetrain-00115-of-00136.parquet506.2 MBdownload
filetrain-00116-of-00136.parquet505.7 MBdownload
filetrain-00117-of-00136.parquet508.3 MBdownload
filetrain-00118-of-00136.parquet506.7 MBdownload
filetrain-00119-of-00136.parquet504.3 MBdownload
filetrain-00120-of-00136.parquet507.3 MBdownload
filetrain-00121-of-00136.parquet504.1 MBdownload
filetrain-00122-of-00136.parquet503.9 MBdownload
filetrain-00123-of-00136.parquet499.9 MBdownload
filetrain-00124-of-00136.parquet495.7 MBdownload
filetrain-00125-of-00136.parquet499.3 MBdownload
filetrain-00126-of-00136.parquet494.8 MBdownload
filetrain-00127-of-00136.parquet492.5 MBdownload
filetrain-00128-of-00136.parquet493.9 MBdownload
filetrain-00129-of-00136.parquet493.4 MBdownload
filetrain-00130-of-00136.parquet499.3 MBdownload
filetrain-00131-of-00136.parquet495.3 MBdownload
filetrain-00132-of-00136.parquet496.9 MBdownload
filetrain-00133-of-00136.parquet496.0 MBdownload
filetrain-00134-of-00136.parquet492.5 MBdownload
filetrain-00135-of-00136.parquet486.5 MBdownload

bigcode/stack-dedup-alt-comments · main · files are served by the source, never re-hosted here

This repository is gated. The listing is public, but downloading a file means accepting the publisher’s terms at Hugging Face first — the links above take you there rather than around it.