CoolFace
Datasetpublic

dakies/verilog_dataset_near_dedup

Original dataset size: 21725 Number of duplicate clusters: 2951 Files in duplicate cluster: 8054 Unique files in duplicate cluster: 3781 Filtered dataset size: 17452 Time to deduplicate dataset: 7.37 Size of deduplicated dataset: 17452, old dataset size 21725

sourceHugging Facemitupdated 2y agoView on Hugging Face
0likes3downloads
Dataset Card

Original dataset size: 21725 Number of duplicate clusters: 2951 Files in duplicate cluster: 8054 Unique files in duplicate cluster: 3781 Filtered dataset size: 17452 Time to deduplicate dataset: 7.37 Size of deduplicated dataset: 17452, old dataset size 21725