bigcode/github-commits-diff-dedup-pjjs-april
Deduplicated Commits Deduplicated based on diff: content = '\n'.join(difflib.unified_diff( old_content.splitlines(keepends=True), new_content.splitlines(keepends=True), n=5 )) Parameters: Minimum ngram size: 5 MinHash ngram size: 5 MinHash threshold: 0.8
Add file 499
Add file 498
Add file 497
Add file 496
Add file 495
Add file 494
Add file 493
Add file 492
Add file 491
Add file 490
Add file 489
Add file 488
Add file 487
Add file 486
Add file 485
Add file 484
Add file 483
Add file 482
Add file 481
Add file 480
Add file 479
Add file 478
Add file 477
Add file 476
Add file 475
Add file 474
Add file 473
Add file 472
Add file 471
Add file 470
Add file 469
Add file 468
Add file 467
Add file 466
Add file 465
Add file 464
Add file 463
Add file 462
Add file 461
Add file 460
Add file 459
Add file 458
Add file 457
Add file 456
Add file 455
Add file 454
Add file 453
Add file 452
Add file 451
Add file 450