RealTimeData/code_alltime
RealTimeData Monthly Collection - Github Code This datasets provides the monthly screenshots of the 500 cherry-picked open source projects on GitHub from 2017 to current. To access articles in a specific month, simple run the following: ds = datasets.load_dataset('RealTimeData/code_alltime', '2020-02') This will give you the 2020-02 version of the 500 selected GitHub repos that were just updated in 2020-02. Want to crawl the data by your own? Please head to… See the full description on the dataset page: https://huggingface.co/datasets/RealTimeData/code_alltime.
21.9k
1---2dataset_info:3- config_name: 2017-014 features:5 - name: file_path6 dtype: string7 - name: num_changed_lines8 dtype: int649 - name: code10 dtype: string11 - name: repo_name12 dtype: string13 - name: commit_date14 dtype: string15 - name: sha16 dtype: string17 splits:18 - name: train19 num_bytes: 2781880920 num_examples: 49821 download_size: 818674422 dataset_size: 2781880923- config_name: 2017-0224 features:25 - name: file_path26 dtype: string27 - name: num_changed_lines28 dtype: int6429 - name: code30 dtype: string31 - name: repo_name32 dtype: string33 - name: commit_date34 dtype: string35 - name: sha36 dtype: string37 splits:38 - name: train39 num_bytes: 906273140 num_examples: 58341 download_size: 275021742 dataset_size: 906273143- config_name: 2017-0344 features:45 - name: file_path46 dtype: string47 - name: num_changed_lines48 dtype: int6449 - name: code50 dtype: string51 - name: repo_name52 dtype: string53 - name: commit_date54 dtype: string55 - name: sha56 dtype: string57 splits:58 - name: train59 num_bytes: 1263589760 num_examples: 43261 download_size: 369916262 dataset_size: 1263589763- config_name: 2017-0464 features:65 - name: file_path66 dtype: string67 - name: num_changed_lines68 dtype: int6469 - name: code70 dtype: string71 - name: repo_name72 dtype: string73 - name: commit_date74 dtype: string75 - name: sha76 dtype: string77 splits:78 - name: train79 num_bytes: 980144580 num_examples: 51581 download_size: 293200682 dataset_size: 980144583- config_name: 2017-0584 features:85 - name: file_path86 dtype: string87 - name: num_changed_lines88 dtype: int6489 - name: code90 dtype: string91 - name: repo_name92 dtype: string93 - name: commit_date94 dtype: string95 - name: sha96 dtype: string97 splits:98 - name: train99 num_bytes: 5356773100 num_examples: 486101 download_size: 1857771102 dataset_size: 5356773103- config_name: 2017-06104 features:105 - name: file_path106 dtype: string107 - name: num_changed_lines108 dtype: int64109 - name: code110 dtype: string111 - name: repo_name112 dtype: string113 - name: commit_date114 dtype: string115 - name: sha116 dtype: string117 splits:118 - name: train119 num_bytes: 5851432120 num_examples: 449121 download_size: 1632423122 dataset_size: 5851432123- config_name: 2017-07124 features:125 - name: file_path126 dtype: string127 - name: num_changed_lines128 dtype: int64129 - name: code130 dtype: string131 - name: repo_name132 dtype: string133 - name: commit_date134 dtype: string135 - name: sha136 dtype: string137 splits:138 - name: train139 num_bytes: 9499347140 num_examples: 471141 download_size: 2807477142 dataset_size: 9499347143- config_name: 2017-08144 features:145 - name: file_path146 dtype: string147 - name: num_changed_lines148 dtype: int64149 - name: code150 dtype: string151 - name: repo_name152 dtype: string153 - name: commit_date154 dtype: string155 - name: sha156 dtype: string157 splits:158 - name: train159 num_bytes: 8017756160 num_examples: 512161 download_size: 2169638162 dataset_size: 8017756163- config_name: 2017-09164 features:165 - name: file_path166 dtype: string167 - name: num_changed_lines168 dtype: int64169 - name: code170 dtype: string171 - name: repo_name172 dtype: string173 - name: commit_date174 dtype: string175 - name: sha176 dtype: string177 splits:178 - name: train179 num_bytes: 7307297180 num_examples: 439181 download_size: 2659164182 dataset_size: 7307297183- config_name: 2017-10184 features:185 - name: file_path186 dtype: string187 - name: num_changed_lines188 dtype: int64189 - name: code190 dtype: string191 - name: repo_name192 dtype: string193 - name: commit_date194 dtype: string195 - name: sha196 dtype: string197 splits:198 - name: train199 num_bytes: 28920173200 num_examples: 596201 download_size: 8740153202 dataset_size: 28920173203- config_name: 2017-11204 features:205 - name: file_path206 dtype: string207 - name: num_changed_lines208 dtype: int64209 - name: code210 dtype: string211 - name: repo_name212 dtype: string213 - name: commit_date214 dtype: string215 - name: sha216 dtype: string217 splits:218 - name: train219 num_bytes: 9053832220 num_examples: 450221 download_size: 3111540222 dataset_size: 9053832223- config_name: 2017-12224 features:225 - name: file_path226 dtype: string227 - name: num_changed_lines228 dtype: int64229 - name: code230 dtype: string231 - name: repo_name232 dtype: string233 - name: commit_date234 dtype: string235 - name: sha236 dtype: string237 splits:238 - name: train239 num_bytes: 10601028240 num_examples: 566241 download_size: 3112609242 dataset_size: 10601028243- config_name: 2018-01244 features:245 - name: file_path246 dtype: string247 - name: num_changed_lines248 dtype: int64249 - name: code250 dtype: string251 - name: repo_name252 dtype: string253 - name: commit_date254 dtype: string255 - name: sha256 dtype: string257 splits:258 - name: train259 num_bytes: 26555392260 num_examples: 436261 download_size: 7651268262 dataset_size: 26555392263- config_name: 2018-02264 features:265 - name: file_path266 dtype: string267 - name: num_changed_lines268 dtype: int64269 - name: code270 dtype: string271 - name: repo_name272 dtype: string273 - name: commit_date274 dtype: string275 - name: sha276 dtype: string277 splits:278 - name: train279 num_bytes: 8199606280 num_examples: 546281 download_size: 2791025282 dataset_size: 8199606283- config_name: 2018-03284 features:285 - name: file_path286 dtype: string287 - name: num_changed_lines288 dtype: int64289 - name: code290 dtype: string291 - name: repo_name292 dtype: string293 - name: commit_date294 dtype: string295 - name: sha296 dtype: string297 splits:298 - name: train299 num_bytes: 31958551300 num_examples: 473301 download_size: 7160895302 dataset_size: 31958551303- config_name: 2018-04304 features:305 - name: file_path306 dtype: string307 - name: num_changed_lines308 dtype: int64309 - name: code310 dtype: string311 - name: repo_name312 dtype: string313 - name: commit_date314 dtype: string315 - name: sha316 dtype: string317 splits:318 - name: train319 num_bytes: 27846854320 num_examples: 431321 download_size: 8187476322 dataset_size: 27846854323- config_name: 2018-05324 features:325 - name: file_path326 dtype: string327 - name: num_changed_lines328 dtype: int64329 - name: code330 dtype: string331 - name: repo_name332 dtype: string333 - name: commit_date334 dtype: string335 - name: sha336 dtype: string337 splits:338 - name: train339 num_bytes: 5913046340 num_examples: 485341 download_size: 1997067342 dataset_size: 5913046343- config_name: 2018-06344 features:345 - name: file_path346 dtype: string347 - name: num_changed_lines348 dtype: int64349 - name: code350 dtype: string351 - name: repo_name352 dtype: string353 - name: commit_date354 dtype: string355 - name: sha356 dtype: string357 splits:358 - name: train359 num_bytes: 4944199360 num_examples: 413361 download_size: 1554876362 dataset_size: 4944199363- config_name: 2018-07364 features:365 - name: file_path366 dtype: string367 - name: num_changed_lines368 dtype: int64369 - name: code370 dtype: string371 - name: repo_name372 dtype: string373 - name: commit_date374 dtype: string375 - name: sha376 dtype: string377 splits:378 - name: train379 num_bytes: 7423297380 num_examples: 500381 download_size: 2460992382 dataset_size: 7423297383- config_name: 2018-08384 features:385 - name: file_path386 dtype: string387 - name: num_changed_lines388 dtype: int64389 - name: code390 dtype: string391 - name: repo_name392 dtype: string393 - name: commit_date394 dtype: string395 - name: sha396 dtype: string397 splits:398 - name: train399 num_bytes: 5012280400 num_examples: 471401 download_size: 1565885402 dataset_size: 5012280403- config_name: 2018-09404 features:405 - name: file_path406 dtype: string407 - name: num_changed_lines408 dtype: int64409 - name: code410 dtype: string411 - name: repo_name412 dtype: string413 - name: commit_date414 dtype: string415 - name: sha416 dtype: string417 splits:418 - name: train419 num_bytes: 11567458420 num_examples: 534421 download_size: 3631200422 dataset_size: 11567458423- config_name: 2018-10424 features:425 - name: file_path426 dtype: string427 - name: num_changed_lines428 dtype: int64429 - name: code430 dtype: string431 - name: repo_name432 dtype: string433 - name: commit_date434 dtype: string435 - name: sha436 dtype: string437 splits:438 - name: train439 num_bytes: 3960621440 num_examples: 469441 download_size: 1189681442 dataset_size: 3960621443- config_name: 2018-11444 features:445 - name: file_path446 dtype: string447 - name: num_changed_lines448 dtype: int64449 - name: code450 dtype: string451 - name: repo_name452 dtype: string453 - name: commit_date454 dtype: string455 - name: sha456 dtype: string457 splits:458 - name: train459 num_bytes: 5787805460 num_examples: 456461 download_size: 1658984462 dataset_size: 5787805463- config_name: 2018-12464 features:465 - name: file_path466 dtype: string467 - name: num_changed_lines468 dtype: int64469 - name: code470 dtype: string471 - name: repo_name472 dtype: string473 - name: commit_date474 dtype: string475 - name: sha476 dtype: string477 splits:478 - name: train479 num_bytes: 80257123480 num_examples: 564481 download_size: 15409397482 dataset_size: 80257123483- config_name: 2019-01484 features:485 - name: file_path486 dtype: string487 - name: num_changed_lines488 dtype: int64489 - name: code490 dtype: string491 - name: repo_name492 dtype: string493 - name: commit_date494 dtype: string495 - name: sha496 dtype: string497 splits:498 - name: train499 num_bytes: 10884294500 num_examples: 559501 download_size: 3443301502 dataset_size: 10884294503- config_name: 2019-02504 features:505 - name: file_path506 dtype: string507 - name: num_changed_lines508 dtype: int64509 - name: code510 dtype: string511 - name: repo_name512 dtype: string513 - name: commit_date514 dtype: string515 - name: sha516 dtype: string517 splits:518 - name: train519 num_bytes: 5649301520 num_examples: 440521 download_size: 1797649522 dataset_size: 5649301523- config_name: 2019-03524 features:525 - name: file_path526 dtype: string527 - name: num_changed_lines528 dtype: int64529 - name: code530 dtype: string531 - name: repo_name532 dtype: string533 - name: commit_date534 dtype: string535 - name: sha536 dtype: string537 splits:538 - name: train539 num_bytes: 18363947540 num_examples: 587541 download_size: 5020308542 dataset_size: 18363947543- config_name: 2019-04544 features:545 - name: file_path546 dtype: string547 - name: num_changed_lines548 dtype: int64549 - name: code550 dtype: string551 - name: repo_name552 dtype: string553 - name: commit_date554 dtype: string555 - name: sha556 dtype: string557 splits:558 - name: train559 num_bytes: 6694701560 num_examples: 551561 download_size: 2107122562 dataset_size: 6694701563- config_name: 2019-05564 features:565 - name: file_path566 dtype: string567 - name: num_changed_lines568 dtype: int64569 - name: code570 dtype: string571 - name: repo_name572 dtype: string573 - name: commit_date574 dtype: string575 - name: sha576 dtype: string577 splits:578 - name: train579 num_bytes: 26803692580 num_examples: 561581 download_size: 6332158582 dataset_size: 26803692583- config_name: 2019-06584 features:585 - name: file_path586 dtype: string587 - name: num_changed_lines588 dtype: int64589 - name: code590 dtype: string591 - name: repo_name592 dtype: string593 - name: commit_date594 dtype: string595 - name: sha596 dtype: string597 splits:598 - name: train599 num_bytes: 7680262600 num_examples: 626601 download_size: 2388316602 dataset_size: 7680262603- config_name: 2019-07604 features:605 - name: file_path606 dtype: string607 - name: num_changed_lines608 dtype: int64609 - name: code610 dtype: string611 - name: repo_name612 dtype: string613 - name: commit_date614 dtype: string615 - name: sha616 dtype: string617 splits:618 - name: train619 num_bytes: 48256751620 num_examples: 782621 download_size: 10976769622 dataset_size: 48256751623- config_name: 2019-08624 features:625 - name: file_path626 dtype: string627 - name: num_changed_lines628 dtype: int64629 - name: code630 dtype: string631 - name: repo_name632 dtype: string633 - name: commit_date634 dtype: string635 - name: sha636 dtype: string637 splits:638 - name: train639 num_bytes: 44531740640 num_examples: 621641 download_size: 9532153642 dataset_size: 44531740643- config_name: 2019-09644 features:645 - name: file_path646 dtype: string647 - name: num_changed_lines648 dtype: int64649 - name: code650 dtype: string651 - name: repo_name652 dtype: string653 - name: commit_date654 dtype: string655 - name: sha656 dtype: string657 splits:658 - name: train659 num_bytes: 13659784660 num_examples: 633661 download_size: 4329485662 dataset_size: 13659784663- config_name: 2019-10664 features:665 - name: file_path666 dtype: string667 - name: num_changed_lines668 dtype: int64669 - name: code670 dtype: string671 - name: repo_name672 dtype: string673 - name: commit_date674 dtype: string675 - name: sha676 dtype: string677 splits:678 - name: train679 num_bytes: 14255546680 num_examples: 641681 download_size: 4620728682 dataset_size: 14255546683- config_name: 2019-11684 features:685 - name: file_path686 dtype: string687 - name: num_changed_lines688 dtype: int64689 - name: code690 dtype: string691 - name: repo_name692 dtype: string693 - name: commit_date694 dtype: string695 - name: sha696 dtype: string697 splits:698 - name: train699 num_bytes: 4447318700 num_examples: 481701 download_size: 1369815702 dataset_size: 4447318703- config_name: 2019-12704 features:705 - name: file_path706 dtype: string707 - name: num_changed_lines708 dtype: int64709 - name: code710 dtype: string711 - name: repo_name712 dtype: string713 - name: commit_date714 dtype: string715 - name: sha716 dtype: string717 splits:718 - name: train719 num_bytes: 8185509720 num_examples: 674721 download_size: 2414564722 dataset_size: 8185509723- config_name: 2020-01724 features:725 - name: file_path726 dtype: string727 - name: num_changed_lines728 dtype: int64729 - name: code730 dtype: string731 - name: repo_name732 dtype: string733 - name: commit_date734 dtype: string735 - name: sha736 dtype: string737 splits:738 - name: train739 num_bytes: 8455425740 num_examples: 550741 download_size: 2711023742 dataset_size: 8455425743- config_name: 2020-02744 features:745 - name: file_path746 dtype: string747 - name: num_changed_lines748 dtype: int64749 - name: code750 dtype: string751 - name: repo_name752 dtype: string753 - name: commit_date754 dtype: string755 - name: sha756 dtype: string757 splits:758 - name: train759 num_bytes: 13324957760 num_examples: 647761 download_size: 4004628762 dataset_size: 13324957763- config_name: 2020-03764 features:765 - name: file_path766 dtype: string767 - name: num_changed_lines768 dtype: int64769 - name: code770 dtype: string771 - name: repo_name772 dtype: string773 - name: commit_date774 dtype: string775 - name: sha776 dtype: string777 splits:778 - name: train779 num_bytes: 8637049780 num_examples: 641781 download_size: 2618621782 dataset_size: 8637049783- config_name: 2020-04784 features:785 - name: file_path786 dtype: string787 - name: num_changed_lines788 dtype: int64789 - name: code790 dtype: string791 - name: repo_name792 dtype: string793 - name: commit_date794 dtype: string795 - name: sha796 dtype: string797 splits:798 - name: train799 num_bytes: 21680797800 num_examples: 523801 download_size: 6186771802 dataset_size: 21680797803- config_name: 2020-05804 features:805 - name: file_path806 dtype: string807 - name: num_changed_lines808 dtype: int64809 - name: code810 dtype: string811 - name: repo_name812 dtype: string813 - name: commit_date814 dtype: string815 - name: sha816 dtype: string817 splits:818 - name: train819 num_bytes: 33247689820 num_examples: 745821 download_size: 9491599822 dataset_size: 33247689823- config_name: 2020-06824 features:825 - name: file_path826 dtype: string827 - name: num_changed_lines828 dtype: int64829 - name: code830 dtype: string831 - name: repo_name832 dtype: string833 - name: commit_date834 dtype: string835 - name: sha836 dtype: string837 splits:838 - name: train839 num_bytes: 32091028840 num_examples: 650841 download_size: 9477554842 dataset_size: 32091028843- config_name: 2020-07844 features:845 - name: file_path846 dtype: string847 - name: num_changed_lines848 dtype: int64849 - name: code850 dtype: string851 - name: repo_name852 dtype: string853 - name: commit_date854 dtype: string855 - name: sha856 dtype: string857 splits:858 - name: train859 num_bytes: 11260724860 num_examples: 648861 download_size: 3516116862 dataset_size: 11260724863- config_name: 2020-08864 features:865 - name: file_path866 dtype: string867 - name: num_changed_lines868 dtype: int64869 - name: code870 dtype: string871 - name: repo_name872 dtype: string873 - name: commit_date874 dtype: string875 - name: sha876 dtype: string877 splits:878 - name: train879 num_bytes: 10871233880 num_examples: 627881 download_size: 3431593882 dataset_size: 10871233883- config_name: 2020-09884 features:885 - name: file_path886 dtype: string887 - name: num_changed_lines888 dtype: int64889 - name: code890 dtype: string891 - name: repo_name892 dtype: string893 - name: commit_date894 dtype: string895 - name: sha896 dtype: string897 splits:898 - name: train899 num_bytes: 31711385900 num_examples: 521901 download_size: 8342950902 dataset_size: 31711385903- config_name: 2020-10904 features:905 - name: file_path906 dtype: string907 - name: num_changed_lines908 dtype: int64909 - name: code910 dtype: string911 - name: repo_name912 dtype: string913 - name: commit_date914 dtype: string915 - name: sha916 dtype: string917 splits:918 - name: train919 num_bytes: 12508833920 num_examples: 613921 download_size: 3741252922 dataset_size: 12508833923- config_name: 2020-11924 features:925 - name: file_path926 dtype: string927 - name: num_changed_lines928 dtype: int64929 - name: code930 dtype: string931 - name: repo_name932 dtype: string933 - name: commit_date934 dtype: string935 - name: sha936 dtype: string937 splits:938 - name: train939 num_bytes: 11227959940 num_examples: 677941 download_size: 3230957942 dataset_size: 11227959943- config_name: 2020-12944 features:945 - name: file_path946 dtype: string947 - name: num_changed_lines948 dtype: int64949 - name: code950 dtype: string951 - name: repo_name952 dtype: string953 - name: commit_date954 dtype: string955 - name: sha956 dtype: string957 splits:958 - name: train959 num_bytes: 11118488960 num_examples: 640961 download_size: 3401502962 dataset_size: 11118488963- config_name: 2021-01964 features:965 - name: file_path966 dtype: string967 - name: num_changed_lines968 dtype: int64969 - name: code970 dtype: string971 - name: repo_name972 dtype: string973 - name: commit_date974 dtype: string975 - name: sha976 dtype: string977 splits:978 - name: train979 num_bytes: 17085054980 num_examples: 621981 download_size: 5321474982 dataset_size: 17085054983- config_name: 2021-02984 features:985 - name: file_path986 dtype: string987 - name: num_changed_lines988 dtype: int64989 - name: code990 dtype: string991 - name: repo_name992 dtype: string993 - name: commit_date994 dtype: string995 - name: sha996 dtype: string997 splits:998 - name: train999 num_bytes: 154585751000 num_examples: 5781001 download_size: 47878081002 dataset_size: 154585751003- config_name: 2021-031004 features:1005 - name: file_path1006 dtype: string1007 - name: num_changed_lines1008 dtype: int641009 - name: code1010 dtype: string1011 - name: repo_name1012 dtype: string1013 - name: commit_date1014 dtype: string1015 - name: sha1016 dtype: string1017 splits:1018 - name: train1019 num_bytes: 77037201020 num_examples: 6531021 download_size: 24269691022 dataset_size: 77037201023- config_name: 2021-041024 features:1025 - name: file_path1026 dtype: string1027 - name: num_changed_lines1028 dtype: int641029 - name: code1030 dtype: string1031 - name: repo_name1032 dtype: string1033 - name: commit_date1034 dtype: string1035 - name: sha1036 dtype: string1037 splits:1038 - name: train1039 num_bytes: 150372781040 num_examples: 6781041 download_size: 45483801042 dataset_size: 150372781043- config_name: 2021-051044 features:1045 - name: file_path1046 dtype: string1047 - name: num_changed_lines1048 dtype: int641049 - name: code1050 dtype: string1051 - name: repo_name1052 dtype: string1053 - name: commit_date1054 dtype: string1055 - name: sha1056 dtype: string1057 splits:1058 - name: train1059 num_bytes: 151874011060 num_examples: 5911061 download_size: 53984321062 dataset_size: 151874011063- config_name: 2021-061064 features:1065 - name: file_path1066 dtype: string1067 - name: num_changed_lines1068 dtype: int641069 - name: code1070 dtype: string1071 - name: repo_name1072 dtype: string1073 - name: commit_date1074 dtype: string1075 - name: sha1076 dtype: string1077 splits:1078 - name: train1079 num_bytes: 139204651080 num_examples: 7061081 download_size: 45504361082 dataset_size: 139204651083- config_name: 2021-071084 features:1085 - name: file_path1086 dtype: string1087 - name: num_changed_lines1088 dtype: int641089 - name: code1090 dtype: string1091 - name: repo_name1092 dtype: string1093 - name: commit_date1094 dtype: string1095 - name: sha1096 dtype: string1097 splits:1098 - name: train1099 num_bytes: 76018241100 num_examples: 5431101 download_size: 23613591102 dataset_size: 76018241103- config_name: 2021-081104 features:1105 - name: file_path1106 dtype: string1107 - name: num_changed_lines1108 dtype: int641109 - name: code1110 dtype: string1111 - name: repo_name1112 dtype: string1113 - name: commit_date1114 dtype: string1115 - name: sha1116 dtype: string1117 splits:1118 - name: train1119 num_bytes: 79451611120 num_examples: 5021121 download_size: 23977101122 dataset_size: 79451611123- config_name: 2021-091124 features:1125 - name: file_path1126 dtype: string1127 - name: num_changed_lines1128 dtype: int641129 - name: code1130 dtype: string1131 - name: repo_name1132 dtype: string1133 - name: commit_date1134 dtype: string1135 - name: sha1136 dtype: string1137 splits:1138 - name: train1139 num_bytes: 75774371140 num_examples: 5511141 download_size: 23256511142 dataset_size: 75774371143- config_name: 2021-101144 features:1145 - name: file_path1146 dtype: string1147 - name: num_changed_lines1148 dtype: int641149 - name: code1150 dtype: string1151 - name: repo_name1152 dtype: string1153 - name: commit_date1154 dtype: string1155 - name: sha1156 dtype: string1157 splits:1158 - name: train1159 num_bytes: 125302051160 num_examples: 6341161 download_size: 32594351162 dataset_size: 125302051163- config_name: 2021-111164 features:1165 - name: file_path1166 dtype: string1167 - name: num_changed_lines1168 dtype: int641169 - name: code1170 dtype: string1171 - name: repo_name1172 dtype: string1173 - name: commit_date1174 dtype: string1175 - name: sha1176 dtype: string1177 splits:1178 - name: train1179 num_bytes: 144727881180 num_examples: 5471181 download_size: 47114711182 dataset_size: 144727881183- config_name: 2021-121184 features:1185 - name: file_path1186 dtype: string1187 - name: num_changed_lines1188 dtype: int641189 - name: code1190 dtype: string1191 - name: repo_name1192 dtype: string1193 - name: commit_date1194 dtype: string1195 - name: sha1196 dtype: string1197 splits:1198 - name: train1199 num_bytes: 52004341200 num_examples: 467