CoolFace
Datasetpublic

RealTimeData/code_alltime

RealTimeData Monthly Collection - Github Code This datasets provides the monthly screenshots of the 500 cherry-picked open source projects on GitHub from 2017 to current. To access articles in a specific month, simple run the following: ds = datasets.load_dataset('RealTimeData/code_alltime', '2020-02') This will give you the 2020-02 version of the 500 selected GitHub repos that were just updated in 2020-02. Want to crawl the data by your own? Please head to… See the full description on the dataset page: https://huggingface.co/datasets/RealTimeData/code_alltime.

sourceHugging Faceupdated 1y agoView on Hugging Face
2likes1.9kdownloads
README.md2487 linesDownload Raw Back to root
1---2dataset_info:3- config_name: 2017-014  features:5  - name: file_path6    dtype: string7  - name: num_changed_lines8    dtype: int649  - name: code10    dtype: string11  - name: repo_name12    dtype: string13  - name: commit_date14    dtype: string15  - name: sha16    dtype: string17  splits:18  - name: train19    num_bytes: 2781880920    num_examples: 49821  download_size: 818674422  dataset_size: 2781880923- config_name: 2017-0224  features:25  - name: file_path26    dtype: string27  - name: num_changed_lines28    dtype: int6429  - name: code30    dtype: string31  - name: repo_name32    dtype: string33  - name: commit_date34    dtype: string35  - name: sha36    dtype: string37  splits:38  - name: train39    num_bytes: 906273140    num_examples: 58341  download_size: 275021742  dataset_size: 906273143- config_name: 2017-0344  features:45  - name: file_path46    dtype: string47  - name: num_changed_lines48    dtype: int6449  - name: code50    dtype: string51  - name: repo_name52    dtype: string53  - name: commit_date54    dtype: string55  - name: sha56    dtype: string57  splits:58  - name: train59    num_bytes: 1263589760    num_examples: 43261  download_size: 369916262  dataset_size: 1263589763- config_name: 2017-0464  features:65  - name: file_path66    dtype: string67  - name: num_changed_lines68    dtype: int6469  - name: code70    dtype: string71  - name: repo_name72    dtype: string73  - name: commit_date74    dtype: string75  - name: sha76    dtype: string77  splits:78  - name: train79    num_bytes: 980144580    num_examples: 51581  download_size: 293200682  dataset_size: 980144583- config_name: 2017-0584  features:85  - name: file_path86    dtype: string87  - name: num_changed_lines88    dtype: int6489  - name: code90    dtype: string91  - name: repo_name92    dtype: string93  - name: commit_date94    dtype: string95  - name: sha96    dtype: string97  splits:98  - name: train99    num_bytes: 5356773100    num_examples: 486101  download_size: 1857771102  dataset_size: 5356773103- config_name: 2017-06104  features:105  - name: file_path106    dtype: string107  - name: num_changed_lines108    dtype: int64109  - name: code110    dtype: string111  - name: repo_name112    dtype: string113  - name: commit_date114    dtype: string115  - name: sha116    dtype: string117  splits:118  - name: train119    num_bytes: 5851432120    num_examples: 449121  download_size: 1632423122  dataset_size: 5851432123- config_name: 2017-07124  features:125  - name: file_path126    dtype: string127  - name: num_changed_lines128    dtype: int64129  - name: code130    dtype: string131  - name: repo_name132    dtype: string133  - name: commit_date134    dtype: string135  - name: sha136    dtype: string137  splits:138  - name: train139    num_bytes: 9499347140    num_examples: 471141  download_size: 2807477142  dataset_size: 9499347143- config_name: 2017-08144  features:145  - name: file_path146    dtype: string147  - name: num_changed_lines148    dtype: int64149  - name: code150    dtype: string151  - name: repo_name152    dtype: string153  - name: commit_date154    dtype: string155  - name: sha156    dtype: string157  splits:158  - name: train159    num_bytes: 8017756160    num_examples: 512161  download_size: 2169638162  dataset_size: 8017756163- config_name: 2017-09164  features:165  - name: file_path166    dtype: string167  - name: num_changed_lines168    dtype: int64169  - name: code170    dtype: string171  - name: repo_name172    dtype: string173  - name: commit_date174    dtype: string175  - name: sha176    dtype: string177  splits:178  - name: train179    num_bytes: 7307297180    num_examples: 439181  download_size: 2659164182  dataset_size: 7307297183- config_name: 2017-10184  features:185  - name: file_path186    dtype: string187  - name: num_changed_lines188    dtype: int64189  - name: code190    dtype: string191  - name: repo_name192    dtype: string193  - name: commit_date194    dtype: string195  - name: sha196    dtype: string197  splits:198  - name: train199    num_bytes: 28920173200    num_examples: 596201  download_size: 8740153202  dataset_size: 28920173203- config_name: 2017-11204  features:205  - name: file_path206    dtype: string207  - name: num_changed_lines208    dtype: int64209  - name: code210    dtype: string211  - name: repo_name212    dtype: string213  - name: commit_date214    dtype: string215  - name: sha216    dtype: string217  splits:218  - name: train219    num_bytes: 9053832220    num_examples: 450221  download_size: 3111540222  dataset_size: 9053832223- config_name: 2017-12224  features:225  - name: file_path226    dtype: string227  - name: num_changed_lines228    dtype: int64229  - name: code230    dtype: string231  - name: repo_name232    dtype: string233  - name: commit_date234    dtype: string235  - name: sha236    dtype: string237  splits:238  - name: train239    num_bytes: 10601028240    num_examples: 566241  download_size: 3112609242  dataset_size: 10601028243- config_name: 2018-01244  features:245  - name: file_path246    dtype: string247  - name: num_changed_lines248    dtype: int64249  - name: code250    dtype: string251  - name: repo_name252    dtype: string253  - name: commit_date254    dtype: string255  - name: sha256    dtype: string257  splits:258  - name: train259    num_bytes: 26555392260    num_examples: 436261  download_size: 7651268262  dataset_size: 26555392263- config_name: 2018-02264  features:265  - name: file_path266    dtype: string267  - name: num_changed_lines268    dtype: int64269  - name: code270    dtype: string271  - name: repo_name272    dtype: string273  - name: commit_date274    dtype: string275  - name: sha276    dtype: string277  splits:278  - name: train279    num_bytes: 8199606280    num_examples: 546281  download_size: 2791025282  dataset_size: 8199606283- config_name: 2018-03284  features:285  - name: file_path286    dtype: string287  - name: num_changed_lines288    dtype: int64289  - name: code290    dtype: string291  - name: repo_name292    dtype: string293  - name: commit_date294    dtype: string295  - name: sha296    dtype: string297  splits:298  - name: train299    num_bytes: 31958551300    num_examples: 473301  download_size: 7160895302  dataset_size: 31958551303- config_name: 2018-04304  features:305  - name: file_path306    dtype: string307  - name: num_changed_lines308    dtype: int64309  - name: code310    dtype: string311  - name: repo_name312    dtype: string313  - name: commit_date314    dtype: string315  - name: sha316    dtype: string317  splits:318  - name: train319    num_bytes: 27846854320    num_examples: 431321  download_size: 8187476322  dataset_size: 27846854323- config_name: 2018-05324  features:325  - name: file_path326    dtype: string327  - name: num_changed_lines328    dtype: int64329  - name: code330    dtype: string331  - name: repo_name332    dtype: string333  - name: commit_date334    dtype: string335  - name: sha336    dtype: string337  splits:338  - name: train339    num_bytes: 5913046340    num_examples: 485341  download_size: 1997067342  dataset_size: 5913046343- config_name: 2018-06344  features:345  - name: file_path346    dtype: string347  - name: num_changed_lines348    dtype: int64349  - name: code350    dtype: string351  - name: repo_name352    dtype: string353  - name: commit_date354    dtype: string355  - name: sha356    dtype: string357  splits:358  - name: train359    num_bytes: 4944199360    num_examples: 413361  download_size: 1554876362  dataset_size: 4944199363- config_name: 2018-07364  features:365  - name: file_path366    dtype: string367  - name: num_changed_lines368    dtype: int64369  - name: code370    dtype: string371  - name: repo_name372    dtype: string373  - name: commit_date374    dtype: string375  - name: sha376    dtype: string377  splits:378  - name: train379    num_bytes: 7423297380    num_examples: 500381  download_size: 2460992382  dataset_size: 7423297383- config_name: 2018-08384  features:385  - name: file_path386    dtype: string387  - name: num_changed_lines388    dtype: int64389  - name: code390    dtype: string391  - name: repo_name392    dtype: string393  - name: commit_date394    dtype: string395  - name: sha396    dtype: string397  splits:398  - name: train399    num_bytes: 5012280400    num_examples: 471401  download_size: 1565885402  dataset_size: 5012280403- config_name: 2018-09404  features:405  - name: file_path406    dtype: string407  - name: num_changed_lines408    dtype: int64409  - name: code410    dtype: string411  - name: repo_name412    dtype: string413  - name: commit_date414    dtype: string415  - name: sha416    dtype: string417  splits:418  - name: train419    num_bytes: 11567458420    num_examples: 534421  download_size: 3631200422  dataset_size: 11567458423- config_name: 2018-10424  features:425  - name: file_path426    dtype: string427  - name: num_changed_lines428    dtype: int64429  - name: code430    dtype: string431  - name: repo_name432    dtype: string433  - name: commit_date434    dtype: string435  - name: sha436    dtype: string437  splits:438  - name: train439    num_bytes: 3960621440    num_examples: 469441  download_size: 1189681442  dataset_size: 3960621443- config_name: 2018-11444  features:445  - name: file_path446    dtype: string447  - name: num_changed_lines448    dtype: int64449  - name: code450    dtype: string451  - name: repo_name452    dtype: string453  - name: commit_date454    dtype: string455  - name: sha456    dtype: string457  splits:458  - name: train459    num_bytes: 5787805460    num_examples: 456461  download_size: 1658984462  dataset_size: 5787805463- config_name: 2018-12464  features:465  - name: file_path466    dtype: string467  - name: num_changed_lines468    dtype: int64469  - name: code470    dtype: string471  - name: repo_name472    dtype: string473  - name: commit_date474    dtype: string475  - name: sha476    dtype: string477  splits:478  - name: train479    num_bytes: 80257123480    num_examples: 564481  download_size: 15409397482  dataset_size: 80257123483- config_name: 2019-01484  features:485  - name: file_path486    dtype: string487  - name: num_changed_lines488    dtype: int64489  - name: code490    dtype: string491  - name: repo_name492    dtype: string493  - name: commit_date494    dtype: string495  - name: sha496    dtype: string497  splits:498  - name: train499    num_bytes: 10884294500    num_examples: 559501  download_size: 3443301502  dataset_size: 10884294503- config_name: 2019-02504  features:505  - name: file_path506    dtype: string507  - name: num_changed_lines508    dtype: int64509  - name: code510    dtype: string511  - name: repo_name512    dtype: string513  - name: commit_date514    dtype: string515  - name: sha516    dtype: string517  splits:518  - name: train519    num_bytes: 5649301520    num_examples: 440521  download_size: 1797649522  dataset_size: 5649301523- config_name: 2019-03524  features:525  - name: file_path526    dtype: string527  - name: num_changed_lines528    dtype: int64529  - name: code530    dtype: string531  - name: repo_name532    dtype: string533  - name: commit_date534    dtype: string535  - name: sha536    dtype: string537  splits:538  - name: train539    num_bytes: 18363947540    num_examples: 587541  download_size: 5020308542  dataset_size: 18363947543- config_name: 2019-04544  features:545  - name: file_path546    dtype: string547  - name: num_changed_lines548    dtype: int64549  - name: code550    dtype: string551  - name: repo_name552    dtype: string553  - name: commit_date554    dtype: string555  - name: sha556    dtype: string557  splits:558  - name: train559    num_bytes: 6694701560    num_examples: 551561  download_size: 2107122562  dataset_size: 6694701563- config_name: 2019-05564  features:565  - name: file_path566    dtype: string567  - name: num_changed_lines568    dtype: int64569  - name: code570    dtype: string571  - name: repo_name572    dtype: string573  - name: commit_date574    dtype: string575  - name: sha576    dtype: string577  splits:578  - name: train579    num_bytes: 26803692580    num_examples: 561581  download_size: 6332158582  dataset_size: 26803692583- config_name: 2019-06584  features:585  - name: file_path586    dtype: string587  - name: num_changed_lines588    dtype: int64589  - name: code590    dtype: string591  - name: repo_name592    dtype: string593  - name: commit_date594    dtype: string595  - name: sha596    dtype: string597  splits:598  - name: train599    num_bytes: 7680262600    num_examples: 626601  download_size: 2388316602  dataset_size: 7680262603- config_name: 2019-07604  features:605  - name: file_path606    dtype: string607  - name: num_changed_lines608    dtype: int64609  - name: code610    dtype: string611  - name: repo_name612    dtype: string613  - name: commit_date614    dtype: string615  - name: sha616    dtype: string617  splits:618  - name: train619    num_bytes: 48256751620    num_examples: 782621  download_size: 10976769622  dataset_size: 48256751623- config_name: 2019-08624  features:625  - name: file_path626    dtype: string627  - name: num_changed_lines628    dtype: int64629  - name: code630    dtype: string631  - name: repo_name632    dtype: string633  - name: commit_date634    dtype: string635  - name: sha636    dtype: string637  splits:638  - name: train639    num_bytes: 44531740640    num_examples: 621641  download_size: 9532153642  dataset_size: 44531740643- config_name: 2019-09644  features:645  - name: file_path646    dtype: string647  - name: num_changed_lines648    dtype: int64649  - name: code650    dtype: string651  - name: repo_name652    dtype: string653  - name: commit_date654    dtype: string655  - name: sha656    dtype: string657  splits:658  - name: train659    num_bytes: 13659784660    num_examples: 633661  download_size: 4329485662  dataset_size: 13659784663- config_name: 2019-10664  features:665  - name: file_path666    dtype: string667  - name: num_changed_lines668    dtype: int64669  - name: code670    dtype: string671  - name: repo_name672    dtype: string673  - name: commit_date674    dtype: string675  - name: sha676    dtype: string677  splits:678  - name: train679    num_bytes: 14255546680    num_examples: 641681  download_size: 4620728682  dataset_size: 14255546683- config_name: 2019-11684  features:685  - name: file_path686    dtype: string687  - name: num_changed_lines688    dtype: int64689  - name: code690    dtype: string691  - name: repo_name692    dtype: string693  - name: commit_date694    dtype: string695  - name: sha696    dtype: string697  splits:698  - name: train699    num_bytes: 4447318700    num_examples: 481701  download_size: 1369815702  dataset_size: 4447318703- config_name: 2019-12704  features:705  - name: file_path706    dtype: string707  - name: num_changed_lines708    dtype: int64709  - name: code710    dtype: string711  - name: repo_name712    dtype: string713  - name: commit_date714    dtype: string715  - name: sha716    dtype: string717  splits:718  - name: train719    num_bytes: 8185509720    num_examples: 674721  download_size: 2414564722  dataset_size: 8185509723- config_name: 2020-01724  features:725  - name: file_path726    dtype: string727  - name: num_changed_lines728    dtype: int64729  - name: code730    dtype: string731  - name: repo_name732    dtype: string733  - name: commit_date734    dtype: string735  - name: sha736    dtype: string737  splits:738  - name: train739    num_bytes: 8455425740    num_examples: 550741  download_size: 2711023742  dataset_size: 8455425743- config_name: 2020-02744  features:745  - name: file_path746    dtype: string747  - name: num_changed_lines748    dtype: int64749  - name: code750    dtype: string751  - name: repo_name752    dtype: string753  - name: commit_date754    dtype: string755  - name: sha756    dtype: string757  splits:758  - name: train759    num_bytes: 13324957760    num_examples: 647761  download_size: 4004628762  dataset_size: 13324957763- config_name: 2020-03764  features:765  - name: file_path766    dtype: string767  - name: num_changed_lines768    dtype: int64769  - name: code770    dtype: string771  - name: repo_name772    dtype: string773  - name: commit_date774    dtype: string775  - name: sha776    dtype: string777  splits:778  - name: train779    num_bytes: 8637049780    num_examples: 641781  download_size: 2618621782  dataset_size: 8637049783- config_name: 2020-04784  features:785  - name: file_path786    dtype: string787  - name: num_changed_lines788    dtype: int64789  - name: code790    dtype: string791  - name: repo_name792    dtype: string793  - name: commit_date794    dtype: string795  - name: sha796    dtype: string797  splits:798  - name: train799    num_bytes: 21680797800    num_examples: 523801  download_size: 6186771802  dataset_size: 21680797803- config_name: 2020-05804  features:805  - name: file_path806    dtype: string807  - name: num_changed_lines808    dtype: int64809  - name: code810    dtype: string811  - name: repo_name812    dtype: string813  - name: commit_date814    dtype: string815  - name: sha816    dtype: string817  splits:818  - name: train819    num_bytes: 33247689820    num_examples: 745821  download_size: 9491599822  dataset_size: 33247689823- config_name: 2020-06824  features:825  - name: file_path826    dtype: string827  - name: num_changed_lines828    dtype: int64829  - name: code830    dtype: string831  - name: repo_name832    dtype: string833  - name: commit_date834    dtype: string835  - name: sha836    dtype: string837  splits:838  - name: train839    num_bytes: 32091028840    num_examples: 650841  download_size: 9477554842  dataset_size: 32091028843- config_name: 2020-07844  features:845  - name: file_path846    dtype: string847  - name: num_changed_lines848    dtype: int64849  - name: code850    dtype: string851  - name: repo_name852    dtype: string853  - name: commit_date854    dtype: string855  - name: sha856    dtype: string857  splits:858  - name: train859    num_bytes: 11260724860    num_examples: 648861  download_size: 3516116862  dataset_size: 11260724863- config_name: 2020-08864  features:865  - name: file_path866    dtype: string867  - name: num_changed_lines868    dtype: int64869  - name: code870    dtype: string871  - name: repo_name872    dtype: string873  - name: commit_date874    dtype: string875  - name: sha876    dtype: string877  splits:878  - name: train879    num_bytes: 10871233880    num_examples: 627881  download_size: 3431593882  dataset_size: 10871233883- config_name: 2020-09884  features:885  - name: file_path886    dtype: string887  - name: num_changed_lines888    dtype: int64889  - name: code890    dtype: string891  - name: repo_name892    dtype: string893  - name: commit_date894    dtype: string895  - name: sha896    dtype: string897  splits:898  - name: train899    num_bytes: 31711385900    num_examples: 521901  download_size: 8342950902  dataset_size: 31711385903- config_name: 2020-10904  features:905  - name: file_path906    dtype: string907  - name: num_changed_lines908    dtype: int64909  - name: code910    dtype: string911  - name: repo_name912    dtype: string913  - name: commit_date914    dtype: string915  - name: sha916    dtype: string917  splits:918  - name: train919    num_bytes: 12508833920    num_examples: 613921  download_size: 3741252922  dataset_size: 12508833923- config_name: 2020-11924  features:925  - name: file_path926    dtype: string927  - name: num_changed_lines928    dtype: int64929  - name: code930    dtype: string931  - name: repo_name932    dtype: string933  - name: commit_date934    dtype: string935  - name: sha936    dtype: string937  splits:938  - name: train939    num_bytes: 11227959940    num_examples: 677941  download_size: 3230957942  dataset_size: 11227959943- config_name: 2020-12944  features:945  - name: file_path946    dtype: string947  - name: num_changed_lines948    dtype: int64949  - name: code950    dtype: string951  - name: repo_name952    dtype: string953  - name: commit_date954    dtype: string955  - name: sha956    dtype: string957  splits:958  - name: train959    num_bytes: 11118488960    num_examples: 640961  download_size: 3401502962  dataset_size: 11118488963- config_name: 2021-01964  features:965  - name: file_path966    dtype: string967  - name: num_changed_lines968    dtype: int64969  - name: code970    dtype: string971  - name: repo_name972    dtype: string973  - name: commit_date974    dtype: string975  - name: sha976    dtype: string977  splits:978  - name: train979    num_bytes: 17085054980    num_examples: 621981  download_size: 5321474982  dataset_size: 17085054983- config_name: 2021-02984  features:985  - name: file_path986    dtype: string987  - name: num_changed_lines988    dtype: int64989  - name: code990    dtype: string991  - name: repo_name992    dtype: string993  - name: commit_date994    dtype: string995  - name: sha996    dtype: string997  splits:998  - name: train999    num_bytes: 154585751000    num_examples: 5781001  download_size: 47878081002  dataset_size: 154585751003- config_name: 2021-031004  features:1005  - name: file_path1006    dtype: string1007  - name: num_changed_lines1008    dtype: int641009  - name: code1010    dtype: string1011  - name: repo_name1012    dtype: string1013  - name: commit_date1014    dtype: string1015  - name: sha1016    dtype: string1017  splits:1018  - name: train1019    num_bytes: 77037201020    num_examples: 6531021  download_size: 24269691022  dataset_size: 77037201023- config_name: 2021-041024  features:1025  - name: file_path1026    dtype: string1027  - name: num_changed_lines1028    dtype: int641029  - name: code1030    dtype: string1031  - name: repo_name1032    dtype: string1033  - name: commit_date1034    dtype: string1035  - name: sha1036    dtype: string1037  splits:1038  - name: train1039    num_bytes: 150372781040    num_examples: 6781041  download_size: 45483801042  dataset_size: 150372781043- config_name: 2021-051044  features:1045  - name: file_path1046    dtype: string1047  - name: num_changed_lines1048    dtype: int641049  - name: code1050    dtype: string1051  - name: repo_name1052    dtype: string1053  - name: commit_date1054    dtype: string1055  - name: sha1056    dtype: string1057  splits:1058  - name: train1059    num_bytes: 151874011060    num_examples: 5911061  download_size: 53984321062  dataset_size: 151874011063- config_name: 2021-061064  features:1065  - name: file_path1066    dtype: string1067  - name: num_changed_lines1068    dtype: int641069  - name: code1070    dtype: string1071  - name: repo_name1072    dtype: string1073  - name: commit_date1074    dtype: string1075  - name: sha1076    dtype: string1077  splits:1078  - name: train1079    num_bytes: 139204651080    num_examples: 7061081  download_size: 45504361082  dataset_size: 139204651083- config_name: 2021-071084  features:1085  - name: file_path1086    dtype: string1087  - name: num_changed_lines1088    dtype: int641089  - name: code1090    dtype: string1091  - name: repo_name1092    dtype: string1093  - name: commit_date1094    dtype: string1095  - name: sha1096    dtype: string1097  splits:1098  - name: train1099    num_bytes: 76018241100    num_examples: 5431101  download_size: 23613591102  dataset_size: 76018241103- config_name: 2021-081104  features:1105  - name: file_path1106    dtype: string1107  - name: num_changed_lines1108    dtype: int641109  - name: code1110    dtype: string1111  - name: repo_name1112    dtype: string1113  - name: commit_date1114    dtype: string1115  - name: sha1116    dtype: string1117  splits:1118  - name: train1119    num_bytes: 79451611120    num_examples: 5021121  download_size: 23977101122  dataset_size: 79451611123- config_name: 2021-091124  features:1125  - name: file_path1126    dtype: string1127  - name: num_changed_lines1128    dtype: int641129  - name: code1130    dtype: string1131  - name: repo_name1132    dtype: string1133  - name: commit_date1134    dtype: string1135  - name: sha1136    dtype: string1137  splits:1138  - name: train1139    num_bytes: 75774371140    num_examples: 5511141  download_size: 23256511142  dataset_size: 75774371143- config_name: 2021-101144  features:1145  - name: file_path1146    dtype: string1147  - name: num_changed_lines1148    dtype: int641149  - name: code1150    dtype: string1151  - name: repo_name1152    dtype: string1153  - name: commit_date1154    dtype: string1155  - name: sha1156    dtype: string1157  splits:1158  - name: train1159    num_bytes: 125302051160    num_examples: 6341161  download_size: 32594351162  dataset_size: 125302051163- config_name: 2021-111164  features:1165  - name: file_path1166    dtype: string1167  - name: num_changed_lines1168    dtype: int641169  - name: code1170    dtype: string1171  - name: repo_name1172    dtype: string1173  - name: commit_date1174    dtype: string1175  - name: sha1176    dtype: string1177  splits:1178  - name: train1179    num_bytes: 144727881180    num_examples: 5471181  download_size: 47114711182  dataset_size: 144727881183- config_name: 2021-121184  features:1185  - name: file_path1186    dtype: string1187  - name: num_changed_lines1188    dtype: int641189  - name: code1190    dtype: string1191  - name: repo_name1192    dtype: string1193  - name: commit_date1194    dtype: string1195  - name: sha1196    dtype: string1197  splits:1198  - name: train1199    num_bytes: 52004341200    num_examples: 467

Showing the first 1,200 of 2487 lines. Download the file for the rest.