CoolFace
Datasetpublic

codeparrot/github-code

The GitHub Code dataest consists of 115M code files from GitHub in 32 programming languages with 60 extensions totalling in 1TB of text data. The dataset was created from the GitHub dataset on BiqQuery.

sourceHugging Faceotherupdated 4y agoView on Hugging Face
420likes40kdownloads
25 commits on main
b5661e64y ago

update metadata

loubnabnl
942a87c4y ago

Don't use datasets.data_files.* functions (#3)

lvwerra, lhoestq
e74c7014y ago

Fix license metadata (#1)

loubnabnl, julien-c
532001a4y ago

update repo name

loubnabnl
cb76e1b4y ago

Update README.md

loubnabnl
a6bb55a4y ago

update namespace

loubnabnl
610516e4y ago

fix typo

lvwerra
cd3272b5y ago

clarify readme

lvwerra
ae0e8ad5y ago

Update README.md

lvwerra
5eb3e125y ago

Upload github-code-stats-alpha.png

lvwerra
352bfbc5y ago

add revision instructions

lvwerra
af403e55y ago

update documentation

lvwerra
d1387b65y ago

fix dedup and add scala/typescript

lvwerra
289cb3e5y ago

Update README.md

lvwerra
b9a85cf5y ago

Update README.md

lvwerra
53a70805y ago

Update README.md

lvwerra
f16b5335y ago

Update README.md

lvwerra
c4d537e5y ago

Update README.md

lvwerra
bb53f695y ago

Create README.md

lvwerra
8552d705y ago

Create github_preprocessing.py

lvwerra
ffb9e045y ago

Create query.sql

lvwerra
011127c5y ago

Update github-code.py

lvwerra
b1f10f45y ago

add loading script

lvwerra
1af92db5y ago

add data files

lvwerra
c9d9dac5y ago

initial commit

system