project-droid/Category-2-final
This dataset contains deduplicated data from The-Vault-function and The-Vault-class. Data filtering notes: AST parsability: we extracted only the AST parsable codes AST Depth: only samples with depth from 2.0 to 31.0 Maximum Line Length: only samples with a maximum of 12.0 to 400.0 characters Average Line Length: only samples with 5.0 to 140.0 characters on average Alphanumeric Fraction of samples is greater than 0.2 and less than 0.9 Number of Lines: from 6.0 to 300.0 Language Filter:… See the full description on the dataset page: https://huggingface.co/datasets/project-droid/Category-2-final.
067
This dataset contains deduplicated data from The-Vault-function and The-Vault-class.
Data filtering notes:
- AST parsability: we extracted only the AST parsable codes
- AST Depth: only samples with depth from 2.0 to 31.0
- Maximum Line Length: only samples with a maximum of 12.0 to 400.0 characters
- Average Line Length: only samples with 5.0 to 140.0 characters on average
- Alphanumeric Fraction of samples is greater than 0.2 and less than 0.9
- Number of Lines: from 6.0 to 300.0
- Language Filter: samples whose docstring scores an English language confidence greater than 98% by the
lingualanguage detector - Deduplication: samples MinHash deduplicated using a shingle size of 8 and a similarity threshold of 0.7