uniref90
Datasets
All datasets matching “uniref90”uniref90
UniRef90
Complete UniRef90 dataset from UniProt, converted from XML to sharded Parquet. UniRef90 clusters sequences at 90% identity, providing a non-redundant protein sequence resource that balances comprehensiveness with reduced redundancy.
Part of the ConvergeBio Protein Database Collection — see also UniRef100, UniRef50, and UniClust30.
Dataset Summary
Clusters
188,848,220
Shards
386
Compressed size
~52 GB (zstd)
Sequence lengths
11 – 49,499 aa… See the full description on the dataset page: https://huggingface.co/datasets/ConvergeBio/uniref90.uniref90uniref90_parquets_shuffledUniRef90 parquet files created by Jude Wells 2025-03-18
see script data_creation_scripts/shuffling/shuffle_uniref90.sh for shuffling it was done
Processing was done on kaspian computer.
uniref90UniRef90
UniRef90 Shard Index
UniRef90 is a clustered protein sequence dataset from UniProt where sequences are grouped so that each cluster contains proteins with at least 90% sequence identity. It reduces redundancy while preserving broad protein sequence coverage, making it useful for protein search, annotation transfer, and training protein language models.
Splits
The split is deterministic by file ID: sha256(file_id) % 10. Bucket 0 is test; buckets 1 through 9 are train.… See the full description on the dataset page: https://huggingface.co/datasets/LiteFold/UniRef90.UniRef90_len_0_50
This is a dataset download from UniRef90 database with sequence length ranging from 0 to 50
codes for the data mining (downloaded on September 30 2024)
import requests
query_url = 'https://rest.uniprot.org/uniref/stream?compressed=true&fields=id%2Clength%2Cidentity%2Csequence&format=tsv&query=%28%28length%3A%5B*+TO+50%5D%29%29+AND+%28identity%3A0.9%29'
uniprot_request = requests.get(query_url)
from io import BytesIO
import pandas
bio = BytesIO(uniprot_request.content)
df =… See the full description on the dataset page: https://huggingface.co/datasets/dzjxzyd/UniRef90_len_0_50.