THULab/github_top_developers
github_top_developers (TsFile) Apache TsFile version of diamond-in/github-top-developers. Records: 39,390 Schema (TsFile structure) name (TAG) — device dimension(s). name (FIELD). rank (FIELD). Usage Install the Apache TsFile Python SDK (pip install tsfile) and read a converted file: from pathlib import Path from tsfile import TsFileReader path = Path("github_top_developers.tsfile") with TsFileReader(str(path)) as reader: schemas =… See the full description on the dataset page: https://huggingface.co/datasets/THULab/github_top_developers.
053
githubtopdevelopers (TsFile)
Apache TsFile version of `diamond-in/github-top-developers`.
- Records: 39,390
Schema (TsFile structure)
- name (TAG) — device dimension(s).
- name (FIELD).
- rank (FIELD).
Usage
Install the Apache TsFile Python SDK (pip install tsfile) and read a converted file:
from pathlib import Path
from tsfile import TsFileReader
path = Path("github_top_developers.tsfile")
with TsFileReader(str(path)) as reader:
schemas = reader.get_all_table_schemas()
print("tables:", list(schemas))
table_name = next(iter(schemas))
table = schemas[table_name]
columns = [column.get_column_name() for column in table.get_columns()]
print("columns:", columns)
field_names = [
column.get_column_name()
for column in table.get_columns()
if column.get_column_name() not in {"Time", "time"}
]
if field_names:
with reader.query_table(table_name, field_names[:3], batch_size=1024) as result:
batch = result.read_arrow_batch()
if batch is not None:
print(batch.to_pandas().head())Source & license
- Original dataset: https://huggingface.co/datasets/diamond-in/github-top-developers
- Author / publisher: diamond-in
- License: mit
