CoolFace
Datasetpublic

luca0621/amex-gelab

AMEX SFT This dataset is a packaged export of the local amex_sft directory for uploading to the Hugging Face Hub as a dataset repository. Source Source dataset roots: /ext_hdd2/tsyou/gelab-env/data_engine/amex_sft (3046 trajectories) Number of trajectory folders: 3046 Number of tar shards: 61 Trajectories per shard: 50 Layout shards/*.tar: tar shards containing trajectory folders manifest.jsonl: trajectory-to-shard index dataset_info.json:… See the full description on the dataset page: https://huggingface.co/datasets/luca0621/amex-gelab.

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes9downloads
Dataset Card

AMEX SFT

This dataset is a packaged export of the local amex_sft directory for uploading to the Hugging Face Hub as a dataset repository.

Source

  • Source dataset roots:
  • /ext_hdd2/tsyou/gelab-env/data_engine/amex_sft (3046 trajectories)
  • Number of trajectory folders: 3046
  • Number of tar shards: 61
  • Trajectories per shard: 50

Layout

  • shards/*.tar: tar shards containing trajectory folders
  • manifest.jsonl: trajectory-to-shard index
  • dataset_info.json: high-level metadata

Each tar shard preserves the original trajectory folder layout. For example:

text
<source_root>/<trajectory_id>/
  ui_structure.json
  ui_structure_layer.json
  trajectory_assets_manifest.json
  action_coord/...
  extracted_assets/...

Why tar shards?

The raw source contains a very large number of small PNG files. Packaging them into tar shards makes Hub upload and downstream download much more reliable for large-scale storage.

Notes

  • This repository is intended for storage and reuse of the packaged dataset.
  • If you want Hub-native previews and lighter access patterns, consider a future Parquet/WebDataset conversion.