CoolFace
Datasetpublic

sfd-anonymous/sefd-archive-100k-analysis-sample-qwen3-20260524

SEFD Archive 100k Analysis Sample Qwen3 20260524 Retained artifacts for the completed archive-wide 100,000-filing Stanford EDGAR Filings Dataset (SEFD) analysis sample used in the arXiv paper update. The sample contains 2,971,490,909 final SEFD tokens, counted with the Qwen3-1.7B tokenizer. This repository is a new versioned artifact and intentionally does not replace the earlier sfd-archive-100k-analysis-sample repository used for the original conference submission. Included:… See the full description on the dataset page: https://huggingface.co/datasets/sfd-anonymous/sefd-archive-100k-analysis-sample-qwen3-20260524.

sourceHugging Facecc-by-nc-4.0updated 4mo agoView on Hugging Face
0likes57downloads
Dataset Card

SEFD Archive 100k Analysis Sample Qwen3 20260524

Retained artifacts for the completed archive-wide 100,000-filing Stanford EDGAR Filings Dataset (SEFD) analysis sample used in the arXiv paper update. The sample contains 2,971,490,909 final SEFD tokens, counted with the Qwen3-1.7B tokenizer.

This repository is a new versioned artifact and intentionally does not replace the earlier sfd-archive-100k-analysis-sample repository used for the original conference submission.

Included:

  • —metadata_parts/: split parts of metadata.jsonl.gz, with one parser-metadata record per successful filing in the completed 100k sample.
  • —metadata_parts/metadata_manifest.json: checksums and reconstruction instructions for the split metadata gzip.
  • —processed_accessions.txt: accession numbers included in the completed sample.
  • —paper_analysis_metrics/: CSV/JSON files used to recreate the dataset-analysis figures and prose.
  • —figures/: rendered PNG versions of the dataset-analysis plots.

Not included:

  • —per-filing parsed MultiMarkdown outputs
  • —temporary raw SEC downloads
  • —parser source code

The field archive_final_tokens in summary.json is the sample token count used in the paper. Source-format token totals are retained only for format-attribution analyses and should not be treated as the corpus-size token count.

To reconstruct the metadata gzip:

bash
cat metadata_parts/metadata.jsonl.gz.part-* > metadata.jsonl.gz
shasum -a 256 metadata.jsonl.gz

The expected SHA-256 is bd5e7087e252d9e42507b5c3bed6e42315ed76f58d9c967ce1221ef1a2e72997.