rochanaro/hf-arxiv-url-bench
arXiv URL Extraction Benchmark & Longitudinal Corpus Dataset Description This repository hosts datasets designed to assess format-specific coverage gaps in URL extraction across the arXiv corpus. The collection facilitates large-scale reproducibility studies and evaluates how different document formats (LaTeX, HTML, XML, Markdown, TXT, PNG) impact automated extraction pipelines. The repository is divided into two primary corpora: The 200-Paper Benchmark: A… See the full description on the dataset page: https://huggingface.co/datasets/rochanaro/hf-arxiv-url-bench.
Update README.md
Update README.md
Update README.md
Upload arxiv-200-benchmark/arxiv_urls_1992_2024_gt.csv with huggingface_hub
Delete arxiv-200-benchmark/arxiv_urls_1992_2024_gt.csv
Update README.md
Update README.md
Update README.md
Delete arxiv_urls_1992_2024_gt.csv
Delete arxiv_extracted_unique_urls_all_200_superset.json
Upload arxiv-200-benchmark/arxiv_extracted_unique_urls_all_200_superset.json with huggingface_hub
Upload arxiv-200-benchmark/arxiv_urls_1992_2024_gt.csv with huggingface_hub
Delete arxiv-url-bench-200.tar.gz
Delete arxiv-200-benchmark/intermediate_results/.ipynb_checkpoints
Upload folder using huggingface_hub
Upload arxiv-200-benchmark/arxiv-url-bench-200-raw-files.tar.gz with huggingface_hub
Update README.md
update readme with schema previews for json files
Update README.md
Update README.md
Delete arxiv-mini-corpus/arxiv_extracted_urls_5_formats_360k.jsonl
Update README.md
Upload arxiv-mini-corpus/arxiv_extracted_urls_5_formats_360k.jsonl with huggingface_hub
Update README.md
Update README.md
Update README.md
Update README.md
Upload arxiv-mini-corpus/intermediate_results/longitudinal_analysis_common_360k_arxiv_ids.json with huggingface_hub
Upload arxiv-mini-corpus/arxiv_extracted_urls_5_formats_360k.json with huggingface_hub
Upload arxiv-mini-corpus/latex.tar.gz with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage4_grobid_xml_master_summary.csv with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage6_latexml_success.jsonl with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage6_html_urls.json with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage5_markdown_urls.json with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage5_markdown_marker_success.json with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage4_xml_grobid_urls.json with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage3b_latex_sources_all.json with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage3_latex_urls.json with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage2_pdf_textwal_urls.json with huggingface_hub
Upload arxiv-mini-corpus/intermediate_results/stage1_sampled_ids.json with huggingface_hub
Delete arxiv-mini-corpus/arxiv_extracted_urls_5_formats_360k.json
Update README.md
Update README.md
Update README.md
Update README.md
Upload arxiv_urls_1992_2024_gt.csv
Update README.md
Update README.md
Update README.md
Update README.md