CoolFace
Datasetpublic

OneScience-Group/cfd_benchmark

CFD Benchmark Dataset Description CFD Benchmark is a comprehensive benchmark dataset for training and evaluating neural PDE solvers. It contains six standard tasks on regular grids, structured grids, and irregular geometries. The dataset was used for unified evaluation in the ICML 2024 paper Transolver, and some of its data originates from the FNO and Geo-FNO works. The dataset contains six subsets: airfoil, darcy, elasticity, ns, pipe, and plas. Paper: Transolver:… See the full description on the dataset page: https://huggingface.co/datasets/OneScience-Group/cfd_benchmark.

sourceHugging Faceotherupdated 2mo agoView on Hugging Face
1likes191downloads
manifest.yaml350 linesDownload Raw Back to root
1onescience_manifest_version: "0.1"2resource_type: dataset3resource:4  id: OneScience/cfd_benchmark5  name: cfd_benchmark6  domain: cfd7  domain_tags:8    - cfd9    - neural_pde_solver10    - benchmark11  task: cfd_operator_learning_dataset12  task_tags:13    - flow_field_prediction14    - pde_operator_learning15    - data_reading_validation16  modalities:17    - gridded_field18    - unstructured_mesh19  input_formats:20    - npy21    - mat22  output_formats: []23  summary: CFD_Benchmark 数据集的 ModelScope 标准数据包,本次包含 airfoil、darcy、elasticity、ns、pipe、plas 六个子集。24 25platform_resource:26  primary:27    platform: modelscope28    repo_id: OneScience/cfd_benchmark29    repo_type: dataset30    url: https://modelscope.cn/datasets/OneScience/cfd_benchmark31    revision: main32    readme_path: README.md33    manifest_path: manifest.yaml34  mirrors: []35  access:36    visibility: public37    license: null38 39website_integration:40  enabled: true41  click_target:42    platform: modelscope43    resource_url: https://modelscope.cn/datasets/OneScience/cfd_benchmark44  llm_handoff:45    readme_required: true46    manifest_required: true47    download_readme_first: true48    resolve_related_models: true49    default_run_goal: minimal_validation50 51runtime:52  enabled: true53  onescience_domain: cfd54  min_onescience_version: null55  supported_execution:56    - local57    - local_slurm58    - remote_slurm59 60onescience:61  repo: https://gitee.com/onescience-ai/onescience62  official_links:63    gitee:64      doc: https://gitee.com/onescience-ai/onescience-doc65      onescience: https://gitee.com/onescience-ai/onescience66      skills: https://gitee.com/onescience-ai/oneskills67    github:68      doc: https://github.com/onescience-ai/OneScience-doc69      onescience: https://github.com/onescience-ai/OneScience70      skills: https://github.com/onescience-ai/oneskills71  install:72    required_by_default: false73    command: source ~/env.sh && bash install.sh cfd74  source_paths: []75  compatibility:76    examples_path: examples/cfd/CFD_Benchmark77    status: examples_compatible78 79runtime_package:80  kind: standard_runtime_package81  package_root: .82  standard_layout:83    workdir: .84    config_dir: metadata85    checkpoint_dir: null86    data_dir: data87    output_dir: reports88  apply_policy:89    mode: direct_use90    target: session_workdir91    overwrite: true92    protect_installed_onescience: true93  entry_files:94    - metadata/file_manifest.csv95    - metadata/schema.yaml96    - scripts/validate_dataset.py97  entrypoints:98    preflight: scripts/validate_dataset.py99    inference: null100    train: null101    finetune: null102    evaluate: null103    visualize: null104    deploy: null105 106files:107  model_files: []108  dataset_files:109    - id: cfd_benchmark_data110      path: data/111      role: train_data112      description_zh: 本次整理的 CFD_Benchmark 六个子集数据目录,包含 airfoil、darcy、elasticity、ns、pipe、plas。113      required: true114      required_for:115        - train116        - evaluate117        - preflight118      format: npy_mat119      source:120        platform: modelscope121        repo_id: OneScience/cfd_benchmark122        repo_type: dataset123        path: data/124        revision: main125        download_method: command_ref126        command_ref: commands.download.download_dataset127      local_path: session_workdir/cfd_cfd_benchmark_data/data/128      size: "约 8.2G"129      checksum: metadata/file_manifest.csv130      large_file: true131    - id: file_manifest132      path: metadata/file_manifest.csv133      role: checksum_manifest134      description_zh: 整理后每个数据文件的相对路径、字节数和 SHA256。135      required: true136      required_for:137        - preflight138      format: csv139      source:140        platform: modelscope141        repo_id: OneScience/cfd_benchmark142        repo_type: dataset143        path: metadata/file_manifest.csv144        revision: main145        download_method: command_ref146        command_ref: commands.download.download_dataset147      local_path: session_workdir/cfd_cfd_benchmark_data/metadata/file_manifest.csv148      size: null149      checksum: null150      large_file: false151  config_files:152    - id: schema153      path: metadata/schema.yaml154      role: schema155      description_zh: 记录 npy shape/dtype 和 MATLAB 文件变量结构。156      required: true157      required_for:158        - preflight159        - train160        - evaluate161      format: yaml162      source:163        platform: modelscope164        repo_id: OneScience/cfd_benchmark165        repo_type: dataset166        path: metadata/schema.yaml167        revision: main168        download_method: command_ref169        command_ref: commands.download.download_dataset170      local_path: session_workdir/cfd_cfd_benchmark_data/metadata/schema.yaml171      checksum: null172      large_file: false173  sample_files: []174 175dataset:176  format:177    - npy178    - matlab_v5_mat179  sample_unit: 不同子集的一个样本定义不同,airfoil/pipe 为一个几何流场样本,darcy/ns/plas 为一个 PDE 系数或时间序列样本,elasticity 为一个随机单元结构样本。180  schema:181    path: metadata/schema.yaml182  checksum_manifest:183    path: metadata/file_manifest.csv184  splits:185    train: 由 CFD_Benchmark 运行脚本通过 ntrain 或 train_ratio 切分。186    validation: null187    test: 由 CFD_Benchmark 运行脚本通过 ntest 或 train_ratio 切分。188 189relations:190  required_datasets: []191  optional_datasets: []192  compatible_models:193    - id: OneScience/CFD_Benchmark194      role: train_data195      required_for:196        - train197        - evaluate198        - preflight199      resource_ref:200        platform: modelscope201        repo_id: OneScience/CFD_Benchmark202        repo_type: model203        url: https://modelscope.cn/models/OneScience/CFD_Benchmark204        revision: main205        readme_path: README.md206        manifest_path: manifest.yaml207      expected_local_path: ../cfd_cfd_benchmark_data/data208      adapter: scripts/standard_train_airfoil_transolver.sh209 210run_matrix:211  scenarios:212    - name: minimal_validation213      capability: preflight214      default: true215      required_datasets:216        - id: OneScience/cfd_benchmark217          role: train_data218          local_path: data/219      required_model_files: []220      command_refs:221        - commands.preflight.validate_dataset222      expected_outputs:223        - reports/dataset_validation.json224      prerequisites:225        - 已下载数据集 OneScience/cfd_benchmark。226    - name: cfd_benchmark_model_train227      capability: train228      required_datasets:229        - id: OneScience/cfd_benchmark230          role: train_data231          local_path: data/232      required_model_files:233        - OneScience/CFD_Benchmark runtime/234      command_refs:235        - commands.preflight.validate_dataset236      expected_outputs:237        - reports/dataset_validation.json238      prerequisites:239        - 下载并进入模型仓库 OneScience/CFD_Benchmark。240 241capabilities:242  inference: false243  train: false244  finetune: false245  evaluate: false246  visualize: false247  deploy: false248  data_reading_validation: true249 250commands:251  download:252    - name: download_dataset253      description: 下载 CFD_Benchmark 数据集标准包。254      cwd: .255      command: modelscope download --dataset OneScience/cfd_benchmark --local_dir ./cfd_cfd_benchmark_data256      required_files: []257      required_env:258        - MODELSCOPE_TOKEN259      expected_outputs:260        - path: cfd_cfd_benchmark_data/manifest.yaml261          type: file262        - path: cfd_cfd_benchmark_data/data/263          type: directory264      success_criteria:265        - exit_code == 0266  preflight:267    - name: validate_dataset268      description: 校验 14 个数据文件的存在性、大小、SHA256、npy shape/dtype 和 mat 变量结构。269      cwd: .270      command: source ~/env.sh && python scripts/validate_dataset.py --data-root data --file-manifest metadata/file_manifest.csv271      required_files:272        - scripts/validate_dataset.py273        - metadata/file_manifest.csv274        - data/275      required_env:276        - python277        - numpy278        - scipy279      expected_outputs:280        - path: reports/dataset_validation.json281          type: file282      success_criteria:283        - exit_code == 0284  prepare: []285  inference: []286  train: []287  finetune: []288  evaluate: []289  visualize: []290  deploy: []291 292expected_outputs:293  - path: reports/dataset_validation.json294    type: json295    description_zh: 数据文件完整性和可读性验证报告。296  - path: metadata/file_manifest.csv297    type: csv298    description_zh: 文件名、大小和 SHA256 校验清单。299  - path: metadata/schema.yaml300    type: yaml301    description_zh: 数据结构说明。302 303diagnostics:304  - id: missing_file305    symptom: validate_dataset.py 报告 status=missing。306    cause: 数据下载不完整或放置目录错误。307    fix: 重新执行 modelscope download --dataset OneScience/cfd_benchmark --local_dir ./cfd_cfd_benchmark_data。308  - id: sha256_mismatch309    symptom: validate_dataset.py 报告 status=sha256_mismatch。310    cause: 文件损坏、复制中断或上传下载过程中内容变化。311    fix: 删除对应文件后重新下载数据集,或用 metadata/source_file_manifest.csv 与源目录重新比对。312  - id: scipy_missing313    symptom: MATLAB 文件只完成 header_only 检查。314    cause: 当前 Python 环境缺少 scipy。315    fix: source ~/env.sh 后重跑验证;当前标准化过程中已用 scipy 生成 metadata/schema.yaml。316 317domain_extension:318  cfd:319    benchmark_name: CFD_Benchmark320    included_subsets:321      airfoil:322        files:323          - NACA_Cylinder_X.npy324          - NACA_Cylinder_Y.npy325          - NACA_Cylinder_Q.npy326      darcy:327        files:328          - piececonst_r421_N1024_smooth1.mat329          - piececonst_r421_N1024_smooth2.mat330      elasticity:331        files:332          - Meshes/Random_UnitCell_XY_10.npy333          - Meshes/Random_UnitCell_rr_10.npy334          - Meshes/Random_UnitCell_sigma_10.npy335          - Meshes/Random_UnitCell_theta_10.npy336      ns:337        files:338          - NavierStokes_V1e-5_N1200_T20.mat339      pipe:340        files:341          - Pipe_X.npy342          - Pipe_Y.npy343          - Pipe_Q.npy344      plas:345        files:346          - plas_N987_T20.mat347    skipped_source_subsets:348      - car349      - diffusion_sorption350