scratch
Datasets
All datasets matching “scratch”inference-scratchscratch-archiveasr_rnnt_eou_from_scratch
NeMo ASR-EOU 训练脚本解读与论文出处梳理
目标文件:examples/asr/asr_eou/speech_to_text_rnnt_eou_train.py链接:https://github.com/NVIDIA-NeMo/NeMo/blob/main/examples/asr/asr_eou/speech_to_text_rnnt_eou_train.py
这份脚本本身是一个 训练入口脚本(Hydra + PyTorch Lightning),核心功能是:按配置创建 EncDecRNNTBPEEOUModel,并支持从已有 .nemo 初始化、添加/训练 adapter,以及在“词表扩展(新增 <EOU>/<EOB>)”时做权重迁移。
下面按“它用到的技术点 → 在代码/配置里怎么体现 → 原始论文出处”总结。
1) ASR-EOU:把“端点/话轮信息”并入 ASR(<EOU>, <EOB>)
它做什么:
除了输出转写文本外,还让模型在时间轴上预测:
EOU:End Of Utterance(一句话结束)… See the full description on the dataset page: https://huggingface.co/datasets/echodict/asr_rnnt_eou_from_scratch.10232025_scratchThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": null,
"total_episodes": 0,
"total_frames": 0,
"total_tasks": 0,
"total_videos": 0,
"total_chunks": 0,
"chunks_size": 1000,
"fps": 30,
"splits": {},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path": null,
"features": {
"observation.image.ego_global": {… See the full description on the dataset page: https://huggingface.co/datasets/rli14/10232025_scratch.hf-scratchpadmy-scratch-ai-extensions
