Darknsu/Rag_Data_91136_with_audio_lora_training_checkpoint
part-1 2026-08-08 12:40:13,071 [rank 0] INFO step 1890/37990 loss=1.2651 text=0.3350 audio=0.9301 lr=1.99e-06 elapsed=31644s 2026-08-08 12:43:12,562 [rank 0] INFO [ckpt] saved step 1899 → /workspace/lora_checkpoints/step_1899 2026-08-08 12:43:29,252 [rank 0] INFO step 1900/37990 loss=1.2689 text=0.3547 audio=0.9142 lr=1.99e-06 elapsed=31840s part-2 2026-08-08 21:30:42,019 [rank 0] INFO step 3790/37990 loss=1.1867 text=0.3062 audio=0.8805 lr=1.96e-06… See the full description on the dataset page: https://huggingface.co/datasets/Darknsu/Rag_Data_91136_with_audio_lora_training_checkpoint.
069
part-1
- 2026-08-08 12:40:13,071 [rank 0] INFO step 1890/37990 loss=1.2651 text=0.3350 audio=0.9301 lr=1.99e-06 elapsed=31644s
- 2026-08-08 12:43:12,562 [rank 0] INFO [ckpt] saved step 1899 → /workspace/loracheckpoints/step1899
- 2026-08-08 12:43:29,252 [rank 0] INFO step 1900/37990 loss=1.2689 text=0.3547 audio=0.9142 lr=1.99e-06 elapsed=31840s
part-2
- 2026-08-08 21:30:42,019 [rank 0] INFO step 3790/37990 loss=1.1867 text=0.3062 audio=0.8805 lr=1.96e-06 elapsed=63473s
- 2026-08-08 21:33:23,475 [rank 0] INFO [ckpt] saved step 3798 → /workspace/loracheckpoints/step3798
- Rank 2 finished epoch 1
- Rank 0 finished epoch 1
- Rank 1 finished epoch 1
- 2026-08-08 21:33:57,379 [rank 0] INFO step 3800/37990 loss=1.2068 text=0.3260 audio=0.8808 lr=1.96e-06 elapsed=63668s
part-3
- 2026-08-09 06:21:17,130 [rank 0] INFO step 5690/37990 loss=1.1982 text=0.3088 audio=0.8894 lr=1.90e-06 elapsed=95308s
- 2026-08-09 06:23:39,282 [rank 0] INFO [ckpt] saved step 5697 → /workspace/loracheckpoints/step5697
- 2026-08-09 06:24:29,480 [rank 0] INFO step 5700/37990 loss=1.1593 text=0.3001 audio=0.8593 lr=1.90e-06 elapsed=95500s
part-4
- 2026-08-09 15:11:28,506 [rank 0] INFO step 7590/37990 loss=1.1371 text=0.2849 audio=0.8522 lr=1.83e-06 elapsed=127119s
- 2026-08-09 15:14:21,540 [rank 0] INFO [ckpt] saved step 7596 → /workspace/loracheckpoints/step7596
- Rank 2 finished epoch 2
- Rank 0 finished epoch 2
- Rank 1 finished epoch 2
- 2026-08-09 15:15:29,194 [rank 0] INFO step 7600/37990 loss=1.1413 text=0.2967 audio=0.8446 lr=1.83e-06 elapsed=127360s
part-5
- 2026-08-10 00:02:48,823 [rank 0] INFO step 9490/37990 loss=1.1399 text=0.2867 audio=0.8532 lr=1.74e-06 elapsed=158999s
- 2026-08-10 00:05:12,770 [rank 0] INFO [ckpt] saved step 9495 → /workspace/loracheckpoints/step9495
- 2026-08-10 00:06:37,297 [rank 0] INFO step 9500/37990 loss=1.1591 text=0.2914 audio=0.8678 lr=1.74e-06 elapsed=159228s
