Anurag1734/cuda-error-resolution-analysis
07
1[2 {3 "post_stream": {4 "posts": [5 {6 "id": 334120,7 "name": "Mona Jalal",8 "username": "Mona_Jalal",9 "avatar_template": "/user_avatar/discuss.pytorch.org/mona_jalal/{size}/25715_2.png",10 "created_at": "2022-03-03T03:43:10.589Z",11 "cooked": "<p>I am reading a <a href=\"https://github.com/arjunvekariyagithub/camelyon16-grand-challenge/blob/660000a79775fbc5cfa8c5b44a591e62ce714089/camelyon16/postprocess/build_heatmap_multi_thread.py\" rel=\"noopener nofollow ugc\">GitHub code</a> that uses a pretrained version of Inception V3. I am confused by this line <code> model.load_state_dict(torch.load(args.model_loc))</code> in the code:</p>\n<pre><code class=\"lang-auto\"> # define the model \n model = models.inception_v3(pretrained=True)\n num_ftrs = model.fc.in_features\n model.fc = nn.Linear(num_ftrs, 2)\n\n # load the model\n model.load_state_dict(torch.load(args.model_loc))\n model.eval()\n model.cuda()\n</code></pre>\n<p>As we see, <a href=\"https://github.com/pytorch/vision/blob/main/torchvision/models/inception.py\" rel=\"noopener nofollow ugc\">in the original Inception code</a>, it is already loading the state dict. I am wondering why the authors are also doing same after setting their model to the pretrained Inception V3?</p>\n<p>At the same time, I see <a href=\"https://www.kaggle.com/beastlyprime/pytorch-beginner-transfer-learning\" rel=\"noopener nofollow ugc\">this piece of Kaggle code</a> for using a pretrained Inception V3 model. So, which method do you comment as correct?</p>\n<pre><code class=\"lang-auto\">import torchvision.models as models\nimport torch.optim as optim\n\nmodel_ft = models.inception_v3(pretrained=True)\nfor param in model_ft.parameters():\n param.requires_grad = False\n\n# Parameters of newly constructed modules have requires_grad=True by default\n# Handle the auxilary net\nnum_ftrs = model_ft.AuxLogits.fc.in_features\nmodel_ft.AuxLogits.fc = nn.Linear(num_ftrs, 2)\n# Handle the primary net\nnum_ftrs = model_ft.fc.in_features\nmodel_ft.fc = nn.Linear(num_ftrs, 2)\n</code></pre>",12 "post_number": 1,13 "post_type": 1,14 "posts_count": 2,15 "updated_at": "2022-03-03T04:11:59.227Z",16 "reply_count": 0,17 "reply_to_post_number": null,18 "quote_count": 0,19 "incoming_link_count": 105,20 "reads": 7,21 "readers_count": 6,22 "score": 526.4,23 "yours": false,24 "topic_id": 145459,25 "topic_slug": "model-load-state-dict-torch-load-args-model-loc-after-using-inception-v3-pretrained-model",26 "display_username": "Mona Jalal",27 "primary_group_name": null,28 "flair_name": null,29 "flair_url": null,30 "flair_bg_color": null,31 "flair_color": null,32 "flair_group_id": null,33 "badges_granted": [],34 "version": 3,35 "can_edit": false,36 "can_delete": false,37 "can_recover": false,38 "can_see_hidden_post": false,39 "can_wiki": false,40 "link_counts": [41 {42 "url": "https://github.com/arjunvekariyagithub/camelyon16-grand-challenge/blob/660000a79775fbc5cfa8c5b44a591e62ce714089/camelyon16/postprocess/build_heatmap_multi_thread.py",43 "internal": false,44 "reflection": false,45 "title": "camelyon16-grand-challenge/build_heatmap_multi_thread.py at 660000a79775fbc5cfa8c5b44a591e62ce714089 · arjunvekariyagithub/camelyon16-grand-challenge · GitHub",46 "clicks": 247 },48 {49 "url": "https://github.com/pytorch/vision/blob/main/torchvision/models/inception.py",50 "internal": false,51 "reflection": false,52 "title": "vision/inception.py at main · pytorch/vision · GitHub",53 "clicks": 154 },55 {56 "url": "https://www.kaggle.com/beastlyprime/pytorch-beginner-transfer-learning",57 "internal": false,58 "reflection": false,59 "title": "PyTorch beginner: Transfer learning | Kaggle",60 "clicks": 061 }62 ],63 "read": true,64 "user_title": "",65 "bookmarked": false,66 "actions_summary": [],67 "moderator": false,68 "admin": false,69 "staff": false,70 "user_id": 12408,71 "hidden": false,72 "trust_level": 1,73 "deleted_at": null,74 "user_deleted": false,75 "edit_reason": null,76 "can_view_edit_history": true,77 "wiki": false,78 "post_url": "/t/model-load-state-dict-torch-load-args-model-loc-after-using-inception-v3-pretrained-model/145459/1",79 "can_accept_answer": false,80 "can_unaccept_answer": false,81 "accepted_answer": false,82 "topic_accepted_answer": true,83 "can_vote": false84 },85 {86 "id": 334161,87 "name": "",88 "username": "ptrblck",89 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",90 "created_at": "2022-03-03T08:17:04.555Z",91 "cooked": "<p>I guess the author of the first code snippet is loading a pretrained <code>state_dict</code> for the manipulated model (note that <code>model.fc</code> is changed)?</p>",92 "post_number": 2,93 "post_type": 1,94 "posts_count": 2,95 "updated_at": "2022-03-03T08:17:04.555Z",96 "reply_count": 0,97 "reply_to_post_number": null,98 "quote_count": 0,99 "incoming_link_count": 3,100 "reads": 5,101 "readers_count": 4,102 "score": 31.0,103 "yours": false,104 "topic_id": 145459,105 "topic_slug": "model-load-state-dict-torch-load-args-model-loc-after-using-inception-v3-pretrained-model",106 "display_username": "",107 "primary_group_name": null,108 "flair_name": null,109 "flair_url": null,110 "flair_bg_color": null,111 "flair_color": null,112 "flair_group_id": null,113 "badges_granted": [],114 "version": 1,115 "can_edit": false,116 "can_delete": false,117 "can_recover": false,118 "can_see_hidden_post": false,119 "can_wiki": false,120 "read": true,121 "user_title": "",122 "bookmarked": false,123 "actions_summary": [124 {125 "id": 2,126 "count": 1127 }128 ],129 "moderator": true,130 "admin": true,131 "staff": true,132 "user_id": 3534,133 "hidden": false,134 "trust_level": 2,135 "deleted_at": null,136 "user_deleted": false,137 "edit_reason": null,138 "can_view_edit_history": true,139 "wiki": false,140 "post_url": "/t/model-load-state-dict-torch-load-args-model-loc-after-using-inception-v3-pretrained-model/145459/2",141 "can_accept_answer": false,142 "can_unaccept_answer": false,143 "accepted_answer": true,144 "topic_accepted_answer": true145 }146 ],147 "stream": [148 334120,149 334161150 ]151 },152 "timeline_lookup": [153 [154 1,155 1333156 ]157 ],158 "suggested_topics": [159 {160 "fancy_title": "List out of range when using boundings boxes in object detection",161 "id": 212657,162 "title": "List out of range when using boundings boxes in object detection",163 "slug": "list-out-of-range-when-using-boundings-boxes-in-object-detection",164 "posts_count": 1,165 "reply_count": 0,166 "highest_post_number": 1,167 "image_url": null,168 "created_at": "2024-11-07T10:27:30.812Z",169 "last_posted_at": "2024-11-07T10:27:30.862Z",170 "bumped": true,171 "bumped_at": "2024-11-07T10:27:30.862Z",172 "archetype": "regular",173 "unseen": false,174 "pinned": false,175 "unpinned": null,176 "visible": true,177 "closed": false,178 "archived": false,179 "bookmarked": null,180 "liked": null,181 "tags_descriptions": {},182 "like_count": 0,183 "views": 152,184 "category_id": 5,185 "featured_link": null,186 "has_accepted_answer": false,187 "posters": [188 {189 "extras": "latest single",190 "description": "Original Poster, Most Recent Poster",191 "user": {192 "id": 58229,193 "username": "Rexedoziem",194 "name": "Rexedoziem",195 "avatar_template": "/user_avatar/discuss.pytorch.org/rexedoziem/{size}/52029_2.png",196 "trust_level": 1197 }198 }199 ]200 },201 {202 "fancy_title": "Model predicting one classe only after running inference on test data",203 "id": 212937,204 "title": "Model predicting one classe only after running inference on test data",205 "slug": "model-predicting-one-classe-only-after-running-inference-on-test-data",206 "posts_count": 1,207 "reply_count": 0,208 "highest_post_number": 1,209 "image_url": null,210 "created_at": "2024-11-13T15:57:08.333Z",211 "last_posted_at": "2024-11-13T15:57:08.392Z",212 "bumped": true,213 "bumped_at": "2024-11-13T15:57:08.392Z",214 "archetype": "regular",215 "unseen": false,216 "pinned": false,217 "unpinned": null,218 "visible": true,219 "closed": false,220 "archived": false,221 "bookmarked": null,222 "liked": null,223 "tags_descriptions": {},224 "like_count": 0,225 "views": 93,226 "category_id": 5,227 "featured_link": null,228 "has_accepted_answer": false,229 "posters": [230 {231 "extras": "latest single",232 "description": "Original Poster, Most Recent Poster",233 "user": {234 "id": 68222,235 "username": "amy2",236 "name": "amy",237 "avatar_template": "/user_avatar/discuss.pytorch.org/amy2/{size}/62675_2.png",238 "trust_level": 1239 }240 }241 ]242 },243 {244 "fancy_title": "How to split input channels at start of model?",245 "id": 213966,246 "title": "How to split input channels at start of model?",247 "slug": "how-to-split-input-channels-at-start-of-model",248 "posts_count": 3,249 "reply_count": 0,250 "highest_post_number": 3,251 "image_url": null,252 "created_at": "2024-12-08T17:30:56.205Z",253 "last_posted_at": "2024-12-22T16:45:43.901Z",254 "bumped": true,255 "bumped_at": "2024-12-22T17:01:30.572Z",256 "archetype": "regular",257 "unseen": false,258 "pinned": false,259 "unpinned": null,260 "visible": true,261 "closed": false,262 "archived": false,263 "bookmarked": null,264 "liked": null,265 "tags_descriptions": {},266 "like_count": 1,267 "views": 120,268 "category_id": 5,269 "featured_link": null,270 "has_accepted_answer": false,271 "posters": [272 {273 "extras": "latest",274 "description": "Original Poster, Most Recent Poster",275 "user": {276 "id": 75430,277 "username": "wmd",278 "name": null,279 "avatar_template": "/letter_avatar_proxy/v4/letter/w/fbc32d/{size}.png",280 "trust_level": 1281 }282 },283 {284 "extras": null,285 "description": "Frequent Poster",286 "user": {287 "id": 3534,288 "username": "ptrblck",289 "name": "",290 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",291 "admin": true,292 "moderator": true,293 "trust_level": 2294 }295 }296 ]297 },298 {299 "fancy_title": "Yolo model does not propose any targets during training",300 "id": 215083,301 "title": "Yolo model does not propose any targets during training",302 "slug": "yolo-model-does-not-propose-any-targets-during-training",303 "posts_count": 1,304 "reply_count": 0,305 "highest_post_number": 1,306 "image_url": null,307 "created_at": "2025-01-07T22:33:01.101Z",308 "last_posted_at": "2025-01-07T22:33:01.148Z",309 "bumped": true,310 "bumped_at": "2025-01-07T22:33:01.148Z",311 "archetype": "regular",312 "unseen": false,313 "pinned": false,314 "unpinned": null,315 "visible": true,316 "closed": false,317 "archived": false,318 "bookmarked": null,319 "liked": null,320 "tags_descriptions": {},321 "like_count": 0,322 "views": 25,323 "category_id": 5,324 "featured_link": null,325 "has_accepted_answer": false,326 "posters": [327 {328 "extras": "latest single",329 "description": "Original Poster, Most Recent Poster",330 "user": {331 "id": 65718,332 "username": "Sam_Tux",333 "name": "Sam Tux",334 "avatar_template": "/user_avatar/discuss.pytorch.org/sam_tux/{size}/60003_2.png",335 "trust_level": 1336 }337 }338 ]339 },340 {341 "fancy_title": "Fine tuning pretrained RestNet for grayscale image classification",342 "id": 221018,343 "title": "Fine tuning pretrained RestNet for grayscale image classification",344 "slug": "fine-tuning-pretrained-restnet-for-grayscale-image-classification",345 "posts_count": 2,346 "reply_count": 0,347 "highest_post_number": 2,348 "image_url": null,349 "created_at": "2025-06-24T11:03:10.058Z",350 "last_posted_at": "2025-06-25T14:22:46.038Z",351 "bumped": true,352 "bumped_at": "2025-06-25T14:22:46.038Z",353 "archetype": "regular",354 "unseen": false,355 "pinned": false,356 "unpinned": null,357 "visible": true,358 "closed": false,359 "archived": false,360 "bookmarked": null,361 "liked": null,362 "tags_descriptions": {},363 "like_count": 0,364 "views": 70,365 "category_id": 5,366 "featured_link": null,367 "has_accepted_answer": false,368 "posters": [369 {370 "extras": null,371 "description": "Original Poster",372 "user": {373 "id": 84808,374 "username": "abir",375 "name": "",376 "avatar_template": "/user_avatar/discuss.pytorch.org/abir/{size}/77461_2.png",377 "trust_level": 1378 }379 },380 {381 "extras": "latest",382 "description": "Most Recent Poster",383 "user": {384 "id": 3534,385 "username": "ptrblck",386 "name": "",387 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",388 "admin": true,389 "moderator": true,390 "trust_level": 2391 }392 }393 ]394 }395 ],396 "tags_descriptions": {},397 "fancy_title": "Model.load_state_dict(torch.load(args.model_loc)) after using Inception V3 pretrained model",398 "id": 145459,399 "title": "Model.load_state_dict(torch.load(args.model_loc)) after using Inception V3 pretrained model",400 "posts_count": 2,401 "created_at": "2022-03-03T03:43:10.523Z",402 "views": 927,403 "reply_count": 0,404 "like_count": 1,405 "last_posted_at": "2022-03-03T08:17:04.555Z",406 "visible": true,407 "closed": false,408 "archived": false,409 "has_summary": false,410 "archetype": "regular",411 "slug": "model-load-state-dict-torch-load-args-model-loc-after-using-inception-v3-pretrained-model",412 "category_id": 5,413 "word_count": 240,414 "deleted_at": null,415 "user_id": 12408,416 "featured_link": null,417 "pinned_globally": false,418 "pinned_at": null,419 "pinned_until": null,420 "image_url": null,421 "slow_mode_seconds": 0,422 "draft": null,423 "draft_key": "topic_145459",424 "draft_sequence": null,425 "unpinned": null,426 "pinned": false,427 "current_post_number": 1,428 "highest_post_number": 2,429 "deleted_by": null,430 "actions_summary": [431 {432 "id": 4,433 "count": 0,434 "hidden": false,435 "can_act": false436 },437 {438 "id": 8,439 "count": 0,440 "hidden": false,441 "can_act": false442 },443 {444 "id": 10,445 "count": 0,446 "hidden": false,447 "can_act": false448 },449 {450 "id": 7,451 "count": 0,452 "hidden": false,453 "can_act": false454 }455 ],456 "chunk_size": 20,457 "bookmarked": false,458 "topic_timer": null,459 "message_bus_last_id": 0,460 "participant_count": 2,461 "show_read_indicator": false,462 "thumbnails": null,463 "slow_mode_enabled_until": null,464 "accepted_answer": {465 "post_number": 2,466 "username": "ptrblck",467 "name": "",468 "excerpt": "I guess the author of the first code snippet is loading a pretrained state_dict for the manipulated model (note that model.fc is changed)?"469 },470 "can_vote": false,471 "vote_count": 0,472 "user_voted": false,473 "discourse_zendesk_plugin_zendesk_id": null,474 "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",475 "details": {476 "can_edit": false,477 "notification_level": 1,478 "participants": [479 {480 "id": 3534,481 "username": "ptrblck",482 "name": "",483 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",484 "post_count": 1,485 "primary_group_name": null,486 "flair_name": null,487 "flair_url": null,488 "flair_color": null,489 "flair_bg_color": null,490 "flair_group_id": null,491 "admin": true,492 "moderator": true,493 "trust_level": 2494 },495 {496 "id": 12408,497 "username": "Mona_Jalal",498 "name": "Mona Jalal",499 "avatar_template": "/user_avatar/discuss.pytorch.org/mona_jalal/{size}/25715_2.png",500 "post_count": 1,501 "primary_group_name": null,502 "flair_name": null,503 "flair_url": null,504 "flair_color": null,505 "flair_bg_color": null,506 "flair_group_id": null,507 "trust_level": 1508 }509 ],510 "created_by": {511 "id": 12408,512 "username": "Mona_Jalal",513 "name": "Mona Jalal",514 "avatar_template": "/user_avatar/discuss.pytorch.org/mona_jalal/{size}/25715_2.png"515 },516 "last_poster": {517 "id": 3534,518 "username": "ptrblck",519 "name": "",520 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png"521 },522 "links": [523 {524 "url": "https://github.com/arjunvekariyagithub/camelyon16-grand-challenge/blob/660000a79775fbc5cfa8c5b44a591e62ce714089/camelyon16/postprocess/build_heatmap_multi_thread.py",525 "title": "camelyon16-grand-challenge/build_heatmap_multi_thread.py at 660000a79775fbc5cfa8c5b44a591e62ce714089 · arjunvekariyagithub/camelyon16-grand-challenge · GitHub",526 "internal": false,527 "attachment": false,528 "reflection": false,529 "clicks": 2,530 "user_id": 12408,531 "domain": "github.com",532 "root_domain": "github.com"533 },534 {535 "url": "https://github.com/pytorch/vision/blob/main/torchvision/models/inception.py",536 "title": "vision/inception.py at main · pytorch/vision · GitHub",537 "internal": false,538 "attachment": false,539 "reflection": false,540 "clicks": 1,541 "user_id": 12408,542 "domain": "github.com",543 "root_domain": "github.com"544 }545 ]546 },547 "bookmarks": []548 },549 {550 "post_stream": {551 "posts": [552 {553 "id": 334018,554 "name": "Alexan",555 "username": "Klink",556 "avatar_template": "/letter_avatar_proxy/v4/letter/k/ea666f/{size}.png",557 "created_at": "2022-03-02T15:26:02.234Z",558 "cooked": "<p>× python setup.py egg_info did not run successfully.<br>\n│ exit code: 1<br>\n╰─> [11 lines of output]<br>\nTraceback (most recent call last):<br>\nFile “”, line 2, in <br>\nFile “”, line 34, in <br>\nFile “C:\\Users\\USER\\DeepSpeed\\setup.py”, line 138, in <br>\nabort(f\"Unable to pre-compile {op_name}\")<br>\nFile “C:\\Users\\USER\\DeepSpeed\\setup.py”, line 43, in abort<br>\nassert False, msg<br>\nAssertionError: Unable to pre-compile cpu_adam<br>\nDS_BUILD_OPS=1<br>\n[WARNING] One can disable cpu_adam with DS_BUILD_CPU_ADAM=0<br>\n[ERROR] Unable to pre-compile cpu_adam<br>\n[end of output]</p>\n<p>I use windows10 and i installed requirements programs : cuda, cpp build tools, pytorch… etc</p>\n<p>I was looking for many sites to find this error, but there is no data about this error.</p>\n<p>How i can solve this problem?</p>",559 "post_number": 1,560 "post_type": 1,561 "posts_count": 3,562 "updated_at": "2022-03-02T15:26:02.234Z",563 "reply_count": 0,564 "reply_to_post_number": null,565 "quote_count": 0,566 "incoming_link_count": 2713,567 "reads": 15,568 "readers_count": 14,569 "score": 13563.0,570 "yours": false,571 "topic_id": 145412,572 "topic_slug": "cant-install-deepspeed",573 "display_username": "Alexan",574 "primary_group_name": null,575 "flair_name": null,576 "flair_url": null,577 "flair_bg_color": null,578 "flair_color": null,579 "flair_group_id": null,580 "badges_granted": [],581 "version": 1,582 "can_edit": false,583 "can_delete": false,584 "can_recover": false,585 "can_see_hidden_post": false,586 "can_wiki": false,587 "read": true,588 "user_title": null,589 "bookmarked": false,590 "actions_summary": [],591 "moderator": false,592 "admin": false,593 "staff": false,594 "user_id": 53566,595 "hidden": false,596 "trust_level": 1,597 "deleted_at": null,598 "user_deleted": false,599 "edit_reason": null,600 "can_view_edit_history": true,601 "wiki": false,602 "post_url": "/t/cant-install-deepspeed/145412/1",603 "can_accept_answer": false,604 "can_unaccept_answer": false,605 "accepted_answer": false,606 "topic_accepted_answer": null,607 "can_vote": false608 },609 {610 "id": 334151,611 "name": "",612 "username": "ptrblck",613 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",614 "created_at": "2022-03-03T07:50:21.699Z",615 "cooked": "<p>The error seems to be raised by <code>cpu_adam</code>. Did you try to disable it as suggested in the warning?</p>\n<pre><code class=\"lang-python\">[WARNING] One can disable cpu_adam with DS_BUILD_CPU_ADAM=0\n[ERROR] Unable to pre-compile cpu_adam\n</code></pre>",616 "post_number": 2,617 "post_type": 1,618 "posts_count": 3,619 "updated_at": "2022-03-03T07:50:21.699Z",620 "reply_count": 1,621 "reply_to_post_number": null,622 "quote_count": 0,623 "incoming_link_count": 11,624 "reads": 14,625 "readers_count": 13,626 "score": 62.8,627 "yours": false,628 "topic_id": 145412,629 "topic_slug": "cant-install-deepspeed",630 "display_username": "",631 "primary_group_name": null,632 "flair_name": null,633 "flair_url": null,634 "flair_bg_color": null,635 "flair_color": null,636 "flair_group_id": null,637 "badges_granted": [],638 "version": 1,639 "can_edit": false,640 "can_delete": false,641 "can_recover": false,642 "can_see_hidden_post": false,643 "can_wiki": false,644 "read": true,645 "user_title": "",646 "bookmarked": false,647 "actions_summary": [],648 "moderator": true,649 "admin": true,650 "staff": true,651 "user_id": 3534,652 "hidden": false,653 "trust_level": 2,654 "deleted_at": null,655 "user_deleted": false,656 "edit_reason": null,657 "can_view_edit_history": true,658 "wiki": false,659 "post_url": "/t/cant-install-deepspeed/145412/2",660 "can_accept_answer": false,661 "can_unaccept_answer": false,662 "accepted_answer": false,663 "topic_accepted_answer": null664 },665 {666 "id": 334155,667 "name": "Alexan",668 "username": "Klink",669 "avatar_template": "/letter_avatar_proxy/v4/letter/k/ea666f/{size}.png",670 "created_at": "2022-03-03T08:03:29.639Z",671 "cooked": "<p>I tried to disable CPU_ADAM.<br>\nBut it called next compile error, CPUAdagrad/FusedAdam/FusedLamb that imported in op_builder folder.</p>",672 "post_number": 3,673 "post_type": 1,674 "posts_count": 3,675 "updated_at": "2022-03-03T08:03:29.639Z",676 "reply_count": 0,677 "reply_to_post_number": 2,678 "quote_count": 0,679 "incoming_link_count": 60,680 "reads": 12,681 "readers_count": 11,682 "score": 302.4,683 "yours": false,684 "topic_id": 145412,685 "topic_slug": "cant-install-deepspeed",686 "display_username": "Alexan",687 "primary_group_name": null,688 "flair_name": null,689 "flair_url": null,690 "flair_bg_color": null,691 "flair_color": null,692 "flair_group_id": null,693 "badges_granted": [],694 "version": 1,695 "can_edit": false,696 "can_delete": false,697 "can_recover": false,698 "can_see_hidden_post": false,699 "can_wiki": false,700 "read": true,701 "user_title": null,702 "reply_to_user": {703 "id": 3534,704 "username": "ptrblck",705 "name": "",706 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png"707 },708 "bookmarked": false,709 "actions_summary": [],710 "moderator": false,711 "admin": false,712 "staff": false,713 "user_id": 53566,714 "hidden": false,715 "trust_level": 1,716 "deleted_at": null,717 "user_deleted": false,718 "edit_reason": null,719 "can_view_edit_history": true,720 "wiki": false,721 "post_url": "/t/cant-install-deepspeed/145412/3",722 "can_accept_answer": false,723 "can_unaccept_answer": false,724 "accepted_answer": false,725 "topic_accepted_answer": null726 }727 ],728 "stream": [729 334018,730 334151,731 334155732 ]733 },734 "timeline_lookup": [735 [736 1,737 1333738 ]739 ],740 "suggested_topics": [741 {742 "fancy_title": "TensorRT: Errors in PTQ Example",743 "id": 215386,744 "title": "TensorRT: Errors in PTQ Example",745 "slug": "tensorrt-errors-in-ptq-example",746 "posts_count": 4,747 "reply_count": 0,748 "highest_post_number": 4,749 "image_url": null,750 "created_at": "2025-01-14T17:41:05.390Z",751 "last_posted_at": "2025-01-21T11:58:15.063Z",752 "bumped": true,753 "bumped_at": "2025-01-21T11:58:15.063Z",754 "archetype": "regular",755 "unseen": false,756 "pinned": false,757 "unpinned": null,758 "visible": true,759 "closed": false,760 "archived": false,761 "bookmarked": null,762 "liked": null,763 "tags_descriptions": {},764 "like_count": 0,765 "views": 365,766 "category_id": 1,767 "featured_link": null,768 "has_accepted_answer": true,769 "posters": [770 {771 "extras": "latest",772 "description": "Original Poster, Most Recent Poster",773 "user": {774 "id": 82089,775 "username": "Tim_Langer",776 "name": "Tim Langer",777 "avatar_template": "/user_avatar/discuss.pytorch.org/tim_langer/{size}/75104_2.png",778 "trust_level": 1779 }780 },781 {782 "extras": null,783 "description": "Frequent Poster, Accepted Answer",784 "user": {785 "id": 50592,786 "username": "narendasan",787 "name": "Naren Dasan",788 "avatar_template": "/user_avatar/discuss.pytorch.org/narendasan/{size}/44133_2.png",789 "trust_level": 1790 }791 },792 {793 "extras": null,794 "description": "Frequent Poster",795 "user": {796 "id": 3534,797 "username": "ptrblck",798 "name": "",799 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",800 "admin": true,801 "moderator": true,802 "trust_level": 2803 }804 }805 ]806 },807 {808 "fancy_title": "Multi-GPU training with training loop that can skip backpropagation",809 "id": 212952,810 "title": "Multi-GPU training with training loop that can skip backpropagation",811 "slug": "multi-gpu-training-with-training-loop-that-can-skip-backpropagation",812 "posts_count": 1,813 "reply_count": 0,814 "highest_post_number": 1,815 "image_url": null,816 "created_at": "2024-11-13T21:25:25.877Z",817 "last_posted_at": "2024-11-13T21:25:25.925Z",818 "bumped": true,819 "bumped_at": "2024-11-13T21:25:25.925Z",820 "archetype": "regular",821 "unseen": false,822 "pinned": false,823 "unpinned": null,824 "visible": true,825 "closed": false,826 "archived": false,827 "bookmarked": null,828 "liked": null,829 "tags_descriptions": {},830 "like_count": 0,831 "views": 99,832 "category_id": 1,833 "featured_link": null,834 "has_accepted_answer": false,835 "posters": [836 {837 "extras": "latest single",838 "description": "Original Poster, Most Recent Poster",839 "user": {840 "id": 71944,841 "username": "RomStriker",842 "name": "Roman",843 "avatar_template": "/user_avatar/discuss.pytorch.org/romstriker/{size}/66440_2.png",844 "trust_level": 1845 }846 }847 ]848 },849 {850 "fancy_title": "No CUDA 12.4 distribution for Linux when using pip?",851 "id": 213783,852 "title": "No CUDA 12.4 distribution for Linux when using pip?",853 "slug": "no-cuda-12-4-distribution-for-linux-when-using-pip",854 "posts_count": 5,855 "reply_count": 2,856 "highest_post_number": 5,857 "image_url": "https://discuss.pytorch.org/uploads/default/original/3X/d/2/d222135c692d3df71abaf45fd1709ced8159e8bd.png",858 "created_at": "2024-12-04T06:31:14.083Z",859 "last_posted_at": "2024-12-04T13:29:00.235Z",860 "bumped": true,861 "bumped_at": "2024-12-04T13:29:00.235Z",862 "archetype": "regular",863 "unseen": false,864 "pinned": false,865 "unpinned": null,866 "visible": true,867 "closed": false,868 "archived": false,869 "bookmarked": null,870 "liked": null,871 "tags_descriptions": {},872 "like_count": 4,873 "views": 209,874 "category_id": 1,875 "featured_link": null,876 "has_accepted_answer": true,877 "posters": [878 {879 "extras": null,880 "description": "Original Poster",881 "user": {882 "id": 81293,883 "username": "jhj0517",884 "name": "jhj0517",885 "avatar_template": "/user_avatar/discuss.pytorch.org/jhj0517/{size}/74344_2.png",886 "trust_level": 0887 }888 },889 {890 "extras": "latest",891 "description": "Most Recent Poster, Accepted Answer",892 "user": {893 "id": 3534,894 "username": "ptrblck",895 "name": "",896 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",897 "admin": true,898 "moderator": true,899 "trust_level": 2900 }901 },902 {903 "extras": null,904 "description": "Frequent Poster",905 "user": {906 "id": 81089,907 "username": "Aknw_Fen",908 "name": "Aknw Fen",909 "avatar_template": "/user_avatar/discuss.pytorch.org/aknw_fen/{size}/74156_2.png",910 "trust_level": 2911 }912 }913 ]914 },915 {916 "fancy_title": "Event Based Vision Data to regress rotation matrix with ConvGRU Architecture but Model isn’t able to learn the data",917 "id": 215276,918 "title": "Event Based Vision Data to regress rotation matrix with ConvGRU Architecture but Model isn't able to learn the data",919 "slug": "event-based-vision-data-to-regress-rotation-matrix-with-convgru-architecture-but-model-isnt-able-to-learn-the-data",920 "posts_count": 1,921 "reply_count": 0,922 "highest_post_number": 1,923 "image_url": "https://discuss.pytorch.org/uploads/default/optimized/3X/2/4/2480f7b0b6a301c0eddb7e8acc42e6ac92444e36_2_1024x538.jpeg",924 "created_at": "2025-01-11T19:43:49.805Z",925 "last_posted_at": "2025-01-11T19:43:49.848Z",926 "bumped": true,927 "bumped_at": "2025-01-11T19:43:49.848Z",928 "archetype": "regular",929 "unseen": false,930 "pinned": false,931 "unpinned": null,932 "visible": true,933 "closed": false,934 "archived": false,935 "bookmarked": null,936 "liked": null,937 "tags_descriptions": {},938 "like_count": 0,939 "views": 21,940 "category_id": 1,941 "featured_link": null,942 "has_accepted_answer": false,943 "posters": [944 {945 "extras": "latest single",946 "description": "Original Poster, Most Recent Poster",947 "user": {948 "id": 82026,949 "username": "MXS01",950 "name": "",951 "avatar_template": "/letter_avatar_proxy/v4/letter/m/ce73a5/{size}.png",952 "trust_level": 1953 }954 }955 ]956 },957 {958 "fancy_title": "CUDA not available",959 "id": 215422,960 "title": "CUDA not available",961 "slug": "cuda-not-available",962 "posts_count": 8,963 "reply_count": 6,964 "highest_post_number": 8,965 "image_url": null,966 "created_at": "2025-01-15T13:11:20.130Z",967 "last_posted_at": "2025-01-16T16:46:47.831Z",968 "bumped": true,969 "bumped_at": "2025-01-16T16:46:47.831Z",970 "archetype": "regular",971 "unseen": false,972 "pinned": false,973 "unpinned": null,974 "visible": true,975 "closed": false,976 "archived": false,977 "bookmarked": null,978 "liked": null,979 "tags_descriptions": {},980 "like_count": 0,981 "views": 1418,982 "category_id": 1,983 "featured_link": null,984 "has_accepted_answer": true,985 "posters": [986 {987 "extras": null,988 "description": "Original Poster",989 "user": {990 "id": 46535,991 "username": "MoRoBe",992 "name": "",993 "avatar_template": "/user_avatar/discuss.pytorch.org/morobe/{size}/39577_2.png",994 "trust_level": 1995 }996 },997 {998 "extras": "latest",999 "description": "Most Recent Poster, Accepted Answer",1000 "user": {1001 "id": 18088,1002 "username": "KFrank",1003 "name": "K. Frank",1004 "avatar_template": "/letter_avatar_proxy/v4/letter/k/ecb155/{size}.png",1005 "trust_level": 21006 }1007 },1008 {1009 "extras": null,1010 "description": "Frequent Poster",1011 "user": {1012 "id": 3534,1013 "username": "ptrblck",1014 "name": "",1015 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",1016 "admin": true,1017 "moderator": true,1018 "trust_level": 21019 }1020 }1021 ]1022 }1023 ],1024 "tags_descriptions": {},1025 "fancy_title": "Can’t install deepspeed",1026 "id": 145412,1027 "title": "Can't install deepspeed",1028 "posts_count": 3,1029 "created_at": "2022-03-02T15:26:02.181Z",1030 "views": 4140,1031 "reply_count": 1,1032 "like_count": 0,1033 "last_posted_at": "2022-03-03T08:03:29.639Z",1034 "visible": true,1035 "closed": false,1036 "archived": false,1037 "has_summary": false,1038 "archetype": "regular",1039 "slug": "cant-install-deepspeed",1040 "category_id": 1,1041 "word_count": 182,1042 "deleted_at": null,1043 "user_id": 53566,1044 "featured_link": null,1045 "pinned_globally": false,1046 "pinned_at": null,1047 "pinned_until": null,1048 "image_url": null,1049 "slow_mode_seconds": 0,1050 "draft": null,1051 "draft_key": "topic_145412",1052 "draft_sequence": null,1053 "unpinned": null,1054 "pinned": false,1055 "current_post_number": 1,1056 "highest_post_number": 3,1057 "deleted_by": null,1058 "actions_summary": [1059 {1060 "id": 4,1061 "count": 0,1062 "hidden": false,1063 "can_act": false1064 },1065 {1066 "id": 8,1067 "count": 0,1068 "hidden": false,1069 "can_act": false1070 },1071 {1072 "id": 10,1073 "count": 0,1074 "hidden": false,1075 "can_act": false1076 },1077 {1078 "id": 7,1079 "count": 0,1080 "hidden": false,1081 "can_act": false1082 }1083 ],1084 "chunk_size": 20,1085 "bookmarked": false,1086 "topic_timer": null,1087 "message_bus_last_id": 0,1088 "participant_count": 2,1089 "show_read_indicator": false,1090 "thumbnails": null,1091 "slow_mode_enabled_until": null,1092 "can_vote": false,1093 "vote_count": 0,1094 "user_voted": false,1095 "discourse_zendesk_plugin_zendesk_id": null,1096 "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",1097 "details": {1098 "can_edit": false,1099 "notification_level": 1,1100 "participants": [1101 {1102 "id": 53566,1103 "username": "Klink",1104 "name": "Alexan",1105 "avatar_template": "/letter_avatar_proxy/v4/letter/k/ea666f/{size}.png",1106 "post_count": 2,1107 "primary_group_name": null,1108 "flair_name": null,1109 "flair_url": null,1110 "flair_color": null,1111 "flair_bg_color": null,1112 "flair_group_id": null,1113 "trust_level": 11114 },1115 {1116 "id": 3534,1117 "username": "ptrblck",1118 "name": "",1119 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",1120 "post_count": 1,1121 "primary_group_name": null,1122 "flair_name": null,1123 "flair_url": null,1124 "flair_color": null,1125 "flair_bg_color": null,1126 "flair_group_id": null,1127 "admin": true,1128 "moderator": true,1129 "trust_level": 21130 }1131 ],1132 "created_by": {1133 "id": 53566,1134 "username": "Klink",1135 "name": "Alexan",1136 "avatar_template": "/letter_avatar_proxy/v4/letter/k/ea666f/{size}.png"1137 },1138 "last_poster": {1139 "id": 53566,1140 "username": "Klink",1141 "name": "Alexan",1142 "avatar_template": "/letter_avatar_proxy/v4/letter/k/ea666f/{size}.png"1143 }1144 },1145 "bookmarks": []1146 },1147 {1148 "post_stream": {1149 "posts": [1150 {1151 "id": 334037,1152 "name": "Honnang",1153 "username": "Honnang",1154 "avatar_template": "/user_avatar/discuss.pytorch.org/honnang/{size}/42769_2.png",1155 "created_at": "2022-03-02T17:48:23.734Z",1156 "cooked": "<p>I am trying to create a custom parameter as a scale factor to resize the tensor via bilinear interpolation</p>\n<p>self.scl = nn.Parameter(torch.tensor(0.5, requires_grad=True))</p>\n<pre><code>def forward(self, inx):\n x = self.lrelu(self.part1_PW(inx))\n x0 = x\n #==========\n b, c, h, w = x.shape\n\n scl = self.scl.item()\n scl = round(scl, 1)\n #print(scl)\n if scl == 0:\n scl = 1.0\n elif scl <0:\n if scl > -1:\n scl = scl*(-1.0)\n else:\n scl = 1.0\n else:\n if scl > 1:\n scl = 1.0\n\n downscale = nn.Upsample(size=(int(h * scl), int(w * scl)), mode='bilinear', align_corners=False)\n</code></pre>\n<p>But when I checked, I realized the weights aren’t updating<br>\nis the problem from the fact that I didn’t use the weights on the input tensors?</p>",1157 "post_number": 1,1158 "post_type": 1,1159 "posts_count": 2,1160 "updated_at": "2022-03-02T17:48:23.734Z",1161 "reply_count": 0,1162 "reply_to_post_number": null,1163 "quote_count": 0,1164 "incoming_link_count": 98,1165 "reads": 13,1166 "readers_count": 12,1167 "score": 492.6,1168 "yours": false,1169 "topic_id": 145422,1170 "topic_slug": "custom-parameter-not-updating-weights",1171 "display_username": "Honnang",1172 "primary_group_name": null,1173 "flair_name": null,1174 "flair_url": null,1175 "flair_bg_color": null,1176 "flair_color": null,1177 "flair_group_id": null,1178 "badges_granted": [],1179 "version": 1,1180 "can_edit": false,1181 "can_delete": false,1182 "can_recover": false,1183 "can_see_hidden_post": false,1184 "can_wiki": false,1185 "read": true,1186 "user_title": null,1187 "bookmarked": false,1188 "actions_summary": [],1189 "moderator": false,1190 "admin": false,1191 "staff": false,1192 "user_id": 49553,1193 "hidden": false,1194 "trust_level": 1,1195 "deleted_at": null,1196 "user_deleted": false,1197 "edit_reason": null,1198 "can_view_edit_history": true,1199 "wiki": false,1200 "post_url": "/t/custom-parameter-not-updating-weights/145422/1",