Anurag1734/cuda-error-resolution-analysis
07
1[2 {3 "post_stream": {4 "posts": [5 {6 "id": 441956,7 "name": "Seungjun",8 "username": "Seungjun99",9 "avatar_template": "/letter_avatar_proxy/v4/letter/s/b38774/{size}.png",10 "created_at": "2024-05-09T07:25:59.240Z",11 "cooked": "<p>Hi, I just started studying pytorch recently, and want to train a model with multi GPUs, so tried an example using DataParallel.</p>\n<p>But after the model is assigned to GPUs, the training does not proceed.<br>\n<div class=\"lightbox-wrapper\"><a class=\"lightbox\" href=\"https://discuss.pytorch.org/uploads/default/original/3X/d/3/d3389115b534606419bd0ba6cb5138a3a68debb9.png\" data-download-href=\"https://discuss.pytorch.org/uploads/default/d3389115b534606419bd0ba6cb5138a3a68debb9\" title=\"image\"><img src=\"https://discuss.pytorch.org/uploads/default/original/3X/d/3/d3389115b534606419bd0ba6cb5138a3a68debb9.png\" alt=\"image\" data-base62-sha1=\"u8xWh8e9RNgU5l33OPjXflG3MIF\" width=\"500\" height=\"500\" data-dominant-color=\"292929\"><div class=\"meta\"><svg class=\"fa d-icon d-icon-far-image svg-icon\" aria-hidden=\"true\"><use href=\"#far-image\"></use></svg><span class=\"filename\">image</span><span class=\"informations\">646×646 21.2 KB</span><svg class=\"fa d-icon d-icon-discourse-expand svg-icon\" aria-hidden=\"true\"><use href=\"#discourse-expand\"></use></svg></div></a></div><br>\nI have 8 GTX 1080Ti GPUs.</p>\n<p>This is the example I tried.<br>\n<a href=\"https://github.com/chi0tzp/pytorch-dataparallel-example/blob/master/main.py\" rel=\"noopener nofollow ugc\">Example</a></p><aside class=\"onebox githubblob\" data-onebox-src=\"https://github.com/chi0tzp/pytorch-dataparallel-example/blob/master/main.py\">\n <header class=\"source\">\n\n <a href=\"https://github.com/chi0tzp/pytorch-dataparallel-example/blob/master/main.py\" target=\"_blank\" rel=\"noopener nofollow ugc\">github.com</a>\n </header>\n\n <article class=\"onebox-body\">\n <h4><a href=\"https://github.com/chi0tzp/pytorch-dataparallel-example/blob/master/main.py\" target=\"_blank\" rel=\"noopener nofollow ugc\">chi0tzp/pytorch-dataparallel-example/blob/master/main.py</a></h4>\n\n\n <pre><code class=\"lang-py\">import torch\nimport torch.nn as nn\nimport torch.optim as optim\nfrom torch.autograd import Variable\nfrom torch.utils.data import Dataset, DataLoader\n\n\nclass RandomDataset(Dataset):\n def __init__(self, size, length):\n self.len = length\n self.data = torch.randn(length, size)\n\n def __getitem__(self, index):\n return self.data[index]\n\n def __len__(self):\n return self.len\n\n\nclass Model(nn.Module):\n</code></pre>\n\n\n\n This file has been truncated. <a href=\"https://github.com/chi0tzp/pytorch-dataparallel-example/blob/master/main.py\" target=\"_blank\" rel=\"noopener nofollow ugc\">show original</a>\n\n </article>\n\n <div class=\"onebox-metadata\">\n \n \n </div>\n\n <div style=\"clear: both\"></div>\n</aside>\n\n<p>I got <em><strong>Let’s use 8 GPUs!</strong></em> message but no more output.</p>\n<pre><code class=\"lang-auto\">python test.py\nLet's use 8 GPUs!\n\n</code></pre>\n<p>This is my torch version.</p>\n<pre><code class=\"lang-auto\">pip show torch\nName: torch\nVersion: 2.2.2+cu118\n\n</code></pre>\n<p>Is there anything else I need to configure to use DataParallel?</p>",12 "post_number": 1,13 "post_type": 1,14 "posts_count": 1,15 "updated_at": "2024-05-09T07:25:59.240Z",16 "reply_count": 0,17 "reply_to_post_number": null,18 "quote_count": 0,19 "incoming_link_count": 14,20 "reads": 3,21 "readers_count": 2,22 "score": 70.6,23 "yours": false,24 "topic_id": 202409,25 "topic_slug": "problems-using-dataparallel",26 "display_username": "Seungjun",27 "primary_group_name": null,28 "flair_name": null,29 "flair_url": null,30 "flair_bg_color": null,31 "flair_color": null,32 "flair_group_id": null,33 "badges_granted": [],34 "version": 1,35 "can_edit": false,36 "can_delete": false,37 "can_recover": false,38 "can_see_hidden_post": false,39 "can_wiki": false,40 "link_counts": [41 {42 "url": "https://github.com/chi0tzp/pytorch-dataparallel-example/blob/master/main.py",43 "internal": false,44 "reflection": false,45 "title": "pytorch-dataparallel-example/main.py at master · chi0tzp/pytorch-dataparallel-example · GitHub",46 "clicks": 347 },48 {49 "url": "https://discuss.pytorch.org/uploads/default/original/3X/d/3/d3389115b534606419bd0ba6cb5138a3a68debb9.png",50 "internal": true,51 "reflection": false,52 "clicks": 053 }54 ],55 "read": true,56 "user_title": null,57 "bookmarked": false,58 "actions_summary": [],59 "moderator": false,60 "admin": false,61 "staff": false,62 "user_id": 75669,63 "hidden": false,64 "trust_level": 1,65 "deleted_at": null,66 "user_deleted": false,67 "edit_reason": null,68 "can_view_edit_history": true,69 "wiki": false,70 "post_url": "/t/problems-using-dataparallel/202409/1",71 "can_accept_answer": false,72 "can_unaccept_answer": false,73 "accepted_answer": false,74 "topic_accepted_answer": null,75 "can_vote": false76 }77 ],78 "stream": [79 44195680 ]81 },82 "timeline_lookup": [83 [84 1,85 53486 ]87 ],88 "suggested_topics": [89 {90 "fancy_title": "How to approach a real-life problem while using rainfall data",91 "id": 212728,92 "title": "How to approach a real-life problem while using rainfall data",93 "slug": "how-to-approach-a-real-life-problem-while-using-rainfall-data",94 "posts_count": 1,95 "reply_count": 0,96 "highest_post_number": 1,97 "image_url": null,98 "created_at": "2024-11-09T07:21:57.841Z",99 "last_posted_at": "2024-11-09T07:21:57.888Z",100 "bumped": true,101 "bumped_at": "2024-11-09T07:21:57.888Z",102 "archetype": "regular",103 "unseen": false,104 "pinned": false,105 "unpinned": null,106 "visible": true,107 "closed": false,108 "archived": false,109 "bookmarked": null,110 "liked": null,111 "tags_descriptions": {},112 "like_count": 0,113 "views": 25,114 "category_id": 1,115 "featured_link": null,116 "has_accepted_answer": false,117 "posters": [118 {119 "extras": "latest single",120 "description": "Original Poster, Most Recent Poster",121 "user": {122 "id": 80781,123 "username": "Ritam_Pradhan",124 "name": "Ritam Pradhan",125 "avatar_template": "/user_avatar/discuss.pytorch.org/ritam_pradhan/{size}/73876_2.png",126 "trust_level": 1127 }128 }129 ]130 },131 {132 "fancy_title": "Gradient of dot product for every index pair",133 "id": 214882,134 "title": "Gradient of dot product for every index pair",135 "slug": "gradient-of-dot-product-for-every-index-pair",136 "posts_count": 2,137 "reply_count": 0,138 "highest_post_number": 2,139 "image_url": null,140 "created_at": "2025-01-02T10:31:28.366Z",141 "last_posted_at": "2025-01-02T15:55:25.964Z",142 "bumped": true,143 "bumped_at": "2025-01-02T15:55:25.964Z",144 "archetype": "regular",145 "unseen": false,146 "pinned": false,147 "unpinned": null,148 "visible": true,149 "closed": false,150 "archived": false,151 "bookmarked": null,152 "liked": null,153 "tags_descriptions": {},154 "like_count": 0,155 "views": 166,156 "category_id": 1,157 "featured_link": null,158 "has_accepted_answer": false,159 "posters": [160 {161 "extras": null,162 "description": "Original Poster",163 "user": {164 "id": 72757,165 "username": "sherlock.h",166 "name": "",167 "avatar_template": "/user_avatar/discuss.pytorch.org/sherlock.h/{size}/62377_2.png",168 "trust_level": 1169 }170 },171 {172 "extras": "latest",173 "description": "Most Recent Poster",174 "user": {175 "id": 41396,176 "username": "soulitzer",177 "name": "",178 "avatar_template": "/letter_avatar_proxy/v4/letter/s/839c29/{size}.png",179 "trust_level": 2180 }181 }182 ]183 },184 {185 "fancy_title": "Checking termination condition is exceptionally slow",186 "id": 214324,187 "title": "Checking termination condition is exceptionally slow",188 "slug": "checking-termination-condition-is-exceptionally-slow",189 "posts_count": 3,190 "reply_count": 1,191 "highest_post_number": 3,192 "image_url": null,193 "created_at": "2024-12-17T16:53:47.241Z",194 "last_posted_at": "2024-12-18T08:55:09.146Z",195 "bumped": true,196 "bumped_at": "2024-12-18T08:55:09.146Z",197 "archetype": "regular",198 "unseen": false,199 "pinned": false,200 "unpinned": null,201 "visible": true,202 "closed": false,203 "archived": false,204 "bookmarked": null,205 "liked": null,206 "tags_descriptions": {},207 "like_count": 1,208 "views": 218,209 "category_id": 1,210 "featured_link": null,211 "has_accepted_answer": false,212 "posters": [213 {214 "extras": "latest",215 "description": "Original Poster, Most Recent Poster",216 "user": {217 "id": 81163,218 "username": "ViktorAJStein",219 "name": "Viktor AJ Stein",220 "avatar_template": "/letter_avatar_proxy/v4/letter/v/47e85d/{size}.png",221 "trust_level": 0222 }223 },224 {225 "extras": null,226 "description": "Frequent Poster",227 "user": {228 "id": 3534,229 "username": "ptrblck",230 "name": "",231 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",232 "admin": true,233 "moderator": true,234 "trust_level": 2235 }236 }237 ]238 },239 {240 "fancy_title": "Replace torch.rfft() code (PyTorch 1.6)",241 "id": 216169,242 "title": "Replace torch.rfft() code (PyTorch 1.6)",243 "slug": "replace-torch-rfft-code-pytorch-1-6",244 "posts_count": 3,245 "reply_count": 0,246 "highest_post_number": 3,247 "image_url": null,248 "created_at": "2025-02-03T09:19:15.576Z",249 "last_posted_at": "2025-02-03T15:14:25.123Z",250 "bumped": true,251 "bumped_at": "2025-02-03T15:14:25.123Z",252 "archetype": "regular",253 "unseen": false,254 "pinned": false,255 "unpinned": null,256 "visible": true,257 "closed": false,258 "archived": false,259 "bookmarked": null,260 "liked": null,261 "tags_descriptions": {},262 "like_count": 0,263 "views": 274,264 "category_id": 1,265 "featured_link": null,266 "has_accepted_answer": true,267 "posters": [268 {269 "extras": null,270 "description": "Original Poster, Accepted Answer",271 "user": {272 "id": 36526,273 "username": "ptrch_c_m",274 "name": null,275 "avatar_template": "/letter_avatar_proxy/v4/letter/p/e274bd/{size}.png",276 "trust_level": 1277 }278 },279 {280 "extras": "latest",281 "description": "Most Recent Poster",282 "user": {283 "id": 19553,284 "username": "anantguptadbl",285 "name": "Anant Gupta",286 "avatar_template": "/user_avatar/discuss.pytorch.org/anantguptadbl/{size}/17784_2.png",287 "trust_level": 2288 }289 }290 ]291 },292 {293 "fancy_title": "Sub results different for tensor shape 1 and 32",294 "id": 216857,295 "title": "Sub results different for tensor shape 1 and 32",296 "slug": "sub-results-different-for-tensor-shape-1-and-32",297 "posts_count": 4,298 "reply_count": 2,299 "highest_post_number": 4,300 "image_url": null,301 "created_at": "2025-02-19T04:28:38.729Z",302 "last_posted_at": "2025-02-19T14:05:59.321Z",303 "bumped": true,304 "bumped_at": "2025-02-19T14:05:59.321Z",305 "archetype": "regular",306 "unseen": false,307 "pinned": false,308 "unpinned": null,309 "visible": true,310 "closed": false,311 "archived": false,312 "bookmarked": null,313 "liked": null,314 "tags_descriptions": {},315 "like_count": 0,316 "views": 45,317 "category_id": 1,318 "featured_link": null,319 "has_accepted_answer": false,320 "posters": [321 {322 "extras": null,323 "description": "Original Poster",324 "user": {325 "id": 82776,326 "username": "guneshwors",327 "name": "",328 "avatar_template": "/letter_avatar_proxy/v4/letter/g/df705f/{size}.png",329 "trust_level": 1330 }331 },332 {333 "extras": "latest",334 "description": "Most Recent Poster",335 "user": {336 "id": 3534,337 "username": "ptrblck",338 "name": "",339 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",340 "admin": true,341 "moderator": true,342 "trust_level": 2343 }344 }345 ]346 }347 ],348 "tags_descriptions": {},349 "fancy_title": "Problems using DataParallel",350 "id": 202409,351 "title": "Problems using DataParallel",352 "posts_count": 1,353 "created_at": "2024-05-09T07:25:58.912Z",354 "views": 190,355 "reply_count": 0,356 "like_count": 0,357 "last_posted_at": "2024-05-09T07:25:59.240Z",358 "visible": true,359 "closed": false,360 "archived": false,361 "has_summary": false,362 "archetype": "regular",363 "slug": "problems-using-dataparallel",364 "category_id": 1,365 "word_count": 121,366 "deleted_at": null,367 "user_id": 75669,368 "featured_link": null,369 "pinned_globally": false,370 "pinned_at": null,371 "pinned_until": null,372 "image_url": "https://discuss.pytorch.org/uploads/default/original/3X/d/3/d3389115b534606419bd0ba6cb5138a3a68debb9.png",373 "slow_mode_seconds": 0,374 "draft": null,375 "draft_key": "topic_202409",376 "draft_sequence": null,377 "unpinned": null,378 "pinned": false,379 "current_post_number": 1,380 "highest_post_number": 1,381 "deleted_by": null,382 "actions_summary": [383 {384 "id": 4,385 "count": 0,386 "hidden": false,387 "can_act": false388 },389 {390 "id": 8,391 "count": 0,392 "hidden": false,393 "can_act": false394 },395 {396 "id": 10,397 "count": 0,398 "hidden": false,399 "can_act": false400 },401 {402 "id": 7,403 "count": 0,404 "hidden": false,405 "can_act": false406 }407 ],408 "chunk_size": 20,409 "bookmarked": false,410 "topic_timer": null,411 "message_bus_last_id": 0,412 "participant_count": 1,413 "show_read_indicator": false,414 "thumbnails": [415 {416 "max_width": null,417 "max_height": null,418 "width": 646,419 "height": 646,420 "url": "https://discuss.pytorch.org/uploads/default/original/3X/d/3/d3389115b534606419bd0ba6cb5138a3a68debb9.png"421 }422 ],423 "slow_mode_enabled_until": null,424 "can_vote": false,425 "vote_count": 0,426 "user_voted": false,427 "discourse_zendesk_plugin_zendesk_id": null,428 "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",429 "details": {430 "can_edit": false,431 "notification_level": 1,432 "participants": [433 {434 "id": 75669,435 "username": "Seungjun99",436 "name": "Seungjun",437 "avatar_template": "/letter_avatar_proxy/v4/letter/s/b38774/{size}.png",438 "post_count": 1,439 "primary_group_name": null,440 "flair_name": null,441 "flair_url": null,442 "flair_color": null,443 "flair_bg_color": null,444 "flair_group_id": null,445 "trust_level": 1446 }447 ],448 "created_by": {449 "id": 75669,450 "username": "Seungjun99",451 "name": "Seungjun",452 "avatar_template": "/letter_avatar_proxy/v4/letter/s/b38774/{size}.png"453 },454 "last_poster": {455 "id": 75669,456 "username": "Seungjun99",457 "name": "Seungjun",458 "avatar_template": "/letter_avatar_proxy/v4/letter/s/b38774/{size}.png"459 },460 "links": [461 {462 "url": "https://github.com/chi0tzp/pytorch-dataparallel-example/blob/master/main.py",463 "title": "pytorch-dataparallel-example/main.py at master · chi0tzp/pytorch-dataparallel-example · GitHub",464 "internal": false,465 "attachment": false,466 "reflection": false,467 "clicks": 3,468 "user_id": 75669,469 "domain": "github.com",470 "root_domain": "github.com"471 }472 ]473 },474 "bookmarks": []475 },476 {477 "post_stream": {478 "posts": [479 {480 "id": 441894,481 "name": "Woongjun Choi",482 "username": "woongjoonchoi",483 "avatar_template": "/user_avatar/discuss.pytorch.org/woongjoonchoi/{size}/67075_2.png",484 "created_at": "2024-05-08T18:10:06.909Z",485 "cooked": "<p>I would like to try multi-GPU training, but I wonder if I can get good results without understanding synchronization and concurrency.</p>",486 "post_number": 1,487 "post_type": 1,488 "posts_count": 3,489 "updated_at": "2024-05-08T18:10:06.909Z",490 "reply_count": 0,491 "reply_to_post_number": null,492 "quote_count": 0,493 "incoming_link_count": 12,494 "reads": 7,495 "readers_count": 6,496 "score": 61.4,497 "yours": false,498 "topic_id": 202381,499 "topic_slug": "is-the-concurrency-and-synchronization-knowledge-learned-in-the-operating-system-course-quite-essential-for-deep-learning-model-training-or-inference",500 "display_username": "Woongjun Choi",501 "primary_group_name": null,502 "flair_name": null,503 "flair_url": null,504 "flair_bg_color": null,505 "flair_color": null,506 "flair_group_id": null,507 "badges_granted": [],508 "version": 1,509 "can_edit": false,510 "can_delete": false,511 "can_recover": false,512 "can_see_hidden_post": false,513 "can_wiki": false,514 "read": true,515 "user_title": null,516 "bookmarked": false,517 "actions_summary": [],518 "moderator": false,519 "admin": false,520 "staff": false,521 "user_id": 72631,522 "hidden": false,523 "trust_level": 1,524 "deleted_at": null,525 "user_deleted": false,526 "edit_reason": null,527 "can_view_edit_history": true,528 "wiki": false,529 "post_url": "/t/is-the-concurrency-and-synchronization-knowledge-learned-in-the-operating-system-course-quite-essential-for-deep-learning-model-training-or-inference/202381/1",530 "can_accept_answer": false,531 "can_unaccept_answer": false,532 "accepted_answer": false,533 "topic_accepted_answer": true,534 "can_vote": false535 },536 {537 "id": 441918,538 "name": "",539 "username": "ptrblck",540 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",541 "created_at": "2024-05-08T20:36:09.330Z",542 "cooked": "<p>It’s hard to tell what’s “essential”, but I would claim you can certainly benefit from Operating System knowledge as well as understanding asynchronous execution in DL.</p>",543 "post_number": 2,544 "post_type": 1,545 "posts_count": 3,546 "updated_at": "2024-05-08T20:36:09.330Z",547 "reply_count": 1,548 "reply_to_post_number": null,549 "quote_count": 0,550 "incoming_link_count": 0,551 "reads": 7,552 "readers_count": 6,553 "score": 21.4,554 "yours": false,555 "topic_id": 202381,556 "topic_slug": "is-the-concurrency-and-synchronization-knowledge-learned-in-the-operating-system-course-quite-essential-for-deep-learning-model-training-or-inference",557 "display_username": "",558 "primary_group_name": null,559 "flair_name": null,560 "flair_url": null,561 "flair_bg_color": null,562 "flair_color": null,563 "flair_group_id": null,564 "badges_granted": [],565 "version": 1,566 "can_edit": false,567 "can_delete": false,568 "can_recover": false,569 "can_see_hidden_post": false,570 "can_wiki": false,571 "read": true,572 "user_title": "",573 "bookmarked": false,574 "actions_summary": [575 {576 "id": 2,577 "count": 1578 }579 ],580 "moderator": true,581 "admin": true,582 "staff": true,583 "user_id": 3534,584 "hidden": false,585 "trust_level": 2,586 "deleted_at": null,587 "user_deleted": false,588 "edit_reason": null,589 "can_view_edit_history": true,590 "wiki": false,591 "post_url": "/t/is-the-concurrency-and-synchronization-knowledge-learned-in-the-operating-system-course-quite-essential-for-deep-learning-model-training-or-inference/202381/2",592 "can_accept_answer": false,593 "can_unaccept_answer": false,594 "accepted_answer": true,595 "topic_accepted_answer": true596 },597 {598 "id": 441953,599 "name": "Woongjun Choi",600 "username": "woongjoonchoi",601 "avatar_template": "/user_avatar/discuss.pytorch.org/woongjoonchoi/{size}/67075_2.png",602 "created_at": "2024-05-09T07:00:07.897Z",603 "cooked": "<p>Thank you for replying. !! It was a bit difficult to understand asynchronous execution in DL at a low level, so I am studying OS knowledge at the same time, and I am glad that it will be helpful.</p>",604 "post_number": 3,605 "post_type": 1,606 "posts_count": 3,607 "updated_at": "2024-05-09T07:00:07.897Z",608 "reply_count": 0,609 "reply_to_post_number": 2,610 "quote_count": 0,611 "incoming_link_count": 0,612 "reads": 6,613 "readers_count": 5,614 "score": 1.2,615 "yours": false,616 "topic_id": 202381,617 "topic_slug": "is-the-concurrency-and-synchronization-knowledge-learned-in-the-operating-system-course-quite-essential-for-deep-learning-model-training-or-inference",618 "display_username": "Woongjun Choi",619 "primary_group_name": null,620 "flair_name": null,621 "flair_url": null,622 "flair_bg_color": null,623 "flair_color": null,624 "flair_group_id": null,625 "badges_granted": [],626 "version": 1,627 "can_edit": false,628 "can_delete": false,629 "can_recover": false,630 "can_see_hidden_post": false,631 "can_wiki": false,632 "read": true,633 "user_title": null,634 "reply_to_user": {635 "id": 3534,636 "username": "ptrblck",637 "name": "",638 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png"639 },640 "bookmarked": false,641 "actions_summary": [],642 "moderator": false,643 "admin": false,644 "staff": false,645 "user_id": 72631,646 "hidden": false,647 "trust_level": 1,648 "deleted_at": null,649 "user_deleted": false,650 "edit_reason": null,651 "can_view_edit_history": true,652 "wiki": false,653 "post_url": "/t/is-the-concurrency-and-synchronization-knowledge-learned-in-the-operating-system-course-quite-essential-for-deep-learning-model-training-or-inference/202381/3",654 "can_accept_answer": false,655 "can_unaccept_answer": false,656 "accepted_answer": false,657 "topic_accepted_answer": true658 }659 ],660 "stream": [661 441894,662 441918,663 441953664 ]665 },666 "timeline_lookup": [667 [668 1,669 535670 ],671 [672 3,673 534674 ]675 ],676 "suggested_topics": [677 {678 "fancy_title": "Reasons behind using convolutional layers of 1x1 kernel sizes",679 "id": 217058,680 "title": "Reasons behind using convolutional layers of 1x1 kernel sizes",681 "slug": "reasons-behind-using-convolutional-layers-of-1x1-kernel-sizes",682 "posts_count": 2,683 "reply_count": 0,684 "highest_post_number": 2,685 "image_url": null,686 "created_at": "2025-02-23T16:30:45.966Z",687 "last_posted_at": "2025-02-24T04:54:29.251Z",688 "bumped": true,689 "bumped_at": "2025-02-24T04:54:29.251Z",690 "archetype": "regular",691 "unseen": false,692 "pinned": false,693 "unpinned": null,694 "visible": true,695 "closed": false,696 "archived": false,697 "bookmarked": null,698 "liked": null,699 "tags_descriptions": {},700 "like_count": 0,701 "views": 64,702 "category_id": 1,703 "featured_link": null,704 "has_accepted_answer": false,705 "posters": [706 {707 "extras": null,708 "description": "Original Poster",709 "user": {710 "id": 55555,711 "username": "amirtmgr",712 "name": "amir T mgr",713 "avatar_template": "/user_avatar/discuss.pytorch.org/amirtmgr/{size}/49195_2.png",714 "trust_level": 1715 }716 },717 {718 "extras": "latest",719 "description": "Most Recent Poster",720 "user": {721 "id": 19553,722 "username": "anantguptadbl",723 "name": "Anant Gupta",724 "avatar_template": "/user_avatar/discuss.pytorch.org/anantguptadbl/{size}/17784_2.png",725 "trust_level": 2726 }727 }728 ]729 },730 {731 "fancy_title": "Infer FM synth register settings from freq. spectrum?",732 "id": 213011,733 "title": "Infer FM synth register settings from freq. spectrum?",734 "slug": "infer-fm-synth-register-settings-from-freq-spectrum",735 "posts_count": 1,736 "reply_count": 0,737 "highest_post_number": 1,738 "image_url": null,739 "created_at": "2024-11-15T14:22:22.183Z",740 "last_posted_at": "2024-11-15T14:22:22.264Z",741 "bumped": true,742 "bumped_at": "2024-11-16T06:48:06.788Z",743 "archetype": "regular",744 "unseen": false,745 "pinned": false,746 "unpinned": null,747 "visible": true,748 "closed": false,749 "archived": false,750 "bookmarked": null,751 "liked": null,752 "tags_descriptions": {},753 "like_count": 0,754 "views": 104,755 "category_id": 1,756 "featured_link": null,757 "has_accepted_answer": false,758 "posters": [759 {760 "extras": "latest single",761 "description": "Original Poster, Most Recent Poster",762 "user": {763 "id": 80934,764 "username": "Craig_Iannello",765 "name": "Craig Iannello",766 "avatar_template": "/user_avatar/discuss.pytorch.org/craig_iannello/{size}/74015_2.png",767 "trust_level": 0768 }769 }770 ]771 },772 {773 "fancy_title": "PyTorch is not using CUDA",774 "id": 213417,775 "title": "PyTorch is not using CUDA",776 "slug": "pytorch-is-not-using-cuda",777 "posts_count": 2,778 "reply_count": 0,779 "highest_post_number": 2,780 "image_url": "https://discuss.pytorch.org/uploads/default/original/3X/c/c/ccb9163052b14d675f74e0f69cbca101560c8547.png",781 "created_at": "2024-11-25T17:54:48.741Z",782 "last_posted_at": "2024-11-25T20:50:41.691Z",783 "bumped": true,784 "bumped_at": "2024-11-25T20:50:41.691Z",785 "archetype": "regular",786 "unseen": false,787 "pinned": false,788 "unpinned": null,789 "visible": true,790 "closed": false,791 "archived": false,792 "bookmarked": null,793 "liked": null,794 "tags_descriptions": {},795 "like_count": 1,796 "views": 539,797 "category_id": 1,798 "featured_link": null,799 "has_accepted_answer": false,800 "posters": [801 {802 "extras": null,803 "description": "Original Poster",804 "user": {805 "id": 81118,806 "username": "Nurtugan_Azatbekuly",807 "name": "Nurtugan Azatbekuly",808 "avatar_template": "/user_avatar/discuss.pytorch.org/nurtugan_azatbekuly/{size}/74189_2.png",809 "trust_level": 0810 }811 },812 {813 "extras": "latest",814 "description": "Most Recent Poster",815 "user": {816 "id": 3534,817 "username": "ptrblck",818 "name": "",819 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",820 "admin": true,821 "moderator": true,822 "trust_level": 2823 }824 }825 ]826 },827 {828 "fancy_title": "2 gpu model loading cuda error",829 "id": 216669,830 "title": "2 gpu model loading cuda error",831 "slug": "2-gpu-model-loading-cuda-error",832 "posts_count": 1,833 "reply_count": 0,834 "highest_post_number": 1,835 "image_url": null,836 "created_at": "2025-02-14T10:56:48.064Z",837 "last_posted_at": "2025-02-14T10:56:48.102Z",838 "bumped": true,839 "bumped_at": "2025-02-14T11:01:40.215Z",840 "archetype": "regular",841 "unseen": false,842 "pinned": false,843 "unpinned": null,844 "visible": true,845 "closed": false,846 "archived": false,847 "bookmarked": null,848 "liked": null,849 "tags_descriptions": {},850 "like_count": 0,851 "views": 87,852 "category_id": 1,853 "featured_link": null,854 "has_accepted_answer": false,855 "posters": [856 {857 "extras": "latest single",858 "description": "Original Poster, Most Recent Poster",859 "user": {860 "id": 82364,861 "username": "Sourabh_Yadav",862 "name": "Sourabh Yadav",863 "avatar_template": "/user_avatar/discuss.pytorch.org/sourabh_yadav/{size}/75350_2.png",864 "trust_level": 1865 }866 }867 ]868 },869 {870 "fancy_title": "Encountered an issue while performing DistributedSampler",871 "id": 219207,872 "title": "Encountered an issue while performing DistributedSampler",873 "slug": "encountered-an-issue-while-performing-distributedsampler",874 "posts_count": 1,875 "reply_count": 0,876 "highest_post_number": 1,877 "image_url": null,878 "created_at": "2025-04-17T14:21:34.013Z",879 "last_posted_at": "2025-04-17T14:21:34.057Z",880 "bumped": true,881 "bumped_at": "2025-04-18T01:45:09.191Z",882 "archetype": "regular",883 "unseen": false,884 "pinned": false,885 "unpinned": null,886 "visible": true,887 "closed": false,888 "archived": false,889 "bookmarked": null,890 "liked": null,891 "tags_descriptions": {},892 "like_count": 0,893 "views": 36,894 "category_id": 1,895 "featured_link": null,896 "has_accepted_answer": false,897 "posters": [898 {899 "extras": "latest single",900 "description": "Original Poster, Most Recent Poster",901 "user": {902 "id": 83877,903 "username": "shangxiaaabb",904 "name": "Jie Huang",905 "avatar_template": "/user_avatar/discuss.pytorch.org/shangxiaaabb/{size}/76694_2.png",906 "trust_level": 1907 }908 }909 ]910 }911 ],912 "tags_descriptions": {},913 "fancy_title": "Is the Concurrency and Synchronization knowledge learned in the Operating System course quite essential for deep learning model training or inference?",914 "id": 202381,915 "title": "Is the Concurrency and Synchronization knowledge learned in the Operating System course quite essential for deep learning model training or inference?",916 "posts_count": 3,917 "created_at": "2024-05-08T18:10:06.779Z",918 "views": 138,919 "reply_count": 1,920 "like_count": 1,921 "last_posted_at": "2024-05-09T07:00:07.897Z",922 "visible": true,923 "closed": false,924 "archived": false,925 "has_summary": false,926 "archetype": "regular",927 "slug": "is-the-concurrency-and-synchronization-knowledge-learned-in-the-operating-system-course-quite-essential-for-deep-learning-model-training-or-inference",928 "category_id": 1,929 "word_count": 88,930 "deleted_at": null,931 "user_id": 72631,932 "featured_link": null,933 "pinned_globally": false,934 "pinned_at": null,935 "pinned_until": null,936 "image_url": null,937 "slow_mode_seconds": 0,938 "draft": null,939 "draft_key": "topic_202381",940 "draft_sequence": null,941 "unpinned": null,942 "pinned": false,943 "current_post_number": 1,944 "highest_post_number": 3,945 "deleted_by": null,946 "actions_summary": [947 {948 "id": 4,949 "count": 0,950 "hidden": false,951 "can_act": false952 },953 {954 "id": 8,955 "count": 0,956 "hidden": false,957 "can_act": false958 },959 {960 "id": 10,961 "count": 0,962 "hidden": false,963 "can_act": false964 },965 {966 "id": 7,967 "count": 0,968 "hidden": false,969 "can_act": false970 }971 ],972 "chunk_size": 20,973 "bookmarked": false,974 "topic_timer": null,975 "message_bus_last_id": 0,976 "participant_count": 2,977 "show_read_indicator": false,978 "thumbnails": null,979 "slow_mode_enabled_until": null,980 "accepted_answer": {981 "post_number": 2,982 "username": "ptrblck",983 "name": "",984 "excerpt": "It’s hard to tell what’s “essential”, but I would claim you can certainly benefit from Operating System knowledge as well as understanding asynchronous execution in DL."985 },986 "can_vote": false,987 "vote_count": 0,988 "user_voted": false,989 "discourse_zendesk_plugin_zendesk_id": null,990 "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",991 "details": {992 "can_edit": false,993 "notification_level": 1,994 "participants": [995 {996 "id": 72631,997 "username": "woongjoonchoi",998 "name": "Woongjun Choi",999 "avatar_template": "/user_avatar/discuss.pytorch.org/woongjoonchoi/{size}/67075_2.png",1000 "post_count": 2,1001 "primary_group_name": null,1002 "flair_name": null,1003 "flair_url": null,1004 "flair_color": null,1005 "flair_bg_color": null,1006 "flair_group_id": null,1007 "trust_level": 11008 },1009 {1010 "id": 3534,1011 "username": "ptrblck",1012 "name": "",1013 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",1014 "post_count": 1,1015 "primary_group_name": null,1016 "flair_name": null,1017 "flair_url": null,1018 "flair_color": null,1019 "flair_bg_color": null,1020 "flair_group_id": null,1021 "admin": true,1022 "moderator": true,1023 "trust_level": 21024 }1025 ],1026 "created_by": {1027 "id": 72631,1028 "username": "woongjoonchoi",1029 "name": "Woongjun Choi",1030 "avatar_template": "/user_avatar/discuss.pytorch.org/woongjoonchoi/{size}/67075_2.png"1031 },1032 "last_poster": {1033 "id": 72631,1034 "username": "woongjoonchoi",1035 "name": "Woongjun Choi",1036 "avatar_template": "/user_avatar/discuss.pytorch.org/woongjoonchoi/{size}/67075_2.png"1037 }1038 },1039 "bookmarks": []1040 },1041 {1042 "post_stream": {1043 "posts": [1044 {1045 "id": 441946,1046 "name": "Harsh Mittal",1047 "username": "Harsh_Mittal",1048 "avatar_template": "/user_avatar/discuss.pytorch.org/harsh_mittal/{size}/68825_2.png",1049 "created_at": "2024-05-09T04:43:33.152Z",1050 "cooked": "<p>Hi there!</p>\n<p>I was playing around with the quantization & there’s a run-time issue I’m facing while running it locally, while it works on google colab.</p>\n<p>Here’s an error statement: Didn’t find engine for operation quantized::linear_prepack NoQEngine</p>\n<p>I checked the torch version which is 2.2.1 in my case (local machine), while it’s 2.2.1+cu121 in the Google colab case.</p>\n<p>I’d appreciate a help.</p>\n<p>Thanks!<br>\n<div class=\"lightbox-wrapper\"><a class=\"lightbox\" href=\"https://discuss.pytorch.org/uploads/default/original/3X/e/2/e25f8117ea878e58098b03bebe078af58d827950.png\" data-download-href=\"https://discuss.pytorch.org/uploads/default/e25f8117ea878e58098b03bebe078af58d827950\" title=\"Screenshot 2024-05-09 at 10.09.46 AM\"><img src=\"https://discuss.pytorch.org/uploads/default/optimized/3X/e/2/e25f8117ea878e58098b03bebe078af58d827950_2_690x475.png\" alt=\"Screenshot 2024-05-09 at 10.09.46 AM\" data-base62-sha1=\"wiAwzaEajk16AHZ015Et5ijhe3S\" width=\"690\" height=\"475\" srcset=\"https://discuss.pytorch.org/uploads/default/optimized/3X/e/2/e25f8117ea878e58098b03bebe078af58d827950_2_690x475.png, https://discuss.pytorch.org/uploads/default/optimized/3X/e/2/e25f8117ea878e58098b03bebe078af58d827950_2_1035x712.png 1.5x, https://discuss.pytorch.org/uploads/default/optimized/3X/e/2/e25f8117ea878e58098b03bebe078af58d827950_2_1380x950.png 2x\" data-dominant-color=\"252625\"><div class=\"meta\"><svg class=\"fa d-icon d-icon-far-image svg-icon\" aria-hidden=\"true\"><use href=\"#far-image\"></use></svg><span class=\"filename\">Screenshot 2024-05-09 at 10.09.46 AM</span><span class=\"informations\">2374×1636 505 KB</span><svg class=\"fa d-icon d-icon-discourse-expand svg-icon\" aria-hidden=\"true\"><use href=\"#discourse-expand\"></use></svg></div></a></div></p>",1051 "post_number": 1,1052 "post_type": 1,1053 "posts_count": 1,1054 "updated_at": "2024-05-09T04:43:33.152Z",1055 "reply_count": 0,1056 "reply_to_post_number": null,1057 "quote_count": 0,1058 "incoming_link_count": 147,1059 "reads": 5,1060 "readers_count": 4,1061 "score": 731.0,1062 "yours": false,1063 "topic_id": 202400,1064 "topic_slug": "quantization-runtime-error-didnt-find-engine-for-operation-quantized-linear-prepack-noqengine",1065 "display_username": "Harsh Mittal",1066 "primary_group_name": null,1067 "flair_name": null,1068 "flair_url": null,1069 "flair_bg_color": null,1070 "flair_color": null,1071 "flair_group_id": null,1072 "badges_granted": [],1073 "version": 1,1074 "can_edit": false,1075 "can_delete": false,1076 "can_recover": false,1077 "can_see_hidden_post": false,1078 "can_wiki": false,1079 "link_counts": [1080 {1081 "url": "https://discuss.pytorch.org/uploads/default/original/3X/e/2/e25f8117ea878e58098b03bebe078af58d827950.png",1082 "internal": true,1083 "reflection": false,1084 "clicks": 01085 }1086 ],1087 "read": true,1088 "user_title": null,1089 "bookmarked": false,1090 "actions_summary": [],1091 "moderator": false,1092 "admin": false,1093 "staff": false,1094 "user_id": 74553,1095 "hidden": false,1096 "trust_level": 1,1097 "deleted_at": null,1098 "user_deleted": false,1099 "edit_reason": null,1100 "can_view_edit_history": true,1101 "wiki": false,1102 "post_url": "/t/quantization-runtime-error-didnt-find-engine-for-operation-quantized-linear-prepack-noqengine/202400/1",1103 "can_accept_answer": false,1104 "can_unaccept_answer": false,1105 "accepted_answer": false,1106 "topic_accepted_answer": null,1107 "can_vote": false1108 }1109 ],1110 "stream": [1111 4419461112 ]1113 },1114 "timeline_lookup": [1115 [1116 1,1117 5351118 ]1119 ],1120 "suggested_topics": [1121 {1122 "fancy_title": "Quantized GLU not implemented?",1123 "id": 214325,1124 "title": "Quantized GLU not implemented?",1125 "slug": "quantized-glu-not-implemented",1126 "posts_count": 2,1127 "reply_count": 0,1128 "highest_post_number": 2,1129 "image_url": null,1130 "created_at": "2024-12-17T17:01:00.816Z",1131 "last_posted_at": "2024-12-17T19:49:39.548Z",1132 "bumped": true,1133 "bumped_at": "2024-12-17T19:49:39.548Z",1134 "archetype": "regular",1135 "unseen": false,1136 "pinned": false,1137 "unpinned": null,1138 "visible": true,1139 "closed": false,1140 "archived": false,1141 "bookmarked": null,1142 "liked": null,1143 "tags_descriptions": {},1144 "like_count": 0,1145 "views": 184,1146 "category_id": 17,1147 "featured_link": null,1148 "has_accepted_answer": false,1149 "posters": [1150 {1151 "extras": "latest single",1152 "description": "Original Poster, Most Recent Poster",1153 "user": {1154 "id": 81150,1155 "username": "iliasslasri",1156 "name": "Iliass",1157 "avatar_template": "/letter_avatar_proxy/v4/letter/i/67e7ee/{size}.png",1158 "trust_level": 11159 }1160 }1161 ]1162 },1163 {1164 "fancy_title": "USing Quantization tutorial,but the result different",1165 "id": 216178,1166 "title": "USing Quantization tutorial,but the result different",1167 "slug": "using-quantization-tutorial-but-the-result-different",1168 "posts_count": 3,1169 "reply_count": 1,1170 "highest_post_number": 3,1171 "image_url": null,1172 "created_at": "2025-02-03T16:16:13.451Z",1173 "last_posted_at": "2025-02-04T12:05:53.320Z",1174 "bumped": true,1175 "bumped_at": "2025-02-04T12:05:53.320Z",1176 "archetype": "regular",1177 "unseen": false,1178 "pinned": false,1179 "unpinned": null,1180 "visible": true,1181 "closed": false,1182 "archived": false,1183 "bookmarked": null,1184 "liked": null,1185 "tags_descriptions": {},1186 "like_count": 0,1187 "views": 66,1188 "category_id": 17,1189 "featured_link": null,1190 "has_accepted_answer": false,1191 "posters": [1192 {1193 "extras": "latest",1194 "description": "Original Poster, Most Recent Poster",1195 "user": {1196 "id": 82456,1197 "username": "BambooKui",1198 "name": "Bamboo Kui",1199 "avatar_template": "/user_avatar/discuss.pytorch.org/bambookui/{size}/75441_2.png",1200 "trust_level": 1