Anurag1734/cuda-error-resolution-analysis
07
1[2 {3 "post_stream": {4 "posts": [5 {6 "id": 339679,7 "name": "",8 "username": "PytorchLearning",9 "avatar_template": "/letter_avatar_proxy/v4/letter/p/d2c977/{size}.png",10 "created_at": "2022-04-04T16:22:22.224Z",11 "cooked": "<p>Hi all,</p>\n<p>I am trying to understand yolo v1 using pytorch from scratch. I have seen several codes how to code iou (interssection over union). In kaggle i found an example I try to understand it, here is the link:</p>\n<aside class=\"onebox allowlistedgeneric\" data-onebox-src=\"https://www.kaggle.com/code/vexxingbanana/yolov1-from-scratch-pytorch/notebook\">\n <header class=\"source\">\n <img src=\"https://www.kaggle.com/static/images/favicon.ico\" class=\"site-icon\" width=\"32\" height=\"32\">\n\n <a href=\"https://www.kaggle.com/code/vexxingbanana/yolov1-from-scratch-pytorch/notebook\" target=\"_blank\" rel=\"noopener nofollow ugc\">kaggle.com</a>\n </header>\n\n <article class=\"onebox-body\">\n <img src=\"https://storage.googleapis.com/kaggle-avatars/thumbnails/default-thumb.png\" class=\"thumbnail onebox-avatar\" width=\"160\" height=\"160\">\n\n<h3><a href=\"https://www.kaggle.com/code/vexxingbanana/yolov1-from-scratch-pytorch/notebook\" target=\"_blank\" rel=\"noopener nofollow ugc\">YoloV1 From Scratch - Pytorch</a></h3>\n\n <p>Explore and run machine learning code with Kaggle Notebooks | Using data from Fruit Images for Object Detection</p>\n\n\n </article>\n\n <div class=\"onebox-metadata\">\n \n \n </div>\n\n <div style=\"clear: both\"></div>\n</aside>\n\n<p>My questions are:<br>\nWhat mean the three dots … founded in box1_x1 = boxes_preds[…, 0:1]</p>\n<p>And can we write this instruction differently? Because I can’t find any examples in python or pytorch that contain three dots.</p>\n<p>Many thanks in advance for your help.</p>",12 "post_number": 1,13 "post_type": 1,14 "posts_count": 3,15 "updated_at": "2022-04-04T16:22:22.224Z",16 "reply_count": 1,17 "reply_to_post_number": null,18 "quote_count": 0,19 "incoming_link_count": 94,20 "reads": 8,21 "readers_count": 7,22 "score": 476.6,23 "yours": false,24 "topic_id": 148271,25 "topic_slug": "try-to-understand-interssection-over-union-from-scratch",26 "display_username": "",27 "primary_group_name": null,28 "flair_name": null,29 "flair_url": null,30 "flair_bg_color": null,31 "flair_color": null,32 "flair_group_id": null,33 "badges_granted": [],34 "version": 1,35 "can_edit": false,36 "can_delete": false,37 "can_recover": false,38 "can_see_hidden_post": false,39 "can_wiki": false,40 "link_counts": [41 {42 "url": "https://www.kaggle.com/code/vexxingbanana/yolov1-from-scratch-pytorch/notebook",43 "internal": false,44 "reflection": false,45 "title": "YoloV1 From Scratch - Pytorch | Kaggle",46 "clicks": 1047 }48 ],49 "read": true,50 "user_title": null,51 "bookmarked": false,52 "actions_summary": [],53 "moderator": false,54 "admin": false,55 "staff": false,56 "user_id": 33853,57 "hidden": false,58 "trust_level": 1,59 "deleted_at": null,60 "user_deleted": false,61 "edit_reason": null,62 "can_view_edit_history": true,63 "wiki": false,64 "post_url": "/t/try-to-understand-interssection-over-union-from-scratch/148271/1",65 "can_accept_answer": false,66 "can_unaccept_answer": false,67 "accepted_answer": false,68 "topic_accepted_answer": null,69 "can_vote": false70 },71 {72 "id": 339682,73 "name": "Matias Vasquez",74 "username": "Matias_Vasquez",75 "avatar_template": "/user_avatar/discuss.pytorch.org/matias_vasquez/{size}/47847_2.png",76 "created_at": "2022-04-04T16:42:59.573Z",77 "cooked": "<p>This is a python constant.</p>\n<aside class=\"onebox allowlistedgeneric\" data-onebox-src=\"https://docs.python.org/3/library/constants.html\">\n <header class=\"source\">\n <img src=\"https://docs.python.org/3/_static/py.svg\" class=\"site-icon\" width=\"16\" height=\"16\">\n\n <a href=\"https://docs.python.org/3/library/constants.html\" target=\"_blank\" rel=\"noopener nofollow ugc\">Python documentation</a>\n </header>\n\n <article class=\"onebox-body\">\n <img width=\"200\" height=\"200\" src=\"https://docs.python.org/3/_static/og-image.png\" class=\"thumbnail onebox-avatar\">\n\n<h3><a href=\"https://docs.python.org/3/library/constants.html\" target=\"_blank\" rel=\"noopener nofollow ugc\">Built-in Constants</a></h3>\n\n <p>A small number of constants live in the built-in namespace. They are: Constants added by the site module: The site module (which is imported automatically during startup, except if the-S command-li...</p>\n\n\n </article>\n\n <div class=\"onebox-metadata\">\n \n \n </div>\n\n <div style=\"clear: both\"></div>\n</aside>\n\n<p>You can even print this constant</p>\n<pre data-code-wrap=\"python\"><code class=\"lang-python\"># Try this\nprint(...)\n# Output\n# Ellipsis\n</code></pre>\n<p>You can use this for indexing, as way of saying “I don´t care”, thus accepting stuff with different dimensions.</p>\n<p>In pytorch it would be the same when you put <strong>-1</strong> in view, for example.</p>\n<pre data-code-wrap=\"python\"><code class=\"lang-python\">tensor = torch.rand(1, 2, 3, 4, 5)\nprint(tensor.view(-1, 2, 3, 4, 5).shape)\nprint(tensor.view(-1, 3, 4, 5).shape)\nprint(tensor.view(-1, 4, 5).shape)\nprint(tensor.view(-1, 5).shape)\nprint(tensor.view(-1).shape)\n# Output\n# torch.Size([1, 2, 3, 4, 5])\n# torch.Size([2, 3, 4, 5])\n# torch.Size([6, 4, 5])\n# torch.Size([24, 5])\n# torch.Size([120])\n</code></pre>\n<aside class=\"quote no-group\" data-username=\"PytorchLearning\" data-post=\"1\" data-topic=\"148271\">\n<div class=\"title\">\n<div class=\"quote-controls\"></div>\n<img loading=\"lazy\" alt=\"\" width=\"24\" height=\"24\" src=\"https://discuss.pytorch.org/letter_avatar_proxy/v4/letter/p/d2c977/48.png\" class=\"avatar\"> PytorchLearning:</div>\n<blockquote>\n<p>I can’t find any examples in python or pytorch that contain three dots.</p>\n</blockquote>\n</aside>\n<p><a href=\"https://note.nkmk.me/en/python-numpy-ellipsis/\" rel=\"noopener nofollow ugc\">Here</a> are some examples to get yourself familiar with this.</p>\n<p>But this is a useful and robust way to accept stuff with many different dimensions and address the thing that you actually want.</p>\n<p>Hope this helps <img src=\"https://discuss.pytorch.org/images/emoji/apple/smile.png?v=12\" title=\":smile:\" class=\"emoji\" alt=\":smile:\" loading=\"lazy\" width=\"20\" height=\"20\"></p>",78 "post_number": 2,79 "post_type": 1,80 "posts_count": 3,81 "updated_at": "2022-04-04T16:54:39.391Z",82 "reply_count": 0,83 "reply_to_post_number": null,84 "quote_count": 1,85 "incoming_link_count": 2,86 "reads": 8,87 "readers_count": 7,88 "score": 26.6,89 "yours": false,90 "topic_id": 148271,91 "topic_slug": "try-to-understand-interssection-over-union-from-scratch",92 "display_username": "Matias Vasquez",93 "primary_group_name": null,94 "flair_name": null,95 "flair_url": null,96 "flair_bg_color": null,97 "flair_color": null,98 "flair_group_id": null,99 "badges_granted": [],100 "version": 2,101 "can_edit": false,102 "can_delete": false,103 "can_recover": false,104 "can_see_hidden_post": false,105 "can_wiki": false,106 "link_counts": [107 {108 "url": "https://note.nkmk.me/en/python-numpy-ellipsis/",109 "internal": false,110 "reflection": false,111 "title": "NumPy: Ellipsis (...) for ndarray | note.nkmk.me",112 "clicks": 1113 },114 {115 "url": "https://docs.python.org/3/library/constants.html",116 "internal": false,117 "reflection": false,118 "title": "Built-in Constants — Python 3.12.0 documentation",119 "clicks": 0120 }121 ],122 "read": true,123 "user_title": null,124 "bookmarked": false,125 "actions_summary": [126 {127 "id": 2,128 "count": 1129 }130 ],131 "moderator": false,132 "admin": false,133 "staff": false,134 "user_id": 54310,135 "hidden": false,136 "trust_level": 2,137 "deleted_at": null,138 "user_deleted": false,139 "edit_reason": null,140 "can_view_edit_history": true,141 "wiki": false,142 "post_url": "/t/try-to-understand-interssection-over-union-from-scratch/148271/2",143 "can_accept_answer": false,144 "can_unaccept_answer": false,145 "accepted_answer": false,146 "topic_accepted_answer": null147 },148 {149 "id": 339692,150 "name": "",151 "username": "PytorchLearning",152 "avatar_template": "/letter_avatar_proxy/v4/letter/p/d2c977/{size}.png",153 "created_at": "2022-04-04T17:39:03.137Z",154 "cooked": "<p>Hi <a class=\"mention\" href=\"/u/matias_vasquez\">@Matias_Vasquez</a>,</p>\n<p>Thanks a lot for the explanation and for the examples. <img src=\"https://discuss.pytorch.org/images/emoji/apple/slightly_smiling_face.png?v=12\" title=\":slightly_smiling_face:\" class=\"emoji\" alt=\":slightly_smiling_face:\" loading=\"lazy\" width=\"20\" height=\"20\"></p>\n<p>Now I understand it very well.</p>",155 "post_number": 3,156 "post_type": 1,157 "posts_count": 3,158 "updated_at": "2022-04-04T17:39:03.137Z",159 "reply_count": 0,160 "reply_to_post_number": null,161 "quote_count": 0,162 "incoming_link_count": 1,163 "reads": 5,164 "readers_count": 4,165 "score": 21.0,166 "yours": false,167 "topic_id": 148271,168 "topic_slug": "try-to-understand-interssection-over-union-from-scratch",169 "display_username": "",170 "primary_group_name": null,171 "flair_name": null,172 "flair_url": null,173 "flair_bg_color": null,174 "flair_color": null,175 "flair_group_id": null,176 "badges_granted": [],177 "version": 1,178 "can_edit": false,179 "can_delete": false,180 "can_recover": false,181 "can_see_hidden_post": false,182 "can_wiki": false,183 "read": true,184 "user_title": null,185 "bookmarked": false,186 "actions_summary": [187 {188 "id": 2,189 "count": 1190 }191 ],192 "moderator": false,193 "admin": false,194 "staff": false,195 "user_id": 33853,196 "hidden": false,197 "trust_level": 1,198 "deleted_at": null,199 "user_deleted": false,200 "edit_reason": null,201 "can_view_edit_history": true,202 "wiki": false,203 "post_url": "/t/try-to-understand-interssection-over-union-from-scratch/148271/3",204 "can_accept_answer": false,205 "can_unaccept_answer": false,206 "accepted_answer": false,207 "topic_accepted_answer": null208 }209 ],210 "stream": [211 339679,212 339682,213 339692214 ]215 },216 "timeline_lookup": [217 [218 1,219 1300220 ]221 ],222 "suggested_topics": [223 {224 "fancy_title": "RuntimeError: invalid dtype for bias - should match query’s dtype #144018",225 "id": 214902,226 "title": "RuntimeError: invalid dtype for bias - should match query's dtype #144018",227 "slug": "runtimeerror-invalid-dtype-for-bias-should-match-querys-dtype-144018",228 "posts_count": 3,229 "reply_count": 1,230 "highest_post_number": 3,231 "image_url": null,232 "created_at": "2025-01-02T18:43:16.682Z",233 "last_posted_at": "2025-01-06T05:01:52.408Z",234 "bumped": true,235 "bumped_at": "2025-01-06T05:01:52.408Z",236 "archetype": "regular",237 "unseen": false,238 "pinned": false,239 "unpinned": null,240 "visible": true,241 "closed": false,242 "archived": false,243 "bookmarked": null,244 "liked": null,245 "tags_descriptions": {},246 "like_count": 1,247 "views": 284,248 "category_id": 1,249 "featured_link": null,250 "has_accepted_answer": true,251 "posters": [252 {253 "extras": "latest",254 "description": "Original Poster, Most Recent Poster, Accepted Answer",255 "user": {256 "id": 37719,257 "username": "Hayat_Ullah",258 "name": "Hayat Ullah",259 "avatar_template": "/user_avatar/discuss.pytorch.org/hayat_ullah/{size}/74922_2.png",260 "trust_level": 1261 }262 },263 {264 "extras": null,265 "description": "Frequent Poster",266 "user": {267 "id": 3534,268 "username": "ptrblck",269 "name": "",270 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",271 "admin": true,272 "moderator": true,273 "trust_level": 2274 }275 }276 ]277 },278 {279 "fancy_title": "Process Pool freezes",280 "id": 214981,281 "title": "Process Pool freezes",282 "slug": "process-pool-freezes",283 "posts_count": 1,284 "reply_count": 0,285 "highest_post_number": 1,286 "image_url": null,287 "created_at": "2025-01-04T22:52:42.533Z",288 "last_posted_at": "2025-01-04T22:52:42.574Z",289 "bumped": true,290 "bumped_at": "2025-01-04T22:52:42.574Z",291 "archetype": "regular",292 "unseen": false,293 "pinned": false,294 "unpinned": null,295 "visible": true,296 "closed": false,297 "archived": false,298 "bookmarked": null,299 "liked": null,300 "tags_descriptions": {},301 "like_count": 0,302 "views": 106,303 "category_id": 1,304 "featured_link": null,305 "has_accepted_answer": false,306 "posters": [307 {308 "extras": "latest single",309 "description": "Original Poster, Most Recent Poster",310 "user": {311 "id": 81433,312 "username": "ACitronella",313 "name": "",314 "avatar_template": "/letter_avatar_proxy/v4/letter/a/9fc29f/{size}.png",315 "trust_level": 1316 }317 }318 ]319 },320 {321 "fancy_title": "Pytorch not compatible with sm_86 CUDA Capability",322 "id": 215283,323 "title": "Pytorch not compatible with sm_86 CUDA Capability",324 "slug": "pytorch-not-compatible-with-sm-86-cuda-capability",325 "posts_count": 5,326 "reply_count": 3,327 "highest_post_number": 5,328 "image_url": null,329 "created_at": "2025-01-11T23:30:42.751Z",330 "last_posted_at": "2025-01-12T17:56:09.703Z",331 "bumped": true,332 "bumped_at": "2025-01-12T17:56:09.703Z",333 "archetype": "regular",334 "unseen": false,335 "pinned": false,336 "unpinned": null,337 "visible": true,338 "closed": false,339 "archived": false,340 "bookmarked": null,341 "liked": null,342 "tags_descriptions": {},343 "like_count": 0,344 "views": 308,345 "category_id": 1,346 "featured_link": null,347 "has_accepted_answer": false,348 "posters": [349 {350 "extras": "latest",351 "description": "Original Poster, Most Recent Poster",352 "user": {353 "id": 82028,354 "username": "the-ml-bulldog",355 "name": "",356 "avatar_template": "/user_avatar/discuss.pytorch.org/the-ml-bulldog/{size}/75057_2.png",357 "trust_level": 1358 }359 },360 {361 "extras": null,362 "description": "Frequent Poster",363 "user": {364 "id": 3534,365 "username": "ptrblck",366 "name": "",367 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",368 "admin": true,369 "moderator": true,370 "trust_level": 2371 }372 }373 ]374 },375 {376 "fancy_title": "TORCH_WARN(“Both fused kernels do not support non-zero dropout.”);",377 "id": 218214,378 "title": "TORCH_WARN(\"Both fused kernels do not support non-zero dropout.\");",379 "slug": "torch-warn-both-fused-kernels-do-not-support-non-zero-dropout",380 "posts_count": 1,381 "reply_count": 0,382 "highest_post_number": 1,383 "image_url": null,384 "created_at": "2025-03-24T23:53:47.068Z",385 "last_posted_at": "2025-03-24T23:53:47.104Z",386 "bumped": true,387 "bumped_at": "2025-03-24T23:53:47.104Z",388 "archetype": "regular",389 "unseen": false,390 "pinned": false,391 "unpinned": null,392 "visible": true,393 "closed": false,394 "archived": false,395 "bookmarked": null,396 "liked": null,397 "tags_descriptions": {},398 "like_count": 0,399 "views": 23,400 "category_id": 1,401 "featured_link": "https://github.com/pytorch/pytorch/blob/51f91e3428be9201e9c1199ec704bc132f979955/aten/src/ATen/native/transformers/sdp_utils_cpp.h#L240",402 "featured_link_root_domain": "github.com",403 "has_accepted_answer": false,404 "posters": [405 {406 "extras": "latest single",407 "description": "Original Poster, Most Recent Poster",408 "user": {409 "id": 82804,410 "username": "githubsgi",411 "name": "_githubsgi",412 "avatar_template": "/user_avatar/discuss.pytorch.org/githubsgi/{size}/75767_2.png",413 "trust_level": 1414 }415 }416 ]417 },418 {419 "fancy_title": "Gradient of dot product for every index pair",420 "id": 214882,421 "title": "Gradient of dot product for every index pair",422 "slug": "gradient-of-dot-product-for-every-index-pair",423 "posts_count": 2,424 "reply_count": 0,425 "highest_post_number": 2,426 "image_url": null,427 "created_at": "2025-01-02T10:31:28.366Z",428 "last_posted_at": "2025-01-02T15:55:25.964Z",429 "bumped": true,430 "bumped_at": "2025-01-02T15:55:25.964Z",431 "archetype": "regular",432 "unseen": false,433 "pinned": false,434 "unpinned": null,435 "visible": true,436 "closed": false,437 "archived": false,438 "bookmarked": null,439 "liked": null,440 "tags_descriptions": {},441 "like_count": 0,442 "views": 166,443 "category_id": 1,444 "featured_link": null,445 "has_accepted_answer": false,446 "posters": [447 {448 "extras": null,449 "description": "Original Poster",450 "user": {451 "id": 72757,452 "username": "sherlock.h",453 "name": "",454 "avatar_template": "/user_avatar/discuss.pytorch.org/sherlock.h/{size}/62377_2.png",455 "trust_level": 1456 }457 },458 {459 "extras": "latest",460 "description": "Most Recent Poster",461 "user": {462 "id": 41396,463 "username": "soulitzer",464 "name": "",465 "avatar_template": "/letter_avatar_proxy/v4/letter/s/839c29/{size}.png",466 "trust_level": 2467 }468 }469 ]470 }471 ],472 "tags_descriptions": {},473 "fancy_title": "Try to understand interssection over union from scratch",474 "id": 148271,475 "title": "Try to understand interssection over union from scratch",476 "posts_count": 3,477 "created_at": "2022-04-04T16:22:22.156Z",478 "views": 587,479 "reply_count": 0,480 "like_count": 2,481 "last_posted_at": "2022-04-04T17:39:03.137Z",482 "visible": true,483 "closed": false,484 "archived": false,485 "has_summary": false,486 "archetype": "regular",487 "slug": "try-to-understand-interssection-over-union-from-scratch",488 "category_id": 1,489 "word_count": 309,490 "deleted_at": null,491 "user_id": 33853,492 "featured_link": null,493 "pinned_globally": false,494 "pinned_at": null,495 "pinned_until": null,496 "image_url": null,497 "slow_mode_seconds": 0,498 "draft": null,499 "draft_key": "topic_148271",500 "draft_sequence": null,501 "unpinned": null,502 "pinned": false,503 "current_post_number": 1,504 "highest_post_number": 3,505 "deleted_by": null,506 "actions_summary": [507 {508 "id": 4,509 "count": 0,510 "hidden": false,511 "can_act": false512 },513 {514 "id": 8,515 "count": 0,516 "hidden": false,517 "can_act": false518 },519 {520 "id": 10,521 "count": 0,522 "hidden": false,523 "can_act": false524 },525 {526 "id": 7,527 "count": 0,528 "hidden": false,529 "can_act": false530 }531 ],532 "chunk_size": 20,533 "bookmarked": false,534 "topic_timer": null,535 "message_bus_last_id": 0,536 "participant_count": 2,537 "show_read_indicator": false,538 "thumbnails": null,539 "slow_mode_enabled_until": null,540 "can_vote": false,541 "vote_count": 0,542 "user_voted": false,543 "discourse_zendesk_plugin_zendesk_id": null,544 "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",545 "details": {546 "can_edit": false,547 "notification_level": 1,548 "participants": [549 {550 "id": 33853,551 "username": "PytorchLearning",552 "name": "",553 "avatar_template": "/letter_avatar_proxy/v4/letter/p/d2c977/{size}.png",554 "post_count": 2,555 "primary_group_name": null,556 "flair_name": null,557 "flair_url": null,558 "flair_color": null,559 "flair_bg_color": null,560 "flair_group_id": null,561 "trust_level": 1562 },563 {564 "id": 54310,565 "username": "Matias_Vasquez",566 "name": "Matias Vasquez",567 "avatar_template": "/user_avatar/discuss.pytorch.org/matias_vasquez/{size}/47847_2.png",568 "post_count": 1,569 "primary_group_name": null,570 "flair_name": null,571 "flair_url": null,572 "flair_color": null,573 "flair_bg_color": null,574 "flair_group_id": null,575 "trust_level": 2576 }577 ],578 "created_by": {579 "id": 33853,580 "username": "PytorchLearning",581 "name": "",582 "avatar_template": "/letter_avatar_proxy/v4/letter/p/d2c977/{size}.png"583 },584 "last_poster": {585 "id": 33853,586 "username": "PytorchLearning",587 "name": "",588 "avatar_template": "/letter_avatar_proxy/v4/letter/p/d2c977/{size}.png"589 },590 "links": [591 {592 "url": "https://www.kaggle.com/code/vexxingbanana/yolov1-from-scratch-pytorch/notebook",593 "title": "YoloV1 From Scratch - Pytorch | Kaggle",594 "internal": false,595 "attachment": false,596 "reflection": false,597 "clicks": 10,598 "user_id": 33853,599 "domain": "www.kaggle.com",600 "root_domain": "kaggle.com"601 },602 {603 "url": "https://note.nkmk.me/en/python-numpy-ellipsis/",604 "title": "NumPy: Ellipsis (...) for ndarray | note.nkmk.me",605 "internal": false,606 "attachment": false,607 "reflection": false,608 "clicks": 1,609 "user_id": 54310,610 "domain": "note.nkmk.me",611 "root_domain": "nkmk.me"612 }613 ]614 },615 "bookmarks": []616 },617 {618 "post_stream": {619 "posts": [620 {621 "id": 339677,622 "name": "Stephen Fernandes",623 "username": "Stephen_Fernandes",624 "avatar_template": "/user_avatar/discuss.pytorch.org/stephen_fernandes/{size}/34557_2.png",625 "created_at": "2022-04-04T16:12:55.116Z",626 "cooked": "<p>given that the new torchtext dataset and dataloading pipeline now involves extending the dataset class by our custom dataset class, using this how do we load pretrained word embeddings in the pipeline.</p>\n<p>also how do we sort the dataset into batches of similar length to minimize padding ?</p>",627 "post_number": 1,628 "post_type": 1,629 "posts_count": 1,630 "updated_at": "2022-04-04T16:12:55.116Z",631 "reply_count": 0,632 "reply_to_post_number": null,633 "quote_count": 0,634 "incoming_link_count": 52,635 "reads": 6,636 "readers_count": 5,637 "score": 261.2,638 "yours": false,639 "topic_id": 148270,640 "topic_slug": "how-to-load-custom-pretrained-word-embedding-in-the-new-torchtext-pipeline",641 "display_username": "Stephen Fernandes",642 "primary_group_name": null,643 "flair_name": null,644 "flair_url": null,645 "flair_bg_color": null,646 "flair_color": null,647 "flair_group_id": null,648 "badges_granted": [],649 "version": 1,650 "can_edit": false,651 "can_delete": false,652 "can_recover": false,653 "can_see_hidden_post": false,654 "can_wiki": false,655 "read": true,656 "user_title": null,657 "bookmarked": false,658 "actions_summary": [],659 "moderator": false,660 "admin": false,661 "staff": false,662 "user_id": 41986,663 "hidden": false,664 "trust_level": 1,665 "deleted_at": null,666 "user_deleted": false,667 "edit_reason": null,668 "can_view_edit_history": true,669 "wiki": false,670 "post_url": "/t/how-to-load-custom-pretrained-word-embedding-in-the-new-torchtext-pipeline/148270/1",671 "can_accept_answer": false,672 "can_unaccept_answer": false,673 "accepted_answer": false,674 "topic_accepted_answer": null,675 "can_vote": false676 }677 ],678 "stream": [679 339677680 ]681 },682 "timeline_lookup": [683 [684 1,685 1300686 ]687 ],688 "suggested_topics": [689 {690 "fancy_title": "Computation of nn.Linear and nn.Embedding",691 "id": 212568,692 "title": "Computation of nn.Linear and nn.Embedding",693 "slug": "computation-of-nn-linear-and-nn-embedding",694 "posts_count": 2,695 "reply_count": 0,696 "highest_post_number": 2,697 "image_url": null,698 "created_at": "2024-11-05T17:51:48.881Z",699 "last_posted_at": "2024-11-22T23:08:53.550Z",700 "bumped": true,701 "bumped_at": "2024-11-22T23:33:05.777Z",702 "archetype": "regular",703 "unseen": false,704 "pinned": false,705 "unpinned": null,706 "visible": true,707 "closed": false,708 "archived": false,709 "bookmarked": null,710 "liked": null,711 "tags_descriptions": {},712 "like_count": 0,713 "views": 227,714 "category_id": 8,715 "featured_link": null,716 "has_accepted_answer": false,717 "posters": [718 {719 "extras": null,720 "description": "Original Poster",721 "user": {722 "id": 80540,723 "username": "na50r",724 "name": "",725 "avatar_template": "/user_avatar/discuss.pytorch.org/na50r/{size}/73632_2.png",726 "trust_level": 1727 }728 },729 {730 "extras": "latest",731 "description": "Most Recent Poster",732 "user": {733 "id": 81077,734 "username": "T0BIAS",735 "name": "",736 "avatar_template": "/user_avatar/discuss.pytorch.org/t0bias/{size}/74141_2.png",737 "trust_level": 1738 }739 }740 ]741 },742 {743 "fancy_title": "Embedding a float into a vector for transformer models",744 "id": 213866,745 "title": "Embedding a float into a vector for transformer models",746 "slug": "embedding-a-float-into-a-vector-for-transformer-models",747 "posts_count": 2,748 "reply_count": 0,749 "highest_post_number": 3,750 "image_url": null,751 "created_at": "2024-12-05T15:34:41.788Z",752 "last_posted_at": "2025-01-07T11:53:28.566Z",753 "bumped": true,754 "bumped_at": "2025-01-07T11:59:24.716Z",755 "archetype": "regular",756 "unseen": false,757 "pinned": false,758 "unpinned": null,759 "visible": true,760 "closed": false,761 "archived": false,762 "bookmarked": null,763 "liked": null,764 "tags_descriptions": {},765 "like_count": 0,766 "views": 158,767 "category_id": 8,768 "featured_link": null,769 "has_accepted_answer": false,770 "posters": [771 {772 "extras": null,773 "description": "Original Poster",774 "user": {775 "id": 81334,776 "username": "Lazy_Ev",777 "name": "Davide Setzu",778 "avatar_template": "/user_avatar/discuss.pytorch.org/lazy_ev/{size}/74220_2.png",779 "trust_level": 0780 }781 },782 {783 "extras": "latest",784 "description": "Most Recent Poster",785 "user": {786 "id": 75884,787 "username": "Kotzi",788 "name": null,789 "avatar_template": "/user_avatar/discuss.pytorch.org/kotzi/{size}/74947_2.png",790 "trust_level": 1791 }792 }793 ]794 },795 {796 "fancy_title": "Can someone explain the benefits of Batches?",797 "id": 212699,798 "title": "Can someone explain the benefits of Batches?",799 "slug": "can-someone-explain-the-benefits-of-batches",800 "posts_count": 3,801 "reply_count": 1,802 "highest_post_number": 3,803 "image_url": null,804 "created_at": "2024-11-08T10:12:40.115Z",805 "last_posted_at": "2024-11-08T15:24:42.721Z",806 "bumped": true,807 "bumped_at": "2024-11-08T15:24:42.721Z",808 "archetype": "regular",809 "unseen": false,810 "pinned": false,811 "unpinned": null,812 "visible": true,813 "closed": false,814 "archived": false,815 "bookmarked": null,816 "liked": null,817 "tags_descriptions": {},818 "like_count": 2,819 "views": 288,820 "category_id": 8,821 "featured_link": null,822 "has_accepted_answer": false,823 "posters": [824 {825 "extras": "latest",826 "description": "Original Poster, Most Recent Poster",827 "user": {828 "id": 80540,829 "username": "na50r",830 "name": "",831 "avatar_template": "/user_avatar/discuss.pytorch.org/na50r/{size}/73632_2.png",832 "trust_level": 1833 }834 },835 {836 "extras": null,837 "description": "Frequent Poster",838 "user": {839 "id": 77701,840 "username": "MLangner",841 "name": "",842 "avatar_template": "/letter_avatar_proxy/v4/letter/m/34f0e0/{size}.png",843 "trust_level": 1844 }845 }846 ]847 },848 {849 "fancy_title": "Feed a model with cumulative sum of sampled classified sequences",850 "id": 216055,851 "title": "Feed a model with cumulative sum of sampled classified sequences",852 "slug": "feed-a-model-with-cumulative-sum-of-sampled-classified-sequences",853 "posts_count": 1,854 "reply_count": 0,855 "highest_post_number": 1,856 "image_url": null,857 "created_at": "2025-01-30T15:22:32.244Z",858 "last_posted_at": "2025-01-30T15:22:32.285Z",859 "bumped": true,860 "bumped_at": "2025-01-30T15:22:32.285Z",861 "archetype": "regular",862 "unseen": false,863 "pinned": false,864 "unpinned": null,865 "visible": true,866 "closed": false,867 "archived": false,868 "bookmarked": null,869 "liked": null,870 "tags_descriptions": {},871 "like_count": 0,872 "views": 32,873 "category_id": 8,874 "featured_link": null,875 "has_accepted_answer": false,876 "posters": [877 {878 "extras": "latest single",879 "description": "Original Poster, Most Recent Poster",880 "user": {881 "id": 82401,882 "username": "Seam1",883 "name": "Seam",884 "avatar_template": "/user_avatar/discuss.pytorch.org/seam1/{size}/75384_2.png",885 "trust_level": 1886 }887 }888 ]889 },890 {891 "fancy_title": "Slow attention when using kvCache",892 "id": 216970,893 "title": "Slow attention when using kvCache",894 "slug": "slow-attention-when-using-kvcache",895 "posts_count": 2,896 "reply_count": 0,897 "highest_post_number": 2,898 "image_url": "https://discuss.pytorch.org/uploads/default/optimized/3X/4/8/48b8b2fe5bbc5b043e270063d7b0fd56f6ac7909_2_1023x299.jpeg",899 "created_at": "2025-02-21T01:42:07.857Z",900 "last_posted_at": "2025-02-21T14:02:17.595Z",901 "bumped": true,902 "bumped_at": "2025-02-21T14:02:17.595Z",903 "archetype": "regular",904 "unseen": false,905 "pinned": false,906 "unpinned": null,907 "visible": true,908 "closed": false,909 "archived": false,910 "bookmarked": null,911 "liked": null,912 "tags_descriptions": {},913 "like_count": 0,914 "views": 77,915 "category_id": 8,916 "featured_link": null,917 "has_accepted_answer": false,918 "posters": [919 {920 "extras": null,921 "description": "Original Poster",922 "user": {923 "id": 82829,924 "username": "ywha0929",925 "name": "영우 하",926 "avatar_template": "/user_avatar/discuss.pytorch.org/ywha0929/{size}/75789_2.png",927 "trust_level": 1928 }929 },930 {931 "extras": "latest",932 "description": "Most Recent Poster",933 "user": {934 "id": 3534,935 "username": "ptrblck",936 "name": "",937 "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",938 "admin": true,939 "moderator": true,940 "trust_level": 2941 }942 }943 ]944 }945 ],946 "tags_descriptions": {},947 "fancy_title": "How to load custom pretrained word embedding in the new torchtext pipeline?",948 "id": 148270,949 "title": "How to load custom pretrained word embedding in the new torchtext pipeline?",950 "posts_count": 1,951 "created_at": "2022-04-04T16:12:55.051Z",952 "views": 450,953 "reply_count": 0,954 "like_count": 0,955 "last_posted_at": "2022-04-04T16:12:55.116Z",956 "visible": true,957 "closed": false,958 "archived": false,959 "has_summary": false,960 "archetype": "regular",961 "slug": "how-to-load-custom-pretrained-word-embedding-in-the-new-torchtext-pipeline",962 "category_id": 8,963 "word_count": 47,964 "deleted_at": null,965 "user_id": 41986,966 "featured_link": null,967 "pinned_globally": false,968 "pinned_at": null,969 "pinned_until": null,970 "image_url": null,971 "slow_mode_seconds": 0,972 "draft": null,973 "draft_key": "topic_148270",974 "draft_sequence": null,975 "unpinned": null,976 "pinned": false,977 "current_post_number": 1,978 "highest_post_number": 1,979 "deleted_by": null,980 "actions_summary": [981 {982 "id": 4,983 "count": 0,984 "hidden": false,985 "can_act": false986 },987 {988 "id": 8,989 "count": 0,990 "hidden": false,991 "can_act": false992 },993 {994 "id": 10,995 "count": 0,996 "hidden": false,997 "can_act": false998 },999 {1000 "id": 7,1001 "count": 0,1002 "hidden": false,1003 "can_act": false1004 }1005 ],1006 "chunk_size": 20,1007 "bookmarked": false,1008 "topic_timer": null,1009 "message_bus_last_id": 0,1010 "participant_count": 1,1011 "show_read_indicator": false,1012 "thumbnails": null,1013 "slow_mode_enabled_until": null,1014 "can_vote": false,1015 "vote_count": 0,1016 "user_voted": false,1017 "discourse_zendesk_plugin_zendesk_id": null,1018 "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",1019 "details": {1020 "can_edit": false,1021 "notification_level": 1,1022 "participants": [1023 {1024 "id": 41986,1025 "username": "Stephen_Fernandes",1026 "name": "Stephen Fernandes",1027 "avatar_template": "/user_avatar/discuss.pytorch.org/stephen_fernandes/{size}/34557_2.png",1028 "post_count": 1,1029 "primary_group_name": null,1030 "flair_name": null,1031 "flair_url": null,1032 "flair_color": null,1033 "flair_bg_color": null,1034 "flair_group_id": null,1035 "trust_level": 11036 }1037 ],1038 "created_by": {1039 "id": 41986,1040 "username": "Stephen_Fernandes",1041 "name": "Stephen Fernandes",1042 "avatar_template": "/user_avatar/discuss.pytorch.org/stephen_fernandes/{size}/34557_2.png"1043 },1044 "last_poster": {1045 "id": 41986,1046 "username": "Stephen_Fernandes",1047 "name": "Stephen Fernandes",1048 "avatar_template": "/user_avatar/discuss.pytorch.org/stephen_fernandes/{size}/34557_2.png"1049 }1050 },1051 "bookmarks": []1052 },1053 {1054 "post_stream": {1055 "posts": [1056 {1057 "id": 339081,1058 "name": "VISHAL GHORPADE",1059 "username": "VISHAL_GHORPADE1",1060 "avatar_template": "/user_avatar/discuss.pytorch.org/vishal_ghorpade1/{size}/48170_2.png",1061 "created_at": "2022-03-31T17:03:14.474Z",1062 "cooked": "<p>Hello,<br>\nI have a 8gpu server for training and use docker to run my experiments. I wanted to use first 4-gpu with one container for setting 1 of the experiment and the last 4-gpus with another container for a different setting of the experiment. But when I try to do that I get ‘Runtime error: Address already in use’ error. I tried giving different port for each of the runs but still the same issue. Any pointers to help me resolve it?</p>",1063 "post_number": 1,1064 "post_type": 1,1065 "posts_count": 4,1066 "updated_at": "2022-03-31T18:32:24.986Z",1067 "reply_count": 0,1068 "reply_to_post_number": null,1069 "quote_count": 0,1070 "incoming_link_count": 861,1071 "reads": 17,1072 "readers_count": 16,1073 "score": 4308.4,1074 "yours": false,1075 "topic_id": 147975,1076 "topic_slug": "distributed-training-with-docker-container-by-splitting-gpus-resource-for-two-instances",1077 "display_username": "VISHAL GHORPADE",1078 "primary_group_name": null,1079 "flair_name": null,1080 "flair_url": null,1081 "flair_bg_color": null,1082 "flair_color": null,1083 "flair_group_id": null,1084 "badges_granted": [],1085 "version": 2,1086 "can_edit": false,1087 "can_delete": false,1088 "can_recover": false,1089 "can_see_hidden_post": false,1090 "can_wiki": false,1091 "read": true,1092 "user_title": null,1093 "bookmarked": false,1094 "actions_summary": [],1095 "moderator": false,1096 "admin": false,1097 "staff": false,1098 "user_id": 54605,1099 "hidden": false,1100 "trust_level": 0,1101 "deleted_at": null,1102 "user_deleted": false,1103 "edit_reason": null,1104 "can_view_edit_history": true,1105 "wiki": false,1106 "post_url": "/t/distributed-training-with-docker-container-by-splitting-gpus-resource-for-two-instances/147975/1",1107 "can_accept_answer": false,1108 "can_unaccept_answer": false,1109 "accepted_answer": false,1110 "topic_accepted_answer": null,1111 "can_vote": false1112 },1113 {1114 "id": 339668,1115 "name": "Howard Huang",1116 "username": "H-Huang",1117 "avatar_template": "/user_avatar/discuss.pytorch.org/h-huang/{size}/35598_2.png",1118 "created_at": "2022-04-04T14:53:32.309Z",1119 "cooked": "<p>Hi, if you are using different ports for each run it will be fine, not sure why you are hitting this error. Can you provide more information about the initialization? Are you using <code>init_process_group</code>, what are you setting for initialization. Additionally, can you post the backtrace of the error?</p>",1120 "post_number": 2,1121 "post_type": 1,1122 "posts_count": 4,1123 "updated_at": "2022-04-04T14:53:32.309Z",1124 "reply_count": 0,1125 "reply_to_post_number": null,1126 "quote_count": 0,1127 "incoming_link_count": 7,1128 "reads": 16,1129 "readers_count": 15,1130 "score": 38.2,1131 "yours": false,1132 "topic_id": 147975,1133 "topic_slug": "distributed-training-with-docker-container-by-splitting-gpus-resource-for-two-instances",1134 "display_username": "Howard Huang",1135 "primary_group_name": null,1136 "flair_name": null,1137 "flair_url": null,1138 "flair_bg_color": null,1139 "flair_color": null,1140 "flair_group_id": null,1141 "badges_granted": [],1142 "version": 1,1143 "can_edit": false,1144 "can_delete": false,1145 "can_recover": false,1146 "can_see_hidden_post": false,1147 "can_wiki": false,1148 "read": true,1149 "user_title": null,1150 "bookmarked": false,1151 "actions_summary": [],1152 "moderator": false,1153 "admin": false,1154 "staff": false,1155 "user_id": 39542,1156 "hidden": false,1157 "trust_level": 2,1158 "deleted_at": null,1159 "user_deleted": false,1160 "edit_reason": null,1161 "can_view_edit_history": true,1162 "wiki": false,1163 "post_url": "/t/distributed-training-with-docker-container-by-splitting-gpus-resource-for-two-instances/147975/2",1164 "can_accept_answer": false,1165 "can_unaccept_answer": false,1166 "accepted_answer": false,1167 "topic_accepted_answer": null1168 },1169 {1170 "id": 339672,1171 "name": "VISHAL GHORPADE",1172 "username": "VISHAL_GHORPADE1",1173 "avatar_template": "/user_avatar/discuss.pytorch.org/vishal_ghorpade1/{size}/48170_2.png",1174 "created_at": "2022-04-04T15:15:02.525Z",1175 "cooked": "<p>Hi,<br>\nI’m currently setting different ports…below is the trace:</p>\n<pre><code class=\"lang-auto\">\nFile \"deepspeedtrain_pyDL.py\", line 345, in __init__\n torch.distributed.init_process_group(backend=\"nccl\", **kwargs)\n File \"/opt/conda/lib/python3.6/site-packages/torch/distributed/distributed_c10d.py\", line 576, in init_process_group\n store, rank, world_size = next(rendezvous_iterator)\n File \"/opt/conda/lib/python3.6/site-packages/torch/distributed/rendezvous.py\", line 229, in _env_rendezvous_handler\n store = _create_c10d_store(master_addr, master_port, rank, world_size, timeout)\n File \"/opt/conda/lib/python3.6/site-packages/torch/distributed/rendezvous.py\", line 158, in _create_c10d_store\n hostname, port, world_size, start_daemon, timeout, multi_tenant=True\nRuntimeError: Address already in use\n</code></pre>\n<p>I had initialised the global vairables for port, local rank, rank as below:</p>\n<pre><code class=\"lang-auto\">os.environ[\"MASTER_ADDR\"] = \"localhost\"\nos.environ[\"MASTER_PORT\"] = \"5653\" \nos.environ[\"RANK\"] = \"0\"\nos.environ[\"LOCAL_RANK\"] = \"0\"\n</code></pre>\n<p>I’m not sure why i’m getting this error…Is there a github example I can refer to for setting up the initialization?</p>",1176 "post_number": 3,1177 "post_type": 1,1178 "posts_count": 4,1179 "updated_at": "2022-04-04T15:15:02.525Z",1180 "reply_count": 1,1181 "reply_to_post_number": null,1182 "quote_count": 0,1183 "incoming_link_count": 16,1184 "reads": 14,1185 "readers_count": 13,1186 "score": 87.8,1187 "yours": false,1188 "topic_id": 147975,1189 "topic_slug": "distributed-training-with-docker-container-by-splitting-gpus-resource-for-two-instances",1190 "display_username": "VISHAL GHORPADE",1191 "primary_group_name": null,1192 "flair_name": null,1193 "flair_url": null,1194 "flair_bg_color": null,1195 "flair_color": null,1196 "flair_group_id": null,1197 "badges_granted": [],1198 "version": 1,1199 "can_edit": false,1200 "can_delete": false,