CoolFace
Datasetpublic

Anurag1734/cuda-error-resolution-analysis

sourceHugging Faceupdated 2mo agoView on Hugging Face
0likes7downloads
topics_batch_216.json67146 linesDownload Raw Back to raw
1[2  {3    "post_stream": {4      "posts": [5        {6          "id": 357991,7          "name": "",8          "username": "Joysn",9          "avatar_template": "/letter_avatar_proxy/v4/letter/j/77aa72/{size}.png",10          "created_at": "2022-07-24T13:04:53.349Z",11          "cooked": "<p>I am developing with torchvision and its infrastructure, like Dataset and Dataloader. During the last months on Win10 there were no issues with that code and how I used it.<br>\nYesterday I moved to a fresh Linux installation and setup the whole env, like CUDA, Python 3.9 and the packages, the requirements.txt created from the venv I used on the Win10 workstation. The GPU memory (2GB) is not sufficient anymore, even when using a batch size of 1 on the dataloaders.<br>\nBut the strangest things happen with the multiprocessing dataloaders. Regardless if I use only one worker or multiples (4). In that code snippet the timeout is reached almost all the time. Only sometimes a record is returned by the call <code>self._data_queue.get(timeout=timeout)</code></p>\n<pre><code class=\"lang-auto\">    def _try_get_data(self, timeout=_utils.MP_STATUS_CHECK_INTERVAL):\n        # Tries to fetch data from `self._data_queue` once for a given timeout.\n        # This can also be used as inner loop of fetching without timeout, with\n        # the sender status as the loop condition.\n        #\n        # This raises a `RuntimeError` if any worker died expectedly. This error\n        # can come from either the SIGCHLD handler in `_utils/signal_handling.py`\n        # (only for non-Windows platforms), or the manual check below on errors\n        # and timeouts.\n        #\n        # Returns a 2-tuple:\n        #   (bool: whether successfully get data, any: data if successful else None)\n        try:\n            data = self._data_queue.get(timeout=timeout)\n            return (True, data)\n        except Exception as e:\n            # At timeout and error, we manually check whether any worker has\n            # failed. Note that this is the only mechanism for Windows to detect\n            # worker failures.\n            failed_workers = []\n            for worker_id, w in enumerate(self._workers):\n                if self._workers_status[worker_id] and not w.is_alive():\n                    failed_workers.append(w)\n                    self._mark_worker_as_unavailable(worker_id)\n            if len(failed_workers) &gt; 0:\n                pids_str = ', '.join(str(w.pid) for w in failed_workers)\n                raise RuntimeError('DataLoader worker (pid(s) {}) exited unexpectedly'.format(pids_str)) from e\n            if isinstance(e, queue.Empty):\n                return (False, None)\n            import tempfile\n            import errno\n            try:\n                # Raise an exception if we are this close to the FDs limit.\n                # Apparently, trying to open only one file is not a sufficient\n                # test.\n                # See NOTE [ DataLoader on Linux and open files limit ]\n                fds_limit_margin = 10\n                fs = [tempfile.NamedTemporaryFile() for i in range(fds_limit_margin)]\n            except OSError as e:\n                if e.errno == errno.EMFILE:\n                    raise RuntimeError(\n                        \"Too many open files. Communication with the\"\n                        \" workers is no longer possible. Please increase the\"\n                        \" limit using `ulimit -n` in the shell or change the\"\n                        \" sharing strategy by calling\"\n                        \" `torch.multiprocessing.set_sharing_strategy('file_system')`\"\n                        \" at the beginning of your code\") from None\n            raise\n</code></pre>\n<p>I started to debug into the details, and what I see is that the Dataset (a Subset) is properly set in the MultiProcessingDataloaderIter:</p>\n<p>This is how i setup the dataloaders:</p>\n<pre><code class=\"lang-auto\">        # split the dataset in train and test set\n        train_size = int(len(dataset) * train_val_split)\n        val_size = len(dataset) - train_size\n        train_set, val_set = torch.utils.data.random_split(dataset, [train_size, val_size])\n\n        # define training and validation data loaders\n        data_loader_train = torch.utils.data.DataLoader(\n            train_set, batch_size=config['batch_size'], shuffle=True, num_workers=4,\n            collate_fn=utils.collate_fn)\n\n        data_loader_val = torch.utils.data.DataLoader(\n            val_set, batch_size=config['batch_size'], shuffle=False, num_workers=1,\n            collate_fn=utils.collate_fn)\n</code></pre>\n<p>I can observe that from start a timeout is reached three times in a row, and then the first record is returned from the dataset. But then I continue getting timeouts after a view records have been returned. And this pattern continues so that training is not feasible, due to the enormous delays.</p>\n<p>Why is the behavior with Linux different? When I set num_workers to 0, then the blocking is gone.</p>",12          "post_number": 1,13          "post_type": 1,14          "posts_count": 1,15          "updated_at": "2022-07-24T13:04:53.349Z",16          "reply_count": 0,17          "reply_to_post_number": null,18          "quote_count": 0,19          "incoming_link_count": 540,20          "reads": 16,21          "readers_count": 15,22          "score": 2703.2,23          "yours": false,24          "topic_id": 157365,25          "topic_slug": "dataloader-hangs-during-training",26          "display_username": "",27          "primary_group_name": null,28          "flair_name": null,29          "flair_url": null,30          "flair_bg_color": null,31          "flair_color": null,32          "flair_group_id": null,33          "badges_granted": [],34          "version": 1,35          "can_edit": false,36          "can_delete": false,37          "can_recover": false,38          "can_see_hidden_post": false,39          "can_wiki": false,40          "read": true,41          "user_title": null,42          "bookmarked": false,43          "actions_summary": [],44          "moderator": false,45          "admin": false,46          "staff": false,47          "user_id": 57335,48          "hidden": false,49          "trust_level": 1,50          "deleted_at": null,51          "user_deleted": false,52          "edit_reason": null,53          "can_view_edit_history": true,54          "wiki": false,55          "post_url": "/t/dataloader-hangs-during-training/157365/1",56          "can_accept_answer": false,57          "can_unaccept_answer": false,58          "accepted_answer": false,59          "topic_accepted_answer": null,60          "can_vote": false61        }62      ],63      "stream": [64        35799165      ]66    },67    "timeline_lookup": [68      [69        1,70        118971      ]72    ],73    "suggested_topics": [74      {75        "fancy_title": "Cannot find unused Parameters (DDP Training)",76        "id": 219344,77        "title": "Cannot find unused Parameters (DDP Training)",78        "slug": "cannot-find-unused-parameters-ddp-training",79        "posts_count": 1,80        "reply_count": 0,81        "highest_post_number": 1,82        "image_url": null,83        "created_at": "2025-04-22T16:49:57.607Z",84        "last_posted_at": "2025-04-22T16:49:57.652Z",85        "bumped": true,86        "bumped_at": "2025-04-22T16:53:49.141Z",87        "archetype": "regular",88        "unseen": false,89        "pinned": false,90        "unpinned": null,91        "visible": true,92        "closed": false,93        "archived": false,94        "bookmarked": null,95        "liked": null,96        "tags_descriptions": {},97        "like_count": 0,98        "views": 200,99        "category_id": 5,100        "featured_link": null,101        "has_accepted_answer": false,102        "posters": [103          {104            "extras": "latest single",105            "description": "Original Poster, Most Recent Poster",106            "user": {107              "id": 83950,108              "username": "rdslater",109              "name": "rds",110              "avatar_template": "/user_avatar/discuss.pytorch.org/rdslater/{size}/75820_2.png",111              "trust_level": 1112            }113          }114        ]115      },116      {117        "fancy_title": "Why grid_sample over direct indexing?",118        "id": 220437,119        "title": "Why grid_sample over direct indexing?",120        "slug": "why-grid-sample-over-direct-indexing",121        "posts_count": 1,122        "reply_count": 0,123        "highest_post_number": 1,124        "image_url": null,125        "created_at": "2025-05-29T17:57:46.456Z",126        "last_posted_at": "2025-05-29T17:57:46.494Z",127        "bumped": true,128        "bumped_at": "2025-05-29T17:57:46.494Z",129        "archetype": "regular",130        "unseen": false,131        "pinned": false,132        "unpinned": null,133        "visible": true,134        "closed": false,135        "archived": false,136        "bookmarked": null,137        "liked": null,138        "tags_descriptions": {},139        "like_count": 0,140        "views": 24,141        "category_id": 5,142        "featured_link": null,143        "has_accepted_answer": false,144        "posters": [145          {146            "extras": "latest single",147            "description": "Original Poster, Most Recent Poster",148            "user": {149              "id": 84422,150              "username": "jeffrey-ke",151              "name": "Jeffrey Ke",152              "avatar_template": "/user_avatar/discuss.pytorch.org/jeffrey-ke/{size}/77137_2.png",153              "trust_level": 1154            }155          }156        ]157      },158      {159        "fancy_title": "No gradient found for a parameter in custom Linear class",160        "id": 212455,161        "title": "No gradient found for a parameter in custom Linear class",162        "slug": "no-gradient-found-for-a-parameter-in-custom-linear-class",163        "posts_count": 2,164        "reply_count": 0,165        "highest_post_number": 2,166        "image_url": null,167        "created_at": "2024-11-02T19:37:13.384Z",168        "last_posted_at": "2024-11-04T14:49:26.100Z",169        "bumped": true,170        "bumped_at": "2024-11-04T14:49:26.100Z",171        "archetype": "regular",172        "unseen": false,173        "pinned": false,174        "unpinned": null,175        "visible": true,176        "closed": false,177        "archived": false,178        "bookmarked": null,179        "liked": null,180        "tags_descriptions": {},181        "like_count": 0,182        "views": 42,183        "category_id": 5,184        "featured_link": null,185        "has_accepted_answer": false,186        "posters": [187          {188            "extras": null,189            "description": "Original Poster",190            "user": {191              "id": 80655,192              "username": "Arkapravo_Ghosh",193              "name": "Arkapravo Ghosh",194              "avatar_template": "/user_avatar/discuss.pytorch.org/arkapravo_ghosh/{size}/73737_2.png",195              "trust_level": 1196            }197          },198          {199            "extras": "latest",200            "description": "Most Recent Poster",201            "user": {202              "id": 3534,203              "username": "ptrblck",204              "name": "",205              "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",206              "admin": true,207              "moderator": true,208              "trust_level": 2209            }210          }211        ]212      },213      {214        "fancy_title": "The data is getting moved to GPU but GPU is not utilized for training",215        "id": 216823,216        "title": "The data is getting moved to GPU but GPU is not utilized for training",217        "slug": "the-data-is-getting-moved-to-gpu-but-gpu-is-not-utilized-for-training",218        "posts_count": 4,219        "reply_count": 2,220        "highest_post_number": 4,221        "image_url": null,222        "created_at": "2025-02-18T12:58:30.725Z",223        "last_posted_at": "2025-02-18T14:02:07.420Z",224        "bumped": true,225        "bumped_at": "2025-02-18T14:02:07.420Z",226        "archetype": "regular",227        "unseen": false,228        "pinned": false,229        "unpinned": null,230        "visible": true,231        "closed": false,232        "archived": false,233        "bookmarked": null,234        "liked": null,235        "tags_descriptions": {},236        "like_count": 0,237        "views": 43,238        "category_id": 5,239        "featured_link": null,240        "has_accepted_answer": false,241        "posters": [242          {243            "extras": null,244            "description": "Original Poster",245            "user": {246              "id": 82760,247              "username": "Preet_Sojitra1",248              "name": "Preet Sojitra",249              "avatar_template": "/user_avatar/discuss.pytorch.org/preet_sojitra1/{size}/75720_2.png",250              "trust_level": 1251            }252          },253          {254            "extras": "latest",255            "description": "Most Recent Poster",256            "user": {257              "id": 3534,258              "username": "ptrblck",259              "name": "",260              "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",261              "admin": true,262              "moderator": true,263              "trust_level": 2264            }265          }266        ]267      },268      {269        "fancy_title": "Sort YoloPose detection using Tracker ID",270        "id": 221474,271        "title": "Sort YoloPose detection using Tracker ID",272        "slug": "sort-yolopose-detection-using-tracker-id",273        "posts_count": 2,274        "reply_count": 0,275        "highest_post_number": 2,276        "image_url": null,277        "created_at": "2025-07-12T17:23:26.556Z",278        "last_posted_at": "2025-07-12T23:58:14.018Z",279        "bumped": true,280        "bumped_at": "2025-07-16T09:25:29.695Z",281        "archetype": "regular",282        "unseen": false,283        "pinned": false,284        "unpinned": null,285        "visible": true,286        "closed": false,287        "archived": false,288        "bookmarked": null,289        "liked": null,290        "tags_descriptions": {},291        "like_count": 0,292        "views": 57,293        "category_id": 5,294        "featured_link": null,295        "has_accepted_answer": false,296        "posters": [297          {298            "extras": null,299            "description": "Original Poster",300            "user": {301              "id": 53578,302              "username": "Miss_M",303              "name": "CodeVision",304              "avatar_template": "/letter_avatar_proxy/v4/letter/m/c5a1d2/{size}.png",305              "trust_level": 0306            }307          },308          {309            "extras": "latest",310            "description": "Most Recent Poster",311            "user": {312              "id": 83318,313              "username": "neonwatty",314              "name": "Jeremy Watt",315              "avatar_template": "/user_avatar/discuss.pytorch.org/neonwatty/{size}/76202_2.png",316              "trust_level": 0317            }318          }319        ]320      }321    ],322    "tags_descriptions": {},323    "fancy_title": "Dataloader hangs during training",324    "id": 157365,325    "title": "Dataloader hangs during training",326    "posts_count": 1,327    "created_at": "2022-07-24T13:04:53.285Z",328    "views": 1085,329    "reply_count": 0,330    "like_count": 0,331    "last_posted_at": "2022-07-24T13:04:53.349Z",332    "visible": true,333    "closed": false,334    "archived": false,335    "has_summary": false,336    "archetype": "regular",337    "slug": "dataloader-hangs-during-training",338    "category_id": 5,339    "word_count": 577,340    "deleted_at": null,341    "user_id": 57335,342    "featured_link": null,343    "pinned_globally": false,344    "pinned_at": null,345    "pinned_until": null,346    "image_url": null,347    "slow_mode_seconds": 0,348    "draft": null,349    "draft_key": "topic_157365",350    "draft_sequence": null,351    "unpinned": null,352    "pinned": false,353    "current_post_number": 1,354    "highest_post_number": 1,355    "deleted_by": null,356    "actions_summary": [357      {358        "id": 4,359        "count": 0,360        "hidden": false,361        "can_act": false362      },363      {364        "id": 8,365        "count": 0,366        "hidden": false,367        "can_act": false368      },369      {370        "id": 10,371        "count": 0,372        "hidden": false,373        "can_act": false374      },375      {376        "id": 7,377        "count": 0,378        "hidden": false,379        "can_act": false380      }381    ],382    "chunk_size": 20,383    "bookmarked": false,384    "topic_timer": null,385    "message_bus_last_id": 0,386    "participant_count": 1,387    "show_read_indicator": false,388    "thumbnails": null,389    "slow_mode_enabled_until": null,390    "can_vote": false,391    "vote_count": 0,392    "user_voted": false,393    "discourse_zendesk_plugin_zendesk_id": null,394    "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",395    "details": {396      "can_edit": false,397      "notification_level": 1,398      "participants": [399        {400          "id": 57335,401          "username": "Joysn",402          "name": "",403          "avatar_template": "/letter_avatar_proxy/v4/letter/j/77aa72/{size}.png",404          "post_count": 1,405          "primary_group_name": null,406          "flair_name": null,407          "flair_url": null,408          "flair_color": null,409          "flair_bg_color": null,410          "flair_group_id": null,411          "trust_level": 1412        }413      ],414      "created_by": {415        "id": 57335,416        "username": "Joysn",417        "name": "",418        "avatar_template": "/letter_avatar_proxy/v4/letter/j/77aa72/{size}.png"419      },420      "last_poster": {421        "id": 57335,422        "username": "Joysn",423        "name": "",424        "avatar_template": "/letter_avatar_proxy/v4/letter/j/77aa72/{size}.png"425      }426    },427    "bookmarks": []428  },429  {430    "post_stream": {431      "posts": [432        {433          "id": 325579,434          "name": "Prerna Khanna",435          "username": "prerna",436          "avatar_template": "/letter_avatar_proxy/v4/letter/p/eada6e/{size}.png",437          "created_at": "2022-01-08T15:16:42.556Z",438          "cooked": "<p>Hi,</p>\n<p>I have a custom PyTorch model, the inputs are of the model as like this:<br>\nmodel(torch.randint(0, 10,(1,1)), torch.rand(1, 51, 2048), torch.randint(0, 10,(1, 1))).<br>\nI am trying to speed benchmark this model with Android, but I am unable to understand how I should use the “input_dims” and “input_type” parameters as this model involves a mix of float and integer types.</p>\n<p>Thanks!</p>",439          "post_number": 1,440          "post_type": 1,441          "posts_count": 4,442          "updated_at": "2022-01-08T15:16:42.556Z",443          "reply_count": 0,444          "reply_to_post_number": null,445          "quote_count": 0,446          "incoming_link_count": 114,447          "reads": 15,448          "readers_count": 14,449          "score": 573.0,450          "yours": false,451          "topic_id": 141120,452          "topic_slug": "input-dims-and-input-type-for-speed-benchmarking-on-android",453          "display_username": "Prerna Khanna",454          "primary_group_name": null,455          "flair_name": null,456          "flair_url": null,457          "flair_bg_color": null,458          "flair_color": null,459          "flair_group_id": null,460          "badges_granted": [],461          "version": 1,462          "can_edit": false,463          "can_delete": false,464          "can_recover": false,465          "can_see_hidden_post": false,466          "can_wiki": false,467          "read": true,468          "user_title": null,469          "bookmarked": false,470          "actions_summary": [],471          "moderator": false,472          "admin": false,473          "staff": false,474          "user_id": 52200,475          "hidden": false,476          "trust_level": 1,477          "deleted_at": null,478          "user_deleted": false,479          "edit_reason": null,480          "can_view_edit_history": true,481          "wiki": false,482          "post_url": "/t/input-dims-and-input-type-for-speed-benchmarking-on-android/141120/1",483          "can_accept_answer": false,484          "can_unaccept_answer": false,485          "accepted_answer": false,486          "topic_accepted_answer": null,487          "can_vote": false488        },489        {490          "id": 325647,491          "name": "Prerna Khanna",492          "username": "prerna",493          "avatar_template": "/letter_avatar_proxy/v4/letter/p/eada6e/{size}.png",494          "created_at": "2022-01-09T10:38:34.294Z",495          "cooked": "<p>An update:<br>\nI checked the speed_benchmark_torch.cc file. It specifies “If multiple input needed, use semicolon to separate the dimension of different tensors.”</p>\n<p>Therefore, I tried: --input_dims=“1,1;1,51,2048;1,1” --input_type=“int64;float;int64”.</p>\n<p>This results in error:<br>\nterminating with uncaught exception of type c10::Error: [enforce fail at speed_benchmark_torch.cc:111] input_dims_list.size() == input_type_list.size(). 1 vs 0. Input dims and type should have the same number of items.</p>\n<p>(no backtrace available)</p>\n<p>Aborted</p>",496          "post_number": 2,497          "post_type": 1,498          "posts_count": 4,499          "updated_at": "2022-01-09T10:38:57.020Z",500          "reply_count": 0,501          "reply_to_post_number": null,502          "quote_count": 0,503          "incoming_link_count": 3,504          "reads": 15,505          "readers_count": 14,506          "score": 18.0,507          "yours": false,508          "topic_id": 141120,509          "topic_slug": "input-dims-and-input-type-for-speed-benchmarking-on-android",510          "display_username": "Prerna Khanna",511          "primary_group_name": null,512          "flair_name": null,513          "flair_url": null,514          "flair_bg_color": null,515          "flair_color": null,516          "flair_group_id": null,517          "badges_granted": [],518          "version": 1,519          "can_edit": false,520          "can_delete": false,521          "can_recover": false,522          "can_see_hidden_post": false,523          "can_wiki": false,524          "read": true,525          "user_title": null,526          "bookmarked": false,527          "actions_summary": [],528          "moderator": false,529          "admin": false,530          "staff": false,531          "user_id": 52200,532          "hidden": false,533          "trust_level": 1,534          "deleted_at": null,535          "user_deleted": false,536          "edit_reason": null,537          "can_view_edit_history": true,538          "wiki": false,539          "post_url": "/t/input-dims-and-input-type-for-speed-benchmarking-on-android/141120/2",540          "can_accept_answer": false,541          "can_unaccept_answer": false,542          "accepted_answer": false,543          "topic_accepted_answer": null544        },545        {546          "id": 327213,547          "name": "Akshit Khurana",548          "username": "axitkhurana",549          "avatar_template": "/user_avatar/discuss.pytorch.org/axitkhurana/{size}/38375_2.png",550          "created_at": "2022-01-18T22:04:18.455Z",551          "cooked": "<p>Hi <a class=\"mention\" href=\"/u/prerna\">@prerna</a>, what’s the full command you are running?</p>",552          "post_number": 3,553          "post_type": 1,554          "posts_count": 4,555          "updated_at": "2022-01-18T22:04:18.455Z",556          "reply_count": 0,557          "reply_to_post_number": null,558          "quote_count": 0,559          "incoming_link_count": 3,560          "reads": 12,561          "readers_count": 11,562          "score": 17.4,563          "yours": false,564          "topic_id": 141120,565          "topic_slug": "input-dims-and-input-type-for-speed-benchmarking-on-android",566          "display_username": "Akshit Khurana",567          "primary_group_name": null,568          "flair_name": null,569          "flair_url": null,570          "flair_bg_color": null,571          "flair_color": null,572          "flair_group_id": null,573          "badges_granted": [],574          "version": 1,575          "can_edit": false,576          "can_delete": false,577          "can_recover": false,578          "can_see_hidden_post": false,579          "can_wiki": false,580          "read": true,581          "user_title": null,582          "bookmarked": false,583          "actions_summary": [],584          "moderator": false,585          "admin": false,586          "staff": false,587          "user_id": 45448,588          "hidden": false,589          "trust_level": 1,590          "deleted_at": null,591          "user_deleted": false,592          "edit_reason": null,593          "can_view_edit_history": true,594          "wiki": false,595          "post_url": "/t/input-dims-and-input-type-for-speed-benchmarking-on-android/141120/3",596          "can_accept_answer": false,597          "can_unaccept_answer": false,598          "accepted_answer": false,599          "topic_accepted_answer": null600        },601        {602          "id": 357985,603          "name": "Timofey Pushkin",604          "username": "TimPushkin",605          "avatar_template": "/user_avatar/discuss.pytorch.org/timpushkin/{size}/51734_2.png",606          "created_at": "2022-07-24T10:31:29.459Z",607          "cooked": "<p>I had the same problem. The solution is to put an escape character before <code>;</code>, so the parameters should look like <code>--input_dims=“1,2\\;1,2,3\\;5,6,7” --input_type=“float\\;float\\;uint8_t”</code> for example. Also, the script will require you to specify the memory format: <code>--input_memory_format=\"contiguous_format\\;contiguous_format\\;contiguous_format\"</code>, for example (<code>contiguous_format</code> is the default value).</p>",608          "post_number": 4,609          "post_type": 1,610          "posts_count": 4,611          "updated_at": "2022-07-24T10:49:03.640Z",612          "reply_count": 0,613          "reply_to_post_number": null,614          "quote_count": 0,615          "incoming_link_count": 0,616          "reads": 8,617          "readers_count": 7,618          "score": 1.6,619          "yours": false,620          "topic_id": 141120,621          "topic_slug": "input-dims-and-input-type-for-speed-benchmarking-on-android",622          "display_username": "Timofey Pushkin",623          "primary_group_name": null,624          "flair_name": null,625          "flair_url": null,626          "flair_bg_color": null,627          "flair_color": null,628          "flair_group_id": null,629          "badges_granted": [],630          "version": 2,631          "can_edit": false,632          "can_delete": false,633          "can_recover": false,634          "can_see_hidden_post": false,635          "can_wiki": false,636          "read": true,637          "user_title": null,638          "bookmarked": false,639          "actions_summary": [],640          "moderator": false,641          "admin": false,642          "staff": false,643          "user_id": 57931,644          "hidden": false,645          "trust_level": 1,646          "deleted_at": null,647          "user_deleted": false,648          "edit_reason": null,649          "can_view_edit_history": true,650          "wiki": false,651          "post_url": "/t/input-dims-and-input-type-for-speed-benchmarking-on-android/141120/4",652          "can_accept_answer": false,653          "can_unaccept_answer": false,654          "accepted_answer": false,655          "topic_accepted_answer": null656        }657      ],658      "stream": [659        325579,660        325647,661        327213,662        357985663      ]664    },665    "timeline_lookup": [666      [667        1,668        1386669      ],670      [671        2,672        1385673      ],674      [675        3,676        1376677      ],678      [679        4,680        1189681      ]682    ],683    "suggested_topics": [684      {685        "fancy_title": "Pytorch on Android App Open Source Code",686        "id": 212345,687        "title": "Pytorch on Android App Open Source Code",688        "slug": "pytorch-on-android-app-open-source-code",689        "posts_count": 4,690        "reply_count": 2,691        "highest_post_number": 4,692        "image_url": null,693        "created_at": "2024-10-31T05:01:09.173Z",694        "last_posted_at": "2024-11-01T05:45:54.334Z",695        "bumped": true,696        "bumped_at": "2024-11-01T05:45:54.334Z",697        "archetype": "regular",698        "unseen": false,699        "pinned": false,700        "unpinned": null,701        "visible": true,702        "closed": false,703        "archived": false,704        "bookmarked": null,705        "liked": null,706        "tags_descriptions": {},707        "like_count": 0,708        "views": 415,709        "category_id": 18,710        "featured_link": null,711        "has_accepted_answer": false,712        "posters": [713          {714            "extras": null,715            "description": "Original Poster",716            "user": {717              "id": 80605,718              "username": "hasan10242048",719              "name": "Hasan",720              "avatar_template": "/letter_avatar_proxy/v4/letter/h/db5fbb/{size}.png",721              "trust_level": 0722            }723          },724          {725            "extras": "latest",726            "description": "Most Recent Poster",727            "user": {728              "id": 78822,729              "username": "Mert_Oguzhan",730              "name": "Mert Oğuzhan",731              "avatar_template": "/user_avatar/discuss.pytorch.org/mert_oguzhan/{size}/72669_2.png",732              "trust_level": 1733            }734          }735        ]736      },737      {738        "fancy_title": "Xcode got error &ldquo;Error loading model: Following ops cannot be found: [aten::scaled_dot_product_attention]. Please check if the operator library is included in the build. If built with selected ops, check if these ops are in the list.&rdquo;",739        "id": 215201,740        "title": "Xcode got error \"Error loading model: Following ops cannot be found: [aten::scaled_dot_product_attention]. Please check if the operator library is included in the build. If built with selected ops, check if these ops are in the list.\"",741        "slug": "xcode-got-error-error-loading-model-following-ops-cannot-be-found-aten-scaled-dot-product-attention-please-check-if-the-operator-library-is-included-in-the-build-if-built-with-selected-ops-check-if-these-ops-are-in-the-list",742        "posts_count": 5,743        "reply_count": 2,744        "highest_post_number": 5,745        "image_url": null,746        "created_at": "2025-01-10T08:48:17.185Z",747        "last_posted_at": "2025-01-13T08:45:48.126Z",748        "bumped": true,749        "bumped_at": "2025-01-13T08:45:48.126Z",750        "archetype": "regular",751        "unseen": false,752        "pinned": false,753        "unpinned": null,754        "visible": true,755        "closed": false,756        "archived": false,757        "bookmarked": null,758        "liked": null,759        "tags_descriptions": {},760        "like_count": 0,761        "views": 55,762        "category_id": 18,763        "featured_link": null,764        "has_accepted_answer": false,765        "posters": [766          {767            "extras": "latest",768            "description": "Original Poster, Most Recent Poster",769            "user": {770              "id": 81987,771              "username": "Danny_Vu",772              "name": "Danny Vu",773              "avatar_template": "/user_avatar/discuss.pytorch.org/danny_vu/{size}/75016_2.png",774              "trust_level": 0775            }776          },777          {778            "extras": null,779            "description": "Frequent Poster",780            "user": {781              "id": 3534,782              "username": "ptrblck",783              "name": "",784              "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",785              "admin": true,786              "moderator": true,787              "trust_level": 2788            }789          },790          {791            "extras": null,792            "description": "Frequent Poster",793            "user": {794              "id": 82002,795              "username": "tarun292",796              "name": "Tarun Karuturi",797              "avatar_template": "/user_avatar/discuss.pytorch.org/tarun292/{size}/75031_2.png",798              "trust_level": 0799            }800          }801        ]802      },803      {804        "fancy_title": "Android build: Native libraries not 16 KB page-aligned, Play Store rejecting apps",805        "id": 223243,806        "title": "Android build: Native libraries not 16 KB page-aligned, Play Store rejecting apps",807        "slug": "android-build-native-libraries-not-16-kb-page-aligned-play-store-rejecting-apps",808        "posts_count": 4,809        "reply_count": 2,810        "highest_post_number": 4,811        "image_url": null,812        "created_at": "2025-09-22T06:36:37.147Z",813        "last_posted_at": "2025-10-07T16:29:30.910Z",814        "bumped": true,815        "bumped_at": "2025-10-07T16:29:30.910Z",816        "archetype": "regular",817        "unseen": false,818        "pinned": false,819        "unpinned": null,820        "visible": true,821        "closed": false,822        "archived": false,823        "bookmarked": null,824        "liked": null,825        "tags_descriptions": {},826        "like_count": 1,827        "views": 71,828        "category_id": 18,829        "featured_link": null,830        "has_accepted_answer": false,831        "posters": [832          {833            "extras": null,834            "description": "Original Poster",835            "user": {836              "id": 85936,837              "username": "Prahlad",838              "name": "Prahlad",839              "avatar_template": "/user_avatar/discuss.pytorch.org/prahlad/{size}/76925_2.png",840              "trust_level": 0841            }842          },843          {844            "extras": null,845            "description": "Frequent Poster",846            "user": {847              "id": 58104,848              "username": "cbilgin",849              "name": "Cagatay Bilgin",850              "avatar_template": "/user_avatar/discuss.pytorch.org/cbilgin/{size}/48008_2.png",851              "trust_level": 1852            }853          },854          {855            "extras": "latest",856            "description": "Most Recent Poster",857            "user": {858              "id": 86070,859              "username": "olokobayusuf",860              "name": "Yusuf",861              "avatar_template": "/user_avatar/discuss.pytorch.org/olokobayusuf/{size}/78371_2.png",862              "trust_level": 0863            }864          }865        ]866      },867      {868        "fancy_title": "[Android] Large model 4GB on Android app is crashing",869        "id": 223543,870        "title": "[Android] Large model 4GB on Android app is crashing",871        "slug": "android-large-model-4gb-on-android-app-is-crashing",872        "posts_count": 7,873        "reply_count": 1,874        "highest_post_number": 7,875        "image_url": null,876        "created_at": "2025-10-09T07:28:00.164Z",877        "last_posted_at": "2025-10-20T19:14:43.627Z",878        "bumped": true,879        "bumped_at": "2025-10-20T19:14:43.627Z",880        "archetype": "regular",881        "unseen": false,882        "pinned": false,883        "unpinned": null,884        "visible": true,885        "closed": false,886        "archived": false,887        "bookmarked": null,888        "liked": null,889        "tags_descriptions": {},890        "like_count": 0,891        "views": 46,892        "category_id": 18,893        "featured_link": null,894        "has_accepted_answer": false,895        "posters": [896          {897            "extras": null,898            "description": "Original Poster",899            "user": {900              "id": 86107,901              "username": "brainchip_india",902              "name": "brainchip india",903              "avatar_template": "/user_avatar/discuss.pytorch.org/brainchip_india/{size}/78397_2.png",904              "trust_level": 1905            }906          },907          {908            "extras": null,909            "description": "Frequent Poster",910            "user": {911              "id": 86058,912              "username": "GerryMan",913              "name": null,914              "avatar_template": "/letter_avatar_proxy/v4/letter/g/f6c823/{size}.png",915              "trust_level": 1916            }917          },918          {919            "extras": null,920            "description": "Frequent Poster",921            "user": {922              "id": 86070,923              "username": "olokobayusuf",924              "name": "Yusuf",925              "avatar_template": "/user_avatar/discuss.pytorch.org/olokobayusuf/{size}/78371_2.png",926              "trust_level": 0927            }928          },929          {930            "extras": "latest",931            "description": "Most Recent Poster",932            "user": {933              "id": 58104,934              "username": "cbilgin",935              "name": "Cagatay Bilgin",936              "avatar_template": "/user_avatar/discuss.pytorch.org/cbilgin/{size}/48008_2.png",937              "trust_level": 1938            }939          }940        ]941      },942      {943        "fancy_title": "NVIDIA L40s | CUDA driver initialization failed, you might not have a CUDA gpu",944        "id": 217505,945        "title": "NVIDIA L40s | CUDA driver initialization failed, you might not have a CUDA gpu",946        "slug": "nvidia-l40s-cuda-driver-initialization-failed-you-might-not-have-a-cuda-gpu",947        "posts_count": 3,948        "reply_count": 0,949        "highest_post_number": 3,950        "image_url": null,951        "created_at": "2025-03-06T06:08:05.076Z",952        "last_posted_at": "2025-03-06T16:43:17.246Z",953        "bumped": true,954        "bumped_at": "2025-03-06T16:43:17.246Z",955        "archetype": "regular",956        "unseen": false,957        "pinned": false,958        "unpinned": null,959        "visible": true,960        "closed": false,961        "archived": false,962        "bookmarked": null,963        "liked": null,964        "tags_descriptions": {},965        "like_count": 0,966        "views": 201,967        "category_id": 14,968        "featured_link": null,969        "has_accepted_answer": false,970        "posters": [971          {972            "extras": null,973            "description": "Original Poster",974            "user": {975              "id": 83098,976              "username": "afnanrahman",977              "name": "Afnan Ngathour Rahman",978              "avatar_template": "/user_avatar/discuss.pytorch.org/afnanrahman/{size}/76009_2.png",979              "trust_level": 0980            }981          },982          {983            "extras": null,984            "description": "Frequent Poster",985            "user": {986              "id": 80724,987              "username": "paulge",988              "name": "",989              "avatar_template": "/letter_avatar_proxy/v4/letter/p/82dd89/{size}.png",990              "trust_level": 2991            }992          },993          {994            "extras": "latest",995            "description": "Most Recent Poster",996            "user": {997              "id": 3534,998              "username": "ptrblck",999              "name": "",1000              "avatar_template": "/user_avatar/discuss.pytorch.org/ptrblck/{size}/1823_2.png",1001              "admin": true,1002              "moderator": true,1003              "trust_level": 21004            }1005          }1006        ]1007      }1008    ],1009    "tags_descriptions": {},1010    "fancy_title": "Input dims and input type for speed benchmarking on Android",1011    "id": 141120,1012    "title": "Input dims and input type for speed benchmarking on Android",1013    "posts_count": 4,1014    "created_at": "2022-01-08T15:16:42.494Z",1015    "views": 1007,1016    "reply_count": 0,1017    "like_count": 0,1018    "last_posted_at": "2022-07-24T10:31:29.459Z",1019    "visible": true,1020    "closed": false,1021    "archived": false,1022    "has_summary": false,1023    "archetype": "regular",1024    "slug": "input-dims-and-input-type-for-speed-benchmarking-on-android",1025    "category_id": 18,1026    "word_count": 216,1027    "deleted_at": null,1028    "user_id": 52200,1029    "featured_link": null,1030    "pinned_globally": false,1031    "pinned_at": null,1032    "pinned_until": null,1033    "image_url": null,1034    "slow_mode_seconds": 0,1035    "draft": null,1036    "draft_key": "topic_141120",1037    "draft_sequence": null,1038    "unpinned": null,1039    "pinned": false,1040    "current_post_number": 1,1041    "highest_post_number": 4,1042    "deleted_by": null,1043    "actions_summary": [1044      {1045        "id": 4,1046        "count": 0,1047        "hidden": false,1048        "can_act": false1049      },1050      {1051        "id": 8,1052        "count": 0,1053        "hidden": false,1054        "can_act": false1055      },1056      {1057        "id": 10,1058        "count": 0,1059        "hidden": false,1060        "can_act": false1061      },1062      {1063        "id": 7,1064        "count": 0,1065        "hidden": false,1066        "can_act": false1067      }1068    ],1069    "chunk_size": 20,1070    "bookmarked": false,1071    "topic_timer": null,1072    "message_bus_last_id": 0,1073    "participant_count": 3,1074    "show_read_indicator": false,1075    "thumbnails": null,1076    "slow_mode_enabled_until": null,1077    "can_vote": false,1078    "vote_count": 0,1079    "user_voted": false,1080    "discourse_zendesk_plugin_zendesk_id": null,1081    "discourse_zendesk_plugin_zendesk_url": "https://your-url.zendesk.com/agent/tickets/",1082    "details": {1083      "can_edit": false,1084      "notification_level": 1,1085      "participants": [1086        {1087          "id": 52200,1088          "username": "prerna",1089          "name": "Prerna Khanna",1090          "avatar_template": "/letter_avatar_proxy/v4/letter/p/eada6e/{size}.png",1091          "post_count": 2,1092          "primary_group_name": null,1093          "flair_name": null,1094          "flair_url": null,1095          "flair_color": null,1096          "flair_bg_color": null,1097          "flair_group_id": null,1098          "trust_level": 11099        },1100        {1101          "id": 45448,1102          "username": "axitkhurana",1103          "name": "Akshit Khurana",1104          "avatar_template": "/user_avatar/discuss.pytorch.org/axitkhurana/{size}/38375_2.png",1105          "post_count": 1,1106          "primary_group_name": null,1107          "flair_name": null,1108          "flair_url": null,1109          "flair_color": null,1110          "flair_bg_color": null,1111          "flair_group_id": null,1112          "trust_level": 11113        },1114        {1115          "id": 57931,1116          "username": "TimPushkin",1117          "name": "Timofey Pushkin",1118          "avatar_template": "/user_avatar/discuss.pytorch.org/timpushkin/{size}/51734_2.png",1119          "post_count": 1,1120          "primary_group_name": null,1121          "flair_name": null,1122          "flair_url": null,1123          "flair_color": null,1124          "flair_bg_color": null,1125          "flair_group_id": null,1126          "trust_level": 11127        }1128      ],1129      "created_by": {1130        "id": 52200,1131        "username": "prerna",1132        "name": "Prerna Khanna",1133        "avatar_template": "/letter_avatar_proxy/v4/letter/p/eada6e/{size}.png"1134      },1135      "last_poster": {1136        "id": 57931,1137        "username": "TimPushkin",1138        "name": "Timofey Pushkin",1139        "avatar_template": "/user_avatar/discuss.pytorch.org/timpushkin/{size}/51734_2.png"1140      }1141    },1142    "bookmarks": []1143  },1144  {1145    "post_stream": {1146      "posts": [1147        {1148          "id": 357927,1149          "name": "Aaron Wang",1150          "username": "Aaron_Wang1",1151          "avatar_template": "/user_avatar/discuss.pytorch.org/aaron_wang1/{size}/45328_2.png",1152          "created_at": "2022-07-23T19:14:58.415Z",1153          "cooked": "<p>Dear sir or madam,</p>\n<p>I have a question about how to get the output of the hidden layer after each epoch because when I tried to do it under the callback, the last result will be covered by the newer one, hence I can only get the final result of the training process. Could you give me some idea about it?</p>",1154          "post_number": 1,1155          "post_type": 1,1156          "posts_count": 5,1157          "updated_at": "2022-07-23T19:14:58.415Z",1158          "reply_count": 0,1159          "reply_to_post_number": null,1160          "quote_count": 0,1161          "incoming_link_count": 34,1162          "reads": 5,1163          "readers_count": 4,1164          "score": 171.0,1165          "yours": false,1166          "topic_id": 157339,1167          "topic_slug": "how-to-save-the-hidden-layer-output-after-each-epoch",1168          "display_username": "Aaron Wang",1169          "primary_group_name": null,1170          "flair_name": null,1171          "flair_url": null,1172          "flair_bg_color": null,1173          "flair_color": null,1174          "flair_group_id": null,1175          "badges_granted": [],1176          "version": 1,1177          "can_edit": false,1178          "can_delete": false,1179          "can_recover": false,1180          "can_see_hidden_post": false,1181          "can_wiki": false,1182          "read": true,1183          "user_title": null,1184          "bookmarked": false,1185          "actions_summary": [],1186          "moderator": false,1187          "admin": false,1188          "staff": false,1189          "user_id": 57593,1190          "hidden": false,1191          "trust_level": 1,1192          "deleted_at": null,1193          "user_deleted": false,1194          "edit_reason": null,1195          "can_view_edit_history": true,1196          "wiki": false,1197          "post_url": "/t/how-to-save-the-hidden-layer-output-after-each-epoch/157339/1",1198          "can_accept_answer": false,1199          "can_unaccept_answer": false,1200          "accepted_answer": false,

Showing the first 1,200 of 67146 lines. Download the file for the rest.