Greatriver/SimBarca

1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 179634 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/00_traj_1253.5.json.gz6Loading a file takes 46.79s7Creating data frames takes 19.12s8Filling data types and values takes 5.55s9 10 Processing a file takes 15.77s11Concatenating time series takes 0.37s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/01_traj_1826.5.json.gz13Loading a file takes 53.25s14Creating data frames takes 23.68s15Filling data types and values takes 6.08s16 17 Processing a file takes 16.18s18Concatenating time series takes 0.25s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/02_traj_2330.5.json.gz20Loading a file takes 55.02s21Creating data frames takes 24.60s22Filling data types and values takes 5.94s23 24 Processing a file takes 15.64s25Concatenating time series takes 0.27s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/03_traj_2801.0.json.gz27Loading a file takes 48.02s28Creating data frames takes 23.29s29Filling data types and values takes 6.08s30 31 Processing a file takes 15.88s32Concatenating time series takes 0.33s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/04_traj_3243.5.json.gz34Loading a file takes 52.14s35Creating data frames takes 23.07s36Filling data types and values takes 6.22s37 38 Processing a file takes 15.53s39Concatenating time series takes 0.37s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/05_traj_3662.0.json.gz41Loading a file takes 42.86s42Creating data frames takes 21.25s43Filling data types and values takes 6.14s44 45 Processing a file takes 15.91s46Concatenating time series takes 0.35s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/06_traj_4054.5.json.gz48Loading a file takes 44.58s49Creating data frames takes 21.36s50Filling data types and values takes 6.05s51 52 Processing a file takes 15.84s53Concatenating time series takes 0.31s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/07_traj_4412.0.json.gz55Loading a file takes 45.10s56Creating data frames takes 21.00s57Filling data types and values takes 6.58s58 59 Processing a file takes 15.79s60Concatenating time series takes 0.33s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/08_traj_4740.0.json.gz62Loading a file takes 50.17s63Creating data frames takes 24.31s64Filling data types and values takes 7.51s65 66 Processing a file takes 17.03s67Concatenating time series takes 0.36s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/09_traj_5046.5.json.gz69Loading a file takes 56.49s70Creating data frames takes 23.60s71Filling data types and values takes 6.37s72 73 Processing a file takes 28.62s74Concatenating time series takes 0.32s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/10_traj_5335.0.json.gz76Loading a file takes 59.35s77Creating data frames takes 24.26s78Filling data types and values takes 6.75s79 80 Processing a file takes 29.47s81Concatenating time series takes 0.31s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/11_traj_5607.5.json.gz83Loading a file takes 59.06s84Creating data frames takes 23.01s85Filling data types and values takes 6.09s86 87 Processing a file takes 15.67s88Concatenating time series takes 0.27s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/12_traj_5861.0.json.gz90Loading a file takes 49.11s91Creating data frames takes 24.10s92Filling data types and values takes 6.39s93 94 Processing a file takes 16.99s95Concatenating time series takes 0.35s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/13_traj_6096.5.json.gz97Loading a file takes 51.34s98Creating data frames takes 23.75s99Filling data types and values takes 6.48s100 101 Processing a file takes 16.52s102Concatenating time series takes 0.39s103Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/14_traj_6317.0.json.gz104Loading a file takes 52.65s105Creating data frames takes 24.08s106Filling data types and values takes 6.65s107 108 Processing a file takes 16.32s109Concatenating time series takes 0.29s110Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/15_traj_6527.0.json.gz111Loading a file takes 53.99s112Creating data frames takes 23.61s113Filling data types and values takes 6.93s114 115 Processing a file takes 15.72s116Concatenating time series takes 0.23s117Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/16_traj_6727.5.json.gz118Loading a file takes 53.46s119Creating data frames takes 23.38s120Filling data types and values takes 6.33s121 122 Processing a file takes 15.99s123Concatenating time series takes 0.39s124Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/17_traj_6918.5.json.gz125Loading a file takes 49.81s126Creating data frames takes 23.24s127Filling data types and values takes 7.01s128 129 Processing a file takes 16.14s130Concatenating time series takes 0.37s131Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/18_traj_7101.0.json.gz132Loading a file takes 53.81s133Creating data frames takes 24.22s134Filling data types and values takes 6.19s135 136 Processing a file takes 16.49s137Concatenating time series takes 0.28s138Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/19_traj_7278.0.json.gz139Loading a file takes 53.52s140Creating data frames takes 23.06s141Filling data types and values takes 5.72s142 143 Processing a file takes 15.65s144Concatenating time series takes 0.33s145Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/20_traj_7459.0.json.gz146Loading a file takes 51.61s147Creating data frames takes 21.25s148Filling data types and values takes 5.96s149 150 Processing a file takes 14.56s151Concatenating time series takes 0.20s152Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/21_traj_7645.0.json.gz153Loading a file takes 45.94s154Creating data frames takes 19.99s155Filling data types and values takes 5.42s156 157 Processing a file takes 14.51s158Concatenating time series takes 0.30s159Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/22_traj_7837.0.json.gz160Loading a file takes 47.36s161Creating data frames takes 21.49s162Filling data types and values takes 5.94s163 164 Processing a file takes 14.90s165Concatenating time series takes 0.29s166Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/23_traj_8038.0.json.gz167Loading a file takes 46.85s168Creating data frames takes 22.51s169Filling data types and values takes 6.25s170 171 Processing a file takes 17.17s172Concatenating time series takes 0.25s173Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/24_traj_8250.0.json.gz174Loading a file takes 52.22s175Creating data frames takes 23.95s176Filling data types and values takes 6.57s177 178 Processing a file takes 15.97s179Concatenating time series takes 0.25s180Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/25_traj_8476.5.json.gz181Loading a file takes 55.86s182Creating data frames takes 25.26s183Filling data types and values takes 6.90s184 185 Processing a file takes 16.43s186Concatenating time series takes 0.29s187Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/26_traj_8717.5.json.gz188Loading a file takes 52.03s189Creating data frames takes 24.22s190Filling data types and values takes 7.68s191 192 Processing a file takes 16.25s193Concatenating time series takes 0.40s194Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/27_traj_8976.5.json.gz195Loading a file takes 51.65s196Creating data frames takes 22.12s197Filling data types and values takes 5.95s198 199 Processing a file takes 14.85s200Concatenating time series takes 0.38s201Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/28_traj_9261.5.json.gz202Loading a file takes 56.12s203Creating data frames takes 24.39s204Filling data types and values takes 6.69s205 206 Processing a file takes 35.32s207Concatenating time series takes 0.25s208Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/29_traj_9576.5.json.gz209Loading a file takes 60.21s210Creating data frames takes 22.34s211Filling data types and values takes 6.18s212 213 Processing a file takes 32.41s214Concatenating time series takes 0.27s215Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/30_traj_9922.5.json.gz216Loading a file takes 59.92s217Creating data frames takes 30.00s218Filling data types and values takes 6.02s219 220 Processing a file takes 15.00s221Concatenating time series takes 0.40s222Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/31_traj_10296.0.json.gz223Loading a file takes 51.82s224Creating data frames takes 23.85s225Filling data types and values takes 6.93s226 227 Processing a file takes 15.78s228Concatenating time series takes 0.35s229Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/32_traj_10702.0.json.gz230Loading a file takes 51.13s231Creating data frames takes 21.32s232Filling data types and values takes 5.76s233 234 Processing a file takes 15.09s235Concatenating time series takes 0.42s236Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/33_traj_11155.5.json.gz237Loading a file takes 55.90s238Creating data frames takes 23.31s239Filling data types and values takes 6.33s240 241 Processing a file takes 14.62s242Concatenating time series takes 0.33s243Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/34_traj_11639.0.json.gz244Loading a file takes 56.20s245Creating data frames takes 23.27s246Filling data types and values takes 6.27s247 248 Processing a file takes 15.59s249Concatenating time series takes 0.30s250Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/35_traj_12142.5.json.gz251Loading a file takes 52.17s252Creating data frames takes 22.77s253Filling data types and values takes 5.97s254 255 Processing a file takes 14.13s256Concatenating time series takes 0.18s257Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/36_traj_12656.5.json.gz258Loading a file takes 44.51s259Creating data frames takes 21.45s260Filling data types and values takes 6.02s261 262 Processing a file takes 13.26s263Concatenating time series takes 0.26s264Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/37_traj_13179.5.json.gz265Loading a file takes 47.98s266Creating data frames takes 21.93s267Filling data types and values takes 6.16s268 269 Processing a file takes 12.97s270Concatenating time series takes 0.22s271Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/38_traj_13714.5.json.gz272Loading a file takes 48.36s273Creating data frames takes 21.53s274Filling data types and values takes 6.13s275 276 Processing a file takes 13.48s277Concatenating time series takes 0.24s278Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/39_traj_14260.5.json.gz279Loading a file takes 57.48s280Creating data frames takes 25.19s281Filling data types and values takes 6.44s282 283 Processing a file takes 14.12s284Concatenating time series takes 0.23s285Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/40_traj_14817.5.json.gz286Loading a file takes 58.38s287Creating data frames takes 24.62s288Filling data types and values takes 6.46s289 290 Processing a file takes 12.58s291Concatenating time series takes 0.20s292Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/41_traj_15379.5.json.gz293Loading a file takes 53.39s294Creating data frames takes 24.45s295Filling data types and values takes 6.60s296 297 Processing a file takes 12.68s298Concatenating time series takes 0.20s299Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/42_traj_15949.0.json.gz300Loading a file takes 57.54s301Creating data frames takes 24.81s302Filling data types and values takes 6.62s303 304 Processing a file takes 14.03s305Concatenating time series takes 0.18s306Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/43_traj_16533.0.json.gz307Loading a file takes 58.94s308Creating data frames takes 24.55s309Filling data types and values takes 6.53s310 311 Processing a file takes 13.33s312Concatenating time series takes 0.23s313Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/44_traj_17132.0.json.gz314Loading a file takes 52.80s315Creating data frames takes 24.17s316Filling data types and values takes 6.63s317 318 Processing a file takes 14.80s319Concatenating time series takes 0.26s320Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/45_traj_17750.0.json.gz321Loading a file takes 53.62s322Creating data frames takes 24.46s323Filling data types and values takes 6.60s324 325 Processing a file takes 15.51s326Concatenating time series takes 0.29s327Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/46_traj_18381.0.json.gz328Loading a file takes 57.48s329Creating data frames takes 24.76s330Filling data types and values takes 6.72s331 332 Processing a file takes 14.08s333Concatenating time series takes 0.25s334Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/47_traj_19026.5.json.gz335Loading a file takes 55.01s336Creating data frames takes 23.92s337Filling data types and values takes 6.43s338 339 Processing a file takes 13.51s340Concatenating time series takes 0.34s341Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/48_traj_19678.5.json.gz342Loading a file takes 57.70s343Creating data frames takes 24.88s344Filling data types and values takes 6.50s345 346 Processing a file takes 13.31s347Concatenating time series takes 0.23s348Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/49_traj_20335.5.json.gz349Loading a file takes 58.21s350Creating data frames takes 24.41s351Filling data types and values takes 6.50s352 353 Processing a file takes 13.11s354Concatenating time series takes 0.24s355Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/50_traj_20996.0.json.gz356Loading a file takes 56.83s357Creating data frames takes 24.21s358Filling data types and values takes 6.51s359 360 Processing a file takes 14.36s361Concatenating time series takes 0.26s362Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/51_traj_21657.5.json.gz363Loading a file takes 51.08s364Creating data frames takes 21.53s365Filling data types and values takes 6.08s366 367 Processing a file takes 13.72s368Concatenating time series takes 0.39s369Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/52_traj_22321.5.json.gz370Loading a file takes 51.99s371Creating data frames takes 21.60s372Filling data types and values takes 6.12s373 374 Processing a file takes 13.28s375Concatenating time series takes 0.21s376Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/53_traj_22987.0.json.gz377Loading a file takes 45.87s378Creating data frames takes 21.70s379Filling data types and values takes 6.25s380 381 Processing a file takes 12.18s382Concatenating time series takes 0.17s383Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/trajectory/54_traj_end.json.gz384Loading a file takes 27.78s385Creating data frames takes 13.12s386Filling data types and values takes 3.24s387 388 Processing a file takes 9.76s389Concatenating time series takes 0.13s390Saving all the section time series takes 176.97s391Saving all the junction time series takes 25.64s392Saving network entrance and exit takes 0.10s393Aggregating the raw statistics to different intervals...394
  0%|          | 0/1525 [00:00<?, ?it/s]
  0%|          | 1/1525 [00:01<27:26,  1.08s/it]
  0%|          | 2/1525 [00:01<12:59,  1.95it/s]
  0%|          | 5/1525 [00:05<31:25,  1.24s/it]
 20%|█▉        | 300/1525 [00:05<00:15, 79.48it/s]
 27%|██▋       | 407/1525 [00:06<00:11, 98.06it/s]
 32%|███▏      | 482/1525 [00:07<00:09, 105.73it/s]
 35%|███▌      | 536/1525 [00:07<00:09, 104.24it/s]
 38%|███▊      | 576/1525 [00:08<00:10, 94.79it/s] 
 40%|███▉      | 606/1525 [00:08<00:09, 93.88it/s]
 41%|████      | 629/1525 [00:08<00:09, 94.47it/s]
 42%|████▏     | 648/1525 [00:08<00:08, 99.74it/s]
 44%|████▎     | 666/1525 [00:09<00:08, 104.31it/s]
 45%|████▍     | 683/1525 [00:09<00:07, 110.79it/s]
 46%|████▌     | 699/1525 [00:09<00:07, 114.32it/s]
 47%|████▋     | 715/1525 [00:09<00:06, 115.92it/s]
 48%|████▊     | 730/1525 [00:09<00:06, 120.76it/s]
 49%|████▉     | 746/1525 [00:09<00:06, 128.25it/s]
 50%|████▉     | 761/1525 [00:09<00:06, 124.82it/s]
 51%|█████     | 775/1525 [00:09<00:05, 126.62it/s]
 52%|█████▏    | 789/1525 [00:09<00:06, 118.55it/s]
 53%|█████▎    | 802/1525 [00:10<00:06, 117.15it/s]
 53%|█████▎    | 815/1525 [00:10<00:06, 114.15it/s]
 54%|█████▍    | 827/1525 [00:10<00:06, 103.86it/s]
 55%|█████▌    | 839/1525 [00:10<00:06, 106.92it/s]
 56%|█████▌    | 850/1525 [00:10<00:06, 104.09it/s]
 57%|█████▋    | 862/1525 [00:10<00:06, 107.57it/s]
 57%|█████▋    | 873/1525 [00:10<00:06, 104.61it/s]
 58%|█████▊    | 884/1525 [00:10<00:06, 94.51it/s] 
 59%|█████▊    | 894/1525 [00:11<00:07, 85.06it/s]
 59%|█████▉    | 905/1525 [00:11<00:06, 90.56it/s]
 60%|██████    | 915/1525 [00:11<00:06, 89.42it/s]
 61%|██████    | 926/1525 [00:11<00:06, 85.81it/s]
 62%|██████▏   | 951/1525 [00:11<00:04, 122.78it/s]
 63%|██████▎   | 964/1525 [00:11<00:04, 123.96it/s]
 64%|██████▍   | 979/1525 [00:11<00:04, 130.31it/s]
 65%|██████▌   | 998/1525 [00:11<00:03, 146.49it/s]
 66%|██████▋   | 1013/1525 [00:11<00:03, 129.29it/s]
 67%|██████▋   | 1027/1525 [00:12<00:05, 97.64it/s] 
 68%|██████▊   | 1039/1525 [00:12<00:06, 79.36it/s]
 69%|██████▉   | 1049/1525 [00:12<00:05, 81.02it/s]
 69%|██████▉   | 1059/1525 [00:12<00:05, 82.21it/s]
 70%|███████   | 1071/1525 [00:12<00:05, 86.11it/s]
 71%|███████   | 1081/1525 [00:12<00:05, 84.21it/s]
 72%|███████▏  | 1092/1525 [00:13<00:05, 84.07it/s]
 73%|███████▎  | 1111/1525 [00:13<00:04, 97.99it/s]
 74%|███████▎  | 1121/1525 [00:13<00:04, 85.15it/s]
 74%|███████▍  | 1130/1525 [00:13<00:04, 82.48it/s]
 75%|███████▌  | 1149/1525 [00:13<00:03, 106.67it/s]
 76%|███████▋  | 1165/1525 [00:13<00:03, 116.07it/s]
 77%|███████▋  | 1178/1525 [00:13<00:03, 108.14it/s]
 78%|███████▊  | 1190/1525 [00:14<00:03, 87.31it/s] 
 79%|███████▊  | 1200/1525 [00:14<00:03, 87.31it/s]
 79%|███████▉  | 1211/1525 [00:14<00:03, 89.48it/s]
 80%|████████  | 1225/1525 [00:14<00:03, 96.18it/s]
 81%|████████▏ | 1242/1525 [00:14<00:02, 110.58it/s]
 82%|████████▏ | 1254/1525 [00:14<00:02, 99.53it/s] 
 83%|████████▎ | 1265/1525 [00:14<00:02, 99.90it/s]
 84%|████████▍ | 1288/1525 [00:14<00:01, 131.84it/s]
 86%|████████▌ | 1306/1525 [00:15<00:01, 143.85it/s]
 87%|████████▋ | 1322/1525 [00:17<00:11, 17.92it/s] 
 88%|████████▊ | 1335/1525 [00:17<00:08, 22.86it/s]
 88%|████████▊ | 1348/1525 [00:17<00:06, 29.19it/s]
 89%|████████▉ | 1364/1525 [00:18<00:04, 38.86it/s]
 90%|█████████ | 1376/1525 [00:18<00:03, 46.03it/s]
 91%|█████████ | 1388/1525 [00:18<00:02, 54.90it/s]
 92%|█████████▏| 1403/1525 [00:18<00:01, 65.24it/s]
 93%|█████████▎| 1421/1525 [00:18<00:01, 83.65it/s]
 94%|█████████▍| 1441/1525 [00:18<00:00, 105.73it/s]
 96%|█████████▌| 1457/1525 [00:18<00:00, 100.92it/s]
 96%|█████████▋| 1471/1525 [00:19<00:00, 94.23it/s] 
 98%|█████████▊| 1490/1525 [00:19<00:00, 105.44it/s]
 99%|█████████▉| 1510/1525 [00:19<00:00, 124.22it/s]
100%|██████████| 1525/1525 [00:19<00:00, 78.90it/s] 395Constructing time series for each modality ...396Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_078/timeseries/agg_timeseries.pkl397Extracting samples from time series ...398number of samples: 20399Packing the samples into numpy arrays ...400Processing completed!