Greatriver/SimBarca

1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 121111 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/00_traj_1348.5.json.gz6Loading a file takes 41.52s7Creating data frames takes 23.07s8Filling data types and values takes 5.40s9 10 Processing a file takes 17.49s11Concatenating time series takes 0.39s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/01_traj_2250.5.json.gz13Loading a file takes 55.88s14Creating data frames takes 21.87s15Filling data types and values takes 5.76s16 17 Processing a file takes 18.61s18Concatenating time series takes 0.28s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/02_traj_3130.5.json.gz20Loading a file takes 53.65s21Creating data frames takes 25.85s22Filling data types and values takes 5.76s23 24 Processing a file takes 17.84s25Concatenating time series takes 0.26s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/03_traj_4025.5.json.gz27Loading a file takes 53.48s28Creating data frames takes 23.41s29Filling data types and values takes 5.89s30 31 Processing a file takes 19.04s32Concatenating time series takes 0.48s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/04_traj_4907.5.json.gz34Loading a file takes 57.09s35Creating data frames takes 26.83s36Filling data types and values takes 5.88s37 38 Processing a file takes 18.93s39Concatenating time series takes 0.52s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/05_traj_5789.5.json.gz41Loading a file takes 54.09s42Creating data frames takes 24.63s43Filling data types and values takes 5.84s44 45 Processing a file takes 36.25s46Concatenating time series takes 0.49s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/06_traj_6661.0.json.gz48Loading a file takes 65.33s49Creating data frames takes 27.71s50Filling data types and values takes 6.03s51 52 Processing a file takes 19.57s53Concatenating time series takes 0.90s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/trajectory/07_traj_end.json.gz55Loading a file takes 49.39s56Creating data frames takes 20.16s57Filling data types and values takes 5.15s58 59 Processing a file takes 18.09s60Concatenating time series takes 0.74s61Saving all the section time series takes 75.21s62Saving all the junction time series takes 10.39s63Saving network entrance and exit takes 0.08s64Aggregating the raw statistics to different intervals...65
  0%|          | 0/1517 [00:00<?, ?it/s]
  0%|          | 1/1517 [00:00<10:18,  2.45it/s]
  2%|▏         | 26/1517 [00:00<00:22, 65.62it/s]
  4%|▍         | 64/1517 [00:00<00:09, 148.41it/s]
  7%|▋         | 101/1517 [00:00<00:07, 194.96it/s]
  9%|▉         | 138/1517 [00:00<00:05, 235.33it/s]
 11%|█         | 167/1517 [00:00<00:06, 224.36it/s]
 13%|█▎        | 194/1517 [00:01<00:06, 218.71it/s]
 15%|█▍        | 221/1517 [00:01<00:05, 229.76it/s]
 16%|█▋        | 250/1517 [00:01<00:05, 240.71it/s]
 18%|█▊        | 279/1517 [00:01<00:04, 251.34it/s]
 20%|██        | 310/1517 [00:01<00:04, 263.24it/s]
 22%|██▏       | 338/1517 [00:02<00:14, 82.55it/s] 
 25%|██▌       | 383/1517 [00:02<00:09, 122.00it/s]
 28%|██▊       | 418/1517 [00:02<00:07, 152.69it/s]
 30%|██▉       | 448/1517 [00:02<00:06, 175.73it/s]
 32%|███▏      | 478/1517 [00:02<00:05, 196.02it/s]
 33%|███▎      | 507/1517 [00:03<00:05, 200.24it/s]
 35%|███▌      | 534/1517 [00:03<00:04, 208.52it/s]
 37%|███▋      | 560/1517 [00:03<00:04, 210.09it/s]
 39%|███▊      | 586/1517 [00:03<00:04, 220.04it/s]
 40%|████      | 611/1517 [00:03<00:04, 223.19it/s]
 42%|████▏     | 639/1517 [00:03<00:03, 236.11it/s]
 45%|████▍     | 677/1517 [00:03<00:03, 261.58it/s]
 47%|████▋     | 710/1517 [00:03<00:02, 270.40it/s]
 49%|████▉     | 741/1517 [00:03<00:02, 276.97it/s]
 51%|█████     | 770/1517 [00:04<00:03, 231.09it/s]
 52%|█████▏    | 795/1517 [00:04<00:03, 228.09it/s]
 54%|█████▍    | 822/1517 [00:04<00:02, 237.52it/s]
 56%|█████▌    | 847/1517 [00:04<00:02, 238.57it/s]
 58%|█████▊    | 874/1517 [00:04<00:02, 246.14it/s]
 59%|█████▉    | 900/1517 [00:04<00:02, 243.45it/s]
 61%|██████    | 925/1517 [00:04<00:02, 235.18it/s]
 63%|██████▎   | 949/1517 [00:04<00:02, 231.32it/s]
 64%|██████▍   | 978/1517 [00:04<00:02, 242.67it/s]
 66%|██████▌   | 1005/1517 [00:05<00:02, 247.10it/s]
 68%|██████▊   | 1030/1517 [00:05<00:02, 238.73it/s]
 70%|██████▉   | 1058/1517 [00:05<00:01, 249.46it/s]
 72%|███████▏  | 1089/1517 [00:05<00:01, 260.72it/s]
 74%|███████▎  | 1117/1517 [00:05<00:01, 264.35it/s]
 75%|███████▌  | 1144/1517 [00:05<00:01, 257.98it/s]
 77%|███████▋  | 1172/1517 [00:05<00:01, 263.43it/s]
 79%|███████▉  | 1200/1517 [00:05<00:01, 266.43it/s]
 81%|████████  | 1227/1517 [00:05<00:01, 266.43it/s]
 83%|████████▎ | 1259/1517 [00:05<00:00, 279.19it/s]
 85%|████████▌ | 1290/1517 [00:06<00:00, 279.08it/s]
 87%|████████▋ | 1326/1517 [00:06<00:00, 299.68it/s]
 89%|████████▉ | 1357/1517 [00:06<00:00, 284.03it/s]
 91%|█████████▏| 1386/1517 [00:07<00:01, 99.38it/s] 
 93%|█████████▎| 1416/1517 [00:07<00:00, 123.80it/s]
 95%|█████████▌| 1446/1517 [00:07<00:00, 149.81it/s]
 97%|█████████▋| 1472/1517 [00:07<00:00, 166.89it/s]
 99%|█████████▉| 1502/1517 [00:07<00:00, 192.68it/s]
100%|██████████| 1517/1517 [00:07<00:00, 201.47it/s]66Constructing time series for each modality ...67Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_017/timeseries/agg_timeseries.pkl68Extracting samples from time series ...69number of samples: 2070Packing the samples into numpy arrays ...71