Greatriver/SimBarca

1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 117612 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/00_traj_1380.5.json.gz6Loading a file takes 53.40s7Creating data frames takes 21.35s8Filling data types and values takes 5.99s9 10 Processing a file takes 18.63s11Concatenating time series takes 0.55s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/01_traj_2320.5.json.gz13Loading a file takes 54.84s14Creating data frames takes 21.45s15Filling data types and values takes 4.64s16 17 Processing a file takes 17.04s18Concatenating time series takes 0.26s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/02_traj_3228.5.json.gz20Loading a file takes 56.31s21Creating data frames takes 22.35s22Filling data types and values takes 4.88s23 24 Processing a file takes 18.19s25Concatenating time series takes 0.37s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/03_traj_4152.5.json.gz27Loading a file takes 51.84s28Creating data frames takes 21.17s29Filling data types and values takes 5.05s30 31 Processing a file takes 18.88s32Concatenating time series takes 0.37s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/04_traj_5084.0.json.gz34Loading a file takes 55.01s35Creating data frames takes 22.96s36Filling data types and values takes 5.07s37 38 Processing a file takes 18.37s39Concatenating time series takes 0.48s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/05_traj_6001.0.json.gz41Loading a file takes 51.28s42Creating data frames takes 22.67s43Filling data types and values takes 5.31s44 45 Processing a file takes 21.91s46Concatenating time series takes 0.54s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/06_traj_6907.5.json.gz48Loading a file takes 62.20s49Creating data frames takes 26.72s50Filling data types and values takes 5.62s51 52 Processing a file takes 20.05s53Concatenating time series takes 0.75s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/trajectory/07_traj_end.json.gz55Loading a file takes 32.43s56Creating data frames takes 14.23s57Filling data types and values takes 2.76s58 59 Processing a file takes 16.95s60Concatenating time series takes 0.77s61Saving all the section time series takes 70.41s62Saving all the junction time series takes 8.52s63Saving network entrance and exit takes 0.07s64Aggregating the raw statistics to different intervals...65
  0%|          | 0/1517 [00:00<?, ?it/s]
  0%|          | 1/1517 [00:00<08:39,  2.92it/s]
  0%|          | 5/1517 [00:00<01:52, 13.43it/s]
  3%|▎         | 43/1517 [00:00<00:12, 116.75it/s]
  5%|▌         | 79/1517 [00:00<00:07, 184.21it/s]
  7%|▋         | 110/1517 [00:00<00:06, 216.91it/s]
  9%|▉         | 136/1517 [00:00<00:06, 222.35it/s]
 11%|█         | 162/1517 [00:01<00:06, 206.29it/s]
 12%|█▏        | 189/1517 [00:01<00:06, 219.69it/s]
 14%|█▍        | 219/1517 [00:01<00:05, 235.66it/s]
 17%|█▋        | 257/1517 [00:01<00:04, 261.70it/s]
 19%|█▉        | 285/1517 [00:01<00:04, 256.95it/s]
 21%|██        | 313/1517 [00:01<00:04, 262.30it/s]
 22%|██▏       | 340/1517 [00:02<00:13, 85.46it/s] 
 26%|██▌       | 389/1517 [00:02<00:08, 129.16it/s]
 28%|██▊       | 420/1517 [00:02<00:07, 150.76it/s]
 30%|██▉       | 455/1517 [00:02<00:05, 182.02it/s]
 32%|███▏      | 484/1517 [00:02<00:05, 188.64it/s]
 34%|███▎      | 511/1517 [00:03<00:05, 195.49it/s]
 35%|███▌      | 536/1517 [00:03<00:05, 190.40it/s]
 37%|███▋      | 559/1517 [00:03<00:05, 185.47it/s]
 38%|███▊      | 584/1517 [00:03<00:04, 197.85it/s]
 40%|███▉      | 606/1517 [00:03<00:04, 193.61it/s]
 42%|████▏     | 630/1517 [00:03<00:04, 202.94it/s]
 43%|████▎     | 657/1517 [00:03<00:03, 217.43it/s]
 45%|████▌     | 684/1517 [00:03<00:03, 229.59it/s]
 47%|████▋     | 712/1517 [00:03<00:03, 243.21it/s]
 49%|████▊     | 738/1517 [00:04<00:03, 243.68it/s]
 50%|█████     | 763/1517 [00:04<00:03, 232.64it/s]
 52%|█████▏    | 787/1517 [00:04<00:03, 228.55it/s]
 53%|█████▎    | 811/1517 [00:04<00:03, 218.58it/s]
 55%|█████▌    | 837/1517 [00:04<00:03, 224.13it/s]
 57%|█████▋    | 864/1517 [00:04<00:02, 236.58it/s]
 59%|█████▉    | 892/1517 [00:04<00:02, 247.07it/s]
 60%|██████    | 917/1517 [00:04<00:02, 240.19it/s]
 62%|██████▏   | 943/1517 [00:04<00:02, 245.35it/s]
 64%|██████▍   | 977/1517 [00:05<00:02, 263.43it/s]
 66%|██████▋   | 1006/1517 [00:05<00:01, 269.14it/s]
 68%|██████▊   | 1033/1517 [00:05<00:01, 260.78it/s]
 70%|███████   | 1062/1517 [00:05<00:01, 264.71it/s]
 72%|███████▏  | 1093/1517 [00:05<00:01, 277.10it/s]
 74%|███████▍  | 1121/1517 [00:05<00:01, 264.85it/s]
 76%|███████▌  | 1155/1517 [00:05<00:01, 283.48it/s]
 78%|███████▊  | 1186/1517 [00:05<00:01, 269.62it/s]
 80%|████████  | 1220/1517 [00:05<00:01, 287.20it/s]
 83%|████████▎ | 1255/1517 [00:06<00:00, 303.91it/s]
 85%|████████▍ | 1288/1517 [00:06<00:00, 307.89it/s]
 87%|████████▋ | 1320/1517 [00:06<00:00, 298.84it/s]
 89%|████████▉ | 1351/1517 [00:06<00:00, 292.67it/s]
 91%|█████████ | 1381/1517 [00:07<00:01, 82.12it/s] 
 93%|█████████▎| 1410/1517 [00:07<00:01, 103.02it/s]
 95%|█████████▍| 1434/1517 [00:07<00:00, 115.28it/s]
 96%|█████████▋| 1461/1517 [00:07<00:00, 136.10it/s]
 98%|█████████▊| 1488/1517 [00:07<00:00, 158.15it/s]
100%|██████████| 1517/1517 [00:07<00:00, 192.65it/s]66Constructing time series for each modality ...67Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_003/timeseries/agg_timeseries.pkl68Extracting samples from time series ...69number of samples: 2070Packing the samples into numpy arrays ...71