Greatriver/SimBarca

1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 142272 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/00_traj_1305.5.json.gz6Loading a file takes 49.80s7Creating data frames takes 22.15s8Filling data types and values takes 5.65s9 10 Processing a file takes 18.12s11Concatenating time series takes 0.46s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/01_traj_2043.5.json.gz13Loading a file takes 56.03s14Creating data frames takes 28.99s15Filling data types and values takes 5.84s16 17 Processing a file takes 17.22s18Concatenating time series takes 0.24s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/02_traj_2750.5.json.gz20Loading a file takes 53.47s21Creating data frames takes 26.00s22Filling data types and values takes 5.85s23 24 Processing a file takes 18.30s25Concatenating time series takes 0.38s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/03_traj_3439.0.json.gz27Loading a file takes 55.63s28Creating data frames takes 29.83s29Filling data types and values takes 5.89s30 31 Processing a file takes 18.33s32Concatenating time series takes 0.42s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/04_traj_4121.0.json.gz34Loading a file takes 57.14s35Creating data frames takes 23.65s36Filling data types and values takes 5.90s37 38 Processing a file takes 17.99s39Concatenating time series takes 0.45s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/05_traj_4786.5.json.gz41Loading a file takes 54.55s42Creating data frames takes 24.67s43Filling data types and values takes 5.97s44 45 Processing a file takes 25.82s46Concatenating time series takes 0.42s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/06_traj_5425.5.json.gz48Loading a file takes 59.32s49Creating data frames takes 28.59s50Filling data types and values takes 6.01s51 52 Processing a file takes 23.74s53Concatenating time series takes 0.61s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/07_traj_6065.5.json.gz55Loading a file takes 56.67s56Creating data frames takes 24.98s57Filling data types and values takes 5.77s58 59 Processing a file takes 22.66s60Concatenating time series takes 0.55s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/08_traj_6714.5.json.gz62Loading a file takes 57.77s63Creating data frames takes 30.79s64Filling data types and values takes 5.75s65 66 Processing a file takes 22.53s67Concatenating time series takes 0.54s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/09_traj_7476.5.json.gz69Loading a file takes 59.56s70Creating data frames takes 23.80s71Filling data types and values takes 6.00s72 73 Processing a file takes 23.55s74Concatenating time series takes 0.65s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/trajectory/10_traj_end.json.gz76Loading a file takes 13.04s77Creating data frames takes 2.64s78Filling data types and values takes 0.48s79 80 Processing a file takes 9.20s81Concatenating time series takes 0.28s82Saving all the section time series takes 85.87s83Saving all the junction time series takes 12.93s84Saving network entrance and exit takes 0.10s85Aggregating the raw statistics to different intervals...86
  0%|          | 0/1516 [00:00<?, ?it/s]
  0%|          | 1/1516 [00:00<08:12,  3.07it/s]
  0%|          | 6/1516 [00:00<01:29, 16.80it/s]
  3%|▎         | 46/1516 [00:00<00:11, 129.67it/s]
  5%|▍         | 72/1516 [00:00<00:08, 166.78it/s]
  7%|▋         | 108/1516 [00:00<00:06, 222.65it/s]
  9%|▉         | 138/1516 [00:00<00:05, 231.63it/s]
 11%|█         | 165/1516 [00:00<00:05, 236.52it/s]
 13%|█▎        | 191/1516 [00:01<00:05, 238.07it/s]
 14%|█▍        | 218/1516 [00:01<00:05, 244.58it/s]
 16%|█▌        | 245/1516 [00:01<00:05, 248.95it/s]
 18%|█▊        | 271/1516 [00:01<00:05, 246.52it/s]
 20%|█▉        | 297/1516 [00:01<00:04, 245.93it/s]
 21%|██        | 322/1516 [00:02<00:15, 75.17it/s] 
 23%|██▎       | 352/1516 [00:02<00:11, 99.55it/s]
 26%|██▌       | 397/1516 [00:02<00:07, 144.97it/s]
 28%|██▊       | 425/1516 [00:02<00:06, 163.72it/s]
 30%|██▉       | 452/1516 [00:02<00:05, 177.43it/s]
 32%|███▏      | 478/1516 [00:02<00:05, 181.74it/s]
 33%|███▎      | 502/1516 [00:03<00:05, 184.71it/s]
 35%|███▍      | 525/1516 [00:03<00:05, 170.20it/s]
 36%|███▌      | 545/1516 [00:03<00:05, 169.58it/s]
 37%|███▋      | 564/1516 [00:03<00:05, 168.25it/s]
 39%|███▊      | 586/1516 [00:03<00:05, 171.39it/s]
 40%|███▉      | 605/1516 [00:03<00:05, 167.36it/s]
 41%|████▏     | 627/1516 [00:03<00:04, 178.46it/s]
 43%|████▎     | 646/1516 [00:03<00:04, 178.20it/s]
 44%|████▍     | 665/1516 [00:04<00:04, 180.31it/s]
 45%|████▌     | 688/1516 [00:04<00:04, 188.81it/s]
 47%|████▋     | 713/1516 [00:04<00:04, 195.21it/s]
 48%|████▊     | 735/1516 [00:04<00:03, 199.68it/s]
 50%|████▉     | 756/1516 [00:04<00:03, 199.42it/s]
 51%|█████▏    | 777/1516 [00:04<00:03, 192.35it/s]
 53%|█████▎    | 797/1516 [00:04<00:03, 186.00it/s]
 54%|█████▍    | 820/1516 [00:04<00:03, 197.33it/s]
 56%|█████▌    | 844/1516 [00:04<00:03, 203.10it/s]
 57%|█████▋    | 865/1516 [00:05<00:03, 204.40it/s]
 59%|█████▊    | 888/1516 [00:05<00:03, 207.91it/s]
 60%|█████▉    | 909/1516 [00:05<00:02, 203.82it/s]
 61%|██████▏   | 930/1516 [00:05<00:03, 191.98it/s]
 63%|██████▎   | 954/1516 [00:05<00:02, 204.46it/s]
 64%|██████▍   | 975/1516 [00:05<00:02, 201.81it/s]
 66%|██████▌   | 999/1516 [00:05<00:02, 210.32it/s]
 67%|██████▋   | 1021/1516 [00:05<00:02, 205.89it/s]
 69%|██████▉   | 1044/1516 [00:05<00:02, 211.62it/s]
 70%|███████   | 1067/1516 [00:06<00:02, 214.33it/s]
 72%|███████▏  | 1092/1516 [00:06<00:01, 218.47it/s]
 74%|███████▎  | 1117/1516 [00:06<00:01, 223.37it/s]
 75%|███████▌  | 1141/1516 [00:06<00:01, 224.40it/s]
 77%|███████▋  | 1168/1516 [00:06<00:01, 237.02it/s]
 79%|███████▊  | 1192/1516 [00:06<00:01, 236.78it/s]
 80%|████████  | 1218/1516 [00:06<00:01, 241.81it/s]
 82%|████████▏ | 1244/1516 [00:06<00:01, 242.05it/s]
 84%|████████▍ | 1276/1516 [00:06<00:00, 259.64it/s]
 86%|████████▌ | 1302/1516 [00:06<00:00, 259.73it/s]
 88%|████████▊ | 1328/1516 [00:07<00:00, 242.97it/s]
 89%|████████▉ | 1353/1516 [00:07<00:00, 236.85it/s]
 91%|█████████ | 1377/1516 [00:08<00:02, 60.04it/s] 
 92%|█████████▏| 1400/1516 [00:08<00:01, 74.67it/s]
 94%|█████████▍| 1430/1516 [00:08<00:00, 99.88it/s]
 96%|█████████▌| 1455/1516 [00:08<00:00, 120.25it/s]
 98%|█████████▊| 1479/1516 [00:08<00:00, 137.10it/s]
 99%|█████████▉| 1502/1516 [00:08<00:00, 151.51it/s]
100%|██████████| 1516/1516 [00:08<00:00, 170.23it/s]87Constructing time series for each modality ...88Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_052/timeseries/agg_timeseries.pkl89Extracting samples from time series ...90number of samples: 2091Packing the samples into numpy arrays ...92