Greatriver/SimBarca

1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 147200 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/00_traj_1296.0.json.gz6Loading a file takes 49.67s7Creating data frames takes 21.69s8Filling data types and values takes 6.55s9 10 Processing a file takes 17.96s11Concatenating time series takes 0.38s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/01_traj_2014.5.json.gz13Loading a file takes 55.56s14Creating data frames takes 23.24s15Filling data types and values takes 5.84s16 17 Processing a file takes 17.76s18Concatenating time series takes 0.29s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/02_traj_2690.5.json.gz20Loading a file takes 55.14s21Creating data frames takes 25.45s22Filling data types and values takes 6.42s23 24 Processing a file takes 18.69s25Concatenating time series takes 0.38s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/03_traj_3301.0.json.gz27Loading a file takes 53.93s28Creating data frames takes 22.50s29Filling data types and values takes 6.20s30 31 Processing a file takes 18.32s32Concatenating time series takes 0.43s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/04_traj_3897.0.json.gz34Loading a file takes 56.84s35Creating data frames takes 21.91s36Filling data types and values takes 5.90s37 38 Processing a file takes 18.16s39Concatenating time series takes 0.40s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/05_traj_4478.5.json.gz41Loading a file takes 55.77s42Creating data frames takes 26.02s43Filling data types and values takes 5.92s44 45 Processing a file takes 18.49s46Concatenating time series takes 0.43s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/06_traj_5074.0.json.gz48Loading a file takes 58.22s49Creating data frames takes 25.12s50Filling data types and values takes 5.84s51 52 Processing a file takes 18.40s53Concatenating time series takes 0.59s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/07_traj_5697.0.json.gz55Loading a file takes 58.32s56Creating data frames takes 25.34s57Filling data types and values takes 5.95s58 59 Processing a file takes 18.88s60Concatenating time series takes 0.77s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/08_traj_6322.0.json.gz62Loading a file takes 59.11s63Creating data frames takes 24.48s64Filling data types and values takes 5.89s65 66 Processing a file takes 19.05s67Concatenating time series takes 0.53s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/09_traj_6951.5.json.gz69Loading a file takes 57.51s70Creating data frames takes 22.04s71Filling data types and values takes 5.72s72 73 Processing a file takes 19.54s74Concatenating time series takes 0.60s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/trajectory/10_traj_end.json.gz76Loading a file takes 47.25s77Creating data frames takes 18.01s78Filling data types and values takes 5.05s79 80 Processing a file takes 17.94s81Concatenating time series takes 0.58s82Saving all the section time series takes 81.81s83Saving all the junction time series takes 12.13s84Saving network entrance and exit takes 0.09s85Aggregating the raw statistics to different intervals...86
  0%|          | 0/1517 [00:00<?, ?it/s]
  0%|          | 1/1517 [00:00<08:37,  2.93it/s]
  0%|          | 3/1517 [00:00<03:14,  7.80it/s]
  2%|▏         | 33/1517 [00:00<00:15, 92.98it/s]
  4%|▍         | 63/1517 [00:00<00:09, 146.79it/s]
  6%|▌         | 90/1517 [00:00<00:07, 179.13it/s]
  8%|▊         | 118/1517 [00:00<00:06, 207.44it/s]
  9%|▉         | 144/1517 [00:00<00:06, 220.37it/s]
 11%|█         | 168/1517 [00:01<00:06, 222.68it/s]
 13%|█▎        | 192/1517 [00:01<00:06, 217.60it/s]
 15%|█▍        | 221/1517 [00:01<00:05, 230.57it/s]
 17%|█▋        | 251/1517 [00:01<00:05, 248.07it/s]
 18%|█▊        | 277/1517 [00:01<00:04, 250.43it/s]
 20%|█▉        | 303/1517 [00:01<00:05, 234.23it/s]
 22%|██▏       | 327/1517 [00:02<00:17, 67.71it/s] 
 23%|██▎       | 352/1517 [00:02<00:13, 85.24it/s]
 26%|██▌       | 397/1517 [00:02<00:08, 128.09it/s]
 28%|██▊       | 425/1517 [00:02<00:07, 148.68it/s]
 30%|██▉       | 450/1517 [00:03<00:06, 158.62it/s]
 31%|███       | 474/1517 [00:03<00:06, 165.20it/s]
 33%|███▎      | 496/1517 [00:03<00:06, 162.09it/s]
 34%|███▍      | 516/1517 [00:03<00:06, 164.88it/s]
 35%|███▌      | 536/1517 [00:03<00:06, 156.16it/s]
 37%|███▋      | 554/1517 [00:03<00:06, 155.32it/s]
 38%|███▊      | 575/1517 [00:03<00:05, 161.86it/s]
 39%|███▉      | 595/1517 [00:03<00:05, 170.29it/s]
 40%|████      | 614/1517 [00:04<00:05, 171.54it/s]
 42%|████▏     | 633/1517 [00:04<00:05, 175.57it/s]
 43%|████▎     | 652/1517 [00:04<00:05, 172.35it/s]
 44%|████▍     | 670/1517 [00:04<00:04, 174.15it/s]
 46%|████▌     | 696/1517 [00:04<00:04, 198.01it/s]
 47%|████▋     | 717/1517 [00:04<00:04, 189.02it/s]
 49%|████▊     | 737/1517 [00:04<00:04, 184.14it/s]
 50%|████▉     | 756/1517 [00:04<00:04, 180.32it/s]
 51%|█████     | 775/1517 [00:04<00:04, 169.86it/s]
 52%|█████▏    | 793/1517 [00:05<00:04, 163.75it/s]
 54%|█████▎    | 815/1517 [00:05<00:04, 175.32it/s]
 55%|█████▌    | 838/1517 [00:05<00:03, 183.24it/s]
 57%|█████▋    | 860/1517 [00:05<00:03, 190.07it/s]
 58%|█████▊    | 880/1517 [00:05<00:03, 190.92it/s]
 59%|█████▉    | 900/1517 [00:05<00:03, 183.20it/s]
 61%|██████    | 919/1517 [00:05<00:03, 171.91it/s]
 62%|██████▏   | 941/1517 [00:05<00:03, 177.46it/s]
 64%|██████▎   | 967/1517 [00:05<00:02, 198.96it/s]
 65%|██████▌   | 992/1517 [00:06<00:02, 196.61it/s]
 67%|██████▋   | 1019/1517 [00:06<00:02, 213.28it/s]
 69%|██████▊   | 1041/1517 [00:06<00:02, 209.21it/s]
 70%|███████   | 1064/1517 [00:06<00:02, 209.65it/s]
 72%|███████▏  | 1087/1517 [00:06<00:02, 203.02it/s]
 73%|███████▎  | 1108/1517 [00:06<00:02, 200.94it/s]
 75%|███████▍  | 1137/1517 [00:06<00:01, 224.55it/s]
 77%|███████▋  | 1165/1517 [00:06<00:01, 229.89it/s]
 79%|███████▊  | 1193/1517 [00:07<00:01, 232.46it/s]
 80%|████████  | 1217/1517 [00:07<00:01, 218.05it/s]
 82%|████████▏ | 1245/1517 [00:07<00:01, 224.85it/s]
 84%|████████▍ | 1273/1517 [00:07<00:01, 227.66it/s]
 86%|████████▌ | 1301/1517 [00:07<00:00, 237.75it/s]
 87%|████████▋ | 1325/1517 [00:07<00:00, 227.09it/s]
 89%|████████▉ | 1348/1517 [00:07<00:00, 214.83it/s]
 90%|█████████ | 1370/1517 [00:09<00:02, 51.56it/s] 
 92%|█████████▏| 1393/1517 [00:09<00:01, 66.10it/s]
 93%|█████████▎| 1415/1517 [00:09<00:01, 82.34it/s]
 95%|█████████▌| 1442/1517 [00:09<00:00, 106.90it/s]
 97%|█████████▋| 1464/1517 [00:09<00:00, 124.53it/s]
 98%|█████████▊| 1488/1517 [00:09<00:00, 144.65it/s]
100%|██████████| 1517/1517 [00:09<00:00, 157.59it/s]87Constructing time series for each modality ...88Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_070/timeseries/agg_timeseries.pkl89Extracting samples from time series ...90number of samples: 2091Packing the samples into numpy arrays ...92