Greatriver/SimBarca

1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 113170 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/00_traj_1375.5.json.gz6Loading a file takes 53.23s7Creating data frames takes 41.18s8Filling data types and values takes 7.11s9 10 Processing a file takes 18.31s11Concatenating time series takes 0.41s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/01_traj_2389.0.json.gz13Loading a file takes 53.32s14Creating data frames takes 32.81s15Filling data types and values takes 5.77s16 17 Processing a file takes 19.41s18Concatenating time series takes 0.31s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/02_traj_3377.0.json.gz20Loading a file takes 56.22s21Creating data frames takes 30.36s22Filling data types and values takes 5.53s23 24 Processing a file takes 18.61s25Concatenating time series takes 0.36s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/03_traj_4373.0.json.gz27Loading a file takes 52.44s28Creating data frames takes 27.26s29Filling data types and values takes 5.34s30 31 Processing a file takes 18.55s32Concatenating time series takes 0.48s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/04_traj_5353.0.json.gz34Loading a file takes 56.50s35Creating data frames takes 27.16s36Filling data types and values takes 5.70s37 38 Processing a file takes 18.23s39Concatenating time series takes 0.57s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/05_traj_6344.5.json.gz41Loading a file takes 56.49s42Creating data frames takes 23.33s43Filling data types and values takes 5.60s44 45 Processing a file takes 19.24s46Concatenating time series takes 0.58s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/06_traj_7397.5.json.gz48Loading a file takes 56.81s49Creating data frames takes 22.12s50Filling data types and values takes 5.65s51 52 Processing a file takes 19.52s53Concatenating time series takes 0.67s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/trajectory/07_traj_end.json.gz55Loading a file takes 6.90s56Creating data frames takes 1.47s57Filling data types and values takes 0.28s58 59 Processing a file takes 8.66s60Concatenating time series takes 0.59s61Saving all the section time series takes 75.62s62Saving all the junction time series takes 10.51s63Saving network entrance and exit takes 0.08s64Aggregating the raw statistics to different intervals...65
  0%|          | 0/1515 [00:00<?, ?it/s]
  0%|          | 1/1515 [00:00<08:20,  3.03it/s]
  0%|          | 2/1515 [00:00<07:10,  3.51it/s]
  0%|          | 5/1515 [00:01<05:58,  4.21it/s]
 17%|█▋        | 256/1515 [00:01<00:04, 306.87it/s]
 22%|██▏       | 332/1515 [00:02<00:07, 150.82it/s]
 25%|██▌       | 383/1515 [00:02<00:06, 175.23it/s]
 28%|██▊       | 431/1515 [00:02<00:05, 189.24it/s]
 31%|███       | 472/1515 [00:02<00:05, 199.02it/s]
 34%|███▎      | 508/1515 [00:03<00:05, 192.74it/s]
 36%|███▌      | 538/1515 [00:03<00:05, 188.43it/s]
 37%|███▋      | 564/1515 [00:03<00:05, 183.89it/s]
 39%|███▉      | 588/1515 [00:03<00:04, 185.72it/s]
 40%|████      | 610/1515 [00:03<00:05, 174.91it/s]
 42%|████▏     | 636/1515 [00:03<00:04, 190.88it/s]
 43%|████▎     | 658/1515 [00:03<00:04, 194.01it/s]
 45%|████▍     | 680/1515 [00:04<00:04, 196.81it/s]
 46%|████▋     | 701/1515 [00:04<00:04, 195.11it/s]
 48%|████▊     | 724/1515 [00:04<00:03, 199.20it/s]
 49%|████▉     | 746/1515 [00:04<00:03, 202.99it/s]
 51%|█████     | 767/1515 [00:04<00:03, 194.52it/s]
 52%|█████▏    | 787/1515 [00:04<00:03, 192.44it/s]
 53%|█████▎    | 807/1515 [00:04<00:03, 187.91it/s]
 55%|█████▌    | 835/1515 [00:04<00:03, 212.51it/s]
 57%|█████▋    | 863/1515 [00:04<00:02, 229.08it/s]
 59%|█████▊    | 887/1515 [00:05<00:02, 226.41it/s]
 60%|██████    | 910/1515 [00:05<00:03, 199.37it/s]
 62%|██████▏   | 938/1515 [00:05<00:02, 216.80it/s]
 64%|██████▍   | 972/1515 [00:05<00:02, 243.60it/s]
 66%|██████▌   | 1002/1515 [00:05<00:02, 252.79it/s]
 68%|██████▊   | 1028/1515 [00:05<00:01, 250.49it/s]
 70%|██████▉   | 1054/1515 [00:05<00:01, 251.15it/s]
 71%|███████▏  | 1080/1515 [00:05<00:01, 252.56it/s]
 73%|███████▎  | 1106/1515 [00:05<00:01, 242.67it/s]
 75%|███████▍  | 1131/1515 [00:06<00:01, 231.14it/s]
 76%|███████▋  | 1156/1515 [00:06<00:01, 235.11it/s]
 78%|███████▊  | 1188/1515 [00:06<00:01, 254.58it/s]
 80%|████████  | 1214/1515 [00:06<00:01, 247.30it/s]
 82%|████████▏ | 1248/1515 [00:06<00:00, 271.36it/s]
 84%|████████▍ | 1280/1515 [00:06<00:00, 285.00it/s]
 86%|████████▋ | 1309/1515 [00:06<00:00, 286.07it/s]
 88%|████████▊ | 1338/1515 [00:07<00:02, 73.53it/s] 
 90%|████████▉ | 1359/1515 [00:07<00:01, 86.43it/s]
 91%|█████████ | 1380/1515 [00:08<00:01, 98.79it/s]
 93%|█████████▎| 1403/1515 [00:08<00:00, 117.45it/s]
 95%|█████████▍| 1432/1515 [00:08<00:00, 142.25it/s]
 96%|█████████▌| 1456/1515 [00:08<00:00, 154.39it/s]
 98%|█████████▊| 1478/1515 [00:08<00:00, 163.80it/s]
 99%|█████████▉| 1504/1515 [00:08<00:00, 184.67it/s]
100%|██████████| 1515/1515 [00:08<00:00, 176.47it/s]66Constructing time series for each modality ...67Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_002/timeseries/agg_timeseries.pkl68Extracting samples from time series ...69number of samples: 2070Packing the samples into numpy arrays ...71