Datasetpublic

Greatriver/SimBarca

🚥 SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic 📚 Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveiling… See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.

sourceHugging Facemitupdated 5mo agoView on Hugging Face

0likes4.2kdownloads

rootsimulation_sessionssession_043processing_log.log

processing_log.log92 linesDownload Raw Back to session_043

1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 140504 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/00_traj_1302.0.json.gz6Loading a file takes 48.82s7Creating data frames takes 19.64s8Filling data types and values takes 5.61s9 10 Processing a file takes 18.23s11Concatenating time series takes 0.41s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/01_traj_2043.5.json.gz13Loading a file takes 48.38s14Creating data frames takes 30.89s15Filling data types and values takes 5.61s16 17 Processing a file takes 16.49s18Concatenating time series takes 0.26s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/02_traj_2750.0.json.gz20Loading a file takes 47.98s21Creating data frames takes 30.94s22Filling data types and values takes 5.42s23 24 Processing a file takes 16.54s25Concatenating time series takes 0.28s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/03_traj_3436.0.json.gz27Loading a file takes 47.43s28Creating data frames takes 32.23s29Filling data types and values takes 5.35s30 31 Processing a file takes 16.67s32Concatenating time series takes 0.36s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/04_traj_4108.5.json.gz34Loading a file takes 54.63s35Creating data frames takes 32.13s36Filling data types and values takes 6.06s37 38 Processing a file takes 18.42s39Concatenating time series takes 0.43s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/05_traj_4768.5.json.gz41Loading a file takes 53.77s42Creating data frames takes 23.53s43Filling data types and values takes 5.83s44 45 Processing a file takes 17.53s46Concatenating time series takes 0.53s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/06_traj_5424.0.json.gz48Loading a file takes 57.74s49Creating data frames takes 23.70s50Filling data types and values takes 5.73s51 52 Processing a file takes 17.37s53Concatenating time series takes 0.62s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/07_traj_6081.0.json.gz55Loading a file takes 59.15s56Creating data frames takes 22.56s57Filling data types and values takes 6.01s58 59 Processing a file takes 18.11s60Concatenating time series takes 0.63s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/08_traj_6733.0.json.gz62Loading a file takes 56.54s63Creating data frames takes 20.58s64Filling data types and values takes 5.86s65 66 Processing a file takes 18.09s67Concatenating time series takes 0.52s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/09_traj_7476.5.json.gz69Loading a file takes 62.23s70Creating data frames takes 20.49s71Filling data types and values takes 6.01s72 73 Processing a file takes 19.36s74Concatenating time series takes 0.69s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/trajectory/10_traj_end.json.gz76Loading a file takes 12.34s77Creating data frames takes 4.15s78Filling data types and values takes 0.90s79 80 Processing a file takes 10.67s81Concatenating time series takes 0.28s82Saving all the section time series takes 86.27s83Saving all the junction time series takes 12.66s84Saving network entrance and exit takes 0.10s85Aggregating the raw statistics to different intervals...86
  0%|          | 0/1521 [00:00<?, ?it/s]
  0%|          | 1/1521 [00:02<1:11:25,  2.82s/it]
 20%|██        | 309/1521 [00:02<00:08, 148.78it/s]
 32%|███▏      | 488/1521 [00:03<00:05, 177.16it/s]
 39%|███▉      | 596/1521 [00:04<00:05, 169.25it/s]
 44%|████▍     | 668/1521 [00:04<00:04, 173.98it/s]
 47%|████▋     | 721/1521 [00:05<00:04, 175.65it/s]
 50%|█████     | 762/1521 [00:05<00:04, 176.67it/s]
 52%|█████▏    | 796/1521 [00:05<00:04, 171.57it/s]
 54%|█████▍    | 824/1521 [00:05<00:03, 174.32it/s]
 56%|█████▌    | 849/1521 [00:05<00:03, 182.75it/s]
 57%|█████▋    | 874/1521 [00:05<00:03, 183.84it/s]
 59%|█████▉    | 897/1521 [00:06<00:03, 185.52it/s]
 60%|██████    | 919/1521 [00:06<00:03, 186.08it/s]
 62%|██████▏   | 940/1521 [00:06<00:03, 188.12it/s]
 63%|██████▎   | 965/1521 [00:06<00:02, 200.05it/s]
 65%|██████▌   | 992/1521 [00:06<00:02, 210.92it/s]
 67%|██████▋   | 1015/1521 [00:06<00:02, 208.31it/s]
 68%|██████▊   | 1037/1521 [00:06<00:02, 204.71it/s]
 70%|██████▉   | 1059/1521 [00:06<00:02, 199.15it/s]
 71%|███████   | 1080/1521 [00:06<00:02, 196.27it/s]
 72%|███████▏  | 1101/1521 [00:07<00:02, 199.70it/s]
 74%|███████▍  | 1122/1521 [00:07<00:02, 194.26it/s]
 75%|███████▌  | 1146/1521 [00:07<00:01, 205.65it/s]
 77%|███████▋  | 1171/1521 [00:07<00:01, 210.20it/s]
 78%|███████▊  | 1193/1521 [00:07<00:01, 201.32it/s]
 80%|███████▉  | 1214/1521 [00:07<00:01, 188.66it/s]
 82%|████████▏ | 1240/1521 [00:07<00:01, 204.37it/s]
 83%|████████▎ | 1261/1521 [00:07<00:01, 197.55it/s]
 85%|████████▌ | 1294/1521 [00:07<00:00, 229.15it/s]
 87%|████████▋ | 1318/1521 [00:08<00:00, 225.17it/s]
 88%|████████▊ | 1341/1521 [00:09<00:03, 49.34it/s] 
 90%|████████▉ | 1364/1521 [00:09<00:02, 63.31it/s]
 91%|█████████ | 1382/1521 [00:09<00:01, 74.43it/s]
 92%|█████████▏| 1404/1521 [00:09<00:01, 92.36it/s]
 94%|█████████▎| 1423/1521 [00:09<00:00, 104.59it/s]
 95%|█████████▌| 1445/1521 [00:09<00:00, 120.39it/s]
 96%|█████████▋| 1467/1521 [00:10<00:00, 137.18it/s]
 98%|█████████▊| 1491/1521 [00:10<00:00, 156.94it/s]
 99%|█████████▉| 1512/1521 [00:10<00:00, 166.31it/s]
100%|██████████| 1521/1521 [00:10<00:00, 147.35it/s]87Constructing time series for each modality ...88Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_043/timeseries/agg_timeseries.pkl89Extracting samples from time series ...90number of samples: 2091Packing the samples into numpy arrays ...92