Datasetpublic
Greatriver/SimBarca

🚥 SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic 📚 Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveiling… See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
sourceHugging Facemitupdated 5mo agoView on Hugging Face
0likes4.1kdownloads
rootsimulation_sessionssession_059processing_log.log
processing_log.log113 linesDownload Raw Back to session_059
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 165500 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/00_traj_1279.0.json.gz6Loading a file takes 49.31s7Creating data frames takes 32.97s8Filling data types and values takes 5.80s9 10 Processing a file takes 18.67s11Concatenating time series takes 0.45s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/01_traj_1902.0.json.gz13Loading a file takes 55.11s14Creating data frames takes 27.42s15Filling data types and values takes 5.91s16 17 Processing a file takes 18.03s18Concatenating time series takes 0.26s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/02_traj_2464.5.json.gz20Loading a file takes 58.72s21Creating data frames takes 23.71s22Filling data types and values takes 5.81s23 24 Processing a file takes 17.75s25Concatenating time series takes 0.30s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/03_traj_3009.5.json.gz27Loading a file takes 54.23s28Creating data frames takes 24.25s29Filling data types and values takes 5.68s30 31 Processing a file takes 17.83s32Concatenating time series takes 0.60s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/04_traj_3543.5.json.gz34Loading a file takes 57.78s35Creating data frames takes 22.52s36Filling data types and values takes 5.86s37 38 Processing a file takes 17.46s39Concatenating time series takes 0.54s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/05_traj_4062.5.json.gz41Loading a file takes 55.07s42Creating data frames takes 27.48s43Filling data types and values takes 6.00s44 45 Processing a file takes 17.02s46Concatenating time series takes 0.48s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/06_traj_4569.0.json.gz48Loading a file takes 58.14s49Creating data frames takes 20.89s50Filling data types and values takes 5.91s51 52 Processing a file takes 17.65s53Concatenating time series takes 0.46s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/07_traj_5072.0.json.gz55Loading a file takes 59.59s56Creating data frames takes 23.61s57Filling data types and values takes 5.88s58 59 Processing a file takes 17.90s60Concatenating time series takes 0.79s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/08_traj_5585.5.json.gz62Loading a file takes 59.96s63Creating data frames takes 22.65s64Filling data types and values takes 5.95s65 66 Processing a file takes 17.98s67Concatenating time series takes 0.68s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/09_traj_6091.5.json.gz69Loading a file takes 56.15s70Creating data frames takes 23.06s71Filling data types and values takes 5.86s72 73 Processing a file takes 17.37s74Concatenating time series takes 0.64s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/10_traj_6577.5.json.gz76Loading a file takes 57.49s77Creating data frames takes 21.55s78Filling data types and values takes 5.58s79 80 Processing a file takes 17.77s81Concatenating time series takes 0.69s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/11_traj_7065.0.json.gz83Loading a file takes 57.31s84Creating data frames takes 22.15s85Filling data types and values takes 5.82s86 87 Processing a file takes 17.25s88Concatenating time series takes 0.47s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/12_traj_8370.0.json.gz90Loading a file takes 53.72s91Creating data frames takes 27.63s92Filling data types and values takes 6.01s93 94 Processing a file takes 25.74s95Concatenating time series takes 0.77s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/trajectory/13_traj_end.json.gz97Loading a file takes 12.59s98Creating data frames takes 2.12s99Filling data types and values takes 0.40s100 101 Processing a file takes 7.18s102Concatenating time series takes 0.22s103Saving all the section time series takes 97.13s104Saving all the junction time series takes 14.51s105Saving network entrance and exit takes 0.11s106Aggregating the raw statistics to different intervals...107
  0%|          | 0/1521 [00:00<?, ?it/s]
  0%|          | 1/1521 [00:00<11:49,  2.14it/s]
  0%|          | 5/1521 [00:00<02:19, 10.88it/s]
  4%|▎         | 54/1521 [00:00<00:11, 126.29it/s]
  6%|▌         | 86/1521 [00:00<00:08, 172.90it/s]
  8%|▊         | 117/1521 [00:00<00:06, 207.50it/s]
  9%|▉         | 144/1521 [00:01<00:07, 191.23it/s]
 11%|█         | 168/1521 [00:01<00:06, 202.73it/s]
 13%|█▎        | 192/1521 [00:01<00:06, 191.13it/s]
 14%|█▍        | 215/1521 [00:01<00:06, 197.89it/s]
 16%|█▌        | 243/1521 [00:01<00:05, 215.87it/s]
 17%|█▋        | 266/1521 [00:01<00:05, 217.60it/s]
 19%|█▉        | 289/1521 [00:01<00:05, 210.41it/s]
 21%|██        | 312/1521 [00:01<00:05, 211.02it/s]
 22%|██▏       | 334/1521 [00:02<00:19, 59.94it/s] 
 24%|██▍       | 366/1521 [00:03<00:13, 82.67it/s]
 26%|██▋       | 400/1521 [00:03<00:09, 113.52it/s]
 28%|██▊       | 423/1521 [00:03<00:09, 119.42it/s]
 30%|██▉       | 449/1521 [00:03<00:07, 140.77it/s]
 31%|███       | 471/1521 [00:03<00:07, 146.44it/s]
 32%|███▏      | 491/1521 [00:03<00:06, 149.87it/s]
 34%|███▎      | 510/1521 [00:03<00:06, 157.90it/s]
 35%|███▍      | 529/1521 [00:03<00:06, 160.55it/s]
 36%|███▌      | 548/1521 [00:03<00:06, 156.94it/s]
 37%|███▋      | 566/1521 [00:04<00:06, 150.80it/s]
 38%|███▊      | 583/1521 [00:04<00:06, 152.20it/s]
 39%|███▉      | 599/1521 [00:04<00:06, 153.14it/s]
 40%|████      | 615/1521 [00:04<00:06, 145.97it/s]
 42%|████▏     | 635/1521 [00:04<00:05, 158.61it/s]
 43%|████▎     | 656/1521 [00:04<00:05, 170.67it/s]
 44%|████▍     | 675/1521 [00:04<00:04, 174.78it/s]
 46%|████▌     | 693/1521 [00:04<00:04, 175.37it/s]
 47%|████▋     | 711/1521 [00:04<00:04, 166.08it/s]
 48%|████▊     | 733/1521 [00:05<00:04, 179.86it/s]
 50%|████▉     | 753/1521 [00:05<00:04, 178.59it/s]
 51%|█████     | 772/1521 [00:05<00:04, 170.26it/s]
 52%|█████▏    | 791/1521 [00:05<00:04, 175.47it/s]
 53%|█████▎    | 809/1521 [00:05<00:04, 173.03it/s]
 55%|█████▍    | 830/1521 [00:05<00:03, 183.20it/s]
 56%|█████▌    | 853/1521 [00:05<00:03, 196.02it/s]
 57%|█████▋    | 874/1521 [00:05<00:03, 198.85it/s]
 59%|█████▉    | 895/1521 [00:05<00:03, 198.80it/s]
 60%|██████    | 915/1521 [00:06<00:03, 198.28it/s]
 61%|██████▏   | 935/1521 [00:06<00:03, 188.77it/s]
 63%|██████▎   | 957/1521 [00:06<00:02, 195.83it/s]
 64%|██████▍   | 977/1521 [00:06<00:02, 195.34it/s]
 66%|██████▌   | 998/1521 [00:06<00:02, 195.70it/s]
 67%|██████▋   | 1018/1521 [00:06<00:02, 180.44it/s]
 68%|██████▊   | 1037/1521 [00:06<00:02, 174.22it/s]
 70%|██████▉   | 1060/1521 [00:06<00:02, 180.70it/s]
 71%|███████   | 1082/1521 [00:06<00:02, 188.07it/s]
 73%|███████▎  | 1106/1521 [00:07<00:02, 192.80it/s]
 74%|███████▍  | 1126/1521 [00:07<00:02, 183.73it/s]
 75%|███████▌  | 1145/1521 [00:07<00:02, 184.91it/s]
 77%|███████▋  | 1165/1521 [00:07<00:01, 186.85it/s]
 78%|███████▊  | 1184/1521 [00:07<00:02, 167.02it/s]
 79%|███████▉  | 1204/1521 [00:07<00:01, 173.36it/s]
 81%|████████  | 1227/1521 [00:07<00:01, 185.16it/s]
 82%|████████▏ | 1246/1521 [00:07<00:01, 185.53it/s]
 83%|████████▎ | 1265/1521 [00:07<00:01, 178.23it/s]
 85%|████████▍ | 1291/1521 [00:08<00:01, 200.72it/s]
 86%|████████▋ | 1312/1521 [00:08<00:01, 194.26it/s]
 88%|████████▊ | 1332/1521 [00:08<00:01, 174.82it/s]
 89%|████████▉ | 1350/1521 [00:08<00:01, 165.32it/s]
 90%|████████▉ | 1367/1521 [00:11<00:07, 21.77it/s] 
 91%|█████████ | 1384/1521 [00:11<00:04, 28.26it/s]
 93%|█████████▎| 1407/1521 [00:11<00:02, 40.36it/s]
 94%|█████████▍| 1429/1521 [00:11<00:01, 54.38it/s]
 95%|█████████▌| 1446/1521 [00:11<00:01, 64.89it/s]
 96%|█████████▋| 1467/1521 [00:11<00:00, 81.84it/s]
 98%|█████████▊| 1489/1521 [00:11<00:00, 101.30it/s]
 99%|█████████▉| 1507/1521 [00:11<00:00, 112.59it/s]
100%|██████████| 1521/1521 [00:11<00:00, 127.51it/s]108Constructing time series for each modality ...109Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_059/timeseries/agg_timeseries.pkl110Extracting samples from time series ...111number of samples: 20112Packing the samples into numpy arrays ...113