Datasetpublic
Greatriver/SimBarca

🚥 SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic 📚 Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveiling… See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
sourceHugging Facemitupdated 5mo agoView on Hugging Face
0likes4.2kdownloads
rootsimulation_sessionssession_097processing_log.log
processing_log.log141 linesDownload Raw Back to session_097
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 170347 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/00_traj_1263.5.json.gz6Loading a file takes 54.21s7Creating data frames takes 34.49s8Filling data types and values takes 6.40s9 10 Processing a file takes 19.07s11Concatenating time series takes 0.40s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/01_traj_1853.5.json.gz13Loading a file takes 57.43s14Creating data frames takes 29.35s15Filling data types and values takes 6.01s16 17 Processing a file takes 18.45s18Concatenating time series takes 0.28s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/02_traj_2375.5.json.gz20Loading a file takes 58.70s21Creating data frames takes 26.25s22Filling data types and values takes 6.08s23 24 Processing a file takes 18.05s25Concatenating time series takes 0.22s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/03_traj_2852.5.json.gz27Loading a file takes 55.97s28Creating data frames takes 25.00s29Filling data types and values takes 5.94s30 31 Processing a file takes 18.06s32Concatenating time series takes 0.36s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/04_traj_3303.5.json.gz34Loading a file takes 58.85s35Creating data frames takes 25.00s36Filling data types and values takes 6.03s37 38 Processing a file takes 17.92s39Concatenating time series takes 0.28s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/05_traj_3742.5.json.gz41Loading a file takes 55.94s42Creating data frames takes 25.37s43Filling data types and values takes 5.97s44 45 Processing a file takes 18.30s46Concatenating time series takes 0.42s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/06_traj_4164.5.json.gz48Loading a file takes 58.77s49Creating data frames takes 25.13s50Filling data types and values takes 6.21s51 52 Processing a file takes 18.36s53Concatenating time series takes 0.43s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/07_traj_4575.5.json.gz55Loading a file takes 59.68s56Creating data frames takes 25.21s57Filling data types and values takes 6.21s58 59 Processing a file takes 18.28s60Concatenating time series takes 0.37s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/08_traj_4978.5.json.gz62Loading a file takes 56.53s63Creating data frames takes 25.20s64Filling data types and values takes 6.14s65 66 Processing a file takes 22.51s67Concatenating time series takes 0.44s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/09_traj_5373.0.json.gz69Loading a file takes 59.26s70Creating data frames takes 24.53s71Filling data types and values takes 6.17s72 73 Processing a file takes 22.34s74Concatenating time series takes 0.47s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/10_traj_5757.0.json.gz76Loading a file takes 59.29s77Creating data frames takes 26.21s78Filling data types and values takes 6.02s79 80 Processing a file takes 27.74s81Concatenating time series takes 0.92s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/11_traj_6124.5.json.gz83Loading a file takes 60.17s84Creating data frames takes 37.63s85Filling data types and values takes 6.09s86 87 Processing a file takes 22.07s88Concatenating time series takes 0.33s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/12_traj_6473.0.json.gz90Loading a file takes 54.53s91Creating data frames takes 25.79s92Filling data types and values takes 5.55s93 94 Processing a file takes 17.39s95Concatenating time series takes 0.53s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/13_traj_6808.0.json.gz97Loading a file takes 49.50s98Creating data frames takes 29.45s99Filling data types and values takes 5.91s100 101 Processing a file takes 18.96s102Concatenating time series takes 0.68s103Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/14_traj_7126.5.json.gz104Loading a file takes 57.12s105Creating data frames takes 27.40s106Filling data types and values takes 6.02s107 108 Processing a file takes 18.47s109Concatenating time series takes 0.52s110Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/15_traj_7474.0.json.gz111Loading a file takes 61.11s112Creating data frames takes 27.62s113Filling data types and values takes 6.19s114 115 Processing a file takes 18.72s116Concatenating time series takes 0.52s117Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/16_traj_8087.5.json.gz118Loading a file takes 61.62s119Creating data frames takes 24.82s120Filling data types and values takes 6.28s121 122 Processing a file takes 17.84s123Concatenating time series takes 0.46s124Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/trajectory/17_traj_end.json.gz125Loading a file takes 57.10s126Creating data frames takes 22.27s127Filling data types and values takes 5.51s128 129 Processing a file takes 17.09s130Concatenating time series takes 0.54s131Saving all the section time series takes 111.64s132Saving all the junction time series takes 16.81s133Saving network entrance and exit takes 0.11s134Aggregating the raw statistics to different intervals...135
  0%|          | 0/1521 [00:00<?, ?it/s]
  0%|          | 1/1521 [00:00<11:14,  2.25it/s]
  0%|          | 6/1521 [00:00<02:01, 12.52it/s]
  3%|▎         | 39/1521 [00:00<00:17, 85.04it/s]
  4%|▍         | 62/1521 [00:00<00:12, 118.76it/s]
  5%|▌         | 80/1521 [00:00<00:11, 125.66it/s]
  6%|▋         | 96/1521 [00:01<00:10, 133.20it/s]
  8%|▊         | 118/1521 [00:01<00:09, 155.02it/s]
  9%|▉         | 136/1521 [00:01<00:08, 158.09it/s]
 10%|█         | 156/1521 [00:01<00:08, 165.97it/s]
 12%|█▏        | 175/1521 [00:01<00:07, 171.55it/s]
 13%|█▎        | 193/1521 [00:01<00:08, 154.36it/s]
 14%|█▍        | 215/1521 [00:01<00:07, 164.54it/s]
 16%|█▌        | 237/1521 [00:01<00:07, 177.11it/s]
 17%|█▋        | 263/1521 [00:01<00:06, 190.22it/s]
 19%|█▊        | 283/1521 [00:02<00:06, 191.76it/s]
 20%|█▉        | 303/1521 [00:02<00:06, 181.21it/s]
 21%|██        | 322/1521 [00:03<00:27, 44.38it/s] 
 22%|██▏       | 336/1521 [00:03<00:22, 52.17it/s]
 25%|██▌       | 382/1521 [00:03<00:11, 95.89it/s]
 27%|██▋       | 408/1521 [00:03<00:10, 110.34it/s]
 28%|██▊       | 430/1521 [00:03<00:08, 126.77it/s]
 30%|██▉       | 452/1521 [00:04<00:07, 135.47it/s]
 31%|███       | 472/1521 [00:04<00:07, 140.18it/s]
 32%|███▏      | 491/1521 [00:04<00:07, 142.60it/s]
 33%|███▎      | 509/1521 [00:04<00:07, 141.14it/s]
 35%|███▍      | 526/1521 [00:04<00:06, 145.29it/s]
 36%|███▌      | 543/1521 [00:04<00:06, 144.66it/s]
 37%|███▋      | 559/1521 [00:04<00:07, 130.66it/s]
 38%|███▊      | 574/1521 [00:04<00:07, 132.91it/s]
 39%|███▉      | 594/1521 [00:05<00:06, 143.61it/s]
 40%|████      | 611/1521 [00:05<00:06, 148.57it/s]
 42%|████▏     | 632/1521 [00:05<00:05, 163.85it/s]
 43%|████▎     | 650/1521 [00:05<00:05, 165.90it/s]
 44%|████▍     | 670/1521 [00:05<00:04, 171.58it/s]
 45%|████▌     | 688/1521 [00:05<00:04, 171.08it/s]
 46%|████▋     | 706/1521 [00:05<00:04, 164.89it/s]
 48%|████▊     | 725/1521 [00:05<00:04, 166.78it/s]
 49%|████▉     | 746/1521 [00:05<00:04, 176.74it/s]
 50%|█████     | 764/1521 [00:06<00:05, 143.63it/s]
 51%|█████▏    | 782/1521 [00:06<00:04, 149.82it/s]
 53%|█████▎    | 800/1521 [00:06<00:04, 154.57it/s]
 54%|█████▍    | 818/1521 [00:06<00:04, 160.03it/s]
 55%|█████▍    | 835/1521 [00:06<00:04, 149.99it/s]
 56%|█████▌    | 853/1521 [00:06<00:04, 155.44it/s]
 57%|█████▋    | 869/1521 [00:06<00:04, 154.26it/s]
 59%|█████▊    | 890/1521 [00:06<00:03, 169.60it/s]
 60%|█████▉    | 908/1521 [00:06<00:03, 166.31it/s]
 61%|██████    | 928/1521 [00:07<00:03, 171.10it/s]
 62%|██████▏   | 946/1521 [00:07<00:03, 169.09it/s]
 64%|██████▎   | 966/1521 [00:07<00:03, 176.84it/s]
 65%|██████▍   | 986/1521 [00:07<00:03, 174.01it/s]
 66%|██████▋   | 1009/1521 [00:07<00:02, 179.85it/s]
 68%|██████▊   | 1028/1521 [00:07<00:02, 171.86it/s]
 69%|██████▉   | 1047/1521 [00:07<00:02, 172.86it/s]
 70%|███████   | 1065/1521 [00:07<00:02, 169.16it/s]
 71%|███████   | 1082/1521 [00:07<00:02, 167.15it/s]
 72%|███████▏  | 1102/1521 [00:08<00:02, 172.85it/s]
 74%|███████▍  | 1126/1521 [00:08<00:02, 191.09it/s]
 75%|███████▌  | 1146/1521 [00:08<00:02, 184.86it/s]
 77%|███████▋  | 1168/1521 [00:08<00:01, 194.70it/s]
 78%|███████▊  | 1188/1521 [00:08<00:01, 173.34it/s]
 79%|███████▉  | 1206/1521 [00:08<00:01, 166.45it/s]
 81%|████████  | 1225/1521 [00:08<00:01, 170.59it/s]
 82%|████████▏ | 1247/1521 [00:08<00:01, 183.36it/s]
 84%|████████▎ | 1272/1521 [00:08<00:01, 200.26it/s]
 85%|████████▌ | 1293/1521 [00:09<00:01, 195.65it/s]
 86%|████████▋ | 1313/1521 [00:09<00:01, 196.74it/s]
 88%|████████▊ | 1333/1521 [00:09<00:01, 178.28it/s]
 89%|████████▉ | 1352/1521 [00:09<00:00, 175.20it/s]
 90%|█████████ | 1370/1521 [00:10<00:03, 40.71it/s] 
 91%|█████████ | 1383/1521 [00:10<00:02, 47.29it/s]
 93%|█████████▎| 1407/1521 [00:10<00:01, 66.83it/s]
 94%|█████████▍| 1426/1521 [00:11<00:01, 80.70it/s]
 95%|█████████▌| 1445/1521 [00:11<00:00, 95.98it/s]
 96%|█████████▋| 1466/1521 [00:11<00:00, 115.42it/s]
 98%|█████████▊| 1488/1521 [00:11<00:00, 134.62it/s]
 99%|█████████▉| 1507/1521 [00:11<00:00, 146.03it/s]
100%|██████████| 1521/1521 [00:11<00:00, 132.12it/s]136Constructing time series for each modality ...137Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_097/timeseries/agg_timeseries.pkl138Extracting samples from time series ...139number of samples: 20140Packing the samples into numpy arrays ...141Processing completed!