CoolFace
Datasetpublic

Greatriver/SimBarca

🚥 SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic 📚 Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveiling… See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.

sourceHugging Facemitupdated 5mo agoView on Hugging Face
0likes4.2kdownloads
rootsimulation_sessionssession_081processing_log.log
processing_log.log134 linesDownload Raw Back to session_081
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 176358 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/00_traj_1260.5.json.gz6Loading a file takes 50.86s7Creating data frames takes 19.37s8Filling data types and values takes 5.60s9 10 Processing a file takes 16.99s11Concatenating time series takes 0.35s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/01_traj_1846.5.json.gz13Loading a file takes 52.93s14Creating data frames takes 24.27s15Filling data types and values takes 5.67s16 17 Processing a file takes 16.69s18Concatenating time series takes 0.22s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/02_traj_2362.5.json.gz20Loading a file takes 53.70s21Creating data frames takes 17.56s22Filling data types and values takes 5.22s23 24 Processing a file takes 15.83s25Concatenating time series takes 0.40s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/03_traj_2854.5.json.gz27Loading a file takes 52.71s28Creating data frames takes 19.96s29Filling data types and values takes 5.65s30 31 Processing a file takes 16.88s32Concatenating time series takes 0.35s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/04_traj_3321.5.json.gz34Loading a file takes 56.11s35Creating data frames takes 22.28s36Filling data types and values takes 5.80s37 38 Processing a file takes 16.97s39Concatenating time series takes 0.39s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/05_traj_3774.0.json.gz41Loading a file takes 52.32s42Creating data frames takes 22.44s43Filling data types and values takes 5.93s44 45 Processing a file takes 17.52s46Concatenating time series takes 0.51s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/06_traj_4222.0.json.gz48Loading a file takes 57.91s49Creating data frames takes 20.80s50Filling data types and values takes 6.00s51 52 Processing a file takes 17.53s53Concatenating time series takes 0.46s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/07_traj_4652.0.json.gz55Loading a file takes 59.28s56Creating data frames takes 20.90s57Filling data types and values takes 6.04s58 59 Processing a file takes 17.42s60Concatenating time series takes 0.45s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/08_traj_5071.5.json.gz62Loading a file takes 55.71s63Creating data frames takes 20.87s64Filling data types and values takes 5.84s65 66 Processing a file takes 22.27s67Concatenating time series takes 0.65s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/09_traj_5480.0.json.gz69Loading a file takes 59.25s70Creating data frames takes 22.39s71Filling data types and values takes 5.98s72 73 Processing a file takes 27.58s74Concatenating time series takes 0.47s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/10_traj_5873.5.json.gz76Loading a file takes 63.07s77Creating data frames takes 22.28s78Filling data types and values takes 6.05s79 80 Processing a file takes 17.99s81Concatenating time series takes 0.65s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/11_traj_6249.5.json.gz83Loading a file takes 56.05s84Creating data frames takes 23.28s85Filling data types and values takes 6.05s86 87 Processing a file takes 18.08s88Concatenating time series takes 0.48s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/12_traj_6617.5.json.gz90Loading a file takes 55.07s91Creating data frames takes 25.44s92Filling data types and values takes 6.09s93 94 Processing a file takes 18.11s95Concatenating time series takes 0.65s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/13_traj_6972.0.json.gz97Loading a file takes 59.71s98Creating data frames takes 23.49s99Filling data types and values takes 6.08s100 101 Processing a file takes 17.86s102Concatenating time series takes 0.47s103Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/14_traj_7317.0.json.gz104Loading a file takes 59.17s105Creating data frames takes 23.61s106Filling data types and values takes 5.90s107 108 Processing a file takes 17.09s109Concatenating time series takes 0.48s110Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/15_traj_7907.5.json.gz111Loading a file takes 50.95s112Creating data frames takes 22.02s113Filling data types and values takes 5.93s114 115 Processing a file takes 28.87s116Concatenating time series takes 0.65s117Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/trajectory/16_traj_end.json.gz118Loading a file takes 30.10s119Creating data frames takes 10.09s120Filling data types and values takes 2.69s121 122 Processing a file takes 13.99s123Concatenating time series takes 0.42s124Saving all the section time series takes 102.17s125Saving all the junction time series takes 15.79s126Saving network entrance and exit takes 0.15s127Aggregating the raw statistics to different intervals...128
  0%|          | 0/1521 [00:00<?, ?it/s]
  0%|          | 1/1521 [00:00<13:32,  1.87it/s]
  0%|          | 3/1521 [00:00<04:44,  5.33it/s]
  0%|          | 7/1521 [00:00<02:00, 12.53it/s]
  4%|▍         | 67/1521 [00:00<00:09, 148.91it/s]
  6%|▌         | 92/1521 [00:01<00:08, 162.29it/s]
  8%|▊         | 118/1521 [00:01<00:08, 174.33it/s]
  9%|▉         | 143/1521 [00:01<00:07, 191.70it/s]
 11%|█         | 166/1521 [00:01<00:06, 195.97it/s]
 12%|█▏        | 189/1521 [00:01<00:06, 200.14it/s]
 14%|█▍        | 211/1521 [00:01<00:07, 180.73it/s]
 15%|█▌        | 231/1521 [00:01<00:07, 172.62it/s]
 17%|█▋        | 256/1521 [00:01<00:06, 191.75it/s]
 18%|█▊        | 278/1521 [00:01<00:06, 198.83it/s]
 20%|█▉        | 304/1521 [00:02<00:05, 215.39it/s]
 21%|██▏       | 327/1521 [00:03<00:21, 55.61it/s] 
 23%|██▎       | 354/1521 [00:03<00:15, 75.29it/s]
 26%|██▌       | 396/1521 [00:03<00:09, 113.68it/s]
 28%|██▊       | 422/1521 [00:03<00:08, 133.24it/s]
 29%|██▉       | 447/1521 [00:03<00:07, 141.52it/s]
 31%|███       | 470/1521 [00:03<00:06, 150.90it/s]
 32%|███▏      | 492/1521 [00:03<00:06, 151.62it/s]
 34%|███▎      | 512/1521 [00:04<00:06, 156.68it/s]
 35%|███▍      | 531/1521 [00:04<00:06, 157.04it/s]
 36%|███▌      | 549/1521 [00:04<00:06, 153.93it/s]
 37%|███▋      | 566/1521 [00:04<00:06, 146.68it/s]
 38%|███▊      | 585/1521 [00:04<00:05, 156.47it/s]
 40%|███▉      | 602/1521 [00:04<00:05, 155.26it/s]
 41%|████      | 622/1521 [00:04<00:05, 164.32it/s]
 42%|████▏     | 644/1521 [00:04<00:04, 177.84it/s]
 44%|████▎     | 665/1521 [00:04<00:04, 186.01it/s]
 45%|████▌     | 685/1521 [00:05<00:04, 184.22it/s]
 47%|████▋     | 708/1521 [00:05<00:04, 193.87it/s]
 48%|████▊     | 728/1521 [00:05<00:04, 190.18it/s]
 49%|████▉     | 748/1521 [00:05<00:04, 183.99it/s]
 50%|█████     | 767/1521 [00:05<00:04, 179.94it/s]
 52%|█████▏    | 786/1521 [00:05<00:04, 177.02it/s]
 53%|█████▎    | 808/1521 [00:05<00:03, 186.06it/s]
 54%|█████▍    | 827/1521 [00:05<00:03, 176.69it/s]
 56%|█████▌    | 845/1521 [00:05<00:03, 174.08it/s]
 57%|█████▋    | 871/1521 [00:06<00:03, 194.87it/s]
 59%|█████▊    | 893/1521 [00:06<00:03, 195.36it/s]
 60%|██████    | 916/1521 [00:06<00:03, 196.50it/s]
 62%|██████▏   | 941/1521 [00:06<00:02, 209.35it/s]
 63%|██████▎   | 963/1521 [00:06<00:02, 209.88it/s]
 65%|██████▍   | 985/1521 [00:06<00:02, 206.54it/s]
 66%|██████▌   | 1006/1521 [00:06<00:02, 207.51it/s]
 68%|██████▊   | 1027/1521 [00:06<00:02, 195.81it/s]
 69%|██████▉   | 1047/1521 [00:06<00:02, 196.01it/s]
 70%|███████   | 1070/1521 [00:07<00:02, 205.57it/s]
 72%|███████▏  | 1092/1521 [00:07<00:02, 209.07it/s]
 73%|███████▎  | 1114/1521 [00:07<00:01, 207.81it/s]
 75%|███████▍  | 1136/1521 [00:07<00:01, 209.24it/s]
 76%|███████▌  | 1157/1521 [00:07<00:01, 191.57it/s]
 78%|███████▊  | 1181/1521 [00:07<00:01, 200.46it/s]
 79%|███████▉  | 1206/1521 [00:07<00:01, 207.28it/s]
 81%|████████  | 1234/1521 [00:07<00:01, 227.24it/s]
 83%|████████▎ | 1258/1521 [00:07<00:01, 230.42it/s]
 84%|████████▍ | 1282/1521 [00:08<00:01, 222.76it/s]
 86%|████████▌ | 1305/1521 [00:08<00:01, 215.95it/s]
 87%|████████▋ | 1327/1521 [00:08<00:00, 197.25it/s]
 89%|████████▊ | 1348/1521 [00:08<00:00, 175.15it/s]
 90%|████████▉ | 1367/1521 [00:09<00:03, 40.71it/s] 
 91%|█████████ | 1384/1521 [00:09<00:02, 50.14it/s]
 93%|█████████▎| 1411/1521 [00:10<00:01, 70.42it/s]
 94%|█████████▍| 1432/1521 [00:10<00:01, 86.49it/s]
 95%|█████████▌| 1450/1521 [00:10<00:00, 97.38it/s]
 96%|█████████▋| 1467/1521 [00:10<00:00, 108.91it/s]
 98%|█████████▊| 1484/1521 [00:10<00:00, 117.56it/s]
 99%|█████████▉| 1504/1521 [00:10<00:00, 130.99it/s]
100%|██████████| 1521/1521 [00:10<00:00, 142.59it/s]129Constructing time series for each modality ...130Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_081/timeseries/agg_timeseries.pkl131Extracting samples from time series ...132number of samples: 20133Packing the samples into numpy arrays ...134