Datasetpublic
Greatriver/SimBarca

🚥 SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic 📚 Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveiling… See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
sourceHugging Facemitupdated 5mo agoView on Hugging Face
0likes4.2kdownloads
rootsimulation_sessionssession_068processing_log.log
processing_log.log162 linesDownload Raw Back to session_068
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 160352 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/00_traj_1279.0.json.gz6Loading a file takes 52.26s7Creating data frames takes 21.89s8Filling data types and values takes 6.89s9 10 Processing a file takes 17.79s11Concatenating time series takes 0.41s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/01_traj_1932.0.json.gz13Loading a file takes 59.19s14Creating data frames takes 28.82s15Filling data types and values takes 6.56s16 17 Processing a file takes 18.53s18Concatenating time series takes 0.23s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/02_traj_2534.0.json.gz20Loading a file takes 60.45s21Creating data frames takes 27.86s22Filling data types and values takes 6.65s23 24 Processing a file takes 17.62s25Concatenating time series takes 0.28s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/03_traj_3126.5.json.gz27Loading a file takes 57.53s28Creating data frames takes 28.98s29Filling data types and values takes 6.99s30 31 Processing a file takes 18.49s32Concatenating time series takes 0.38s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/04_traj_3684.5.json.gz34Loading a file takes 62.55s35Creating data frames takes 25.42s36Filling data types and values takes 6.35s37 38 Processing a file takes 17.95s39Concatenating time series takes 0.88s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/05_traj_4220.5.json.gz41Loading a file takes 55.74s42Creating data frames takes 24.84s43Filling data types and values takes 5.78s44 45 Processing a file takes 17.33s46Concatenating time series takes 0.39s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/06_traj_4730.5.json.gz48Loading a file takes 54.78s49Creating data frames takes 22.85s50Filling data types and values takes 5.79s51 52 Processing a file takes 17.36s53Concatenating time series takes 0.61s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/07_traj_5222.5.json.gz55Loading a file takes 57.79s56Creating data frames takes 22.54s57Filling data types and values takes 5.81s58 59 Processing a file takes 16.88s60Concatenating time series takes 0.42s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/08_traj_5699.0.json.gz62Loading a file takes 55.02s63Creating data frames takes 21.12s64Filling data types and values takes 5.67s65 66 Processing a file takes 16.20s67Concatenating time series takes 0.56s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/09_traj_6149.5.json.gz69Loading a file takes 51.12s70Creating data frames takes 21.91s71Filling data types and values takes 5.78s72 73 Processing a file takes 15.75s74Concatenating time series takes 0.36s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/10_traj_6582.5.json.gz76Loading a file takes 54.25s77Creating data frames takes 21.99s78Filling data types and values takes 5.83s79 80 Processing a file takes 16.17s81Concatenating time series takes 0.57s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/11_traj_7006.0.json.gz83Loading a file takes 54.88s84Creating data frames takes 21.24s85Filling data types and values takes 6.01s86 87 Processing a file takes 17.34s88Concatenating time series takes 0.52s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/12_traj_7489.0.json.gz90Loading a file takes 58.66s91Creating data frames takes 21.64s92Filling data types and values takes 6.11s93 94 Processing a file takes 17.49s95Concatenating time series takes 0.59s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/13_traj_8471.5.json.gz97Loading a file takes 52.82s98Creating data frames takes 21.52s99Filling data types and values takes 5.72s100 101 Processing a file takes 28.74s102Concatenating time series takes 0.38s103Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/14_traj_9838.5.json.gz104Loading a file takes 56.08s105Creating data frames takes 22.66s106Filling data types and values takes 5.92s107 108 Processing a file takes 25.21s109Concatenating time series takes 0.38s110Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/15_traj_11964.0.json.gz111Loading a file takes 53.65s112Creating data frames takes 21.99s113Filling data types and values takes 5.60s114 115 Processing a file takes 19.44s116Concatenating time series takes 0.28s117Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/16_traj_14371.0.json.gz118Loading a file takes 58.21s119Creating data frames takes 21.94s120Filling data types and values takes 5.64s121 122 Processing a file takes 13.82s123Concatenating time series takes 0.16s124Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/17_traj_16845.5.json.gz125Loading a file takes 53.95s126Creating data frames takes 20.10s127Filling data types and values takes 5.70s128 129 Processing a file takes 11.18s130Concatenating time series takes 0.16s131Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/18_traj_19358.0.json.gz132Loading a file takes 54.16s133Creating data frames takes 20.83s134Filling data types and values takes 5.52s135 136 Processing a file takes 11.88s137Concatenating time series takes 0.16s138Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/19_traj_21908.5.json.gz139Loading a file takes 57.81s140Creating data frames takes 20.93s141Filling data types and values takes 5.47s142 143 Processing a file takes 11.28s144Concatenating time series takes 0.18s145Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/trajectory/20_traj_end.json.gz146Loading a file takes 32.04s147Creating data frames takes 11.87s148Filling data types and values takes 2.96s149 150 Processing a file takes 9.43s151Concatenating time series takes 0.13s152Saving all the section time series takes 111.94s153Saving all the junction time series takes 16.50s154Saving network entrance and exit takes 0.12s155Aggregating the raw statistics to different intervals...156
  0%|          | 0/1522 [00:00<?, ?it/s]
  0%|          | 1/1522 [00:00<17:11,  1.47it/s]
  1%|          | 14/1522 [00:00<01:03, 23.64it/s]
  2%|▏         | 31/1522 [00:00<00:28, 52.50it/s]
  3%|▎         | 53/1522 [00:00<00:16, 87.16it/s]
  5%|▌         | 81/1522 [00:01<00:11, 124.85it/s]
  7%|▋         | 112/1522 [00:01<00:10, 140.81it/s]
 10%|▉         | 147/1522 [00:01<00:07, 182.42it/s]
 11%|█         | 170/1522 [00:01<00:07, 192.81it/s]
 13%|█▎        | 193/1522 [00:01<00:07, 179.94it/s]
 14%|█▍        | 219/1522 [00:01<00:06, 193.49it/s]
 16%|█▋        | 249/1522 [00:01<00:05, 218.36it/s]
 18%|█▊        | 273/1522 [00:02<00:06, 193.97it/s]
 19%|█▉        | 294/1522 [00:02<00:07, 166.41it/s]
 21%|██        | 320/1522 [00:03<00:21, 56.72it/s] 
 22%|██▏       | 339/1522 [00:03<00:17, 68.61it/s]
 25%|██▍       | 377/1522 [00:03<00:11, 102.97it/s]
 27%|██▋       | 407/1522 [00:03<00:08, 125.83it/s]
 28%|██▊       | 429/1522 [00:03<00:07, 139.05it/s]
 30%|██▉       | 451/1522 [00:03<00:07, 149.21it/s]
 31%|███       | 472/1522 [00:04<00:07, 149.64it/s]
 32%|███▏      | 491/1522 [00:04<00:08, 125.08it/s]
 34%|███▍      | 515/1522 [00:04<00:06, 146.40it/s]
 35%|███▌      | 534/1522 [00:04<00:06, 146.35it/s]
 36%|███▋      | 552/1522 [00:04<00:06, 141.65it/s]
 37%|███▋      | 569/1522 [00:04<00:06, 148.09it/s]
 39%|███▊      | 586/1522 [00:04<00:06, 150.52it/s]
 40%|███▉      | 603/1522 [00:04<00:06, 151.17it/s]
 41%|████      | 625/1522 [00:05<00:05, 167.73it/s]
 42%|████▏     | 646/1522 [00:05<00:05, 170.71it/s]
 44%|████▍     | 674/1522 [00:05<00:04, 199.46it/s]
 46%|████▌     | 695/1522 [00:05<00:04, 199.04it/s]
 47%|████▋     | 716/1522 [00:05<00:04, 199.94it/s]
 48%|████▊     | 737/1522 [00:05<00:04, 193.81it/s]
 50%|████▉     | 757/1522 [00:05<00:04, 186.50it/s]
 51%|█████     | 776/1522 [00:05<00:04, 176.72it/s]
 52%|█████▏    | 797/1522 [00:05<00:03, 185.10it/s]
 54%|█████▎    | 817/1522 [00:06<00:03, 188.54it/s]
 55%|█████▍    | 837/1522 [00:06<00:03, 183.43it/s]
 56%|█████▌    | 856/1522 [00:06<00:03, 181.72it/s]
 58%|█████▊    | 876/1522 [00:06<00:03, 185.51it/s]
 59%|█████▉    | 895/1522 [00:06<00:04, 138.60it/s]
 60%|█████▉    | 911/1522 [00:06<00:04, 126.53it/s]
 61%|██████    | 925/1522 [00:06<00:04, 129.31it/s]
 62%|██████▏   | 944/1522 [00:06<00:04, 134.35it/s]
 64%|██████▍   | 975/1522 [00:07<00:03, 173.52it/s]
 66%|██████▌   | 998/1522 [00:07<00:02, 185.91it/s]
 67%|██████▋   | 1018/1522 [00:07<00:02, 185.76it/s]
 68%|██████▊   | 1038/1522 [00:07<00:02, 163.24it/s]
 69%|██████▉   | 1056/1522 [00:07<00:02, 159.45it/s]
 70%|███████   | 1073/1522 [00:07<00:03, 128.98it/s]
 71%|███████▏  | 1088/1522 [00:07<00:03, 127.32it/s]
 73%|███████▎  | 1111/1522 [00:08<00:02, 150.65it/s]
 74%|███████▍  | 1128/1522 [00:08<00:02, 132.68it/s]
 76%|███████▌  | 1154/1522 [00:08<00:02, 161.22it/s]
 77%|███████▋  | 1177/1522 [00:08<00:01, 173.90it/s]
 79%|███████▉  | 1199/1522 [00:08<00:01, 185.54it/s]
 80%|████████  | 1223/1522 [00:08<00:01, 199.77it/s]
 82%|████████▏ | 1249/1522 [00:08<00:01, 213.27it/s]
 84%|████████▎ | 1272/1522 [00:08<00:01, 204.08it/s]
 86%|████████▌ | 1302/1522 [00:08<00:00, 227.83it/s]
 87%|████████▋ | 1326/1522 [00:09<00:00, 212.02it/s]
 89%|████████▊ | 1348/1522 [00:09<00:00, 180.62it/s]
 90%|████████▉ | 1368/1522 [00:10<00:03, 50.13it/s] 
 91%|█████████▏| 1391/1522 [00:10<00:01, 65.51it/s]
 93%|█████████▎| 1410/1522 [00:10<00:01, 79.10it/s]
 94%|█████████▍| 1433/1522 [00:10<00:00, 98.71it/s]
 96%|█████████▌| 1455/1522 [00:10<00:00, 115.29it/s]
 97%|█████████▋| 1474/1522 [00:10<00:00, 124.47it/s]
 98%|█████████▊| 1493/1522 [00:11<00:00, 134.80it/s]
100%|██████████| 1522/1522 [00:11<00:00, 136.73it/s]157Constructing time series for each modality ...158Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_068/timeseries/agg_timeseries.pkl159Extracting samples from time series ...160number of samples: 20161Packing the samples into numpy arrays ...162