Datasetpublic
Greatriver/SimBarca

🚥 SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic 📚 Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveiling… See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
sourceHugging Facemitupdated 5mo agoView on Hugging Face
0likes4.2kdownloads
rootsimulation_sessionssession_088processing_log.log
processing_log.log199 linesDownload Raw Back to session_088
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 183231 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/00_traj_1245.5.json.gz6Loading a file takes 57.00s7Creating data frames takes 21.76s8Filling data types and values takes 5.87s9 10 Processing a file takes 18.87s11Concatenating time series takes 0.53s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/01_traj_1802.0.json.gz13Loading a file takes 58.66s14Creating data frames takes 32.53s15Filling data types and values takes 6.14s16 17 Processing a file takes 18.22s18Concatenating time series takes 0.25s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/02_traj_2288.5.json.gz20Loading a file takes 58.08s21Creating data frames takes 23.60s22Filling data types and values takes 5.99s23 24 Processing a file takes 17.36s25Concatenating time series takes 0.20s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/03_traj_2740.5.json.gz27Loading a file takes 54.71s28Creating data frames takes 22.59s29Filling data types and values takes 5.97s30 31 Processing a file takes 17.03s32Concatenating time series takes 0.35s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/04_traj_3165.0.json.gz34Loading a file takes 57.59s35Creating data frames takes 22.22s36Filling data types and values takes 6.00s37 38 Processing a file takes 17.57s39Concatenating time series takes 0.40s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/05_traj_3565.0.json.gz41Loading a file takes 54.45s42Creating data frames takes 24.70s43Filling data types and values takes 5.88s44 45 Processing a file takes 17.26s46Concatenating time series takes 0.45s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/06_traj_3949.0.json.gz48Loading a file takes 57.69s49Creating data frames takes 24.09s50Filling data types and values takes 6.13s51 52 Processing a file takes 17.34s53Concatenating time series takes 0.36s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/07_traj_4315.5.json.gz55Loading a file takes 62.52s56Creating data frames takes 25.38s57Filling data types and values takes 6.28s58 59 Processing a file takes 17.25s60Concatenating time series takes 0.41s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/08_traj_4669.0.json.gz62Loading a file takes 56.37s63Creating data frames takes 22.67s64Filling data types and values takes 6.25s65 66 Processing a file takes 17.41s67Concatenating time series takes 0.32s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/09_traj_5015.0.json.gz69Loading a file takes 62.12s70Creating data frames takes 32.11s71Filling data types and values takes 6.13s72 73 Processing a file takes 17.37s74Concatenating time series takes 0.44s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/10_traj_5345.0.json.gz76Loading a file takes 59.36s77Creating data frames takes 23.16s78Filling data types and values takes 6.14s79 80 Processing a file takes 17.72s81Concatenating time series takes 0.41s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/11_traj_5656.0.json.gz83Loading a file takes 55.03s84Creating data frames takes 24.73s85Filling data types and values takes 6.23s86 87 Processing a file takes 17.74s88Concatenating time series takes 0.47s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/12_traj_5959.5.json.gz90Loading a file takes 58.20s91Creating data frames takes 23.83s92Filling data types and values takes 6.31s93 94 Processing a file takes 18.08s95Concatenating time series takes 0.41s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/13_traj_6252.5.json.gz97Loading a file takes 56.28s98Creating data frames takes 23.55s99Filling data types and values takes 6.36s100 101 Processing a file takes 17.91s102Concatenating time series takes 0.42s103Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/14_traj_6535.0.json.gz104Loading a file takes 60.24s105Creating data frames takes 25.92s106Filling data types and values takes 6.20s107 108 Processing a file takes 17.82s109Concatenating time series takes 0.49s110Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/15_traj_6802.5.json.gz111Loading a file takes 59.61s112Creating data frames takes 25.31s113Filling data types and values takes 6.22s114 115 Processing a file takes 17.70s116Concatenating time series takes 0.41s117Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/16_traj_7056.0.json.gz118Loading a file takes 55.05s119Creating data frames takes 25.07s120Filling data types and values takes 6.23s121 122 Processing a file takes 18.68s123Concatenating time series takes 0.38s124Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/17_traj_7297.5.json.gz125Loading a file takes 60.02s126Creating data frames takes 26.95s127Filling data types and values takes 6.22s128 129 Processing a file takes 18.12s130Concatenating time series takes 0.32s131Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/18_traj_7564.0.json.gz132Loading a file takes 59.16s133Creating data frames takes 32.03s134Filling data types and values takes 6.20s135 136 Processing a file takes 17.99s137Concatenating time series takes 0.46s138Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/19_traj_7902.0.json.gz139Loading a file takes 60.49s140Creating data frames takes 23.06s141Filling data types and values takes 6.34s142 143 Processing a file takes 22.43s144Concatenating time series takes 0.44s145Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/20_traj_8379.0.json.gz146Loading a file takes 59.77s147Creating data frames takes 26.38s148Filling data types and values takes 6.23s149 150 Processing a file takes 27.77s151Concatenating time series takes 0.37s152Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/21_traj_9221.5.json.gz153Loading a file takes 60.67s154Creating data frames takes 29.47s155Filling data types and values takes 6.54s156 157 Processing a file takes 31.93s158Concatenating time series takes 0.72s159Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/22_traj_11701.5.json.gz160Loading a file takes 62.30s161Creating data frames takes 25.11s162Filling data types and values takes 6.33s163 164 Processing a file takes 30.54s165Concatenating time series takes 0.41s166Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/23_traj_15701.5.json.gz167Loading a file takes 60.20s168Creating data frames takes 25.41s169Filling data types and values takes 6.00s170 171 Processing a file takes 23.45s172Concatenating time series takes 0.18s173Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/24_traj_19893.0.json.gz174Loading a file takes 59.41s175Creating data frames takes 25.06s176Filling data types and values takes 5.80s177/home/weijiang/Projects/Netsanut/scripts/data/simbarca/time_series_from_traj.py:424: FutureWarning: The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.178  df = pd.concat([df, entering, exiting], ignore_index=True, copy=False)179 180 Processing a file takes 14.67s181Concatenating time series takes 0.12s182Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/trajectory/25_traj_end.json.gz183Loading a file takes 52.72s184Creating data frames takes 19.54s185Filling data types and values takes 10.05s186 187 Processing a file takes 9.65s188Concatenating time series takes 0.12s189Saving all the section time series takes 127.10s190Saving all the junction time series takes 19.77s191Saving network entrance and exit takes 0.14s192Aggregating the raw statistics to different intervals...193
  0%|          | 0/1517 [00:00<?, ?it/s]
  0%|          | 1/1517 [00:00<21:16,  1.19it/s]
  0%|          | 4/1517 [00:01<06:07,  4.12it/s]
  5%|▍         | 73/1517 [00:01<00:14, 96.74it/s]
  7%|▋         | 102/1517 [00:01<00:13, 106.41it/s]
  8%|▊         | 125/1517 [00:01<00:11, 122.35it/s]
 10%|▉         | 147/1517 [00:01<00:10, 133.79it/s]
 11%|█         | 167/1517 [00:01<00:09, 146.96it/s]
 12%|█▏        | 187/1517 [00:01<00:09, 139.40it/s]
 14%|█▍        | 219/1517 [00:02<00:07, 175.99it/s]
 16%|█▌        | 243/1517 [00:02<00:06, 190.03it/s]
 18%|█▊        | 269/1517 [00:02<00:06, 201.14it/s]
 19%|█▉        | 292/1517 [00:02<00:05, 204.88it/s]
 21%|██        | 315/1517 [00:03<00:24, 49.89it/s] 
 22%|██▏       | 340/1517 [00:03<00:17, 66.22it/s]
 24%|██▍       | 368/1517 [00:03<00:12, 88.49it/s]
 26%|██▌       | 397/1517 [00:04<00:09, 114.58it/s]
 28%|██▊       | 421/1517 [00:04<00:08, 126.32it/s]
 29%|██▉       | 443/1517 [00:04<00:07, 134.48it/s]
 31%|███       | 464/1517 [00:04<00:07, 143.76it/s]
 32%|███▏      | 484/1517 [00:04<00:07, 145.60it/s]
 33%|███▎      | 503/1517 [00:04<00:08, 121.09it/s]
 34%|███▍      | 519/1517 [00:04<00:08, 112.08it/s]
 35%|███▌      | 537/1517 [00:05<00:07, 123.61it/s]
 36%|███▋      | 552/1517 [00:05<00:08, 114.28it/s]
 38%|███▊      | 569/1517 [00:05<00:07, 125.68it/s]
 39%|███▊      | 587/1517 [00:05<00:06, 133.16it/s]
 40%|███▉      | 602/1517 [00:05<00:06, 131.42it/s]
 41%|████      | 625/1517 [00:05<00:05, 155.46it/s]
 43%|████▎     | 646/1517 [00:05<00:05, 167.69it/s]
 44%|████▍     | 668/1517 [00:05<00:04, 178.55it/s]
 45%|████▌     | 689/1517 [00:06<00:04, 183.95it/s]
 47%|████▋     | 708/1517 [00:06<00:04, 174.57it/s]
 48%|████▊     | 726/1517 [00:06<00:04, 173.15it/s]
 49%|████▉     | 744/1517 [00:06<00:04, 162.61it/s]
 50%|█████     | 761/1517 [00:06<00:04, 158.52it/s]
 51%|█████▏    | 778/1517 [00:06<00:04, 151.19it/s]
 52%|█████▏    | 794/1517 [00:06<00:05, 139.97it/s]
 53%|█████▎    | 809/1517 [00:06<00:05, 139.05it/s]
 54%|█████▍    | 826/1517 [00:06<00:04, 142.77it/s]
 56%|█████▌    | 843/1517 [00:07<00:04, 140.68it/s]
 57%|█████▋    | 858/1517 [00:07<00:04, 135.19it/s]
 58%|█████▊    | 876/1517 [00:07<00:04, 141.95it/s]
 59%|█████▊    | 891/1517 [00:07<00:05, 114.20it/s]
 60%|██████    | 914/1517 [00:07<00:04, 140.05it/s]
 61%|██████▏   | 930/1517 [00:07<00:04, 129.64it/s]
 62%|██████▏   | 947/1517 [00:07<00:04, 118.14it/s]
 64%|██████▍   | 973/1517 [00:08<00:03, 150.02it/s]
 65%|██████▌   | 990/1517 [00:08<00:03, 141.42it/s]
 67%|██████▋   | 1017/1517 [00:08<00:02, 170.62it/s]
 68%|██████▊   | 1036/1517 [00:08<00:02, 168.65it/s]
 70%|██████▉   | 1055/1517 [00:08<00:02, 172.50it/s]
 71%|███████   | 1074/1517 [00:08<00:02, 175.96it/s]
 72%|███████▏  | 1093/1517 [00:08<00:02, 175.33it/s]
 74%|███████▎  | 1116/1517 [00:08<00:02, 179.91it/s]
 75%|███████▌  | 1138/1517 [00:08<00:01, 189.58it/s]
 76%|███████▋  | 1158/1517 [00:09<00:01, 180.30it/s]
 78%|███████▊  | 1185/1517 [00:09<00:01, 200.74it/s]
 79%|███████▉  | 1206/1517 [00:09<00:02, 150.11it/s]
 81%|████████  | 1230/1517 [00:09<00:01, 153.75it/s]
 83%|████████▎ | 1257/1517 [00:09<00:01, 177.94it/s]
 85%|████████▍ | 1282/1517 [00:09<00:01, 194.55it/s]
 86%|████████▌ | 1303/1517 [00:09<00:01, 197.74it/s]
 87%|████████▋ | 1324/1517 [00:09<00:00, 194.01it/s]
 89%|████████▊ | 1345/1517 [00:10<00:00, 176.85it/s]
 90%|████████▉ | 1364/1517 [00:11<00:03, 38.60it/s] 
 91%|█████████ | 1380/1517 [00:11<00:02, 47.38it/s]
 92%|█████████▏| 1400/1517 [00:11<00:01, 61.52it/s]
 93%|█████████▎| 1416/1517 [00:11<00:01, 71.14it/s]
 94%|█████████▍| 1432/1517 [00:12<00:01, 82.52it/s]
 96%|█████████▌| 1455/1517 [00:12<00:00, 106.91it/s]
 97%|█████████▋| 1473/1517 [00:12<00:00, 110.07it/s]
 98%|█████████▊| 1492/1517 [00:12<00:00, 120.02it/s]
100%|██████████| 1517/1517 [00:12<00:00, 120.78it/s]194Constructing time series for each modality ...195Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_088/timeseries/agg_timeseries.pkl196Extracting samples from time series ...197number of samples: 20198Packing the samples into numpy arrays ...199