Greatriver/SimBarca
π₯ SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic π Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveilingβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
04.1k
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 130058 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/00_traj_1331.5.json.gz6Loading a file takes 49.94s7Creating data frames takes 24.42s8Filling data types and values takes 8.24s9 10 Processing a file takes 18.03s11Concatenating time series takes 0.38s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/01_traj_2165.0.json.gz13Loading a file takes 55.44s14Creating data frames takes 58.93s15Filling data types and values takes 6.85s16 17 Processing a file takes 18.01s18Concatenating time series takes 0.28s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/02_traj_2963.5.json.gz20Loading a file takes 55.97s21Creating data frames takes 28.46s22Filling data types and values takes 5.92s23 24 Processing a file takes 19.31s25Concatenating time series takes 0.26s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/03_traj_3743.0.json.gz27Loading a file takes 57.02s28Creating data frames takes 30.44s29Filling data types and values takes 5.87s30 31 Processing a file takes 17.63s32Concatenating time series takes 0.41s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/04_traj_4513.5.json.gz34Loading a file takes 51.68s35Creating data frames takes 27.72s36Filling data types and values takes 5.50s37 38 Processing a file takes 18.44s39Concatenating time series takes 0.43s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/05_traj_5280.0.json.gz41Loading a file takes 46.68s42Creating data frames takes 42.14s43Filling data types and values takes 6.99s44 45 Processing a file takes 27.71s46Concatenating time series takes 0.44s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/06_traj_6030.5.json.gz48Loading a file takes 48.92s49Creating data frames takes 41.64s50Filling data types and values takes 6.04s51 52 Processing a file takes 22.30s53Concatenating time series takes 0.53s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/07_traj_6799.0.json.gz55Loading a file takes 56.95s56Creating data frames takes 33.51s57Filling data types and values takes 6.00s58 59 Processing a file takes 18.87s60Concatenating time series takes 0.72s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/trajectory/08_traj_end.json.gz62Loading a file takes 47.73s63Creating data frames takes 21.07s64Filling data types and values takes 5.07s65 66 Processing a file takes 18.32s67Concatenating time series takes 0.51s68Saving all the section time series takes 81.02s69Saving all the junction time series takes 11.24s70Saving network entrance and exit takes 0.09s71Aggregating the raw statistics to different intervals...72
0%| | 0/1519 [00:00<?, ?it/s]
0%| | 1/1519 [00:00<09:23, 2.70it/s]
2%|β | 24/1519 [00:00<00:23, 63.69it/s]
4%|β | 66/1519 [00:00<00:09, 161.27it/s]
6%|β | 97/1519 [00:00<00:07, 199.40it/s]
9%|β | 136/1519 [00:00<00:05, 251.29it/s]
11%|β | 167/1519 [00:00<00:05, 239.89it/s]
13%|ββ | 195/1519 [00:01<00:05, 246.24it/s]
15%|ββ | 223/1519 [00:01<00:05, 247.95it/s]
17%|ββ | 257/1519 [00:01<00:04, 267.25it/s]
19%|ββ | 287/1519 [00:01<00:04, 256.70it/s]
21%|ββ | 315/1519 [00:02<00:14, 83.79it/s]
23%|βββ | 348/1519 [00:02<00:10, 110.28it/s]
25%|βββ | 385/1519 [00:02<00:07, 145.03it/s]
27%|βββ | 413/1519 [00:02<00:06, 165.54it/s]
29%|βββ | 441/1519 [00:02<00:05, 185.03it/s]
31%|βββ | 469/1519 [00:02<00:05, 198.72it/s]
33%|ββββ | 496/1519 [00:02<00:05, 196.97it/s]
34%|ββββ | 521/1519 [00:03<00:05, 199.60it/s]
36%|ββββ | 545/1519 [00:03<00:05, 186.45it/s]
37%|ββββ | 566/1519 [00:03<00:05, 172.69it/s]
39%|ββββ | 592/1519 [00:03<00:04, 188.31it/s]
40%|ββββ | 613/1519 [00:03<00:04, 182.98it/s]
42%|βββββ | 638/1519 [00:03<00:04, 198.19it/s]
44%|βββββ | 663/1519 [00:03<00:04, 207.18it/s]
45%|βββββ | 688/1519 [00:03<00:04, 207.69it/s]
47%|βββββ | 714/1519 [00:04<00:03, 219.50it/s]
49%|βββββ | 737/1519 [00:04<00:03, 220.43it/s]
50%|βββββ | 760/1519 [00:04<00:03, 211.38it/s]
51%|ββββββ | 782/1519 [00:04<00:03, 195.84it/s]
53%|ββββββ | 805/1519 [00:04<00:03, 201.78it/s]
55%|ββββββ | 830/1519 [00:04<00:03, 211.40it/s]
56%|ββββββ | 856/1519 [00:04<00:03, 215.97it/s]
58%|ββββββ | 878/1519 [00:04<00:02, 217.04it/s]
59%|ββββββ | 900/1519 [00:04<00:03, 206.07it/s]
61%|ββββββ | 921/1519 [00:05<00:02, 200.61it/s]
62%|βββββββ | 942/1519 [00:05<00:02, 198.48it/s]
63%|βββββββ | 963/1519 [00:05<00:02, 200.38it/s]
65%|βββββββ | 984/1519 [00:05<00:02, 193.40it/s]
67%|βββββββ | 1011/1519 [00:05<00:02, 207.98it/s]
68%|βββββββ | 1032/1519 [00:05<00:02, 207.88it/s]
69%|βββββββ | 1053/1519 [00:05<00:02, 203.80it/s]
71%|βββββββ | 1076/1519 [00:05<00:02, 209.12it/s]
72%|ββββββββ | 1100/1519 [00:05<00:01, 213.51it/s]
74%|ββββββββ | 1122/1519 [00:06<00:02, 196.21it/s]
75%|ββββββββ | 1142/1519 [00:06<00:01, 195.50it/s]
77%|ββββββββ | 1171/1519 [00:06<00:01, 219.09it/s]
79%|ββββββββ | 1198/1519 [00:06<00:01, 232.11it/s]
81%|ββββββββ | 1227/1519 [00:06<00:01, 245.44it/s]
83%|βββββββββ | 1258/1519 [00:06<00:00, 263.24it/s]
85%|βββββββββ | 1287/1519 [00:06<00:00, 265.80it/s]
87%|βββββββββ | 1314/1519 [00:06<00:00, 264.52it/s]
88%|βββββββββ | 1341/1519 [00:06<00:00, 243.66it/s]
90%|βββββββββ | 1366/1519 [00:08<00:02, 53.70it/s]
91%|βββββββββ | 1384/1519 [00:08<00:02, 62.82it/s]
93%|ββββββββββ| 1411/1519 [00:08<00:01, 83.27it/s]
94%|ββββββββββ| 1431/1519 [00:08<00:00, 94.57it/s]
95%|ββββββββββ| 1450/1519 [00:08<00:00, 107.20it/s]
97%|ββββββββββ| 1476/1519 [00:08<00:00, 132.29it/s]
99%|ββββββββββ| 1497/1519 [00:08<00:00, 146.46it/s]
100%|ββββββββββ| 1519/1519 [00:09<00:00, 167.89it/s]73Constructing time series for each modality ...74Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_029/timeseries/agg_timeseries.pkl75Extracting samples from time series ...76number of samples: 2077Packing the samples into numpy arrays ...78 