Greatriver/SimBarca
π₯ SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic π Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveilingβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
04.2k
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 124355 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/00_traj_1339.5.json.gz6Loading a file takes 51.95s7Creating data frames takes 23.88s8Filling data types and values takes 7.66s9 10 Processing a file takes 18.65s11Concatenating time series takes 0.60s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/01_traj_2224.0.json.gz13Loading a file takes 59.45s14Creating data frames takes 32.76s15Filling data types and values takes 6.01s16 17 Processing a file takes 18.93s18Concatenating time series takes 0.32s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/02_traj_3070.5.json.gz20Loading a file takes 58.17s21Creating data frames takes 34.17s22Filling data types and values takes 5.61s23 24 Processing a file takes 18.14s25Concatenating time series takes 0.37s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/03_traj_3893.5.json.gz27Loading a file takes 54.29s28Creating data frames takes 28.91s29Filling data types and values takes 5.51s30 31 Processing a file takes 17.99s32Concatenating time series takes 0.44s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/04_traj_4707.0.json.gz34Loading a file takes 57.19s35Creating data frames takes 30.42s36Filling data types and values takes 5.88s37 38 Processing a file takes 17.88s39Concatenating time series takes 0.49s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/05_traj_5494.5.json.gz41Loading a file takes 57.41s42Creating data frames takes 26.94s43Filling data types and values takes 6.19s44 45 Processing a file takes 31.28s46Concatenating time series takes 0.54s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/06_traj_6275.0.json.gz48Loading a file takes 65.83s49Creating data frames takes 28.58s50Filling data types and values takes 6.14s51 52 Processing a file takes 22.96s53Concatenating time series takes 0.50s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/07_traj_7040.0.json.gz55Loading a file takes 63.69s56Creating data frames takes 30.36s57Filling data types and values takes 6.83s58 59 Processing a file takes 19.79s60Concatenating time series takes 0.71s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/trajectory/08_traj_end.json.gz62Loading a file takes 56.01s63Creating data frames takes 26.65s64Filling data types and values takes 5.99s65 66 Processing a file takes 19.15s67Concatenating time series takes 0.46s68Saving all the section time series takes 77.78s69Saving all the junction time series takes 11.15s70Saving network entrance and exit takes 0.10s71Aggregating the raw statistics to different intervals...72
0%| | 0/1522 [00:00<?, ?it/s]
0%| | 1/1522 [00:00<10:08, 2.50it/s]
1%|β | 21/1522 [00:00<00:30, 49.32it/s]
3%|β | 48/1522 [00:00<00:14, 100.15it/s]
5%|β | 82/1522 [00:00<00:09, 153.58it/s]
8%|β | 119/1522 [00:00<00:06, 202.87it/s]
9%|β | 144/1522 [00:01<00:07, 194.58it/s]
11%|β | 170/1522 [00:01<00:06, 205.21it/s]
13%|ββ | 193/1522 [00:01<00:06, 198.74it/s]
15%|ββ | 221/1522 [00:01<00:06, 209.22it/s]
16%|ββ | 249/1522 [00:01<00:05, 217.25it/s]
18%|ββ | 273/1522 [00:01<00:05, 216.38it/s]
20%|ββ | 309/1522 [00:01<00:05, 237.33it/s]
22%|βββ | 334/1522 [00:02<00:15, 74.67it/s]
24%|βββ | 366/1522 [00:02<00:11, 99.78it/s]
27%|βββ | 405/1522 [00:02<00:08, 136.87it/s]
28%|βββ | 432/1522 [00:03<00:07, 154.52it/s]
30%|βββ | 458/1522 [00:03<00:06, 162.31it/s]
32%|ββββ | 482/1522 [00:03<00:06, 171.83it/s]
33%|ββββ | 505/1522 [00:03<00:06, 169.21it/s]
35%|ββββ | 526/1522 [00:03<00:05, 173.65it/s]
36%|ββββ | 547/1522 [00:03<00:06, 162.19it/s]
37%|ββββ | 566/1522 [00:03<00:06, 158.80it/s]
39%|ββββ | 589/1522 [00:03<00:05, 174.12it/s]
40%|ββββ | 608/1522 [00:04<00:05, 177.99it/s]
42%|βββββ | 637/1522 [00:04<00:04, 206.35it/s]
44%|βββββ | 665/1522 [00:04<00:03, 223.60it/s]
45%|βββββ | 692/1522 [00:04<00:03, 233.08it/s]
47%|βββββ | 720/1522 [00:04<00:03, 245.65it/s]
49%|βββββ | 746/1522 [00:04<00:03, 249.47it/s]
51%|βββββ | 772/1522 [00:04<00:03, 233.38it/s]
52%|ββββββ | 796/1522 [00:04<00:03, 222.71it/s]
54%|ββββββ | 819/1522 [00:04<00:03, 222.91it/s]
55%|ββββββ | 844/1522 [00:04<00:02, 228.74it/s]
57%|ββββββ | 873/1522 [00:05<00:02, 242.82it/s]
59%|ββββββ | 898/1522 [00:05<00:02, 227.74it/s]
61%|ββββββ | 922/1522 [00:05<00:02, 222.09it/s]
62%|βββββββ | 945/1522 [00:05<00:02, 215.98it/s]
64%|βββββββ | 970/1522 [00:05<00:02, 218.42it/s]
65%|βββββββ | 992/1522 [00:05<00:02, 212.19it/s]
67%|βββββββ | 1014/1522 [00:05<00:02, 202.99it/s]
68%|βββββββ | 1035/1522 [00:05<00:02, 192.64it/s]
70%|βββββββ | 1059/1522 [00:06<00:02, 200.11it/s]
71%|βββββββ | 1084/1522 [00:06<00:02, 213.48it/s]
73%|ββββββββ | 1108/1522 [00:06<00:01, 209.78it/s]
74%|ββββββββ | 1132/1522 [00:06<00:01, 217.20it/s]
76%|ββββββββ | 1163/1522 [00:06<00:01, 239.97it/s]
78%|ββββββββ | 1192/1522 [00:06<00:01, 251.36it/s]
80%|ββββββββ | 1218/1522 [00:06<00:01, 249.97it/s]
82%|βββββββββ | 1245/1522 [00:06<00:01, 254.11it/s]
84%|βββββββββ | 1271/1522 [00:06<00:00, 252.37it/s]
85%|βββββββββ | 1297/1522 [00:06<00:00, 239.65it/s]
87%|βββββββββ | 1322/1522 [00:07<00:00, 237.40it/s]
88%|βββββββββ | 1346/1522 [00:07<00:00, 229.90it/s]
90%|βββββββββ | 1370/1522 [00:08<00:02, 56.93it/s]
92%|ββββββββββ| 1396/1522 [00:08<00:01, 73.95it/s]
93%|ββββββββββ| 1418/1522 [00:08<00:01, 89.99it/s]
95%|ββββββββββ| 1439/1522 [00:08<00:00, 106.30it/s]
96%|ββββββββββ| 1459/1522 [00:08<00:00, 118.31it/s]
98%|ββββββββββ| 1484/1522 [00:08<00:00, 140.76it/s]
99%|ββββββββββ| 1511/1522 [00:09<00:00, 162.41it/s]
100%|ββββββββββ| 1522/1522 [00:09<00:00, 168.05it/s]73Constructing time series for each modality ...74Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_004/timeseries/agg_timeseries.pkl75Extracting samples from time series ...76number of samples: 2077Packing the samples into numpy arrays ...78 