Greatriver/SimBarca
π₯ SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic π Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveilingβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
04.2k
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 136424 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/00_traj_1328.0.json.gz6Loading a file takes 51.28s7Creating data frames takes 19.18s8Filling data types and values takes 5.85s9 10 Processing a file takes 17.43s11Concatenating time series takes 0.43s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/01_traj_2101.5.json.gz13Loading a file takes 57.25s14Creating data frames takes 20.77s15Filling data types and values takes 5.65s16 17 Processing a file takes 16.37s18Concatenating time series takes 0.27s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/02_traj_2846.5.json.gz20Loading a file takes 55.02s21Creating data frames takes 19.08s22Filling data types and values takes 5.44s23 24 Processing a file takes 16.34s25Concatenating time series takes 0.26s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/03_traj_3578.0.json.gz27Loading a file takes 50.90s28Creating data frames takes 28.51s29Filling data types and values takes 6.70s30 31 Processing a file takes 17.64s32Concatenating time series takes 0.39s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/04_traj_4322.5.json.gz34Loading a file takes 58.40s35Creating data frames takes 23.95s36Filling data types and values takes 5.65s37 38 Processing a file takes 18.51s39Concatenating time series takes 0.49s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/05_traj_5082.0.json.gz41Loading a file takes 55.47s42Creating data frames takes 21.87s43Filling data types and values takes 5.61s44 45 Processing a file takes 30.84s46Concatenating time series takes 0.44s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/06_traj_5824.0.json.gz48Loading a file takes 63.64s49Creating data frames takes 23.89s50Filling data types and values takes 5.54s51 52 Processing a file takes 34.56s53Concatenating time series takes 0.56s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/07_traj_6568.0.json.gz55Loading a file takes 65.26s56Creating data frames takes 20.16s57Filling data types and values takes 5.30s58 59 Processing a file takes 34.06s60Concatenating time series takes 0.53s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/08_traj_7333.5.json.gz62Loading a file takes 60.90s63Creating data frames takes 20.58s64Filling data types and values takes 5.75s65 66 Processing a file takes 21.76s67Concatenating time series takes 0.40s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/trajectory/09_traj_end.json.gz69Loading a file takes 10.58s70Creating data frames takes 3.59s71Filling data types and values takes 0.83s72 73 Processing a file takes 11.10s74Concatenating time series takes 0.49s75Saving all the section time series takes 76.88s76Saving all the junction time series takes 11.50s77Saving network entrance and exit takes 0.09s78Aggregating the raw statistics to different intervals...79
0%| | 0/1517 [00:00<?, ?it/s]
0%| | 1/1517 [00:00<10:18, 2.45it/s]
0%| | 5/1517 [00:00<02:10, 11.63it/s]
3%|β | 53/1517 [00:00<00:11, 132.33it/s]
5%|β | 82/1517 [00:00<00:08, 170.49it/s]
8%|β | 124/1517 [00:00<00:05, 236.36it/s]
10%|β | 154/1517 [00:00<00:05, 241.26it/s]
12%|ββ | 183/1517 [00:01<00:05, 239.86it/s]
14%|ββ | 210/1517 [00:01<00:05, 238.72it/s]
16%|ββ | 236/1517 [00:01<00:05, 223.36it/s]
17%|ββ | 260/1517 [00:01<00:05, 216.48it/s]
19%|ββ | 287/1517 [00:01<00:05, 227.27it/s]
21%|ββ | 311/1517 [00:01<00:05, 222.27it/s]
22%|βββ | 334/1517 [00:02<00:18, 65.07it/s]
24%|βββ | 365/1517 [00:02<00:12, 89.69it/s]
26%|βββ | 401/1517 [00:02<00:09, 123.58it/s]
28%|βββ | 427/1517 [00:02<00:07, 141.69it/s]
30%|βββ | 453/1517 [00:03<00:06, 156.82it/s]
31%|ββββ | 477/1517 [00:03<00:06, 169.74it/s]
33%|ββββ | 501/1517 [00:03<00:06, 167.43it/s]
34%|ββββ | 523/1517 [00:03<00:05, 172.21it/s]
36%|ββββ | 544/1517 [00:03<00:05, 172.43it/s]
37%|ββββ | 564/1517 [00:03<00:05, 167.65it/s]
38%|ββββ | 584/1517 [00:03<00:05, 174.68it/s]
40%|ββββ | 603/1517 [00:03<00:05, 164.81it/s]
41%|βββββ | 626/1517 [00:04<00:05, 173.40it/s]
43%|βββββ | 653/1517 [00:04<00:04, 197.99it/s]
45%|βββββ | 677/1517 [00:04<00:04, 208.30it/s]
46%|βββββ | 699/1517 [00:04<00:03, 207.43it/s]
48%|βββββ | 721/1517 [00:04<00:03, 200.41it/s]
49%|βββββ | 742/1517 [00:04<00:03, 201.87it/s]
50%|βββββ | 763/1517 [00:04<00:03, 196.50it/s]
52%|ββββββ | 786/1517 [00:04<00:03, 203.42it/s]
53%|ββββββ | 807/1517 [00:04<00:03, 200.94it/s]
55%|ββββββ | 832/1517 [00:05<00:03, 208.17it/s]
57%|ββββββ | 858/1517 [00:05<00:03, 211.99it/s]
58%|ββββββ | 886/1517 [00:05<00:02, 229.50it/s]
60%|ββββββ | 910/1517 [00:05<00:03, 201.82it/s]
61%|βββββββ | 931/1517 [00:05<00:02, 201.04it/s]
63%|βββββββ | 962/1517 [00:05<00:02, 229.19it/s]
65%|βββββββ | 986/1517 [00:05<00:02, 220.72it/s]
67%|βββββββ | 1011/1517 [00:05<00:02, 224.98it/s]
68%|βββββββ | 1034/1517 [00:05<00:02, 217.36it/s]
70%|βββββββ | 1056/1517 [00:06<00:02, 202.53it/s]
71%|βββββββ | 1077/1517 [00:06<00:02, 196.51it/s]
72%|ββββββββ | 1097/1517 [00:06<00:02, 194.18it/s]
74%|ββββββββ | 1117/1517 [00:06<00:02, 184.23it/s]
75%|ββββββββ | 1138/1517 [00:06<00:02, 188.12it/s]
77%|ββββββββ | 1164/1517 [00:06<00:01, 202.11it/s]
78%|ββββββββ | 1188/1517 [00:06<00:01, 203.28it/s]
80%|ββββββββ | 1211/1517 [00:06<00:01, 209.25it/s]
82%|βββββββββ | 1237/1517 [00:07<00:01, 216.02it/s]
84%|βββββββββ | 1270/1517 [00:07<00:01, 239.15it/s]
85%|βββββββββ | 1297/1517 [00:07<00:00, 244.44it/s]
87%|βββββββββ | 1322/1517 [00:07<00:00, 222.12it/s]
89%|βββββββββ | 1345/1517 [00:07<00:00, 217.27it/s]
90%|βββββββββ | 1367/1517 [00:08<00:02, 57.08it/s]
91%|βββββββββ | 1383/1517 [00:08<00:02, 66.15it/s]
93%|ββββββββββ| 1414/1517 [00:08<00:01, 93.41it/s]
95%|ββββββββββ| 1441/1517 [00:08<00:00, 116.10it/s]
97%|ββββββββββ| 1464/1517 [00:09<00:00, 133.70it/s]
98%|ββββββββββ| 1490/1517 [00:09<00:00, 153.52it/s]
100%|ββββββββββ| 1517/1517 [00:09<00:00, 164.76it/s]80Constructing time series for each modality ...81Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_025/timeseries/agg_timeseries.pkl82Extracting samples from time series ...83number of samples: 2084Packing the samples into numpy arrays ...85 