Greatriver/SimBarca
π₯ SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic π Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveilingβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
04.2k
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 161832 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/00_traj_1272.5.json.gz6Loading a file takes 53.97s7Creating data frames takes 74.87s8Filling data types and values takes 15.25s9 10 Processing a file takes 19.35s11Concatenating time series takes 0.69s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/01_traj_1917.5.json.gz13Loading a file takes 60.22s14Creating data frames takes 27.27s15Filling data types and values takes 5.85s16 17 Processing a file takes 18.27s18Concatenating time series takes 0.30s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/02_traj_2477.5.json.gz20Loading a file takes 57.06s21Creating data frames takes 26.99s22Filling data types and values takes 5.89s23 24 Processing a file takes 17.95s25Concatenating time series takes 0.26s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/03_traj_3007.5.json.gz27Loading a file takes 53.50s28Creating data frames takes 23.84s29Filling data types and values takes 6.09s30 31 Processing a file takes 16.99s32Concatenating time series takes 0.34s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/04_traj_3522.0.json.gz34Loading a file takes 54.02s35Creating data frames takes 23.07s36Filling data types and values takes 5.73s37 38 Processing a file takes 16.60s39Concatenating time series takes 0.30s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/05_traj_4035.0.json.gz41Loading a file takes 50.92s42Creating data frames takes 23.18s43Filling data types and values takes 5.98s44 45 Processing a file takes 17.18s46Concatenating time series takes 0.41s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/06_traj_4548.0.json.gz48Loading a file takes 50.10s49Creating data frames takes 20.21s50Filling data types and values takes 5.42s51 52 Processing a file takes 16.07s53Concatenating time series takes 0.49s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/07_traj_5057.5.json.gz55Loading a file takes 50.23s56Creating data frames takes 21.17s57Filling data types and values takes 5.88s58 59 Processing a file takes 16.95s60Concatenating time series takes 0.43s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/08_traj_5569.0.json.gz62Loading a file takes 54.53s63Creating data frames takes 21.93s64Filling data types and values takes 5.98s65 66 Processing a file takes 21.08s67Concatenating time series takes 0.50s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/09_traj_6077.0.json.gz69Loading a file takes 57.82s70Creating data frames takes 22.63s71Filling data types and values takes 5.96s72 73 Processing a file takes 21.63s74Concatenating time series takes 0.43s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/10_traj_6589.0.json.gz76Loading a file takes 59.74s77Creating data frames takes 23.60s78Filling data types and values takes 6.01s79 80 Processing a file takes 21.82s81Concatenating time series takes 0.59s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/11_traj_7085.0.json.gz83Loading a file takes 59.43s84Creating data frames takes 29.76s85Filling data types and values takes 5.99s86 87 Processing a file takes 18.24s88Concatenating time series takes 0.50s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/12_traj_7962.5.json.gz90Loading a file takes 59.25s91Creating data frames takes 20.61s92Filling data types and values takes 6.22s93 94 Processing a file takes 17.98s95Concatenating time series takes 0.73s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/trajectory/13_traj_end.json.gz97Loading a file takes 16.79s98Creating data frames takes 4.48s99Filling data types and values takes 1.01s100 101 Processing a file takes 9.11s102Concatenating time series takes 0.29s103Saving all the section time series takes 95.03s104Saving all the junction time series takes 14.47s105Saving network entrance and exit takes 0.11s106Aggregating the raw statistics to different intervals...107
0%| | 0/1517 [00:00<?, ?it/s]
0%| | 1/1517 [00:00<13:44, 1.84it/s]
0%| | 4/1517 [00:00<03:33, 7.09it/s]
3%|β | 47/1517 [00:00<00:15, 97.91it/s]
5%|β | 75/1517 [00:00<00:10, 137.67it/s]
7%|β | 109/1517 [00:00<00:07, 187.26it/s]
9%|β | 136/1517 [00:01<00:06, 201.21it/s]
11%|β | 162/1517 [00:01<00:06, 202.75it/s]
12%|ββ | 187/1517 [00:01<00:06, 210.46it/s]
14%|ββ | 211/1517 [00:01<00:06, 191.50it/s]
15%|ββ | 234/1517 [00:01<00:06, 187.18it/s]
18%|ββ | 268/1517 [00:01<00:05, 223.89it/s]
19%|ββ | 294/1517 [00:01<00:05, 226.15it/s]
21%|ββ | 318/1517 [00:01<00:05, 228.73it/s]
23%|βββ | 342/1517 [00:03<00:20, 56.66it/s]
25%|βββ | 374/1517 [00:03<00:14, 79.67it/s]
26%|βββ | 402/1517 [00:03<00:10, 101.75it/s]
28%|βββ | 426/1517 [00:03<00:09, 117.06it/s]
30%|βββ | 449/1517 [00:03<00:08, 132.21it/s]
31%|βββ | 471/1517 [00:03<00:07, 140.82it/s]
32%|ββββ | 492/1517 [00:03<00:06, 148.86it/s]
34%|ββββ | 512/1517 [00:03<00:06, 148.78it/s]
35%|ββββ | 531/1517 [00:04<00:06, 150.79it/s]
36%|ββββ | 549/1517 [00:04<00:06, 145.33it/s]
37%|ββββ | 568/1517 [00:04<00:06, 153.32it/s]
39%|ββββ | 588/1517 [00:04<00:05, 163.47it/s]
40%|ββββ | 606/1517 [00:04<00:05, 163.30it/s]
41%|βββββ | 628/1517 [00:04<00:05, 168.45it/s]
43%|βββββ | 651/1517 [00:04<00:04, 181.18it/s]
45%|βββββ | 676/1517 [00:04<00:04, 197.05it/s]
46%|βββββ | 699/1517 [00:05<00:04, 203.84it/s]
48%|βββββ | 723/1517 [00:05<00:03, 213.94it/s]
49%|βββββ | 745/1517 [00:05<00:03, 214.91it/s]
51%|βββββ | 767/1517 [00:05<00:03, 199.09it/s]
52%|ββββββ | 788/1517 [00:05<00:03, 190.34it/s]
53%|ββββββ | 808/1517 [00:05<00:03, 189.94it/s]
55%|ββββββ | 828/1517 [00:05<00:03, 185.58it/s]
56%|ββββββ | 850/1517 [00:05<00:03, 191.90it/s]
58%|ββββββ | 875/1517 [00:05<00:03, 203.77it/s]
59%|ββββββ | 899/1517 [00:05<00:02, 211.00it/s]
61%|ββββββ | 921/1517 [00:06<00:02, 208.59it/s]
62%|βββββββ | 942/1517 [00:06<00:02, 203.47it/s]
64%|βββββββ | 964/1517 [00:06<00:02, 200.18it/s]
65%|βββββββ | 985/1517 [00:06<00:02, 197.27it/s]
66%|βββββββ | 1005/1517 [00:06<00:02, 184.28it/s]
68%|βββββββ | 1024/1517 [00:06<00:02, 175.58it/s]
69%|βββββββ | 1044/1517 [00:06<00:02, 179.13it/s]
70%|βββββββ | 1063/1517 [00:06<00:02, 167.06it/s]
72%|ββββββββ | 1087/1517 [00:07<00:02, 183.54it/s]
73%|ββββββββ | 1107/1517 [00:07<00:02, 184.76it/s]
74%|ββββββββ | 1126/1517 [00:07<00:02, 174.42it/s]
76%|ββββββββ | 1151/1517 [00:07<00:01, 185.82it/s]
77%|ββββββββ | 1175/1517 [00:07<00:01, 200.30it/s]
79%|ββββββββ | 1198/1517 [00:07<00:01, 208.05it/s]
80%|ββββββββ | 1220/1517 [00:07<00:01, 208.39it/s]
82%|βββββββββ | 1247/1517 [00:07<00:01, 225.89it/s]
84%|βββββββββ | 1274/1517 [00:07<00:01, 234.38it/s]
86%|βββββββββ | 1298/1517 [00:08<00:00, 221.04it/s]
87%|βββββββββ | 1321/1517 [00:08<00:00, 218.45it/s]
89%|βββββββββ | 1344/1517 [00:08<00:00, 209.41it/s]
90%|βββββββββ | 1366/1517 [00:09<00:03, 48.21it/s]
91%|ββββββββββ| 1387/1517 [00:09<00:02, 61.42it/s]
93%|ββββββββββ| 1407/1517 [00:09<00:01, 75.48it/s]
94%|ββββββββββ| 1429/1517 [00:09<00:00, 94.16it/s]
95%|ββββββββββ| 1448/1517 [00:10<00:00, 107.82it/s]
97%|ββββββββββ| 1468/1517 [00:10<00:00, 124.32it/s]
98%|ββββββββββ| 1493/1517 [00:10<00:00, 149.79it/s]
100%|ββββββββββ| 1517/1517 [00:10<00:00, 147.66it/s]108Constructing time series for each modality ...109Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_077/timeseries/agg_timeseries.pkl110Extracting samples from time series ...111number of samples: 20112Packing the samples into numpy arrays ...113 