Greatriver/SimBarca
π₯ SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic π Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveilingβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
04.2k
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 138256 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/00_traj_1316.5.json.gz6Loading a file takes 52.40s7Creating data frames takes 25.09s8Filling data types and values takes 15.65s9 10 Processing a file takes 18.24s11Concatenating time series takes 0.38s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/01_traj_2089.0.json.gz13Loading a file takes 56.29s14Creating data frames takes 53.34s15Filling data types and values takes 5.99s16 17 Processing a file takes 16.99s18Concatenating time series takes 0.36s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/02_traj_2808.0.json.gz20Loading a file takes 57.98s21Creating data frames takes 60.70s22Filling data types and values takes 6.41s23 24 Processing a file takes 18.24s25Concatenating time series takes 0.34s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/03_traj_3501.5.json.gz27Loading a file takes 54.17s28Creating data frames takes 57.94s29Filling data types and values takes 6.72s30 31 Processing a file takes 18.40s32Concatenating time series takes 0.49s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/04_traj_4174.0.json.gz34Loading a file takes 59.09s35Creating data frames takes 31.29s36Filling data types and values takes 6.25s37 38 Processing a file takes 18.56s39Concatenating time series takes 0.46s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/05_traj_4842.0.json.gz41Loading a file takes 56.04s42Creating data frames takes 32.00s43Filling data types and values takes 6.56s44 45 Processing a file takes 22.56s46Concatenating time series takes 0.56s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/06_traj_5501.5.json.gz48Loading a file takes 58.90s49Creating data frames takes 25.31s50Filling data types and values takes 5.86s51 52 Processing a file takes 28.10s53Concatenating time series takes 0.47s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/07_traj_6148.5.json.gz55Loading a file takes 57.08s56Creating data frames takes 26.10s57Filling data types and values takes 6.03s58 59 Processing a file takes 25.90s60Concatenating time series takes 0.44s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/08_traj_6786.5.json.gz62Loading a file takes 56.85s63Creating data frames takes 25.52s64Filling data types and values takes 5.77s65 66 Processing a file takes 26.18s67Concatenating time series takes 0.43s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/09_traj_7458.5.json.gz69Loading a file takes 55.32s70Creating data frames takes 25.27s71Filling data types and values takes 5.98s72 73 Processing a file takes 23.96s74Concatenating time series takes 0.53s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/trajectory/10_traj_end.json.gz76Loading a file takes 45.71s77Creating data frames takes 15.16s78Filling data types and values takes 4.20s79 80 Processing a file takes 14.35s81Concatenating time series takes 0.25s82Saving all the section time series takes 87.17s83Saving all the junction time series takes 12.30s84Saving network entrance and exit takes 0.10s85Aggregating the raw statistics to different intervals...86
0%| | 0/1522 [00:00<?, ?it/s]
0%| | 1/1522 [00:00<12:46, 1.98it/s]
1%| | 8/1522 [00:00<01:29, 16.96it/s]
2%|β | 36/1522 [00:00<00:18, 79.50it/s]
5%|β | 69/1522 [00:00<00:10, 140.08it/s]
7%|β | 103/1522 [00:00<00:07, 189.28it/s]
9%|β | 130/1522 [00:01<00:06, 203.80it/s]
10%|β | 155/1522 [00:01<00:06, 197.34it/s]
12%|ββ | 178/1522 [00:01<00:06, 201.29it/s]
13%|ββ | 201/1522 [00:01<00:06, 203.01it/s]
15%|ββ | 231/1522 [00:01<00:05, 228.11it/s]
17%|ββ | 256/1522 [00:01<00:05, 220.18it/s]
18%|ββ | 280/1522 [00:01<00:05, 223.00it/s]
20%|ββ | 303/1522 [00:01<00:05, 204.81it/s]
21%|βββ | 325/1522 [00:02<00:19, 60.76it/s]
23%|βββ | 352/1522 [00:02<00:14, 80.71it/s]
25%|βββ | 388/1522 [00:03<00:10, 110.31it/s]
28%|βββ | 420/1522 [00:03<00:07, 139.71it/s]
29%|βββ | 444/1522 [00:03<00:06, 154.18it/s]
31%|βββ | 468/1522 [00:03<00:06, 165.57it/s]
32%|ββββ | 491/1522 [00:03<00:06, 162.23it/s]
34%|ββββ | 512/1522 [00:03<00:05, 169.30it/s]
35%|ββββ | 533/1522 [00:03<00:05, 170.74it/s]
36%|ββββ | 553/1522 [00:03<00:05, 168.62it/s]
38%|ββββ | 575/1522 [00:04<00:05, 180.46it/s]
39%|ββββ | 596/1522 [00:04<00:04, 187.61it/s]
41%|ββββ | 617/1522 [00:04<00:04, 192.24it/s]
42%|βββββ | 644/1522 [00:04<00:04, 212.07it/s]
44%|βββββ | 671/1522 [00:04<00:03, 225.51it/s]
46%|βββββ | 699/1522 [00:04<00:03, 236.99it/s]
48%|βββββ | 724/1522 [00:04<00:03, 239.64it/s]
49%|βββββ | 749/1522 [00:04<00:03, 232.26it/s]
51%|βββββ | 773/1522 [00:04<00:03, 228.28it/s]
52%|ββββββ | 796/1522 [00:05<00:03, 214.68it/s]
54%|ββββββ | 824/1522 [00:05<00:03, 230.99it/s]
56%|ββββββ | 850/1522 [00:05<00:02, 238.13it/s]
58%|ββββββ | 878/1522 [00:05<00:02, 248.33it/s]
59%|ββββββ | 904/1522 [00:05<00:02, 237.65it/s]
61%|ββββββ | 929/1522 [00:05<00:02, 222.24it/s]
64%|βββββββ | 969/1522 [00:05<00:02, 263.26it/s]
65%|βββββββ | 996/1522 [00:05<00:02, 261.39it/s]
67%|βββββββ | 1023/1522 [00:05<00:01, 257.61it/s]
69%|βββββββ | 1049/1522 [00:06<00:01, 245.05it/s]
71%|βββββββ | 1074/1522 [00:06<00:01, 233.61it/s]
72%|ββββββββ | 1098/1522 [00:06<00:02, 206.53it/s]
74%|ββββββββ | 1120/1522 [00:06<00:01, 205.20it/s]
75%|ββββββββ | 1141/1522 [00:06<00:01, 199.26it/s]
76%|ββββββββ | 1162/1522 [00:06<00:01, 193.28it/s]
78%|ββββββββ | 1182/1522 [00:06<00:01, 190.33it/s]
79%|ββββββββ | 1208/1522 [00:06<00:01, 206.84it/s]
81%|βββββββββ | 1239/1522 [00:06<00:01, 228.54it/s]
83%|βββββββββ | 1269/1522 [00:07<00:01, 248.08it/s]
85%|βββββββββ | 1295/1522 [00:07<00:00, 244.22it/s]
87%|βββββββββ | 1320/1522 [00:07<00:00, 241.02it/s]
88%|βββββββββ | 1345/1522 [00:07<00:00, 219.59it/s]
90%|βββββββββ | 1368/1522 [00:08<00:02, 58.35it/s]
91%|βββββββββ | 1387/1522 [00:08<00:01, 69.44it/s]
93%|ββββββββββ| 1411/1522 [00:08<00:01, 88.73it/s]
94%|ββββββββββ| 1436/1522 [00:08<00:00, 110.16it/s]
96%|ββββββββββ| 1457/1522 [00:08<00:00, 125.04it/s]
97%|ββββββββββ| 1478/1522 [00:09<00:00, 140.45it/s]
99%|ββββββββββ| 1500/1522 [00:09<00:00, 154.26it/s]
100%|ββββββββββ| 1522/1522 [00:09<00:00, 165.04it/s]87Constructing time series for each modality ...88Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_027/timeseries/agg_timeseries.pkl89Extracting samples from time series ...90number of samples: 2091Packing the samples into numpy arrays ...92 