Greatriver/SimBarca
π₯ SimBarca: Simulated Barcelona Traffic This is the dataset accompanying https://github.com/Weijiang-Xiong/OpenSkyTraffic π Publications and Citation Weijiang Xiong, Robert Fonod, Alexandre Alahi and Nikolas Geroliminis, "Multi-Source Urban Traffic Flow Forecasting With Drone and Loop Detector Data," in IEEE Transactions on Intelligent Transportation Systems. [Paper] [Preprint] [Exp. Config] Weijiang Xiong, Robert Fonod and Nikolas Geroliminis, "Unveilingβ¦ See the full description on the dataset page: https://huggingface.co/datasets/Greatriver/SimBarca.
04.2k
1INFO: Pandarallel will run on 8 workers.2INFO: Pandarallel will use Memory file system to transfer data between the main process and workers.3 4 Selecting 5.0% vehicles from 163711 vehicles5Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/00_traj_1270.5.json.gz6Loading a file takes 49.22s7Creating data frames takes 19.11s8Filling data types and values takes 5.81s9 10 Processing a file takes 17.64s11Concatenating time series takes 0.45s12Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/01_traj_1889.5.json.gz13Loading a file takes 55.96s14Creating data frames takes 25.88s15Filling data types and values takes 5.87s16 17 Processing a file takes 16.87s18Concatenating time series takes 0.26s19Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/02_traj_2447.5.json.gz20Loading a file takes 55.01s21Creating data frames takes 22.37s22Filling data types and values takes 5.80s23 24 Processing a file takes 17.41s25Concatenating time series takes 0.22s26Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/03_traj_2992.5.json.gz27Loading a file takes 51.75s28Creating data frames takes 24.64s29Filling data types and values takes 6.41s30 31 Processing a file takes 17.40s32Concatenating time series takes 0.31s33Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/04_traj_3522.5.json.gz34Loading a file takes 57.92s35Creating data frames takes 25.58s36Filling data types and values takes 7.02s37 38 Processing a file takes 18.56s39Concatenating time series takes 0.35s40Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/05_traj_4052.5.json.gz41Loading a file takes 54.00s42Creating data frames takes 24.90s43Filling data types and values takes 7.17s44 45 Processing a file takes 18.57s46Concatenating time series takes 0.40s47Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/06_traj_4566.0.json.gz48Loading a file takes 58.17s49Creating data frames takes 21.83s50Filling data types and values takes 5.84s51 52 Processing a file takes 18.58s53Concatenating time series takes 0.63s54Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/07_traj_5057.0.json.gz55Loading a file takes 58.94s56Creating data frames takes 21.58s57Filling data types and values takes 5.87s58 59 Processing a file takes 18.07s60Concatenating time series takes 0.41s61Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/08_traj_5538.0.json.gz62Loading a file takes 57.74s63Creating data frames takes 19.73s64Filling data types and values takes 5.70s65 66 Processing a file takes 17.55s67Concatenating time series takes 0.53s68Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/09_traj_6034.0.json.gz69Loading a file takes 52.57s70Creating data frames takes 20.19s71Filling data types and values takes 5.88s72 73 Processing a file takes 17.65s74Concatenating time series takes 0.47s75Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/10_traj_6540.5.json.gz76Loading a file takes 50.66s77Creating data frames takes 19.93s78Filling data types and values takes 5.74s79 80 Processing a file takes 36.78s81Concatenating time series takes 0.46s82Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/11_traj_7057.0.json.gz83Loading a file takes 60.28s84Creating data frames takes 19.66s85Filling data types and values takes 5.79s86 87 Processing a file takes 18.29s88Concatenating time series takes 0.57s89Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/12_traj_9063.5.json.gz90Loading a file takes 58.24s91Creating data frames takes 20.83s92Filling data types and values takes 6.08s93 94 Processing a file takes 19.38s95Concatenating time series takes 0.80s96Working on file /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/trajectory/13_traj_end.json.gz97Loading a file takes 4.77s98Creating data frames takes 0.66s99Filling data types and values takes 0.10s100 101 Processing a file takes 5.02s102Concatenating time series takes 0.18s103Saving all the section time series takes 95.55s104Saving all the junction time series takes 13.88s105Saving network entrance and exit takes 0.11s106Aggregating the raw statistics to different intervals...107
0%| | 0/1517 [00:00<?, ?it/s]
0%| | 1/1517 [00:00<09:10, 2.76it/s]
0%| | 4/1517 [00:00<02:54, 8.68it/s]
4%|β | 54/1517 [00:00<00:11, 129.27it/s]
5%|β | 83/1517 [00:00<00:08, 165.36it/s]
8%|β | 121/1517 [00:00<00:06, 216.43it/s]
10%|β | 149/1517 [00:00<00:06, 223.59it/s]
12%|ββ | 176/1517 [00:01<00:06, 218.09it/s]
13%|ββ | 201/1517 [00:01<00:05, 220.05it/s]
15%|ββ | 225/1517 [00:01<00:05, 217.78it/s]
16%|ββ | 250/1517 [00:01<00:06, 209.92it/s]
18%|ββ | 272/1517 [00:01<00:05, 209.43it/s]
19%|ββ | 294/1517 [00:01<00:05, 208.27it/s]
21%|ββ | 316/1517 [00:01<00:05, 201.35it/s]
22%|βββ | 337/1517 [00:02<00:20, 57.73it/s]
24%|βββ | 367/1517 [00:02<00:14, 81.34it/s]
26%|βββ | 398/1517 [00:03<00:10, 109.43it/s]
28%|βββ | 421/1517 [00:03<00:09, 116.80it/s]
29%|βββ | 444/1517 [00:03<00:07, 134.70it/s]
31%|βββ | 465/1517 [00:03<00:07, 148.59it/s]
32%|ββββ | 486/1517 [00:03<00:06, 152.39it/s]
33%|ββββ | 506/1517 [00:03<00:06, 154.82it/s]
35%|ββββ | 525/1517 [00:03<00:06, 162.35it/s]
36%|ββββ | 544/1517 [00:03<00:06, 151.64it/s]
37%|ββββ | 561/1517 [00:04<00:07, 133.67it/s]
38%|ββββ | 579/1517 [00:04<00:06, 142.49it/s]
39%|ββββ | 595/1517 [00:04<00:06, 140.38it/s]
40%|ββββ | 612/1517 [00:04<00:06, 147.23it/s]
42%|βββββ | 635/1517 [00:04<00:05, 168.55it/s]
43%|βββββ | 659/1517 [00:04<00:04, 185.81it/s]
45%|βββββ | 679/1517 [00:04<00:04, 180.65it/s]
46%|βββββ | 698/1517 [00:04<00:04, 173.71it/s]
47%|βββββ | 716/1517 [00:04<00:04, 173.98it/s]
48%|βββββ | 734/1517 [00:05<00:04, 170.59it/s]
50%|βββββ | 754/1517 [00:05<00:04, 166.53it/s]
51%|βββββ | 771/1517 [00:05<00:04, 162.61it/s]
52%|ββββββ | 788/1517 [00:05<00:04, 162.83it/s]
53%|ββββββ | 805/1517 [00:05<00:04, 164.70it/s]
54%|ββββββ | 823/1517 [00:05<00:04, 168.20it/s]
56%|ββββββ | 845/1517 [00:05<00:03, 174.97it/s]
57%|ββββββ | 864/1517 [00:05<00:03, 173.02it/s]
58%|ββββββ | 886/1517 [00:05<00:03, 183.82it/s]
60%|ββββββ | 905/1517 [00:06<00:03, 185.10it/s]
61%|ββββββ | 924/1517 [00:06<00:03, 185.69it/s]
62%|βββββββ | 944/1517 [00:06<00:03, 187.77it/s]
64%|βββββββ | 969/1517 [00:06<00:02, 194.00it/s]
66%|βββββββ | 1001/1517 [00:06<00:02, 229.43it/s]
68%|βββββββ | 1025/1517 [00:06<00:02, 207.90it/s]
69%|βββββββ | 1047/1517 [00:06<00:02, 188.85it/s]
70%|βββββββ | 1067/1517 [00:06<00:02, 191.26it/s]
72%|ββββββββ | 1093/1517 [00:06<00:02, 207.36it/s]
74%|ββββββββ | 1115/1517 [00:07<00:01, 208.89it/s]
75%|ββββββββ | 1138/1517 [00:07<00:01, 212.41it/s]
77%|ββββββββ | 1168/1517 [00:07<00:01, 233.02it/s]
79%|ββββββββ | 1192/1517 [00:07<00:01, 234.51it/s]
80%|ββββββββ | 1216/1517 [00:07<00:01, 223.65it/s]
82%|βββββββββ | 1241/1517 [00:07<00:01, 221.64it/s]
83%|βββββββββ | 1264/1517 [00:07<00:01, 212.78it/s]
85%|βββββββββ | 1286/1517 [00:07<00:01, 214.08it/s]
86%|βββββββββ | 1308/1517 [00:07<00:00, 214.20it/s]
88%|βββββββββ | 1330/1517 [00:08<00:01, 186.23it/s]
89%|βββββββββ | 1353/1517 [00:08<00:00, 190.78it/s]
91%|βββββββββ | 1373/1517 [00:09<00:03, 41.77it/s]
92%|ββββββββββ| 1395/1517 [00:09<00:02, 55.18it/s]
93%|ββββββββββ| 1417/1517 [00:09<00:01, 70.99it/s]
95%|ββββββββββ| 1436/1517 [00:09<00:00, 84.18it/s]
96%|ββββββββββ| 1456/1517 [00:10<00:00, 100.59it/s]
97%|ββββββββββ| 1475/1517 [00:10<00:00, 111.52it/s]
98%|ββββββββββ| 1494/1517 [00:10<00:00, 126.51it/s]
100%|ββββββββββ| 1517/1517 [00:10<00:00, 146.03it/s]108Constructing time series for each modality ...109Saving aggregated time series to /home/weijiang/Projects/Netsanut/datasets/simbarca/simulation_sessions/session_065/timeseries/agg_timeseries.pkl110Extracting samples from time series ...111number of samples: 20112Packing the samples into numpy arrays ...113 