sparse-encoder/example-splade-distilbert-base-uncased-nq
060
1---2language:3- en4license: apache-2.05tags:6- sentence-transformers7- sparse-encoder8- sparse9- splade10- generated_from_trainer11- dataset_size:9900012- loss:SpladeLoss13- loss:SparseMultipleNegativesRankingLoss14- loss:FlopsLoss15base_model: distilbert/distilbert-base-uncased16widget:17- text: Rollin' (Limp Bizkit song) The music video was filmed atop the South Tower18 of the former World Trade Center in New York City. The introduction features Ben19 Stiller and Stephen Dorff mistaking Fred Durst for the valet and giving him the20 keys to their Bentley Azure. Also making a cameo is break dancer Mr. Wiggles.21 The rest of the video has several cuts to Durst and his bandmates hanging out22 of the Bentley as they drive about Manhattan. The song Ben Stiller is playing23 at the beginning is "My Generation" from the same album. The video also features24 scenes of Fred Durst with five girls dancing in a room. The video was filmed around25 the same time as the film Zoolander, which explains Stiller and Dorff's appearance.26 Fred Durst has a small cameo in that film.27- text: 'Maze Runner: The Death Cure On April 22, 2017, the studio delayed the release28 date once again, to February 9, 2018, in order to allow more time for post-production;29 months later, on August 25, the studio moved the release forward two weeks.[17]30 The film will premiere on January 26, 2018 in 3D, IMAX and IMAX 3D.[18][19]'31- text: who played the dj in the movie the warriors32- text: Lionel Messi Born and raised in central Argentina, Messi was diagnosed with33 a growth hormone deficiency as a child. At age 13, he relocated to Spain to join34 Barcelona, who agreed to pay for his medical treatment. After a fast progression35 through Barcelona's youth academy, Messi made his competitive debut aged 17 in36 October 2004. Despite being injury-prone during his early career, he established37 himself as an integral player for the club within the next three years, finishing38 2007 as a finalist for both the Ballon d'Or and FIFA World Player of the Year39 award, a feat he repeated the following year. His first uninterrupted campaign40 came in the 2008–09 season, during which he helped Barcelona achieve the first41 treble in Spanish football. At 22 years old, Messi won the Ballon d'Or and FIFA42 World Player of the Year award by record voting margins.43- text: 'Send In the Clowns "Send In the Clowns" is a song written by Stephen Sondheim44 for the 1973 musical A Little Night Music, an adaptation of Ingmar Bergman''s45 film Smiles of a Summer Night. It is a ballad from Act Two, in which the character46 Desirée reflects on the ironies and disappointments of her life. Among other things,47 she looks back on an affair years earlier with the lawyer Fredrik, who was deeply48 in love with her but whose marriage proposals she had rejected. Meeting him after49 so long, she realizes she is in love with him and finally ready to marry him,50 but now it is he who rejects her: he is in an unconsummated marriage with a much51 younger woman. Desirée proposes marriage to rescue him from this situation, but52 he declines, citing his dedication to his bride. Reacting to his rejection, Desirée53 sings this song. The song is later reprised as a coda after Fredrik''s young wife54 runs away with his son, and Fredrik is finally free to accept Desirée''s offer.[1]'55datasets:56- sentence-transformers/natural-questions57pipeline_tag: feature-extraction58library_name: sentence-transformers59metrics:60- dot_accuracy@161- dot_accuracy@362- dot_accuracy@563- dot_accuracy@1064- dot_precision@165- dot_precision@366- dot_precision@567- dot_precision@1068- dot_recall@169- dot_recall@370- dot_recall@571- dot_recall@1072- dot_ndcg@1073- dot_mrr@1074- dot_map@10075- query_active_dims76- query_sparsity_ratio77- corpus_active_dims78- corpus_sparsity_ratio79co2_eq_emissions:80 emissions: 2.22907012997935781 energy_consumed: 0.039777121825502982 source: codecarbon83 training_type: fine-tuning84 on_cloud: false85 cpu_model: AMD Ryzen 9 6900HX with Radeon Graphics86 ram_total_size: 30.611450195312587 hours_used: 0.32288 hardware_used: 1 x NVIDIA GeForce RTX 3070 Ti Laptop GPU89model-index:90- name: splade-distilbert-base-uncased trained on Natural Questions91 results:92 - task:93 type: sparse-information-retrieval94 name: Sparse Information Retrieval95 dataset:96 name: NanoMSMARCO97 type: NanoMSMARCO98 metrics:99 - type: dot_accuracy@1100 value: 0.28101 name: Dot Accuracy@1102 - type: dot_accuracy@3103 value: 0.5104 name: Dot Accuracy@3105 - type: dot_accuracy@5106 value: 0.66107 name: Dot Accuracy@5108 - type: dot_accuracy@10109 value: 0.74110 name: Dot Accuracy@10111 - type: dot_precision@1112 value: 0.28113 name: Dot Precision@1114 - type: dot_precision@3115 value: 0.16666666666666663116 name: Dot Precision@3117 - type: dot_precision@5118 value: 0.132119 name: Dot Precision@5120 - type: dot_precision@10121 value: 0.07400000000000001122 name: Dot Precision@10123 - type: dot_recall@1124 value: 0.28125 name: Dot Recall@1126 - type: dot_recall@3127 value: 0.5128 name: Dot Recall@3129 - type: dot_recall@5130 value: 0.66131 name: Dot Recall@5132 - type: dot_recall@10133 value: 0.74134 name: Dot Recall@10135 - type: dot_ndcg@10136 value: 0.49577037509991184137 name: Dot Ndcg@10138 - type: dot_mrr@10139 value: 0.4185238095238094140 name: Dot Mrr@10141 - type: dot_map@100142 value: 0.4294303031277172143 name: Dot Map@100144 - type: query_active_dims145 value: 52.560001373291016146 name: Query Active Dims147 - type: query_sparsity_ratio148 value: 0.9982779633912164149 name: Query Sparsity Ratio150 - type: corpus_active_dims151 value: 106.13404846191406152 name: Corpus Active Dims153 - type: corpus_sparsity_ratio154 value: 0.9965227033463759155 name: Corpus Sparsity Ratio156 - type: dot_accuracy@1157 value: 0.28158 name: Dot Accuracy@1159 - type: dot_accuracy@3160 value: 0.5161 name: Dot Accuracy@3162 - type: dot_accuracy@5163 value: 0.66164 name: Dot Accuracy@5165 - type: dot_accuracy@10166 value: 0.74167 name: Dot Accuracy@10168 - type: dot_precision@1169 value: 0.28170 name: Dot Precision@1171 - type: dot_precision@3172 value: 0.16666666666666663173 name: Dot Precision@3174 - type: dot_precision@5175 value: 0.132176 name: Dot Precision@5177 - type: dot_precision@10178 value: 0.07400000000000001179 name: Dot Precision@10180 - type: dot_recall@1181 value: 0.28182 name: Dot Recall@1183 - type: dot_recall@3184 value: 0.5185 name: Dot Recall@3186 - type: dot_recall@5187 value: 0.66188 name: Dot Recall@5189 - type: dot_recall@10190 value: 0.74191 name: Dot Recall@10192 - type: dot_ndcg@10193 value: 0.49577037509991184194 name: Dot Ndcg@10195 - type: dot_mrr@10196 value: 0.4185238095238094197 name: Dot Mrr@10198 - type: dot_map@100199 value: 0.4294303031277172200 name: Dot Map@100201 - type: query_active_dims202 value: 52.560001373291016203 name: Query Active Dims204 - type: query_sparsity_ratio205 value: 0.9982779633912164206 name: Query Sparsity Ratio207 - type: corpus_active_dims208 value: 106.13404846191406209 name: Corpus Active Dims210 - type: corpus_sparsity_ratio211 value: 0.9965227033463759212 name: Corpus Sparsity Ratio213 - task:214 type: sparse-information-retrieval215 name: Sparse Information Retrieval216 dataset:217 name: NanoNFCorpus218 type: NanoNFCorpus219 metrics:220 - type: dot_accuracy@1221 value: 0.38222 name: Dot Accuracy@1223 - type: dot_accuracy@3224 value: 0.46225 name: Dot Accuracy@3226 - type: dot_accuracy@5227 value: 0.52228 name: Dot Accuracy@5229 - type: dot_accuracy@10230 value: 0.62231 name: Dot Accuracy@10232 - type: dot_precision@1233 value: 0.38234 name: Dot Precision@1235 - type: dot_precision@3236 value: 0.31999999999999995237 name: Dot Precision@3238 - type: dot_precision@5239 value: 0.292240 name: Dot Precision@5241 - type: dot_precision@10242 value: 0.236243 name: Dot Precision@10244 - type: dot_recall@1245 value: 0.0242331024704017246 name: Dot Recall@1247 - type: dot_recall@3248 value: 0.053060546044216006249 name: Dot Recall@3250 - type: dot_recall@5251 value: 0.07273890139350063252 name: Dot Recall@5253 - type: dot_recall@10254 value: 0.09593681264940912255 name: Dot Recall@10256 - type: dot_ndcg@10257 value: 0.2784960942139155258 name: Dot Ndcg@10259 - type: dot_mrr@10260 value: 0.4393888888888889261 name: Dot Mrr@10262 - type: dot_map@100263 value: 0.11744499575471842264 name: Dot Map@100265 - type: query_active_dims266 value: 62.5267 name: Query Active Dims268 - type: query_sparsity_ratio269 value: 0.9979522967040168270 name: Query Sparsity Ratio271 - type: corpus_active_dims272 value: 126.24652862548828273 name: Corpus Active Dims274 - type: corpus_sparsity_ratio275 value: 0.9958637530756345276 name: Corpus Sparsity Ratio277 - type: dot_accuracy@1278 value: 0.38279 name: Dot Accuracy@1280 - type: dot_accuracy@3281 value: 0.46282 name: Dot Accuracy@3283 - type: dot_accuracy@5284 value: 0.52285 name: Dot Accuracy@5286 - type: dot_accuracy@10287 value: 0.62288 name: Dot Accuracy@10289 - type: dot_precision@1290 value: 0.38291 name: Dot Precision@1292 - type: dot_precision@3293 value: 0.31999999999999995294 name: Dot Precision@3295 - type: dot_precision@5296 value: 0.292297 name: Dot Precision@5298 - type: dot_precision@10299 value: 0.236300 name: Dot Precision@10301 - type: dot_recall@1302 value: 0.0242331024704017303 name: Dot Recall@1304 - type: dot_recall@3305 value: 0.053060546044216006306 name: Dot Recall@3307 - type: dot_recall@5308 value: 0.07273890139350063309 name: Dot Recall@5310 - type: dot_recall@10311 value: 0.09593681264940912312 name: Dot Recall@10313 - type: dot_ndcg@10314 value: 0.2784960942139155315 name: Dot Ndcg@10316 - type: dot_mrr@10317 value: 0.4393888888888889318 name: Dot Mrr@10319 - type: dot_map@100320 value: 0.11744499575471842321 name: Dot Map@100322 - type: query_active_dims323 value: 62.5324 name: Query Active Dims325 - type: query_sparsity_ratio326 value: 0.9979522967040168327 name: Query Sparsity Ratio328 - type: corpus_active_dims329 value: 126.24652862548828330 name: Corpus Active Dims331 - type: corpus_sparsity_ratio332 value: 0.9958637530756345333 name: Corpus Sparsity Ratio334 - task:335 type: sparse-information-retrieval336 name: Sparse Information Retrieval337 dataset:338 name: NanoNQ339 type: NanoNQ340 metrics:341 - type: dot_accuracy@1342 value: 0.36343 name: Dot Accuracy@1344 - type: dot_accuracy@3345 value: 0.58346 name: Dot Accuracy@3347 - type: dot_accuracy@5348 value: 0.66349 name: Dot Accuracy@5350 - type: dot_accuracy@10351 value: 0.76352 name: Dot Accuracy@10353 - type: dot_precision@1354 value: 0.36355 name: Dot Precision@1356 - type: dot_precision@3357 value: 0.2358 name: Dot Precision@3359 - type: dot_precision@5360 value: 0.14361 name: Dot Precision@5362 - type: dot_precision@10363 value: 0.08364 name: Dot Precision@10365 - type: dot_recall@1366 value: 0.34367 name: Dot Recall@1368 - type: dot_recall@3369 value: 0.56370 name: Dot Recall@3371 - type: dot_recall@5372 value: 0.64373 name: Dot Recall@5374 - type: dot_recall@10375 value: 0.72376 name: Dot Recall@10377 - type: dot_ndcg@10378 value: 0.5341909779287488379 name: Dot Ndcg@10380 - type: dot_mrr@10381 value: 0.4836666666666667382 name: Dot Mrr@10383 - type: dot_map@100384 value: 0.47986132889672267385 name: Dot Map@100386 - type: query_active_dims387 value: 45.63999938964844388 name: Query Active Dims389 - type: query_sparsity_ratio390 value: 0.9985046851651384391 name: Query Sparsity Ratio392 - type: corpus_active_dims393 value: 104.37854766845703394 name: Corpus Active Dims395 - type: corpus_sparsity_ratio396 value: 0.9965802192625498397 name: Corpus Sparsity Ratio398 - type: dot_accuracy@1399 value: 0.36400 name: Dot Accuracy@1401 - type: dot_accuracy@3402 value: 0.58403 name: Dot Accuracy@3404 - type: dot_accuracy@5405 value: 0.66406 name: Dot Accuracy@5407 - type: dot_accuracy@10408 value: 0.76409 name: Dot Accuracy@10410 - type: dot_precision@1411 value: 0.36412 name: Dot Precision@1413 - type: dot_precision@3414 value: 0.2415 name: Dot Precision@3416 - type: dot_precision@5417 value: 0.14418 name: Dot Precision@5419 - type: dot_precision@10420 value: 0.08421 name: Dot Precision@10422 - type: dot_recall@1423 value: 0.34424 name: Dot Recall@1425 - type: dot_recall@3426 value: 0.56427 name: Dot Recall@3428 - type: dot_recall@5429 value: 0.64430 name: Dot Recall@5431 - type: dot_recall@10432 value: 0.72433 name: Dot Recall@10434 - type: dot_ndcg@10435 value: 0.5341909779287488436 name: Dot Ndcg@10437 - type: dot_mrr@10438 value: 0.4836666666666667439 name: Dot Mrr@10440 - type: dot_map@100441 value: 0.47986132889672267442 name: Dot Map@100443 - type: query_active_dims444 value: 45.63999938964844445 name: Query Active Dims446 - type: query_sparsity_ratio447 value: 0.9985046851651384448 name: Query Sparsity Ratio449 - type: corpus_active_dims450 value: 104.37854766845703451 name: Corpus Active Dims452 - type: corpus_sparsity_ratio453 value: 0.9965802192625498454 name: Corpus Sparsity Ratio455 - task:456 type: sparse-nano-beir457 name: Sparse Nano BEIR458 dataset:459 name: NanoBEIR mean460 type: NanoBEIR_mean461 metrics:462 - type: dot_accuracy@1463 value: 0.34464 name: Dot Accuracy@1465 - type: dot_accuracy@3466 value: 0.5133333333333333467 name: Dot Accuracy@3468 - type: dot_accuracy@5469 value: 0.6133333333333334470 name: Dot Accuracy@5471 - type: dot_accuracy@10472 value: 0.7066666666666667473 name: Dot Accuracy@10474 - type: dot_precision@1475 value: 0.34476 name: Dot Precision@1477 - type: dot_precision@3478 value: 0.22888888888888884479 name: Dot Precision@3480 - type: dot_precision@5481 value: 0.18800000000000003482 name: Dot Precision@5483 - type: dot_precision@10484 value: 0.13485 name: Dot Precision@10486 - type: dot_recall@1487 value: 0.21474436749013393488 name: Dot Recall@1489 - type: dot_recall@3490 value: 0.3710201820147387491 name: Dot Recall@3492 - type: dot_recall@5493 value: 0.45757963379783356494 name: Dot Recall@5495 - type: dot_recall@10496 value: 0.5186456042164697497 name: Dot Recall@10498 - type: dot_ndcg@10499 value: 0.436152482414192500 name: Dot Ndcg@10501 - type: dot_mrr@10502 value: 0.4471931216931217503 name: Dot Mrr@10504 - type: dot_map@100505 value: 0.3422455425930528506 name: Dot Map@100507 - type: query_active_dims508 value: 53.56666692097982509 name: Query Active Dims510 - type: query_sparsity_ratio511 value: 0.9982449817534571512 name: Query Sparsity Ratio513 - type: corpus_active_dims514 value: 110.01350571216182515 name: Corpus Active Dims516 - type: corpus_sparsity_ratio517 value: 0.9963955997080087518 name: Corpus Sparsity Ratio519 - type: dot_accuracy@1520 value: 0.44241758241758244521 name: Dot Accuracy@1522 - type: dot_accuracy@3523 value: 0.6319937205651491524 name: Dot Accuracy@3525 - type: dot_accuracy@5526 value: 0.6982103610675039527 name: Dot Accuracy@5528 - type: dot_accuracy@10529 value: 0.7922762951334378530 name: Dot Accuracy@10531 - type: dot_precision@1532 value: 0.44241758241758244533 name: Dot Precision@1534 - type: dot_precision@3535 value: 0.28906331763474624536 name: Dot Precision@3537 - type: dot_precision@5538 value: 0.22349764521193094539 name: Dot Precision@5540 - type: dot_precision@10541 value: 0.1596828885400314542 name: Dot Precision@10543 - type: dot_recall@1544 value: 0.24762543099163964545 name: Dot Recall@1546 - type: dot_recall@3547 value: 0.4029567497606036548 name: Dot Recall@3549 - type: dot_recall@5550 value: 0.47356029516066417551 name: Dot Recall@5552 - type: dot_recall@10553 value: 0.5593700517107145554 name: Dot Recall@10555 - type: dot_ndcg@10556 value: 0.4973635297458972557 name: Dot Ndcg@10558 - type: dot_mrr@10559 value: 0.5535014203483591560 name: Dot Mrr@10561 - type: dot_map@100562 value: 0.41852441580546024563 name: Dot Map@100564 - type: query_active_dims565 value: 70.98613267025705566 name: Query Active Dims567 - type: query_sparsity_ratio568 value: 0.9976742633945921569 name: Query Sparsity Ratio570 - type: corpus_active_dims571 value: 109.8632523295962572 name: Corpus Active Dims573 - type: corpus_sparsity_ratio574 value: 0.996400522497556575 name: Corpus Sparsity Ratio576 - task:577 type: sparse-information-retrieval578 name: Sparse Information Retrieval579 dataset:580 name: NanoClimateFEVER581 type: NanoClimateFEVER582 metrics:583 - type: dot_accuracy@1584 value: 0.26585 name: Dot Accuracy@1586 - type: dot_accuracy@3587 value: 0.42588 name: Dot Accuracy@3589 - type: dot_accuracy@5590 value: 0.48591 name: Dot Accuracy@5592 - type: dot_accuracy@10593 value: 0.62594 name: Dot Accuracy@10595 - type: dot_precision@1596 value: 0.26597 name: Dot Precision@1598 - type: dot_precision@3599 value: 0.15333333333333332600 name: Dot Precision@3601 - type: dot_precision@5602 value: 0.10800000000000001603 name: Dot Precision@5604 - type: dot_precision@10605 value: 0.07800000000000001606 name: Dot Precision@10607 - type: dot_recall@1608 value: 0.12499999999999999609 name: Dot Recall@1610 - type: dot_recall@3611 value: 0.20166666666666663612 name: Dot Recall@3613 - type: dot_recall@5614 value: 0.24615 name: Dot Recall@5616 - type: dot_recall@10617 value: 0.32166666666666666618 name: Dot Recall@10619 - type: dot_ndcg@10620 value: 0.26602915512735714621 name: Dot Ndcg@10622 - type: dot_mrr@10623 value: 0.3617857142857142624 name: Dot Mrr@10625 - type: dot_map@100626 value: 0.2080211358638896627 name: Dot Map@100628 - type: query_active_dims629 value: 89.9000015258789630 name: Query Active Dims631 - type: query_sparsity_ratio632 value: 0.997054583529065633 name: Query Sparsity Ratio634 - type: corpus_active_dims635 value: 107.88761901855469636 name: Corpus Active Dims637 - type: corpus_sparsity_ratio638 value: 0.9964652506710387639 name: Corpus Sparsity Ratio640 - task:641 type: sparse-information-retrieval642 name: Sparse Information Retrieval643 dataset:644 name: NanoDBPedia645 type: NanoDBPedia646 metrics:647 - type: dot_accuracy@1648 value: 0.62649 name: Dot Accuracy@1650 - type: dot_accuracy@3651 value: 0.82652 name: Dot Accuracy@3653 - type: dot_accuracy@5654 value: 0.86655 name: Dot Accuracy@5656 - type: dot_accuracy@10657 value: 0.92658 name: Dot Accuracy@10659 - type: dot_precision@1660 value: 0.62661 name: Dot Precision@1662 - type: dot_precision@3663 value: 0.5266666666666667664 name: Dot Precision@3665 - type: dot_precision@5666 value: 0.4640000000000001667 name: Dot Precision@5668 - type: dot_precision@10669 value: 0.43199999999999994670 name: Dot Precision@10671 - type: dot_recall@1672 value: 0.07037508003753436673 name: Dot Recall@1674 - type: dot_recall@3675 value: 0.1332476350020503676 name: Dot Recall@3677 - type: dot_recall@5678 value: 0.17834335811098734679 name: Dot Recall@5680 - type: dot_recall@10681 value: 0.3023813591870427682 name: Dot Recall@10683 - type: dot_ndcg@10684 value: 0.5284701506717093685 name: Dot Ndcg@10686 - type: dot_mrr@10687 value: 0.7312222222222222688 name: Dot Mrr@10689 - type: dot_map@100690 value: 0.39806509167251636691 name: Dot Map@100692 - type: query_active_dims693 value: 48.779998779296875694 name: Query Active Dims695 - type: query_sparsity_ratio696 value: 0.9984018085715453697 name: Query Sparsity Ratio698 - type: corpus_active_dims699 value: 112.2790756225586700 name: Corpus Active Dims701 - type: corpus_sparsity_ratio702 value: 0.9963213722684438703 name: Corpus Sparsity Ratio704 - task:705 type: sparse-information-retrieval706 name: Sparse Information Retrieval707 dataset:708 name: NanoFEVER709 type: NanoFEVER710 metrics:711 - type: dot_accuracy@1712 value: 0.54713 name: Dot Accuracy@1714 - type: dot_accuracy@3715 value: 0.72716 name: Dot Accuracy@3717 - type: dot_accuracy@5718 value: 0.82719 name: Dot Accuracy@5720 - type: dot_accuracy@10721 value: 0.92722 name: Dot Accuracy@10723 - type: dot_precision@1724 value: 0.54725 name: Dot Precision@1726 - type: dot_precision@3727 value: 0.24728 name: Dot Precision@3729 - type: dot_precision@5730 value: 0.16799999999999998731 name: Dot Precision@5732 - type: dot_precision@10733 value: 0.09599999999999997734 name: Dot Precision@10735 - type: dot_recall@1736 value: 0.5266666666666666737 name: Dot Recall@1738 - type: dot_recall@3739 value: 0.6866666666666665740 name: Dot Recall@3741 - type: dot_recall@5742 value: 0.7666666666666666743 name: Dot Recall@5744 - type: dot_recall@10745 value: 0.8766666666666667746 name: Dot Recall@10747 - type: dot_ndcg@10748 value: 0.696250000763901749 name: Dot Ndcg@10750 - type: dot_mrr@10751 value: 0.6531666666666667752 name: Dot Mrr@10753 - type: dot_map@100754 value: 0.6383785103785103755 name: Dot Map@100756 - type: query_active_dims757 value: 82.72000122070312758 name: Query Active Dims759 - type: query_sparsity_ratio760 value: 0.9972898236937061761 name: Query Sparsity Ratio762 - type: corpus_active_dims763 value: 121.61109161376953764 name: Corpus Active Dims765 - type: corpus_sparsity_ratio766 value: 0.9960156250699899767 name: Corpus Sparsity Ratio768 - task:769 type: sparse-information-retrieval770 name: Sparse Information Retrieval771 dataset:772 name: NanoFiQA2018773 type: NanoFiQA2018774 metrics:775 - type: dot_accuracy@1776 value: 0.22777 name: Dot Accuracy@1778 - type: dot_accuracy@3779 value: 0.42780 name: Dot Accuracy@3781 - type: dot_accuracy@5782 value: 0.44783 name: Dot Accuracy@5784 - type: dot_accuracy@10785 value: 0.54786 name: Dot Accuracy@10787 - type: dot_precision@1788 value: 0.22789 name: Dot Precision@1790 - type: dot_precision@3791 value: 0.16666666666666663792 name: Dot Precision@3793 - type: dot_precision@5794 value: 0.11200000000000002795 name: Dot Precision@5796 - type: dot_precision@10797 value: 0.07200000000000001798 name: Dot Precision@10799 - type: dot_recall@1800 value: 0.12335714285714286801 name: Dot Recall@1802 - type: dot_recall@3803 value: 0.29043650793650794804 name: Dot Recall@3805 - type: dot_recall@5806 value: 0.3084365079365079807 name: Dot Recall@5808 - type: dot_recall@10809 value: 0.38043650793650796810 name: Dot Recall@10811 - type: dot_ndcg@10812 value: 0.2842623648908474813 name: Dot Ndcg@10814 - type: dot_mrr@10815 value: 0.3184126984126985816 name: Dot Mrr@10817 - type: dot_map@100818 value: 0.24328509002216755819 name: Dot Map@100820 - type: query_active_dims821 value: 52.91999816894531822 name: Query Active Dims823 - type: query_sparsity_ratio824 value: 0.9982661687252163825 name: Query Sparsity Ratio826 - type: corpus_active_dims827 value: 104.23889923095703828 name: Corpus Active Dims829 - type: corpus_sparsity_ratio830 value: 0.9965847945996016831 name: Corpus Sparsity Ratio832 - task:833 type: sparse-information-retrieval834 name: Sparse Information Retrieval835 dataset:836 name: NanoHotpotQA837 type: NanoHotpotQA838 metrics:839 - type: dot_accuracy@1840 value: 0.74841 name: Dot Accuracy@1842 - type: dot_accuracy@3843 value: 0.9844 name: Dot Accuracy@3845 - type: dot_accuracy@5846 value: 0.9847 name: Dot Accuracy@5848 - type: dot_accuracy@10849 value: 0.98850 name: Dot Accuracy@10851 - type: dot_precision@1852 value: 0.74853 name: Dot Precision@1854 - type: dot_precision@3855 value: 0.41999999999999993856 name: Dot Precision@3857 - type: dot_precision@5858 value: 0.284859 name: Dot Precision@5860 - type: dot_precision@10861 value: 0.16399999999999998862 name: Dot Precision@10863 - type: dot_recall@1864 value: 0.37865 name: Dot Recall@1866 - type: dot_recall@3867 value: 0.63868 name: Dot Recall@3869 - type: dot_recall@5870 value: 0.71871 name: Dot Recall@5872 - type: dot_recall@10873 value: 0.82874 name: Dot Recall@10875 - type: dot_ndcg@10876 value: 0.7250698177423742877 name: Dot Ndcg@10878 - type: dot_mrr@10879 value: 0.8267222222222221880 name: Dot Mrr@10881 - type: dot_map@100882 value: 0.63152024851727883 name: Dot Map@100884 - type: query_active_dims885 value: 69.81999969482422886 name: Query Active Dims887 - type: query_sparsity_ratio888 value: 0.9977124697039897889 name: Query Sparsity Ratio890 - type: corpus_active_dims891 value: 134.8498992919922892 name: Corpus Active Dims893 - type: corpus_sparsity_ratio894 value: 0.9955818786681085895 name: Corpus Sparsity Ratio896 - task:897 type: sparse-information-retrieval898 name: Sparse Information Retrieval899 dataset:900 name: NanoQuoraRetrieval901 type: NanoQuoraRetrieval902 metrics:903 - type: dot_accuracy@1904 value: 0.8905 name: Dot Accuracy@1906 - type: dot_accuracy@3907 value: 0.92908 name: Dot Accuracy@3909 - type: dot_accuracy@5910 value: 0.94911 name: Dot Accuracy@5912 - type: dot_accuracy@10913 value: 0.98914 name: Dot Accuracy@10915 - type: dot_precision@1916 value: 0.8917 name: Dot Precision@1918 - type: dot_precision@3919 value: 0.35999999999999993920 name: Dot Precision@3921 - type: dot_precision@5922 value: 0.23599999999999993923 name: Dot Precision@5924 - type: dot_precision@10925 value: 0.12999999999999998926 name: Dot Precision@10927 - type: dot_recall@1928 value: 0.7240000000000001929 name: Dot Recall@1930 - type: dot_recall@3931 value: 0.8613333333333333932 name: Dot Recall@3933 - type: dot_recall@5934 value: 0.9059999999999999935 name: Dot Recall@5936 - type: dot_recall@10937 value: 0.9633333333333333938 name: Dot Recall@10939 - type: dot_ndcg@10940 value: 0.8826618022083887941 name: Dot Ndcg@10942 - type: dot_mrr@10943 value: 0.8673809523809524944 name: Dot Mrr@10945 - type: dot_map@100946 value: 0.8507124011593389947 name: Dot Map@100948 - type: query_active_dims949 value: 49.619998931884766950 name: Query Active Dims951 - type: query_sparsity_ratio952 value: 0.9983742874342479953 name: Query Sparsity Ratio954 - type: corpus_active_dims955 value: 54.11692428588867956 name: Corpus Active Dims957 - type: corpus_sparsity_ratio958 value: 0.998226953532341959 name: Corpus Sparsity Ratio960 - task:961 type: sparse-information-retrieval962 name: Sparse Information Retrieval963 dataset:964 name: NanoSCIDOCS965 type: NanoSCIDOCS966 metrics:967 - type: dot_accuracy@1968 value: 0.44969 name: Dot Accuracy@1970 - type: dot_accuracy@3971 value: 0.62972 name: Dot Accuracy@3973 - type: dot_accuracy@5974 value: 0.66975 name: Dot Accuracy@5976 - type: dot_accuracy@10977 value: 0.76978 name: Dot Accuracy@10979 - type: dot_precision@1980 value: 0.44981 name: Dot Precision@1982 - type: dot_precision@3983 value: 0.2733333333333334984 name: Dot Precision@3985 - type: dot_precision@5986 value: 0.22987 name: Dot Precision@5988 - type: dot_precision@10989 value: 0.16399999999999998990 name: Dot Precision@10991 - type: dot_recall@1992 value: 0.09166666666666666993 name: Dot Recall@1994 - type: dot_recall@3995 value: 0.16866666666666666996 name: Dot Recall@3997 - type: dot_recall@5998 value: 0.22566666666666665999 name: Dot Recall@51000 - type: dot_recall@101001 value: 0.33566666666666661002 name: Dot Recall@101003 - type: dot_ndcg@101004 value: 0.3269037425875381005 name: Dot Ndcg@101006 - type: dot_mrr@101007 value: 0.53519047619047611008 name: Dot Mrr@101009 - type: dot_map@1001010 value: 0.249634395838957051011 name: Dot Map@1001012 - type: query_active_dims1013 value: 86.160003662109381014 name: Query Active Dims1015 - type: query_sparsity_ratio1016 value: 0.99717711802430681017 name: Query Sparsity Ratio1018 - type: corpus_active_dims1019 value: 115.150588989257811020 name: Corpus Active Dims1021 - type: corpus_sparsity_ratio1022 value: 0.99622729215027661023 name: Corpus Sparsity Ratio1024 - task:1025 type: sparse-information-retrieval1026 name: Sparse Information Retrieval1027 dataset:1028 name: NanoArguAna1029 type: NanoArguAna1030 metrics:1031 - type: dot_accuracy@11032 value: 0.11033 name: Dot Accuracy@11034 - type: dot_accuracy@31035 value: 0.521036 name: Dot Accuracy@31037 - type: dot_accuracy@51038 value: 0.661039 name: Dot Accuracy@51040 - type: dot_accuracy@101041 value: 0.781042 name: Dot Accuracy@101043 - type: dot_precision@11044 value: 0.11045 name: Dot Precision@11046 - type: dot_precision@31047 value: 0.173333333333333371048 name: Dot Precision@31049 - type: dot_precision@51050 value: 0.1321051 name: Dot Precision@51052 - type: dot_precision@101053 value: 0.078000000000000011054 name: Dot Precision@101055 - type: dot_recall@11056 value: 0.11057 name: Dot Recall@11058 - type: dot_recall@31059 value: 0.521060 name: Dot Recall@31061 - type: dot_recall@51062 value: 0.661063 name: Dot Recall@51064 - type: dot_recall@101065 value: 0.781066 name: Dot Recall@101067 - type: dot_ndcg@101068 value: 0.441660450983068661069 name: Dot Ndcg@101070 - type: dot_mrr@101071 value: 0.33307936507936521072 name: Dot Mrr@101073 - type: dot_map@1001074 value: 0.339895331465919661075 name: Dot Map@1001076 - type: query_active_dims1077 value: 119.260002136230471078 name: Query Active Dims1079 - type: query_sparsity_ratio1080 value: 0.99609265440874681081 name: Query Sparsity Ratio1082 - type: corpus_active_dims1083 value: 117.858871459960941084 name: Corpus Active Dims1085 - type: corpus_sparsity_ratio1086 value: 0.99613856000720921087 name: Corpus Sparsity Ratio1088 - task:1089 type: sparse-information-retrieval1090 name: Sparse Information Retrieval1091 dataset:1092 name: NanoSciFact1093 type: NanoSciFact1094 metrics:1095 - type: dot_accuracy@11096 value: 0.441097 name: Dot Accuracy@11098 - type: dot_accuracy@31099 value: 0.541100 name: Dot Accuracy@31101 - type: dot_accuracy@51102 value: 0.641103 name: Dot Accuracy@51104 - type: dot_accuracy@101105 value: 0.71106 name: Dot Accuracy@101107 - type: dot_precision@11108 value: 0.441109 name: Dot Precision@11110 - type: dot_precision@31111 value: 0.21112 name: Dot Precision@31113 - type: dot_precision@51114 value: 0.144000000000000021115 name: Dot Precision@51116 - type: dot_precision@101117 value: 0.078000000000000011118 name: Dot Precision@101119 - type: dot_recall@11120 value: 0.4051121 name: Dot Recall@11122 - type: dot_recall@31123 value: 0.5251124 name: Dot Recall@31125 - type: dot_recall@51126 value: 0.631127 name: Dot Recall@51128 - type: dot_recall@101129 value: 0.681130 name: Dot Recall@101131 - type: dot_ndcg@101132 value: 0.55384955585501871133 name: Dot Ndcg@101134 - type: dot_mrr@101135 value: 0.52169047619047611136 name: Dot Mrr@101137 - type: dot_map@1001138 value: 0.51767334027868081139 name: Dot Map@1001140 - type: query_active_dims1141 value: 111.379997253417971142 name: Query Active Dims1143 - type: query_sparsity_ratio1144 value: 0.99635082900028121145 name: Query Sparsity Ratio1146 - type: corpus_active_dims1147 value: 109.966766357421881148 name: Corpus Active Dims1149 - type: corpus_sparsity_ratio1150 value: 0.99639713104130071151 name: Corpus Sparsity Ratio1152 - task:1153 type: sparse-information-retrieval1154 name: Sparse Information Retrieval1155 dataset:1156 name: NanoTouche20201157 type: NanoTouche20201158 metrics:1159 - type: dot_accuracy@11160 value: 0.57142857142857141161 name: Dot Accuracy@11162 - type: dot_accuracy@31163 value: 0.79591836734693881164 name: Dot Accuracy@31165 - type: dot_accuracy@51166 value: 0.83673469387755111167 name: Dot Accuracy@51168 - type: dot_accuracy@101169 value: 0.97959183673469391170 name: Dot Accuracy@101171 - type: dot_precision@11172 value: 0.57142857142857141173 name: Dot Precision@11174 - type: dot_precision@31175 value: 0.55782312925170061176 name: Dot Precision@31177 - type: dot_precision@51178 value: 0.47346938775510211179 name: Dot Precision@51180 - type: dot_precision@101181 value: 0.39387755102040811182 name: Dot Precision@101183 - type: dot_recall@11184 value: 0.038831944192902521185 name: Dot Recall@11186 - type: dot_recall@31187 value: 0.108359724571739551188 name: Dot Recall@31189 - type: dot_recall@51190 value: 0.158431736314305881191 name: Dot Recall@51192 - type: dot_recall@101193 value: 0.255722659132996971194 name: Dot Recall@101195 - type: dot_ndcg@101196 value: 0.45211139862388411197 name: Dot Ndcg@101198 - type: dot_mrr@101199 value: 0.70528830579850981200 name: Dot Mrr@10