thomaskim1130/stella_en_400M_v5-FinanceRAG-md

SentenceTransformer based on thomaskim1130/stellaen400M_v5-FinanceRAG-v2

This is a sentence-transformers model finetuned from thomaskim1130/stella_en_400M_v5-FinanceRAG-v2. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• —Model Type: Sentence Transformer
• —Base model: thomaskim1130/stella_en_400M_v5-FinanceRAG-v2 <!-- at revision fb539253ffbe0326a966434281a7694d1a08d510 -->
• —Maximum Sequence Length: 512 tokens
• —Output Dimensionality: 1024 tokens
• —Similarity Function: Cosine Similarity <!-- - Training Dataset: Unknown --> <!-- - Language: Unknown --> <!-- - License: Unknown -->

Model Sources

• —Documentation: Sentence Transformers Documentation
• —Repository: Sentence Transformers on GitHub
• —Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: NewModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Dense({'in_features': 1024, 'out_features': 1024, 'bias': True, 'activation_function': 'torch.nn.modules.linear.Identity'})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Instruct: Given a web search query, retrieve relevant passages that answer the query.\nQuery: Title: \nText: | _id | q83deb16a |\n| title |  |\n| text | In the section with the most Bank deposits, what is the growth rate of Collateral financing arrangements?\n\nIn section with most Bank deposits, what growth rate of Collateral financing arrangements?\n\n\n',
    'Title: \nText: | _id | d83b9f596 |\n| title |  |\n| text | Contractual Obligations.\nThe following table summarizes the Company’s major contractual obligations at December 31, 2009:\n| Contractual Obligations | Total | Less Than   One Year | More Than   One Year and   Less Than   Three Years | More Than   Three Years   and Less   Than Five   Years | More Than   Five Years |\n|  | (In millions) |\n| Future policy benefits | $310,592 | $7,220 | $10,681 | $11,424 | $281,267 |\n| Policyholder account balances | 198,087 | 22,764 | 30,586 | 24,536 | 120,201 |\n\n| Other policyholder liabilities | 6,142 | 6,142 | — | — | — |\n| Payables for collateral under securities loaned and other transactions | 24,196 | 24,196 | — | — | — |\n| Bank deposits | 10,354 | 8,998 | 1,293 | 63 | — |\n| Short-term debt | 912 | 912 | — | — | — |\n| Long-term debt | 21,138 | 1,155 | 4,214 | 2,312 | 13,457 |\n| Collateral financing arrangements | 6,694 | 61 | 122 | 122 | 6,389 |\n| Junior subordinated debt securities | 10,450 | 258 | 517 | 517 | 9,158 |\n\n| Commitments to lend funds | 7,549 | 7,349 | 177 | 4 | 19 |\n| Operating leases | 1,996 | 287 | 427 | 288 | 994 |\n| Other | 11,788 | 11,374 | 6 | 6 | 402 |\n| Total | $609,898 | $90,716 | $48,023 | $39,272 | $431,887 |\n\nFuture policyholder benefits — Future policyholder benefits include liabilities related to traditional whole life policies, term life policies, pension closeout and other group annuity contracts, structured settlements, master terminal funding agreements, single premium immediate annuities, long-term disability policies, individual disability income policies, long-term care (“LTC”) policies and property and casualty contracts.\n\nIncluded within future policyholder benefits are contracts where the Company is currently making payments and will continue to do so until the occurrence of a specific event such as death, as well as those where the timing of a portion of the payments has been determined by the contract.\n\nAlso included are contracts where the Company is not currently making payments and will not make payments until the occurrence of an insurable event, such as death or illness, or where the occurrence of the payment triggering event, such as a surrender of a policy or contract, is outside the control of the Company.\nThe Company has estimated the timing of the cash flows related to these contracts based on historical experience, as well as its expectation of future payment patterns.\n\nLiabilities related to accounting conventions, or which are not contractually due, such as shadow liabilities, excess interest reserves and property and casualty loss adjustment expenses, of $498 million have been excluded from amounts presented in the table above.\n\nAmounts presented in the table above, excluding those related to property and casualty contracts, represent the estimated cash payments for benefits under such contracts including assumptions related to the receipt of future premiums and assumptions related to mortality, morbidity, policy lapse, renewal, retirement, inflation, disability incidence, disability terminations, policy loans and other contingent events as appropriate to the respective product type.\n\nPayments for case reserve liabilities and incurred but not reported liabilities associated with property and casualty contracts of $1.5 billion have been included using an estimate of the ultimate amount to be settled under the policies based upon historical payment patterns.\n\nThe ultimate amount to be paid under property and casualty contracts is not determined until the Company reaches a settlement with the claimant, which may vary significantly from the liability or contractual obligation presented above especially as it relates to incurred but not reported liabilities.\nAll estimated cash payments presented in the table above are undiscounted as to interest, net of estimated future premiums on policies currently in-force and gross of any reinsurance recoverable.\n\nThe more than five years category includes estimated payments due for periods extending for more than 100 years from the present date.\n\nThe sum of the estimated cash flows shown for all years in the table of $310.6 billion exceeds the liability amount of $135.9 billion included on the consolidated balance sheet principally due to the time value of money, which accounts for at least 80% of the difference, as well as differences in assumptions, most significantly mortality, between the date the liabilities were initially established and the current date.\n\nFor the majority of the Company’s insurance operations, estimated contractual obligations for future policy benefits and policyholder account balance liabilities as presented in the table above are derived from the annual asset adequacy analysis used to develop actuarial opinions of statutory reserve adequacy for state regulatory purposes.\nThese cash flows are materially representative of the cash flows under generally accepted accounting principles.\n(See “— Policyholder account balances” below. )\n\n(See “— Policyholder account balances” below. )\nActual cash payments to policyholders may differ significantly from the liabilities as presented in the consolidated balance sheet and the estimated cash payments as presented in the table above due to differences between actual experience and the assumptions used in the establishment of these liabilities and the estimation of these cash payments.\n\nPolicyholder account balances — Policyholder account balances include liabilities related to conventional guaranteed interest contracts, guaranteed interest contracts associated with formal offering programs, funding agreements, individual and group annuities, total control accounts, individual and group universal life, variable universal life and company-owned life insurance.\n\nIncluded within policyholder account balances are contracts where the amount and timing of the payment is essentially fixed and determinable.\nThese amounts relate to policies where the Company is currently making payments and will continue to do so, as well as those where the timing of the payments has been determined by the contract.\n\nOther contracts involve payment obligations where the timing of future payments is uncertain and where the Company is not currently making payments and will not make payments until the occurrence of an insurable event, such as death, or where the occurrence of the payment triggering event, such as a surrender of or partial withdrawal on a policy or deposit contract, is outside the control of the Company.\n\nThe Company has estimated the timing of the cash flows related to these contracts based on historical experience, as well as its expectation of future payment patterns.\nExcess interest reserves representing purchase accounting adjustments of $565 million have been excluded from amounts presented in the table above as they represent an accounting convention and not a contractual obligation.\n\nContractual Obligations.\n table summarizes Company’s major contractual obligations at December 31, 2009:\n Included within future policyholder benefits are contracts where Company is currently making payments and will continue to until specific event death, those where timing of portion of payments determined by contract.\n\nAlso included are contracts where Company not currently making payments and will not make payments until insurable event, death or illness, or where occurrence payment triggering event surrender of policy or contract, outside control of Company.\n Company estimated timing of cash flows related to these contracts based on historical experience expectation of future payment patterns.\n\nLiabilities related to accounting conventions, or not contractually due, shadow liabilities, excess interest reserves and property and casualty loss adjustment expenses, of $498 million excluded from amounts in table above.\n\nAmounts presented in table above, excluding related to property and casualty contracts, represent estimated cash payments for benefits under such contracts including assumptions related to receipt of future premiums and assumptions related to mortality, morbidity, policy lapse, renewal, retirement, inflation, disability incidence, disability terminations, policy loans and other contingent events as appropriate to respective product type.\n\nPayments for case reserve liabilities and incurred but not reported liabilities associated with property and casualty contracts of $1. 5 billion included using estimate of ultimate amount to be settled under policies based upon historical payment patterns.\n\nultimate amount to be paid under property and casualty contracts is not determined until Company reaches settlement with claimant, which may vary significantly from liability or contractual obligation presented above especially to incurred but not reported liabilities.\nestimated cash payments in table above are undiscounted to interest, net of estimated future premiums on policies currently in-force gross of reinsurance recoverable.\n\nmore than five years category includes estimated payments due for periods extending for more than 100 years from present date.\n sum of estimated cash flows for all years in table of $310. 6 billion exceeds liability amount of $135. 9 billion on consolidated balance sheet principally due to time value of money accounts for at least 80% of difference differences in assumptions, significantly mortality, between date liabilities initially established and current date.\n\nFor majority of Company’s insurance operations, estimated contractual obligations for future policy benefits and policyholder account balance liabilities in table derived from annual asset adequacy analysis to develop actuarial opinions of statutory reserve adequacy for state regulatory purposes.\n cash flows representative of cash flows under generally accepted accounting principles.\n (See “— Policyholder account balances” below.\n\n(See “— Policyholder account balances” below.\n Actual cash payments to policyholders may differ significantly from liabilities in consolidated balance sheet and estimated cash payments in table due to differences between actual experience and assumptions used in establishment of liabilities estimation of cash payments.\n\nPolicyholder account balances — Policyholder account balances include liabilities related to conventional guaranteed interest contracts, guaranteed interest contracts associated with formal offering programs, funding agreements individual group annuities total control accounts individual group universal life, variable universal life company-owned life insurance.\n Included within policyholder account balances are contracts where amount and timing of payment is essentially fixed and determinable.\n\nThese amounts relate to policies where Company currently making payments and will continue those where timing payments determined by contract.\nOther contracts involve payment obligations where timing of future payments uncertain where Company not currently making payments and will not make payments until occurrence of insurable event, such as death, or where occurrence of payment triggering event, as surrender of or partial withdrawal on policy or deposit contract, outside control of Company.\n\nCompany has estimated timing of cash flows related to these contracts based on historical experience, expectation of future payment patterns.\n Excess interest reserves representing purchase accounting adjustments of $565 million excluded from amounts presented in table above as they represent accounting convention not contractual obligation.\n\n| Contractual Obligations | Total | Less Than   One Year | More Than   One Year and   Less Than   Three Years | More Than   Three Years   and Less   Than Five   Years | More Than   Five Years |\n|  | (In millions) |\n| Future policy benefits | $310,592 | $7,220 | $10,681 | $11,424 | $281,267 |\n| Policyholder account balances | 198,087 | 22,764 | 30,586 | 24,536 | 120,201 |\n| Other policyholder liabilities | 6,142 | 6,142 | — | — | — |\n\n| Payables for collateral under securities loaned and other transactions | 24,196 | 24,196 | — | — | — |\n| Bank deposits | 10,354 | 8,998 | 1,293 | 63 | — |\n| Short-term debt | 912 | 912 | — | — | — |\n| Long-term debt | 21,138 | 1,155 | 4,214 | 2,312 | 13,457 |\n| Collateral financing arrangements | 6,694 | 61 | 122 | 122 | 6,389 |\n| Junior subordinated debt securities | 10,450 | 258 | 517 | 517 | 9,158 |\n| Commitments to lend funds | 7,549 | 7,349 | 177 | 4 | 19 |\n\n| Operating leases | 1,996 | 287 | 427 | 288 | 994 |\n| Other | 11,788 | 11,374 | 6 | 6 | 402 |\n| Total | $609,898 | $90,716 | $48,023 | $39,272 | $431,887 |\n\n\n',
    'Title: \nText: | _id | d81f933f2 |\n| title |  |\n| text | | Cash | $45,826 |\n| Customer-related intangible assets | 42,721 |\n| Acquired technology | 27,954 |\n| Trade name | 2,901 |\n| Other assets | 2,337 |\n| Deferred income tax assets (liabilities) | -9,788 |\n| Other liabilities | -49,797 |\n| Total identifiable net assets | 62,154 |\n| Goodwill | 203,828 |\n| Total purchase consideration | $265,982 |\n\n| Total purchase consideration | $265,982 |\nGoodwill of $203.8 million arising from the acquisition, included in the Asia-Pacific segment, was attributable to expected growth opportunities in Australia and New Zealand, as well as growth opportunities and operating synergies in integrated payments in our existing Asia-Pacific and North America markets.\nGoodwill associated with this acquisition is not deductible for income tax purposes.\n\nThe customer-related intangible assets have an estimated amortization period of 15 years.\nThe acquired technology has an estimated amortization period of 15 years.\nThe trade name has an estimated amortization period of 5 years.\nNOTE 3 \x80\x94 SETTLEMENT PROCESSING ASSETS AND OBLIGATIONS Funds settlement refers to the process of transferring funds for sales and credits between card issuers and merchants.\n\nFor transactions processed on our systems, we use our internal network to provide funding instructions to financial institutions that in turn fund the merchants.\nWe process funds settlement under two models, a sponsorship model and a direct membership model.\n\nUnder the sponsorship model, we are designated as a Merchant Service Provider by MasterCard and an Independent Sales Organization by Visa, which means that member clearing banks (\x80\x9cMember\x80\x9d) sponsor us and require our adherence to the standards of the payment networks.\nIn certain markets, we have sponsorship or depository and clearing agreements with financial institution sponsors.\n\nThese agreements allow us to route transactions under the Members\x80\x99 control and identification numbers to clear credit card transactions through MasterCard and Visa.\nIn this model, the standards of the payment networks restrict us from performing funds settlement or accessing merchant settlement funds, and, instead, require that these funds be in the possession of the Member until the merchant is funded.\n\nUnder the direct membership model, we are members in various payment networks, allowing us to process and fund transactions without third-party sponsorship.\nIn this model, we route and clear transactions directly through the card brand\x80\x99s network and are not restricted from performing funds settlement.\nOtherwise, we process these transactions similarly to how we process transactions in the sponsorship model.\nWe are required to adhere to the standards of the payment networks in which we are direct members.\n\nWe maintain relationships with financial institutions, which may also serve as our Member sponsors for other card brands or in other markets, to assist with funds settlement.\nTiming differences, interchange fees, Merchant Reserves and exception items cause differences between the amount received from the payment networks and the amount funded to the merchants.\n\nThese intermediary balances arising in our settlement process for direct merchants are reflected as settlement processing assets and obligations on our consolidated balance sheets.\nSettlement processing assets and obligations include the components outlined below: ?\nInterchange reimbursement.\nOur receivable from merchants for the portion of the discount fee related to reimbursement of the interchange fee.\n\nx The Executive Benefits business offers corporate-owned universal and variable universal life insurance (\x80\x9cCOLI\x80\x9d) and bankowned universal and variable universal life insurance (\x80\x9cBOLI\x80\x9d) to small to mid-sized banks and mid to large-sized corporations, mostly through executive benefit brokers.11 The Group Protection segment focuses on offering group term life, disability income and dental insurance primarily in the small to mid-sized employer marketplace for their eligible employees.\n\nEmployer Markets - Retirement Products The Defined Contribution business is the largest business in this segment and focuses on 403(b) plans and 401(k) plans.\nLincoln has a strong historical presence in the 403(b) space where assets account for about 61% of total assets under management in this segment as of December 31, 2007.\nThe 401(k) business accounts for 51% of our new deposits as of December 31, 2007.\nThe Retirement Products segment\x80\x99s deposits (in millions) were as follows:\n\nGoodwill associated with acquisition not deductible for income tax purposes.\n customer-related intangible assets have estimated amortization period of 15 years.\n acquired technology has estimated amortization period of 15 years.\n trade name has estimated amortization period 5 years.\n NOTE 3 \x80\x94 SETTLEMENT PROCESSING ASSETS AND OBLIGATIONS Funds settlement refers to process transferring funds for sales and credits between card issuers and merchants.\n\nFor transactions processed on our systems we use our internal network to provide funding instructions to financial institutions fund merchants.\n We process funds settlement under two models, sponsorship model and direct membership model.\n Under sponsorship model we designated as Merchant Service Provider by MasterCard and Independent Sales Organization by Visa member clearing banks (\x80\x9cMember\x80\x9d) sponsor us require adherence to standards of payment networks.\n\nIn certain markets we have sponsorship or depository and clearing agreements with financial institution sponsors.\n agreements allow us to route transactions under Members\x80\x99 control identification numbers to clear credit card transactions through MasterCard and Visa.\n In model standards of payment networks restrict us from performing funds settlement or accessing merchant settlement funds require funds be in possession of Member until merchant funded.\n\nUnder direct membership model we members in various payment networks process and fund transactions without third-party sponsorship.\n model route and clear transactions directly through card brand\x80\x99s network not restricted from performing funds settlement.\n process transactions similarly to in sponsorship model.\n required to adhere to standards of payment networks in we direct members.\n\nmaintain relationships with financial institutions, may serve as Member sponsors for other card brands in other markets, to assist with funds settlement.\nTiming differences interchange fees Merchant Reserves exception items cause differences between amount received from payment networks and amount funded to merchants.\n intermediary balances in settlement process for direct merchants are reflected as settlement processing assets obligations on consolidated balance sheets.\n\nSettlement processing assets obligations include components ?\n Interchange reimbursement.\n receivable from merchants for portion of discount fee related to reimbursement interchange fee.\n\nExecutive Benefits business offers corporate-owned universal variable universal life insurance and bankowned universal variable universal life insurance (\x80\x9cBOLI\x80\x9d to small to mid-sized banks large-sized corporations mostly through executive benefit brokers. Group Protection segment focuses on group term life, disability income dental insurance in small to mid-sized employer marketplace for eligible employees.\n\nEmployer Markets - Retirement Products Defined Contribution business is largest business in segment focuses on 403(b) plans 401(k) plans.\n Lincoln has strong historical presence in 403(b) space assets account for about 61% of total assets under management in as of December 31, 2007.\n 401(k) business accounts for 51% of new deposits as of December 31, 2007.\n Retirement Products segment\x80\x99s deposits (in millions) were as\n\n| Cash | $45,826 |\n| Customer-related intangible assets | 42,721 |\n| Acquired technology | 27,954 |\n| Trade name | 2,901 |\n| Other assets | 2,337 |\n| Deferred income tax assets (liabilities) | -9,788 |\n| Other liabilities | -49,797 |\n| Total identifiable net assets | 62,154 |\n| Goodwill | 203,828 |\n| Total purchase consideration | $265,982 |\n\n\n',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

<!--

Direct Usage (Transformers)

<details><summary>Click to see the direct usage in Transformers</summary>

</details> -->

<!--

Downstream Usage (Sentence Transformers)

You can finetune this model on your own dataset.

<details><summary>Click to expand</summary>

</details> -->

<!--

Out-of-Scope Use

List how the model may foreseeably be misused and address what users ought not to do with the model. -->

Evaluation

Metrics

Information Retrieval

• —Dataset: Evaluate
• —Evaluated with <code>InformationRetrievalEvaluator</code>

<!--

Bias, Risks and Limitations

What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model. -->

<!--

Recommendations

What are recommendations with respect to the foreseeable issues? For example, filtering explicit content. -->

Training Details

Training Dataset

Unnamed Dataset

• —Size: 2,240 training samples
• —Columns: <code>sentence0</code> and <code>sentence1</code>
• —Approximate statistics based on the first 1000 samples: | | sentence0 | sentence1 | |:--------|:-----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------| | type | string | string | | details | <ul><li>min: 46 tokens</li><li>mean: 80.0 tokens</li><li>max: 217 tokens</li></ul> | <ul><li>min: 53 tokens</li><li>mean: 465.99 tokens</li><li>max: 512 tokens</li></ul> |
• —Samples: | sentence0 | sentence1 | |:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | <code>Instruct: Given a web search query, retrieve relevant passages that answer the query.<br>Query: Title: <br>Text: | id | q8455ea96 |<br>| title | |<br>| text | Which year is Standardized Approach the most? (in million)<br><br>year Standardized Approach most? (in million)<br><br><br></code> | <code>Title: <br>Text: | id | d8445e56a |<br>| title | |<br>| text | | | Bank of America Corporation | Bank of America, N.A. |<br>| | Standardized Approach | Advanced Approaches | Regulatory Minimum-2 | Standardized Approach | Advanced Approaches | Regulatory Minimum-3 |<br>| (Dollars in millions, except as noted) | December 31, 2018 |<br>| Risk-based capital metrics: | | | | | | |<br>| Common equity tier 1 capital | $167,272 | $167,272 | | $149,824 | $149,824 | |<br>| Tier 1 capital | 189,038 | 189,038 | | 149,824 | 149,824 | |<br><br>| Total capital-4 | 221,304 | 212,878 | | 161,760 | 153,627 | |<br>| Risk-weighted assets (in billions) | 1,437 | 1,409 | | 1,195 | 959 | |<br>| Common equity tier 1 capital ratio | 11.6% | 11.9% | 8.25% | 12.5% | 15.6% | 6.5% |<br>| Tier 1 capital ratio | 13.2 | 13.4 | 9.75 | 12.5 | 15.6 | 8.0 |<br>| Total capital ratio | 15.4 | 15.1 | 11.75 | 13.5 | 16.0 | 10.0 |<br>| Leverage-based metrics: | | | | | | |<br>| Adjusted quarterly average assets (in billions)(5) | $2,258 | $2,258 | | $1,719 | $1,719 | |<br><br>| Tier 1 leverage ratio | 8.4% | 8.4% | 4.0 | 8.7% | 8.7% | 5.0 |<br>| SLR leverage exposure (in billions) | | $2,791 | | | $2,112 | |<br>| SLR | | 6.8% | 5.0 | | 7.1% | 6.0 |<br>| | December 31, 2017 |<br>| Risk-based capital metrics: | | | | | | |<br>| Common equity tier 1 capital | $171,063 | $171,063 | | $150,552 | $150,552 | |<br>| Tier 1 capital | 191,496 | 191,496 | | 150,552 | 150,552 | |<br>| Total capital-4 | 227,427 | 218,529 | | 163,243 | 154,675 | |<br><br>| Risk-weighted assets (in billions) | 1,434 | 1,449 | | 1,201 | 1,007 | |<br>| Common equity tier 1 capital ratio | 11.9% | 11.8% | 7.25% | 12.5% | 14.9% | 6.5% |<br>| Tier 1 capital ratio | 13.4 | 13.2 | 8.75 | 12.5 | 14.9 | 8.0 |<br>| Total capital ratio | 15.9 | 15.1 | 10.75 | 13.6 | 15.4 | 10.0 |<br>| Leverage-based metrics: | | | | | | |<br>| Adjusted quarterly average assets (in billions)(5) | $2,224 | $2,224 | | $1,672 | $1,672 | |<br>| Tier 1 leverage ratio | 8.6% | 8.6% | 4.0 | 9.0% | 9.0% | 5.0 |<br><br>(1) Regulatory capital metrics at December 31, 2017 reflect Basel 3 transition provisions for regulatory capital adjustments and deductions, which were fully phased-in as of January 1, 2018.<br>(2) The December 31, 2018 and 2017 amounts include a transition capital conservation buffer of 1.875 percent and 1.25 percent and a transition global systemically important bank surcharge of 1.875 percent and 1.5 percent.<br>The countercyclical capital buffer for both periods is zero.<br><br>(3) Percent required to meet guidelines to be considered €œwell capitalized€ under the PCA framework.<br>(4) Total capital under the Advanced approaches differs from the Standardized approach due to differences in the amount permitted in Tier 2 capital related to the qualifying allowance for credit losses.<br>(5) Reflects adjusted average total assets for the three months ended December 31, 2018 and 2017.<br><br>The capital adequacy rules issued by the U. S. banking regulators require institutions to meet the established minimums outlined in the table above.<br>Failure to meet the minimum requirements can lead to certain mandatory and discretionary actions by regulators that could have a material adverse impact on the Corporation€™s financial position.<br>At December 31, 2018 and 2017, the Corporation and its banking entity affiliates were €œwell capitalized.<br><br>€ Other Regulatory Matters The Federal Reserve requires the Corporation€™s bank subsidiaries to maintain reserve requirements based on a percentage of certain deposit liabilities.<br>The average daily reserve balance requirements, in excess of vault cash, maintained by the Corporation with the Federal Reserve Bank were $11.4 billion and $8.9 billion for 2018 and 2017.<br><br>At December 31, 2018 and 2017, the Corporation had cash and cash equivalents in the amount of $5.8 billion and $4.1 billion, and securities with a fair value of $16.6 billion and $17.3 billion that were segregated in compliance with securities regulations.<br>Cash held on deposit with the Federal Reserve Bank to meet reserve requirements and cash and cash equivalents segregated in compliance with securities regulations are components of restricted cash.<br><br>For additional information, see Note 10 €“ Federal Funds Sold or Purchased, Securities Financing Agreements, Short-term Borrowings and Restricted Cash.<br>In addition, at December 31, 2018 and 2017, the Corporation had cash deposited with clearing organizations of $8.1 billion and $11.9 billion primarily recorded in other assets on the Consolidated Balance Sheet.<br><br>Bank Subsidiary Distributions The primary sources of funds for cash distributions by the Corporation to its shareholders are capital distributions received from its bank subsidiaries, BANA and Bank of America California, N. A.<br>In 2018, the Corporation received dividends of $26.1 billion from BANA and $320 million from Bank of America California, N. A.<br>In addition, Bank of America California, N. A. returned capital of $1.4 billion to the Corporation in 2018.<br><br>The amount of dividends that a subsidiary bank may declare in a calendar year without OCC approval is the subsidiary bank€™s net profits for that year combined with its retained net profits for the preceding two years.<br>Retained net profits, as defined by the OCC, consist of net income less dividends declared during the period.<br><br>In 2019, BANA can declare and pay dividends of approximately $3.1 billion to the Corporation plus an additional amount equal to its retained net profits for 2019 up to the date of any such dividend declaration.<br>Bank of America California, N. A. can pay dividends of $40 million in 2019 plus an additional amount equal to its retained net profits for 2019 up to the date of any such dividend declaration.<br><br>December 31, 2018 and 2017 amounts include transition capital conservation buffer 1. 875 percent 1. 25 percent transition global systemically important bank surcharge of 1. 875 percent 1. 5 percent.<br> countercyclical capital buffer for both periods is zero.<br> Percent required to meet guidelines to be €œwell capitalized€ under PCA framework.<br><br>Total capital under Advanced approaches differs from Standardized approach due to differences in amount permitted Tier 2 capital qualifying allowance for credit losses.<br> Reflects adjusted average total assets for three months ended December 31, 2018 and 2017.<br> capital adequacy rules by U. S. banking regulators require institutions to meet minimums in table above.<br> Failure to meet minimum requirements can lead to mandatory actions adverse impact on Corporation€™s financial position.<br><br>At December 31, 2018 and 2017 Corporation and banking entity affiliates were €œwell capitalized.<br> Federal Reserve requires Corporation€™s bank subsidiaries to maintain reserve requirements based on percentage of certain deposit liabilities.<br> average daily reserve balance requirements excess of vault cash Corporation with Federal Reserve Bank were $11. 4 billion and $8. 9 billion for 2018 and 2017.<br><br>At December 31, 2018 and 2017 Corporation had cash cash equivalents $5. 8 billion and $4. 1 billion securities with fair value of $16. 6 billion and $17. 3 billion segregated in compliance with securities regulations.<br> Cash held on deposit with Federal Reserve Bank to meet reserve requirements cash cash equivalents segregated in compliance with securities regulations are components of restricted cash.<br><br>For additional information, see Note 10 Federal Funds Sold or Purchased, Securities Financing Agreements, Short-term Borrowings Restricted Cash.<br> at December 31, 2018 and 2017 Corporation had cash deposited with clearing organizations of $8. 1 billion and $11.9 billion recorded in other assets on Consolidated Balance Sheet.<br><br>Bank Subsidiary Distributions primary sources of funds for cash distributions Corporation to shareholders are capital distributions from bank subsidiaries BANA and Bank of America California, N. A.<br> In 2018 Corporation received dividends $26. 1 billion from BANA $320 million from Bank of America California, N. A.<br> Bank of America California, N. A. returned capital of $1. 4 billion to Corporation in 2018.<br><br>amount dividends subsidiary bank may declare year without OCC approval is subsidiary bank€™s net profits for year combined with retained net profits for preceding two years.<br> Retained net profits defined OCC, consist of net income less dividends declared during period.<br> In 2019, BANA can declare pay dividends of approximately $3. 1 billion to Corporation plus additional amount equal to retained net profits for 2019 dividend declaration.<br><br>Bank of America California, N. A. can pay dividends of $40 million in 2019 plus additional amount equal to retained net profits for 2019 date dividend declaration.<br><br>| | Bank of America Corporation | Bank of America, N.A. |<br>| | Standardized Approach | Advanced Approaches | Regulatory Minimum-2 | Standardized Approach | Advanced Approaches | Regulatory Minimum-3 |<br>| (Dollars in millions, except as noted) | December 31, 2018 |<br>| Risk-based capital metrics: | | | | | | |<br>| Common equity tier 1 capital | $167,272 | $167,272 | | $149,824 | $149,824 | |<br>| Tier 1 capital | 189,038 | 189,038 | | 149,824 | 149,824 | |<br><br>| Total capital-4 | 221,304 | 212,878 | | 161,760 | 153,627 | |<br>| Risk-weighted assets (in billions) | 1,437 | 1,409 | | 1,195 | 959 | |<br>| Common equity tier 1 capital ratio | 11.6% | 11.9% | 8.25% | 12.5% | 15.6% | 6.5% |<br>| Tier 1 capital ratio | 13.2 | 13.4 | 9.75 | 12.5 | 15.6 | 8.0 |<br>| Total capital ratio | 15.4 | 15.1 | 11.75 | 13.5 | 16.0 | 10.0 |<br>| Leverage-based metrics: | | | | | | |<br>| Adjusted quarterly average assets (in billions)(5) | $2,258 | $2,258 | | $1,719 | $1,719 | |<br><br>| Tier 1 leverage ratio | 8.4% | 8.4% | 4.0 | 8.7% | 8.7% | 5.0 |<br>| SLR leverage exposure (in billions) | | $2,791 | | | $2,112 | |<br>| SLR | | 6.8% | 5.0 | | 7.1% | 6.0 |<br>| | December 31, 2017 |<br>| Risk-based capital metrics: | | | | | | |<br>| Common equity tier 1 capital | $171,063 | $171,063 | | $150,552 | $150,552 | |<br>| Tier 1 capital | 191,496 | 191,496 | | 150,552 | 150,552 | |<br>| Total capital-4 | 227,427 | 218,529 | | 163,243 | 154,675 | |<br><br>| Risk-weighted assets (in billions) | 1,434 | 1,449 | | 1,201 | 1,007 | |<br>| Common equity tier 1 capital ratio | 11.9% | 11.8% | 7.25% | 12.5% | 14.9% | 6.5% |<br>| Tier 1 capital ratio | 13.4 | 13.2 | 8.75 | 12.5 | 14.9 | 8.0 |<br>| Total capital ratio | 15.9 | 15.1 | 10.75 | 13.6 | 15.4 | 10.0 |<br>| Leverage-based metrics: | | | | | | |<br>| Adjusted quarterly average assets (in billions)(5) | $2,224 | $2,224 | | $1,672 | $1,672 | |<br>| Tier 1 leverage ratio | 8.6% | 8.6% | 4.0 | 9.0% | 9.0% | 5.0 |<br><br><br></code> | | <code>Instruct: Given a web search query, retrieve relevant passages that answer the query.<br>Query: Title: <br>Text: | id | q61694076 |<br>| title | |<br>| text | as of december 31 , 2006 what was the percent of the total route miles covered by the main line<br><br>as of december 31 , 2006 percent of total route miles covered by main line<br><br><br></code> | <code>Title: <br>Text: | id | d6168db72 |<br>| title | |<br>| text | our access to commercial paper and reduce our credit ratings below investment grade , which would prohibit us from utilizing our sale of receivables program and significantly increase the cost of issuing debt .<br>we are dependent on two key domestic suppliers of locomotives 2013 due to the capital intensive nature and sophistication of locomotive equipment , high barriers to entry face potential new suppliers .<br><br>therefore , if one of these domestic suppliers discontinues manufacturing locomotives , we could experience a significant cost increase and risk reduced availability of the locomotives that are necessary to our operations .<br>we may be affected by acts of terrorism , war , or risk of war 2013 our rail lines , facilities , and equipment , including rail cars carrying hazardous materials , could be direct targets or indirect casualties of terrorist attacks .<br><br>terrorist attacks , or other similar events , any government response thereto , and war or risk of war may adversely affect our results of operations , financial condition , and liquidity .<br>in addition , insurance premiums for some or all of our current coverages could increase dramatically , or certain coverages may not be available to us in the future .<br>item 1b .<br>unresolved staff comments item 2 .<br><br>item 1b .<br>unresolved staff comments item 2 .<br>properties with operations in 23 states , we employ a variety of assets in the management and operation of our rail business .<br>these assets include real estate , track and track structure , equipment , and facilities .<br>we own and lease real estate that we use in our operations , and we also own real estate that is not required for our business , which we sell from time to time .<br><br>our equipment includes owned and leased locomotives and rail cars ; heavy maintenance equipment and machinery ; other equipment and tools in our shops , offices and facilities ; and vehicles for maintenance , transportation of crews , and other activities .<br><br>we operate numerous facilities , including terminals for intermodal and other freight ; rail yards for train-building , switching , storage-in-transit ( the temporary storage of customer goods in rail cars prior to shipment ) and other activities ; offices to administer and manage our operations ; dispatch centers to direct traffic on our rail network ; crew quarters to house train crews along our network ; and shops and other facilities for fueling , maintenance , and repair of locomotives and repair and<br><br>, and repair of locomotives and repair and maintenance of rail cars and other equipment .<br><br>we spent approximately $ 2.2 billion in cash capital during 2006 for , among other things , building and maintaining track , structures and infrastructure ; upgrading and augmenting equipment ; and implementing new technologies ( see the capital investments table in management 2019s discussion and analysis of financial condition and results of operations 2013 liquidity and capital resources 2013 financial condition , item 7 ) .<br><br>certain of our properties are subject to federal , state , and local laws and regulations governing the protection of the environment ( see discussion of environmental issues in business 2013 governmental and environmental regulation , item 1 , and management 2019s discussion and analysis of financial condition and results of operations 2013 critical accounting policies 2013 environmental , item 7 ) .<br><br>track 2013 the railroad operates on 32339 main line and branch line route miles in 23 states in the western two-thirds of the united states .<br>we own 26466 route miles , with the remainder of route miles operated pursuant to trackage rights or leases .<br>route miles as of december 31 , 2006 and 2005 , were as follows : 2006 2005 .<br><br>| 2006 | 2005 <br>----------------------------- | ----- | -----<br>main line | 27318 | 27301<br>branch line | 5021 | 5125 <br>yards sidings and other lines | 19257 | 20241<br>total | 51596 | 52667<br><br>access to commercial paper reduce credit ratings below investment grade prohibit us from utilizing sale of receivables program increase cost of issuing debt.<br> dependent on two key domestic suppliers of locomotives 2013 due to capital intensive nature sophistication of locomotive equipment high barriers to entry face potential new suppliers.<br><br>if one domestic suppliers discontinues manufacturing locomotives, could experience significant cost increase risk reduced availability of locomotives necessary to operations.<br> may be affected by acts of terrorism , war or risk of war 2013 our rail lines , facilities equipment , including rail cars carrying hazardous materials could be direct targets or indirect casualties of terrorist attacks.<br><br>terrorist attacks other similar events , government response war or risk of war may adversely affect results of operations , financial condition liquidity.<br> insurance premiums for some or all current coverages could increase dramatically or certain coverages may not be available to in future.<br> item 1b.<br> unresolved staff comments item 2.<br> properties with operations in 23 states employ variety of assets in management and operation of rail business.<br><br>assets include real estate , track and track structure equipment facilities.<br> own and lease real estate we use in operations also own real estate not required for business we sell from time to time.<br> equipment includes owned and leased locomotives and rail cars ; heavy maintenance equipment and machinery ; other equipment and tools in shops , offices facilities ; vehicles for maintenance , transportation of crews other activities.<br><br>operate numerous facilities including terminals for intermodal freight ; rail yards for train-building switching storage-in-transit ( temporary storage customer goods in rail cars prior shipment ) other activities ; offices to administer manage operations ; dispatch centers direct traffic rail network ; crew quarters house train crews network shops facilities for fueling maintenance repair of locomotives repair maintenance rail cars other equipment.<br><br>spent approximately $ 2. 2 billion in cash capital during 2006 for building maintaining track structures infrastructure ; upgrading augmenting equipment implementing new technologies ( see capital investments table in management 2019s discussion analysis of financial condition results of operations 2013 liquidity capital resources 2013 financial condition , item 7 ).<br><br>certain properties subject to federal state local laws regulations governing protection environment ( see discussion environmental issues in business 2013 governmental environmental regulation , item 1 , management 2019s discussion analysis financial condition results of operations 2013 critical accounting policies 2013 environmental , item 7 ).<br> track 2013 railroad operates on 32339 main line branch line route miles in 23 states in western two-thirds of united states.<br><br>own 26466 route miles remainder route miles operated pursuant to trackage rights or leases.<br> route miles as of december 31 , 2006 2005 as follows : 2006 2005.<br> | 2006 | 2005<br> ----------------------------- | -----|<br> main line | 27318 | 27301<br> branch line | 5021 | 5125<br> yards sidings and other lines | 19257 | 20241<br> total | 51596 | 52667<br><br><br></code> | | <code>Instruct: Given a web search query, retrieve relevant passages that answer the query.<br>Query: Title: <br>Text: | id | q813b8c26 |<br>| title | |<br>| text | What's the sum of the Unit redemptions in the years where Mortgages Payable for Carrying Amounts is positive?<br><br>What's sum of Unit redemptions years where Mortgages Payable for Carrying Amounts positive?<br><br><br></code> | <code>Title: <br>Text: | id | d813b8e42 |<br>| title | |<br>| text | iTunes, Software and Services The following table presents net sales information of iTunes, Software and Services for 2014, 2013 and 2012 (dollars in millions):<br>| | 2014 | Change | 2013 | Change | 2012 |<br>| iTunes, Software and Services | $18,063 | 13% | $16,051 | 25% | $12,890 |<br>| Percentage of total net sales | 10% | | 9% | | 8% |<br>The increase in net sales of iTunes, Software and Services in 2014 compared to 2013 was primarily due to growth in net sales from the iTunes Store, AppleCare and licensing.<br><br>The iTunes Store generated a total of $10.2 billion in net sales during 2014 compared to $9.3 billion during 2013.<br>Growth in net sales from the iTunes Store was driven by increases in revenue from app sales reflecting continued growth in the installed base of iOS devices and the expanded offerings of iOS Apps and related in-App purchases.<br>This was partially offset by a decline in sales of digital music.<br><br>The increase in net sales of iTunes, Software and Services in 2013 compared to 2012 was primarily due to growth in net sales from the iTunes Store, AppleCare and licensing.<br>The iTunes Store generated a total of $9.3 billion in net sales during 2013, a 24% increase from 2012.<br><br>Growth in the iTunes Store, which includes the App Store, the Mac App Store and the iBooks Store, reflected continued growth in the installed base of iOS devices, expanded offerings of iOS Apps and related in-App purchases, and expanded offerings of iTunes digital content.<br><br>iTunes, Software and Services table presents net sales information of iTunes for 2014, 2013 2012 (dollars in millions):<br> iTunes Store generated $10. 2 billion net sales during 2014 compared to $9. 3 billion 2013.<br> Growth in net sales iTunes Store driven by increases in revenue from app sales reflecting continued growth in installed base iOS devices expanded offerings of iOS Apps related in-App purchases.<br> partially offset by decline in sales of digital music.<br><br>increase in net sales of iTunes, Software and Services in 2013 compared to 2012 primarily due to growth in net sales from iTunes Store, AppleCare licensing.<br> iTunes Store generated $9. 3 billion in net sales during 2013, 24% increase from 2012.<br> Growth in iTunes Store includes App Store, Mac App Store iBooks Store reflected continued growth in installed base of iOS devices expanded offerings of iOS Apps related in-App purchases expanded offerings iTunes digital content.<br><br>| | 2014 | Change | 2013 | Change | 2012 |<br>| iTunes, Software and Services | $18,063 | 13% | $16,051 | 25% | $12,890 |<br>| Percentage of total net sales | 10% | | 9% | | 8% |<br><br><br></code> |
• —Loss: <code>MultipleNegativesRankingLoss</code> with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }

Training Hyperparameters

Non-Default Hyperparameters

• —eval_strategy: steps
• —per_device_train_batch_size: 16
• —per_device_eval_batch_size: 16
• —num_train_epochs: 2
• —fp16: True
• —batch_sampler: no_duplicates
• —multi_dataset_batch_sampler: round_robin

All Hyperparameters

<details><summary>Click to expand</summary>

• —overwrite_output_dir: False
• —do_predict: False
• —eval_strategy: steps
• —prediction_loss_only: True
• —per_device_train_batch_size: 16
• —per_device_eval_batch_size: 16
• —per_gpu_train_batch_size: None
• —per_gpu_eval_batch_size: None
• —gradient_accumulation_steps: 1
• —eval_accumulation_steps: None
• —torch_empty_cache_steps: None
• —learning_rate: 5e-05
• —weight_decay: 0.0
• —adam_beta1: 0.9
• —adam_beta2: 0.999
• —adam_epsilon: 1e-08
• —max_grad_norm: 1
• —num_train_epochs: 2
• —max_steps: -1
• —lr_scheduler_type: linear
• —lr_scheduler_kwargs: {}
• —warmup_ratio: 0.0
• —warmup_steps: 0
• —log_level: passive
• —log_level_replica: warning
• —log_on_each_node: True
• —logging_nan_inf_filter: True
• —save_safetensors: True
• —save_on_each_node: False
• —save_only_model: False
• —restore_callback_states_from_checkpoint: False
• —no_cuda: False
• —use_cpu: False
• —use_mps_device: False
• —seed: 42
• —data_seed: None
• —jit_mode_eval: False
• —use_ipex: False
• —bf16: False
• —fp16: True
• —fp16_opt_level: O1
• —half_precision_backend: auto
• —bf16_full_eval: False
• —fp16_full_eval: False
• —tf32: None
• —local_rank: 0
• —ddp_backend: None
• —tpu_num_cores: None
• —tpu_metrics_debug: False
• —debug: []
• —dataloader_drop_last: False
• —dataloader_num_workers: 0
• —dataloader_prefetch_factor: None
• —past_index: -1
• —disable_tqdm: False
• —remove_unused_columns: True
• —label_names: None
• —load_best_model_at_end: False
• —ignore_data_skip: False
• —fsdp: []
• —fsdp_min_num_params: 0
• —fsdp_config: {'minnumparams': 0, 'xla': False, 'xlafsdpv2': False, 'xlafsdpgrad_ckpt': False}
• —fsdp_transformer_layer_cls_to_wrap: None
• —accelerator_config: {'splitbatches': False, 'dispatchbatches': None, 'evenbatches': True, 'useseedablesampler': True, 'nonblocking': False, 'gradientaccumulationkwargs': None}
• —deepspeed: None
• —label_smoothing_factor: 0.0
• —optim: adamw_torch
• —optim_args: None
• —adafactor: False
• —group_by_length: False
• —length_column_name: length
• —ddp_find_unused_parameters: None
• —ddp_bucket_cap_mb: None
• —ddp_broadcast_buffers: False
• —dataloader_pin_memory: True
• —dataloader_persistent_workers: False
• —skip_memory_metrics: True
• —use_legacy_prediction_loop: False
• —push_to_hub: False
• —resume_from_checkpoint: None
• —hub_model_id: None
• —hub_strategy: every_save
• —hub_private_repo: False
• —hub_always_push: False
• —gradient_checkpointing: False
• —gradient_checkpointing_kwargs: None
• —include_inputs_for_metrics: False
• —eval_do_concat_batches: True
• —fp16_backend: auto
• —push_to_hub_model_id: None
• —push_to_hub_organization: None
• —mp_parameters:
• —auto_find_batch_size: False
• —full_determinism: False
• —torchdynamo: None
• —ray_scope: last
• —ddp_timeout: 1800
• —torch_compile: False
• —torch_compile_backend: None
• —torch_compile_mode: None
• —dispatch_batches: None
• —split_batches: None
• —include_tokens_per_second: False
• —include_num_input_tokens_seen: False
• —neftune_noise_alpha: None
• —optim_target_modules: None
• —batch_eval_metrics: False
• —eval_on_start: False
• —use_liger_kernel: False
• —eval_use_gather_object: False
• —batch_sampler: no_duplicates
• —multi_dataset_batch_sampler: round_robin

</details>

Training Logs

Framework Versions

• —Python: 3.10.12
• —Sentence Transformers: 3.1.1
• —Transformers: 4.45.2
• —PyTorch: 2.5.1+cu121
• —Accelerate: 1.1.1
• —Datasets: 3.1.0
• —Tokenizers: 0.20.3

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

<!--

Glossary

Clearly define terms in order to be accessible across audiences. -->

<!--

Model Card Authors

Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction. -->

<!--

Model Card Contact

Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors. -->