wjunwei/ecommerce_text_embedding
0112
1---2base_model: avsolatorio/GIST-Embedding-v03datasets: []4language: []5library_name: sentence-transformers6pipeline_tag: sentence-similarity7tags:8- sentence-transformers9- sentence-similarity10- feature-extraction11- generated_from_trainer12- dataset_size:586413- loss:ContrastiveTensionLoss14widget:15- source_sentence: pyrex blue cup rectangular plastic cover pc pack original genuine16 pyrex made in the usa genuine pyrex replacement lid nonporous surface does not17 absorb food odors flavors or stains refrigerator microwave and toprack dishwasher18 safe will not fit anchor hocking products included pyrex pc blue cup rectangle19 plastic lids lids only containers not included20 sentences:21 - 'kpywzer vintage leather sling bag bags for men women backpack shoulder messenger22 crossbody outdoor travel hiking camping tactical chest pack daypack brown '23 - dove beauty bar original moisturizing bar made with moisturizing cream gentle24 for soft skin count oz each lock in moisture dove original beauty bar is the25 classic white bar cleanser you trust to nourish and pamper skin and give you softer26 smoother more radiantlooking skin effective cleanser gently wash away dirt and27 germs for use every day on body face and hands this dove beauty bar creates luxurious28 lather and wont dry your skin like ordinary bar soaps no dermatologist recommended29 formulated with moisturizing cream dove moisturizing beauty bar and gentle skin30 cleanser leaves skin instantly soft and smooth with lasting nourishment versatile31 cleanser the unique formulation for effective skin care can be enjoyed by the32 entire family as this allinone cleanser nourishes your face body and hands for33 beautiful skin thoughtfully made this beauty bar is certified crueltyfree by peta34 and sulfate free cleansers so you can feel good about switching from ordinary35 bar soap to dove beauty bar care with your cleanser our mission is to help the36 next generation of women develop a positive relationship with the way they look37 helping them raise their selfesteem38 - professional stainless steel pots and pans setply piece induction cookware setinduction39 oven broiler safe f pots and pans silver stainless steel professional cookware40 set geanbioso ply stainless steel pots and pans set combines the epitome in rapid41 heating heat retention and cooking stability each piece features cast stainless42 steel handles durable rivets measurement markings easytopour edges and allcooktop43 compatibility superior qualitypots and pans are crafted from heavyduty ply clad44 stainless steelthe outer layer is magneticconducting stainless steel the middle45 is layer aluminum alloycore for even heat transfer throughout the panthe pot46 is formed in one piece riveted links safe and solid healthy and environmentally47 friendly physically nonstick and the service life of up to years or more suitable48 for all cooktopsgeanbioso ply stainless steel cookware set is suitable for all49 cooktops and is compatible with oven electric gas ceramic halogen and induction50 cooktops it is convenient to put the pans in the dishwasheroven safe up to polished51 technique easytoclean cookware setthis stainless steel pans and pots set interior52 surface used mirror polished technique it make stainless steel cookware sets effectively53 avoid deformation warping and rust easy to wash and quick cleanup this kitchen54 set not only have long use life also make housework much more easier and decorate55 your kitchen looks shining and high class this fabulous set consists of basics56 and more the quart covered stockpot with lid takes care of everything from oatmeal57 to bechamel sauce also included are and inch open skillets that turn out perfect58 grilled cheese hamburgers and crepesand an quart covered stockpot for stews and59 soups dishwashersafe this set has no coatings to flake off or plastic to melt60 and will surely be family businessmotivated by our year familyhistory in kitchen61 supplywe setout to multigenerational familyowned manufacturers in the usand western62 europe to buildsuperior culinary toolsour aim is to enhance the experience of63 your culinary creation and let them become your best kitchen companion64- source_sentence: logitech g lightspeed wireless gaming headset with suspension headband65 lightsync rgb blue voce mic technology and prog audio drivers black total freedom66 with up to meter wireless range and lightspeed wireless audio transmission keep67 playing for up to hours of battery life play in stereo on playstationr note if68 the size of the earbud tips does not match the size of your ear canals or the69 headset is not worn properly in your ears you may not obtain the correct sound70 qualities or call performance change the earbud tips to ones that fit more snugly71 in your earspecific uses for product gamingpersonalstreaming personalize your72 headset lighting across the full spectrum m colors play in colors with frontfacing73 dualzone lightsync rgb lighting and choose from preset animations or create your74 own with g hub software colorful reversible suspension headbands are designed75 for comfort during long play sessions advanced mic filters that make your voice76 sound richer cleaner and more professional customize with g hub and find your77 sound hear every audio cue with breathtaking clarity and get immerse in your game78 prog drivers are designed to significantly reduce distortion and reproduce precise79 consistent rich sound quality soft duallayer memory foam that conforms to your80 head and reduces stress points for longlasting comfort console compatible playstation playstation nintendo81 switch in dock stereo sound only via usb wireless dongle frequency response hz khz82 sentences:83 - 'levis kids pajamas '84 - bright dream placemats washable easy to clean pvc placemat for kitchen table heatresistand85 woven vinyl hard table mats x inches set of blue placemats pvc and polyesterx86 inch xcm dont put tomato juice on the placemats its hard to clean uptemperature87 should not exceed washable and easy to cleanhand wash in warm soapy water and88 wipe dryif there is stains stuch in the placematuse a brush and soapy water to89 clean it no machine wash ecofriendly kitchen accessorieswashablenonfadingnonstainwipe90 clean protect your table from scratches and stains liquid can go through placemats91 clean it when finishedperfect additon to your dinner tablebeautiful stylish placemats92 to addmore fun to your kitchen table93 - outdoor portable volleyball net system adjustable height poles with soft volleyball94 ball pump hammer boundary line and carry bag for backyard beach lawn for this95 volleyball net set easy conversion for the height design for men height for96 coplay height and for women height standard volleyball net sturdy nylon97 net with strengthen polyester ropes knit together this net could durable inch98 piece steel poles with black powdercoating for the total height is official instant99 set up designed for easy use the makes each assembly step very simple set100 up this set just in minutes volleyball set for backyardlawnbeach this set includes101 standard volleyball net steel poles official size and weight volleyball balls102 and inflation pump with needle boundary line and a carry bag patent pending103- source_sentence: king queen apron set wedding engagement gifts for couples funny104 kitchen gifts for couples husband wife boyfriend girlfriend him her bridal shower105 gifts unique valentines day gifts ideas perfect gift for couples searching for106 a couples gift that is guaranteed to put glowing smiles on the faces of that special107 pair look no further whats better than give the couple a great matching apron108 of king queen to help them spending the happy cooking time together beautiful109 gift for couples parents friends fantastic gift idea for fathers day mothers day110 birthday valentines day anniversaries weddings or christmas superior quality practical couples111 aprons are made of denselywoven polyester soft breathable fabric to be used and112 enjoyed for years to come designed with adjustable neck waist straps comfortably113 fit all body shapes sizes these aprons dont just look cute they add extra fun114 to your daily routine quality time with your partner just got way better premium115 quality design and printing carefully crafted for those who appreciate distinctive116 elegance and quality our peel proof graphics are machine washable our aprons are117 built to last and waterproof and deformable these matching aprons make a perfect118 idea for valentines day gifts christmas gifts thanksgiving gifts birthday gifts119 couple gifts engagement wedding anniversary gifts or housewarming gifts gifts120 for couples who have everything king and queen apron gift set is made of denselywoven121 polyester fabrics do waterproof and stainproof it can be worn while doing housework122 gardening painting and baking our king and queen matching aprons come packaged123 in a beautiful box ready to be gifted want to be the hit of the party add to cart124 hasslefree guarantee never worry about not having a suitable choice for engagement125 wedding anniversary gifts valentines day gifts christmas gifts housewarming gifts king queen126 aprons gift set is perfect couples gifts your girlfriend boyfriend wife husband127 partner parents best friend and family members will have a great laugh we take128 pride in our king queen aprons with pockets and back these up with a lifetime129 guarantee130 sentences:131 - 'maven thread workout headbands for women wide headbands for women sports running132 headband for exercise gym hairband athletic workouts and yoga thick non slip133 sweatbands for women pack fashionable functional these headbands for women make134 the perfect accessory for a killer workout outfit or for adorable casual wear135 whether youre doing yoga playing sports running hitting the gym or simply lounging136 at home our headband will keep your hair out of the way and keep you looking fresh137 nomess sweatband a girls gotta sweat and when she does our thick headband accessories138 are ready for it this stretchy band features nonslip grip and moisturewicking139 material so no matter the sport youre playing or the exercise youre doing you140 can give it your all this hairband will wrap snugly around your head but wont141 be too tight cute designs our headbands come in a variety of cute modern designs142 that both girls and women love whether youre looking for an accessory to match143 your favorite sweats or a headband to spruce up your ponytail were sure to have144 a look youll love this basics set features darkgray headband lightgray headband navy145 headband and black headband style for any wear whether youre a nurse trying to146 keep her hair pulled back at work a runner pounding the pavement a biker hitting147 the trails or just someone looking to add a boho or athletic touch to your outfit148 these wraps are for you the cloth will keep thin straight curly or even thick149 hair back if youre going to get sweaty toss an extra headband in your purse comfort quality150 combined at maven thread we take pride in creating highquality products that are151 both stylish and durable our headbands are made of comfortable fabric with of152 blend of polyester rayon and spandex this fabric gives our bands fourway stretch153 for onesizefitsall sizing we also offer sweatbands in widths and '154 - 'disney minnie mouse girls short sleeve tshirt and shorts set for toddlers and155 big kids '156 - 'gymboree boys and toddler linen chino shorts '157- source_sentence: 'ntbay flannel fuzzy toddler blanket fluffy warm and lightweight158 reversible stripes design baby plush blanket x inches pink flannel package include x159 toddler blanket x inches product features our cozy baby blanket is made of flannel160 fabric which is skin friendly and soft the lightweight toddler blanket is not161 so thick but it can keep your baby warm and does not feel the pressure of the162 blanket weight product function the size of the baby blanket is suitable and lightweight163 which means that you can easily fold it up and pack it in bags while traveling164 our baby blanket can be a multipurpose for baby stroller covers car seat covers165 and all seasons applicable easy care machine wash cold gentle cycle only nonchlorine166 bleach when needed tumble dry low cool iron if needed satisfactory sales service167 we are so confident in the quality of our product that we offer days return and168 replacement service we also provide it with a life time free customer service169 if you find that our products have quality problems just contact us and we will170 solve the problem for you immediately '171 sentences:172 - neutrogena original fragrancefree facial cleansing bar with glycerin pure transparent173 gentle face wash bar soap free of harsh detergents dyes hardeners oz ounce neutrogena174 facial cleansing bar in original fragrancefree formula for gentle daily facial175 cleansing from a dermatologistrecommended skin care brand this pure cleansing176 bar is designed for all skin types and lathers up to remove excess oil and gently177 cleanse skin featuring the original neutrogena formula the face soap bar is glycerinrich178 to attract moisture and contains no harsh detergents dyes or hardeners that can179 irritate the skin our face cleansing bar is exceptionally cleanrinsing without180 leaving behind any poreclogging residue for clear healthierlooking skin the pure181 and gentle formula of this facial soap bar is fragrancefree hypoallergenic and182 suitable for daily use183 - 'french toast girls big vneck jumper blue gold plaid '184 - philips norelco shaver rechargeable cordless electric shaver with popup trimmer185 x with comfortcut blades you get a clean shave thats comfortable on your skin186 rounded caps shield selfsharpening blades to gently cut hair just above skin187 level and help the shaver glide smoothly over your skin d flex heads move independently188 in directions to automatically adjust to the curves of your face neck and jaw189 line popup trimmer for mustache and sideburns finish your look with the builtin190 trimmer its ideal for maintaining your mustache and trimming your sideburns at191 the touch of a button you can pop the heads open for an easy and thorough clean192 under the tap up to minutes of cordless runtime thats about shaves or plug193 it in for instant continuous power194- source_sentence: magic the gathering modern horizons bundle gift edition deluxe195 bundle with collector booster play boosters fullart lands exclusive accessories196 give the gift of magicthe perfect present for any magic fan this gift bundle is197 full of exclusive accessories and the coolest cards from modern horizons including198 a collector booster packed with rare cards shiny foils and altart altframe cards199 moderns never been more marvelousintroducing a heaping helping of exciting cards200 for modern one of magics most celebrated formats plus the return of competitive201 favorites theres something for every fan to love in modern horizons a collector202 booster full of treasuresboth powerful and flashy the included collector booster203 is packed with only the coolest cards and is the only place fans may find foiletched204 cards textured foil cards or serialized cards printed with a unique number boosters205 for playing building decksplay boosters are the best packs for playing magic206 with friends and are fun to open with a possibility of multiple rares and at least shining207 foil card in every pack fullart lands special alternateart cardevery mh bundle208 gift edition also comes with traditional foil promo card featuring bundleexclusive209 alternate art and of the included land cards feature stunning fullart foil nonfoil210 exclusive accessorieseach gift bundle also comes with exclusive accessories including211 a special die to track your life total as you play and a sturdy box to store everything212 in bundle gift edition contents collector booster play boosters traditional213 foil altart card land cards foil nonfoil spindown life counter card storage214 box and reference cards215 sentences:216 - dove men care in bar cleanser for body face and shaving extra fresh body and217 facial cleanser more moisturizing than bar soap to clean and hydrate skin ounce218 pack of hydrate your skin unlike other regular bar soap that can dry out skin219 dove mencare extra fresh body and face bar deeply cleans and hydrates skin leaving220 skin feeling smooth and comfortable from the dermatologist recommended mens brand221 this face and body bar is formulated with more moisturizer than ordinary soap222 bar and washes off easily to leave skin feeling healthy in for bar cleanser223 for body face and shaving dove mencare extra fresh body and face bar formulation224 is so hydrating and gentle on skin that you can also use it to wash your face225 or to shave refreshing clean feel clean and invigorated with this hydrating body226 cleanser and face bar and enjoy its crisp refreshing scent of mandarin citrus227 patchouli and rosemary designed for men mens skin care is different men sweat228 more have thicker skin and lose hydration faster dove mencare is specifically229 developed for mens skin to protect it against skin dryness pledge for paternity230 from the dermatologist recommended mens brand were committed to making paid paternity231 leave the new standard232 - backdrop stand xft photo video studio adjustable backdrop stand for parties wedding233 photography advertising display note balloons colorful decorations are not included234 meaningful family gathering cheerful and memorable birthday party romantic and235 warm wedding professional photography attractive advertising display and other236 uses just get ft backdrop stands adjustable stable backdrop stand loading capacity237 up to lbkg good flexibility with width ftft height ft ft heavy duty spring clamp238 and backdrop elastic string clip to holds curtains canvas muslin projector screen239 or seamless paper prevent background slippage photography weight sandbag to stabilize240 the backdrop support system note this bag comes empty its capacity is about lbub241 the kit includes pcs crossbar parts pcs tripod bracket pcs spring clamp pcs242 backdrop elastic string clip pcs sand bag pc carry bag243 - 'burts bees baby baby girls mittens noscratch mitts organic cotton set of '244---245 246# SentenceTransformer based on avsolatorio/GIST-Embedding-v0247 248This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [avsolatorio/GIST-Embedding-v0](https://huggingface.co/avsolatorio/GIST-Embedding-v0). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.249 250## Model Details251 252### Model Description253- **Model Type:** Sentence Transformer254- **Base model:** [avsolatorio/GIST-Embedding-v0](https://huggingface.co/avsolatorio/GIST-Embedding-v0) <!-- at revision bf6b2e55e92f510a570ad4d7d2da2ec8cd22590c -->255- **Maximum Sequence Length:** 512 tokens256- **Output Dimensionality:** 768 tokens257- **Similarity Function:** Cosine Similarity258<!-- - **Training Dataset:** Unknown -->259<!-- - **Language:** Unknown -->260<!-- - **License:** Unknown -->261 262### Model Sources263 264- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)265- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)266- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)267 268### Full Model Architecture269 270```271SentenceTransformer(272 (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel 273 (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})274 (2): Normalize()275)276```277 278## Usage279 280### Direct Usage (Sentence Transformers)281 282First install the Sentence Transformers library:283 284```bash285pip install -U sentence-transformers286```287 288Then you can load this model and run inference.289```python290from sentence_transformers import SentenceTransformer291 292# Download from the 🤗 Hub293model = SentenceTransformer("wjunwei/ecommerce_text_embedding")294# Run inference295sentences = [296 'magic the gathering modern horizons bundle gift edition deluxe bundle with collector booster play boosters fullart lands exclusive accessories give the gift of magicthe perfect present for any magic fan this gift bundle is full of exclusive accessories and the coolest cards from modern horizons including a collector booster packed with rare cards shiny foils and altart altframe cards moderns never been more marvelousintroducing a heaping helping of exciting cards for modern one of magics most celebrated formats plus the return of competitive favorites theres something for every fan to love in modern horizons a collector booster full of treasuresboth powerful and flashy the included collector booster is packed with only the coolest cards and is the only place fans may find foiletched cards textured foil cards or serialized cards printed with a unique number boosters for playing building decksplay boosters are the best packs for playing magic with friends and are fun to open with a possibility of multiple rares and at least shining foil card in every pack fullart lands special alternateart cardevery mh bundle gift edition also comes with traditional foil promo card featuring bundleexclusive alternate art and of the included land cards feature stunning fullart foil nonfoil exclusive accessorieseach gift bundle also comes with exclusive accessories including a special die to track your life total as you play and a sturdy box to store everything in bundle gift edition contents collector booster play boosters traditional foil altart card land cards foil nonfoil spindown life counter card storage box and reference cards',297 'backdrop stand xft photo video studio adjustable backdrop stand for parties wedding photography advertising display note balloons colorful decorations are not included meaningful family gathering cheerful and memorable birthday party romantic and warm wedding professional photography attractive advertising display and other uses just get ft backdrop stands adjustable stable backdrop stand loading capacity up to lbkg good flexibility with width ftft height ft ft heavy duty spring clamp and backdrop elastic string clip to holds curtains canvas muslin projector screen or seamless paper prevent background slippage photography weight sandbag to stabilize the backdrop support system note this bag comes empty its capacity is about lbub the kit includes pcs crossbar parts pcs tripod bracket pcs spring clamp pcs backdrop elastic string clip pcs sand bag pc carry bag',298 'burts bees baby baby girls mittens noscratch mitts organic cotton set of ',299]300embeddings = model.encode(sentences)301print(embeddings.shape)302# [3, 768]303 304# Get the similarity scores for the embeddings305similarities = model.similarity(embeddings, embeddings)306print(similarities.shape)307# [3, 3]308```309 310<!--311### Direct Usage (Transformers)312 313<details><summary>Click to see the direct usage in Transformers</summary>314 315</details>316-->317 318<!--319### Downstream Usage (Sentence Transformers)320 321You can finetune this model on your own dataset.322 323<details><summary>Click to expand</summary>324 325</details>326-->327 328<!--329### Out-of-Scope Use330 331*List how the model may foreseeably be misused and address what users ought not to do with the model.*332-->333 334<!--335## Bias, Risks and Limitations336 337*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*338-->339 340<!--341### Recommendations342 343*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*344-->345 346## Training Details347 348### Training Dataset349 350#### Unnamed Dataset351 352 353* Size: 5,864 training samples354* Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>355* Approximate statistics based on the first 1000 samples:356 | | sentence_0 | sentence_1 | label |357 |:--------|:-----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------|358 | type | string | string | int |359 | details | <ul><li>min: 5 tokens</li><li>mean: 144.3 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 5 tokens</li><li>mean: 143.08 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>0: ~87.50%</li><li>1: ~12.50%</li></ul> |360* Samples:361 | sentence_0 | sentence_1 | label |362 |:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------|363 | <code>philips norelco shaver rechargeable electric shaver with popup trimmer s comfortcut blades get a clean shave thats comfortable on your skin rounded blade caps shield selfsharpening blades to gently cut hair just above skin level and help the shaver glide smoothly over your skin experience a convenient clean shave with heads that flex and float in directions the head adjusts to the curves of your face ensuring smooth contact with your skin without a lot of pressure d flex heads follow your faces contours for a clean shave popup trimmer for mustache and sideburns finish your look with the builtin trimmer ideal for maintaining your mustache and trimming your sideburns onetouch open for easy cleaning experience a convenient clean shave with heads that flex and float in directions the head adjusts to the curves of your face ensuring smooth contact with your skin without a lot of pressure minutes of cordless shaving from an hour charge thats about shaves or plug it in for instant continuous power</code> | <code>philips norelco shaver rechargeable electric shaver with popup trimmer s comfortcut blades get a clean shave thats comfortable on your skin rounded blade caps shield selfsharpening blades to gently cut hair just above skin level and help the shaver glide smoothly over your skin experience a convenient clean shave with heads that flex and float in directions the head adjusts to the curves of your face ensuring smooth contact with your skin without a lot of pressure d flex heads follow your faces contours for a clean shave popup trimmer for mustache and sideburns finish your look with the builtin trimmer ideal for maintaining your mustache and trimming your sideburns onetouch open for easy cleaning experience a convenient clean shave with heads that flex and float in directions the head adjusts to the curves of your face ensuring smooth contact with your skin without a lot of pressure minutes of cordless shaving from an hour charge thats about shaves or plug it in for instant continuous power</code> | <code>1</code> |364 | <code>speedo girls swimsuit one piece thin straps </code> | <code>lace tulle flower girl long dress for wedding oneck princess dresses long sleeve pageant party gown </code> | <code>0</code> |365 | <code>pyrex blue cup rectangular plastic cover pc pack original genuine pyrex made in the usa genuine pyrex replacement lid nonporous surface does not absorb food odors flavors or stains refrigerator microwave and toprack dishwasher safe will not fit anchor hocking products included pyrex pc blue cup rectangle plastic lids lids only containers not included</code> | <code>kpywzer vintage leather sling bag bags for men women backpack shoulder messenger crossbody outdoor travel hiking camping tactical chest pack daypack brown </code> | <code>0</code> |366* Loss: [<code>ContrastiveTensionLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#contrastivetensionloss)367 368### Training Hyperparameters369#### Non-Default Hyperparameters370 371- `num_train_epochs`: 5372- `multi_dataset_batch_sampler`: round_robin373 374#### All Hyperparameters375<details><summary>Click to expand</summary>376 377- `overwrite_output_dir`: False378- `do_predict`: False379- `eval_strategy`: no380- `prediction_loss_only`: True381- `per_device_train_batch_size`: 8382- `per_device_eval_batch_size`: 8383- `per_gpu_train_batch_size`: None384- `per_gpu_eval_batch_size`: None385- `gradient_accumulation_steps`: 1386- `eval_accumulation_steps`: None387- `learning_rate`: 5e-05388- `weight_decay`: 0.0389- `adam_beta1`: 0.9390- `adam_beta2`: 0.999391- `adam_epsilon`: 1e-08392- `max_grad_norm`: 1393- `num_train_epochs`: 5394- `max_steps`: -1395- `lr_scheduler_type`: linear396- `lr_scheduler_kwargs`: {}397- `warmup_ratio`: 0.0398- `warmup_steps`: 0399- `log_level`: passive400- `log_level_replica`: warning401- `log_on_each_node`: True402- `logging_nan_inf_filter`: True403- `save_safetensors`: True404- `save_on_each_node`: False405- `save_only_model`: False406- `restore_callback_states_from_checkpoint`: False407- `no_cuda`: False408- `use_cpu`: False409- `use_mps_device`: False410- `seed`: 42411- `data_seed`: None412- `jit_mode_eval`: False413- `use_ipex`: False414- `bf16`: False415- `fp16`: False416- `fp16_opt_level`: O1417- `half_precision_backend`: auto418- `bf16_full_eval`: False419- `fp16_full_eval`: False420- `tf32`: None421- `local_rank`: 0422- `ddp_backend`: None423- `tpu_num_cores`: None424- `tpu_metrics_debug`: False425- `debug`: []426- `dataloader_drop_last`: False427- `dataloader_num_workers`: 0428- `dataloader_prefetch_factor`: None429- `past_index`: -1430- `disable_tqdm`: False431- `remove_unused_columns`: True432- `label_names`: None433- `load_best_model_at_end`: False434- `ignore_data_skip`: False435- `fsdp`: []436- `fsdp_min_num_params`: 0437- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}438- `fsdp_transformer_layer_cls_to_wrap`: None439- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}440- `deepspeed`: None441- `label_smoothing_factor`: 0.0442- `optim`: adamw_torch443- `optim_args`: None444- `adafactor`: False445- `group_by_length`: False446- `length_column_name`: length447- `ddp_find_unused_parameters`: None448- `ddp_bucket_cap_mb`: None449- `ddp_broadcast_buffers`: False450- `dataloader_pin_memory`: True451- `dataloader_persistent_workers`: False452- `skip_memory_metrics`: True453- `use_legacy_prediction_loop`: False454- `push_to_hub`: False455- `resume_from_checkpoint`: None456- `hub_model_id`: None457- `hub_strategy`: every_save458- `hub_private_repo`: False459- `hub_always_push`: False460- `gradient_checkpointing`: False461- `gradient_checkpointing_kwargs`: None462- `include_inputs_for_metrics`: False463- `eval_do_concat_batches`: True464- `fp16_backend`: auto465- `push_to_hub_model_id`: None466- `push_to_hub_organization`: None467- `mp_parameters`: 468- `auto_find_batch_size`: False469- `full_determinism`: False470- `torchdynamo`: None471- `ray_scope`: last472- `ddp_timeout`: 1800473- `torch_compile`: False474- `torch_compile_backend`: None475- `torch_compile_mode`: None476- `dispatch_batches`: None477- `split_batches`: None478- `include_tokens_per_second`: False479- `include_num_input_tokens_seen`: False480- `neftune_noise_alpha`: None481- `optim_target_modules`: None482- `batch_eval_metrics`: False483- `batch_sampler`: batch_sampler484- `multi_dataset_batch_sampler`: round_robin485 486</details>487 488### Training Logs489| Epoch | Step | Training Loss |490|:------:|:----:|:-------------:|491| 0.6821 | 500 | 7.4403 |492| 1.3643 | 1000 | 4.8536 |493| 2.0464 | 1500 | 3.8646 |494| 2.7285 | 2000 | 3.8877 |495| 3.4106 | 2500 | 3.8789 |496| 4.0928 | 3000 | 3.8052 |497| 4.7749 | 3500 | 3.8385 |498 499 500### Framework Versions501- Python: 3.10.12502- Sentence Transformers: 3.0.1503- Transformers: 4.41.2504- PyTorch: 2.3.0+cu121505- Accelerate: 0.31.0506- Datasets: 2.20.0507- Tokenizers: 0.19.1508 509## Citation510 511### BibTeX512 513#### Sentence Transformers514```bibtex515@inproceedings{reimers-2019-sentence-bert,516 title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",517 author = "Reimers, Nils and Gurevych, Iryna",518 booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",519 month = "11",520 year = "2019",521 publisher = "Association for Computational Linguistics",522 url = "https://arxiv.org/abs/1908.10084",523}524```525 526#### ContrastiveTensionLoss527```bibtex528@inproceedings{carlsson2021semantic,529 title={Semantic Re-tuning with Contrastive Tension},530 author={Fredrik Carlsson and Amaru Cuba Gyllensten and Evangelia Gogoulou and Erik Ylip{"a}{"a} Hellqvist and Magnus Sahlgren},531 booktitle={International Conference on Learning Representations},532 year={2021},533 url={https://openreview.net/forum?id=Ov_sMNau-PF}534}535```536 537<!--538## Glossary539 540*Clearly define terms in order to be accessible across audiences.*541-->542 543<!--544## Model Card Authors545 546*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*547-->548 549<!--550## Model Card Contact551 552*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*553-->