elplaguister/patent_classifier_nemotron_v1.1
054
SentenceTransformer based on nvidia/Nemotron-3-Embed-1B-BF16
This is a sentence-transformers model finetuned from nvidia/Nemotron-3-Embed-1B-BF16. It maps sentences & paragraphs to a 2048-dimensional dense vector space and can be used for retrieval.
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformersThen you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the π€ Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
queries = [
'query: λ³Έ λ°λͺ
μ μμκ°μ§μ₯μΉμ κ΄ν κ²μΌλ‘,...',
]
documents = [
'passage: κΈ°κ³:κΈ°κ³ λΆμΌλ μν...',
'passage: 건μ€/κ΅ν΅:건μ€/κ΅ν΅ λΆμΌλ μΈνλΌ κ°λ°...',
'passage: λλ¦Όμμ°μν:λλ¦Όμμ°μν λΆμΌλ λμ
, μμ
...',
]
query_embeddings = model.encode_query(queries)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings.shape)
# [1, 2048] [3, 2048]
# Get the similarity scores for the embeddings
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
# tensor([[0.4402, 0.1592, 0.1305]])Training Details
Training Dataset
Unnamed Dataset
- Size: 1,703 training samples
- Columns: <code>anchor</code> and <code>positive</code>
- Approximate statistics based on the first 100 samples: | | anchor | positive | |:---------|:------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------| | type | string | string | | modality | text | text | | details | <ul><li>min: 1090 tokens</li><li>mean: 4299.41 tokens</li><li>max: 14370 tokens</li></ul> | <ul><li>min: 300 tokens</li><li>mean: 371.75 tokens</li><li>max: 494 tokens</li></ul> |
- Loss: <code>CachedMultipleNegativesRankingLoss</code> with these parameters:
{
"scale": 20.0,
"similarity_fct": "cos_sim",
"mini_batch_size": 8,
"gather_across_devices": true,
"directions": [
"query_to_doc"
],
"partition_mode": "joint",
"hardness_mode": null,
"hardness_strength": 0.0
}Training Hyperparameters
Non-Default Hyperparameters
per_device_train_batch_size: 32learning_rate: 2e-05warmup_steps: 0.1weight_decay: 0.01bf16: Truetf32: Truegradient_checkpointing: Truedataloader_num_workers: 4remove_unused_columns: Falsebatch_sampler: no_duplicates
All Hyperparameters
<details><summary>Click to expand</summary>
per_device_train_batch_size: 32num_train_epochs: 3max_steps: -1learning_rate: 2e-05lr_scheduler_type: linearlr_scheduler_kwargs: Nonewarmup_steps: 0.1optim: adamwtorchfusedoptim_args: Noneweight_decay: 0.01adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08optim_target_modules: Nonegradient_accumulation_steps: 1average_tokens_across_devices: Truemax_grad_norm: 1.0label_smoothing_factor: 0.0bf16: Truefp16: Falsebf16_full_eval: Falsefp16_full_eval: Falsetf32: Truegradient_checkpointing: Truegradient_checkpointing_kwargs: Nonetorch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneuse_liger_kernel: Falseliger_kernel_config: Noneuse_cache: Falseneftune_noise_alpha: Nonetorch_empty_cache_steps: Noneauto_find_batch_size: Falselog_on_each_node: Truelogging_nan_inf_filter: Trueinclude_num_input_tokens_seen: nolog_level: passivelog_level_replica: warningdisable_tqdm: Falseproject: huggingfacetrackio_space_id: Nonetrackio_bucket_id: Nonetrackio_static_space_id: Noneper_device_eval_batch_size: 8prediction_loss_only: Trueeval_on_start: Falseeval_do_concat_batches: Trueeval_use_gather_object: Falseeval_accumulation_steps: Noneinclude_for_metrics: []batch_eval_metrics: Falsesave_only_model: Falsesave_on_each_node: Falseenable_jit_checkpoint: Falsepush_to_hub: Falsehub_private_repo: Nonehub_model_id: Nonehub_strategy: every_savehub_always_push: Falsehub_revision: Noneload_best_model_at_end: Falseignore_data_skip: Falserestore_callback_states_from_checkpoint: Falsefull_determinism: Falseseed: 42data_seed: Noneuse_cpu: Falseaccelerator_config: {'splitbatches': False, 'dispatchbatches': None, 'evenbatches': True, 'useseedablesampler': True, 'nonblocking': False, 'gradientaccumulationkwargs': None}parallelism_config: Nonedataloader_drop_last: Truedataloader_num_workers: 4dataloader_pin_memory: Truedataloader_persistent_workers: Falsedataloader_prefetch_factor: Noneremove_unused_columns: Falselabel_names: Nonetrain_sampling_strategy: randomlength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falseddp_static_graph: Noneddp_backend: Noneddp_timeout: 1800fsdp: Nonefsdp_config: Nonedeepspeed: Nonedebug: []skip_memory_metrics: Truedo_predict: Falseresume_from_checkpoint: Nonewarmup_ratio: Nonelocal_rank: -1prompts: Nonebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportionalrouter_mapping: {}learning_rate_mapping: {}
Framework Versions
- Python: 3.12.3
- Sentence Transformers: 5.6.1
- Transformers: 5.14.1
- PyTorch: 2.8.0+cu128
- Accelerate: 1.10.1
- Datasets: 3.6.0
- Tokenizers: 0.22.2
