---
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:3999600
- loss:MultipleNegativesRankingLoss
base_model: Shuu12121/CodeModernBERT-Owl-v1
widget:
- source_sentence: 'The list of databases
Generated from protobuf field repeated .google.cloud.alloydb.v1.Database
databases = 1;
@param array<\Google\Cloud\AlloyDb\V1\Database>|\Google\Protobuf\Internal\RepeatedField
$var
@return $this'
sentences:
- "public function setDatabases($var)\n {\n $arr = GPBUtil::checkRepeatedField($var,\
\ \\Google\\Protobuf\\Internal\\GPBType::MESSAGE, \\Google\\Cloud\\AlloyDb\\V1\\\
Database::class);\n $this->databases = $arr;\n\n return $this;\n\
\ }"
- "public function toApiArray($row, $role = 'guest', $deep = true)\n {\n \
\ return $row;\n }"
- "def adapter( type = :file, *args, &block )\n adapters.add(type, *args,\
\ &block)\n end"
- source_sentence: 'Gets mention
@return \LINE\Webhook\Model\Mention|null'
sentences:
- "public final ListPhoneNumbersPagedResponse listPhoneNumbers(String parent) {\n\
\ ListPhoneNumbersRequest request =\n ListPhoneNumbersRequest.newBuilder().setParent(parent).build();\n\
\ return listPhoneNumbers(request);\n }"
- "public function getMention()\n {\n return $this->container['mention'];\n\
\ }"
- "function parse(raw, opts) {\n opts = opts || {};\n\n var preserveNumbers =\
\ opts.preserveNumbers;\n var trim = function (s) {\n return s.trim();\n \
\ };\n var obj = {};\n\n getKeyValueChunks(raw).map(trim).filter(Boolean).forEach(function\
\ (item) {\n // split with `.indexOf` rather than `.split` because the value\
\ may also contain colons.\n var pos = item.indexOf(':');\n var key = item.substr(0,\
\ pos).trim();\n var val = item.substr(pos + 1).trim();\n if (preserveNumbers\
\ && isNumeric(val)) {\n val = Number(val);\n }\n\n obj[key] = val;\n\
\ });\n\n return obj;\n}"
- source_sentence: reset clears the current state of the tree.
sentences:
- "func (a *TreeToListAdapter) reset() {\n\tcount := a.adapter.Count()\n\ta.node.descendants\
\ = count\n\ta.node.children = make([]*TreeToListNode, count)\n\tfor i := range\
\ a.node.children {\n\t\tnode := a.adapter.NodeAt(i)\n\t\titem := node.Item()\n\
\t\ta.node.children[i] = &TreeToListNode{container: node, item: item, parent:\
\ a}\n\t}\n}"
- "public void setPhases(java.util.List phases) {\n this.phases =\
\ phases;\n }"
- "protected function getJobIdsByQueue($queue)\n {\n $failer = $this->laravel['queue.failer'];\n\
\n $ids = method_exists($failer, 'ids')\n ? $failer->ids($queue)\n\
\ : collect($failer->all())\n ->where('queue', $queue)\n\
\ ->pluck('id')\n ->toArray();\n\n if (count($ids)\
\ === 0) {\n $this->components->error(\"Unable to find failed jobs\
\ for queue [{$queue}].\");\n }\n\n return $ids;\n }"
- source_sentence: Creates a new `JsNativeError` from its `kind`, `message` and (optionally)
its `cause`.
sentences:
- "public function group(array $attributes, Closure $callback)\n {\n $previousGroupAttributes\
\ = $this->groupAttributes;\n $this->groupAttributes = array_merge_recursive($previousGroupAttributes,\
\ $attributes);\n\n \\call_user_func($callback, $this);\n\n $this->groupAttributes\
\ = $previousGroupAttributes;\n }"
- "const fn new(\n kind: JsNativeErrorKind,\n message: Cow<'static,\
\ str>,\n cause: Option>,\n ) -> Self {\n Self {\n\
\ kind,\n message,\n cause,\n realm:\
\ None,\n }\n }"
- "fn column_id_to_prune(&self, name: &str) -> Option {\n let metadata\
\ = self\n .expected_metadata\n .as_ref()\n .unwrap_or_else(||\
\ self.read_format.metadata());\n metadata.column_by_name(name).map(|col|\
\ col.column_id)\n }"
- source_sentence: '#
Deletes the cluster, including the Kubernetes endpoint and all worker
nodes.
Firewalls and routes that were configured during cluster creation
are also deleted.
Other Google Compute Engine resources that might be in use by the cluster,
such as load balancer resources, are not deleted if they weren''t present
when the cluster was initially created.
@overload delete_cluster(request, options = nil)
Pass arguments to `delete_cluster` via a request object, either of type
{::Google::Cloud::Container::V1::DeleteClusterRequest} or an equivalent Hash.
@param request [::Google::Cloud::Container::V1::DeleteClusterRequest, ::Hash]
A request object representing the call parameters. Required. To specify no
parameters, or to keep all the default parameter values, pass an empty Hash.
@param options [::Gapic::CallOptions, ::Hash]
Overrides the default settings for this call, e.g, timeout, retries, etc. Optional.
@overload delete_cluster(project_id: nil, zone: nil, cluster_id: nil, name: nil)
Pass arguments to `delete_cluster` via keyword arguments. Note that at
least one keyword argument is required. To specify no parameters, or to keep all
the default parameter values, pass an empty Hash as a request object (see above).
@param project_id [::String]
Deprecated. The Google Developers Console [project ID or project
number](https://cloud.google.com/resource-manager/docs/creating-managing-projects).
This field has been deprecated and replaced by the name field.
@param zone [::String]
Deprecated. The name of the Google Compute Engine
[zone](https://cloud.google.com/compute/docs/zones#available) in which the
cluster resides. This field has been deprecated and replaced by the name
field.
@param cluster_id [::String]
Deprecated. The name of the cluster to delete.
This field has been deprecated and replaced by the name field.
@param name [::String]
The name (project, location, cluster) of the cluster to delete.
Specified in the format `projects/*/locations/*/clusters/*`.
@yield [response, operation] Access the result along with the RPC operation
@yieldparam response [::Google::Cloud::Container::V1::Operation]
@yieldparam operation [::GRPC::ActiveCall::Operation]
@return [::Google::Cloud::Container::V1::Operation]
@raise [::Google::Cloud::Error] if the RPC is aborted.
@example Basic example
require "google/cloud/container/v1"
# Create a client object. The client can be reused for multiple calls.
client = Google::Cloud::Container::V1::ClusterManager::Client.new
# Create a request. To set request fields, pass in keyword arguments.
request = Google::Cloud::Container::V1::DeleteClusterRequest.new
# Call the delete_cluster method.
result = client.delete_cluster request
# The returned object is of type Google::Cloud::Container::V1::Operation.
p result'
sentences:
- "public function getWiFiSecurityType()\n {\n if (array_key_exists(\"\
wiFiSecurityType\", $this->_propDict)) {\n if (is_a($this->_propDict[\"\
wiFiSecurityType\"], \"\\Beta\\Microsoft\\Graph\\Model\\AospDeviceOwnerWiFiSecurityType\"\
) || is_null($this->_propDict[\"wiFiSecurityType\"])) {\n return\
\ $this->_propDict[\"wiFiSecurityType\"];\n } else {\n \
\ $this->_propDict[\"wiFiSecurityType\"] = new AospDeviceOwnerWiFiSecurityType($this->_propDict[\"\
wiFiSecurityType\"]);\n return $this->_propDict[\"wiFiSecurityType\"\
];\n }\n }\n return null;\n }"
- "device(deviceType, deviceId = 0) {\n\t return new DLDevice(deviceType,\
\ deviceId, this.lib);\n\t }"
- "def delete_cluster request, options = nil\n raise ::ArgumentError,\
\ \"request must be provided\" if request.nil?\n\n request = ::Gapic::Protobuf.coerce\
\ request, to: ::Google::Cloud::Container::V1::DeleteClusterRequest\n\n \
\ # Converts hash and nil to an options object\n options =\
\ ::Gapic::CallOptions.new(**options.to_h) if options.respond_to? :to_h\n\n \
\ # Customize the options with defaults\n metadata = @config.rpcs.delete_cluster.metadata.to_h\n\
\n # Set x-goog-api-client, x-goog-user-project and x-goog-api-version\
\ headers\n metadata[:\"x-goog-api-client\"] ||= ::Gapic::Headers.x_goog_api_client\
\ \\\n lib_name: @config.lib_name, lib_version: @config.lib_version,\n\
\ gapic_version: ::Google::Cloud::Container::V1::VERSION\n \
\ metadata[:\"x-goog-api-version\"] = API_VERSION unless API_VERSION.empty?\n\
\ metadata[:\"x-goog-user-project\"] = @quota_project_id if @quota_project_id\n\
\n header_params = {}\n if request.name\n \
\ header_params[\"name\"] = request.name\n end\n\n \
\ request_params_header = header_params.map { |k, v| \"#{k}=#{v}\" }.join(\"\
&\")\n metadata[:\"x-goog-request-params\"] ||= request_params_header\n\
\n options.apply_defaults timeout: @config.rpcs.delete_cluster.timeout,\n\
\ metadata: metadata,\n \
\ retry_policy: @config.rpcs.delete_cluster.retry_policy\n\
\n options.apply_defaults timeout: @config.timeout,\n \
\ metadata: @config.metadata,\n \
\ retry_policy: @config.retry_policy\n\n \
\ @cluster_manager_stub.call_rpc :delete_cluster, request, options: options do\
\ |response, operation|\n yield response, operation if block_given?\n\
\ end\n rescue ::GRPC::BadStatus => e\n raise\
\ ::Google::Cloud::Error.from_error(e)\n end"
pipeline_tag: sentence-similarity
library_name: sentence-transformers
---
# SentenceTransformer based on Shuu12121/CodeModernBERT-Owl-v1
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Shuu12121/CodeModernBERT-Owl-v1](https://huggingface.co/Shuu12121/CodeModernBERT-Owl-v1). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [Shuu12121/CodeModernBERT-Owl-v1](https://huggingface.co/Shuu12121/CodeModernBERT-Owl-v1)
- **Maximum Sequence Length:** 1024 tokens
- **Output Dimensionality:** 768 dimensions
- **Similarity Function:** Cosine Similarity
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 1024, 'do_lower_case': False}) with Transformer model: ModernBertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
'#\nDeletes the cluster, including the Kubernetes endpoint and all worker\nnodes.\n\nFirewalls and routes that were configured during cluster creation\nare also deleted.\n\nOther Google Compute Engine resources that might be in use by the cluster,\nsuch as load balancer resources, are not deleted if they weren\'t present\nwhen the cluster was initially created.\n\n@overload delete_cluster(request, options = nil)\nPass arguments to `delete_cluster` via a request object, either of type\n{::Google::Cloud::Container::V1::DeleteClusterRequest} or an equivalent Hash.\n\n@param request [::Google::Cloud::Container::V1::DeleteClusterRequest, ::Hash]\nA request object representing the call parameters. Required. To specify no\nparameters, or to keep all the default parameter values, pass an empty Hash.\n@param options [::Gapic::CallOptions, ::Hash]\nOverrides the default settings for this call, e.g, timeout, retries, etc. Optional.\n\n@overload delete_cluster(project_id: nil, zone: nil, cluster_id: nil, name: nil)\nPass arguments to `delete_cluster` via keyword arguments. Note that at\nleast one keyword argument is required. To specify no parameters, or to keep all\nthe default parameter values, pass an empty Hash as a request object (see above).\n\n@param project_id [::String]\nDeprecated. The Google Developers Console [project ID or project\nnumber](https://cloud.google.com/resource-manager/docs/creating-managing-projects).\nThis field has been deprecated and replaced by the name field.\n@param zone [::String]\nDeprecated. The name of the Google Compute Engine\n[zone](https://cloud.google.com/compute/docs/zones#available) in which the\ncluster resides. This field has been deprecated and replaced by the name\nfield.\n@param cluster_id [::String]\nDeprecated. The name of the cluster to delete.\nThis field has been deprecated and replaced by the name field.\n@param name [::String]\nThe name (project, location, cluster) of the cluster to delete.\nSpecified in the format `projects/*/locations/*/clusters/*`.\n\n@yield [response, operation] Access the result along with the RPC operation\n@yieldparam response [::Google::Cloud::Container::V1::Operation]\n@yieldparam operation [::GRPC::ActiveCall::Operation]\n\n@return [::Google::Cloud::Container::V1::Operation]\n\n@raise [::Google::Cloud::Error] if the RPC is aborted.\n\n@example Basic example\nrequire "google/cloud/container/v1"\n\n# Create a client object. The client can be reused for multiple calls.\nclient = Google::Cloud::Container::V1::ClusterManager::Client.new\n\n# Create a request. To set request fields, pass in keyword arguments.\nrequest = Google::Cloud::Container::V1::DeleteClusterRequest.new\n\n# Call the delete_cluster method.\nresult = client.delete_cluster request\n\n# The returned object is of type Google::Cloud::Container::V1::Operation.\np result',
'def delete_cluster request, options = nil\n raise ::ArgumentError, "request must be provided" if request.nil?\n\n request = ::Gapic::Protobuf.coerce request, to: ::Google::Cloud::Container::V1::DeleteClusterRequest\n\n # Converts hash and nil to an options object\n options = ::Gapic::CallOptions.new(**options.to_h) if options.respond_to? :to_h\n\n # Customize the options with defaults\n metadata = @config.rpcs.delete_cluster.metadata.to_h\n\n # Set x-goog-api-client, x-goog-user-project and x-goog-api-version headers\n metadata[:"x-goog-api-client"] ||= ::Gapic::Headers.x_goog_api_client \\\n lib_name: @config.lib_name, lib_version: @config.lib_version,\n gapic_version: ::Google::Cloud::Container::V1::VERSION\n metadata[:"x-goog-api-version"] = API_VERSION unless API_VERSION.empty?\n metadata[:"x-goog-user-project"] = @quota_project_id if @quota_project_id\n\n header_params = {}\n if request.name\n header_params["name"] = request.name\n end\n\n request_params_header = header_params.map { |k, v| "#{k}=#{v}" }.join("&")\n metadata[:"x-goog-request-params"] ||= request_params_header\n\n options.apply_defaults timeout: @config.rpcs.delete_cluster.timeout,\n metadata: metadata,\n retry_policy: @config.rpcs.delete_cluster.retry_policy\n\n options.apply_defaults timeout: @config.timeout,\n metadata: @config.metadata,\n retry_policy: @config.retry_policy\n\n @cluster_manager_stub.call_rpc :delete_cluster, request, options: options do |response, operation|\n yield response, operation if block_given?\n end\n rescue ::GRPC::BadStatus => e\n raise ::Google::Cloud::Error.from_error(e)\n end',
'device(deviceType, deviceId = 0) {\n\t return new DLDevice(deviceType, deviceId, this.lib);\n\t }',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 3,999,600 training samples
* Columns: sentence_0, sentence_1, and label
* Approximate statistics based on the first 1000 samples:
| | sentence_0 | sentence_1 | label |
|:--------|:------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------|:--------------------------------------------------------------|
| type | string | string | float |
| details | - min: 8 tokens
- mean: 74.13 tokens
- max: 1024 tokens
| - min: 13 tokens
- mean: 154.33 tokens
- max: 1024 tokens
| - min: 1.0
- mean: 1.0
- max: 1.0
|
* Samples:
| sentence_0 | sentence_1 | label |
|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
| Set the column title
@param column - column number (first column is: 0)
@param title - new column title | setHeader = function(column, newValue) {
const obj = this;
if (obj.headers[column]) {
const oldValue = obj.headers[column].textContent;
const onchangeheaderOldValue = (obj.options.columns && obj.options.columns[column] && obj.options.columns[column].title) || '';
if (! newValue) {
newValue = getColumnName(column);
}
obj.headers[column].textContent = newValue;
// Keep the title property
obj.headers[column].setAttribute('title', newValue);
// Update title
if (!obj.options.columns) {
obj.options.columns = [];
}
if (!obj.options.columns[column]) {
obj.options.columns[column] = {};
}
obj.options.columns[column].title = newValue;
setHistory.call(obj, {
action: 'setHeader',
column: column,
oldValue: oldValue,
newValue: newValue
});
// On onchange header
dispatch.c... | 1.0 |
| Elsewhere this is known as a "Weak Value Map". Whereas a std JS WeakMap
is weak on its keys, this map is weak on its values. It does not retain these
values strongly. If a given value disappears, then the entries for it
disappear from every weak-value-map that holds it as a value.
Just as a WeakMap only allows gc-able values as keys, a weak-value-map
only allows gc-able values as values.
Unlike a WeakMap, a weak-value-map unavoidably exposes the non-determinism of
gc to its clients. Thus, both the ability to create one, as well as each
created one, must be treated as dangerous capabilities that must be closely
held. A program with access to these can read side channels though gc that do
not* rely on the ability to measure duration. This is a separate, and bad,
timing-independent side channel.
This non-determinism also enables code to escape deterministic replay. In a
blockchain context, this could cause validators to differ from each other,
preventing consensus, and thus preventing ... | makeFinalizingMap = (finalizer, opts) => {
const { weakValues = false } = opts || {};
if (!weakValues || !WeakRef || !FinalizationRegistry) {
/** @type Map */
const keyToVal = new Map();
return Far('fakeFinalizingMap', {
clearWithoutFinalizing: keyToVal.clear.bind(keyToVal),
get: keyToVal.get.bind(keyToVal),
has: keyToVal.has.bind(keyToVal),
set: (key, val) => {
keyToVal.set(key, val);
},
delete: keyToVal.delete.bind(keyToVal),
getSize: () => keyToVal.size,
});
}
/** @type Map> */
const keyToRef = new Map();
const registry = new FinalizationRegistry(key => {
// Because this will delete the current binding of `key`, we need to
// be sure that it is not called because a previous binding was collected.
// We do this with the `unregister` in `set` below, assuming that
// `unregister` *immediately* suppresses the finalization of the thing
// it unregisters. TODO If this is... | 1.0 |
| Creates a function that memoizes the result of `func`. If `resolver` is
provided, it determines the cache key for storing the result based on the
arguments provided to the memoized function. By default, the first argument
provided to the memoized function is used as the map cache key. The `func`
is invoked with the `this` binding of the memoized function.
**Note:** The cache is exposed as the `cache` property on the memoized
function. Its creation may be customized by replacing the `_.memoize.Cache`
constructor with one whose instances implement the
[`Map`](http://ecma-international.org/ecma-262/6.0/#sec-properties-of-the-map-prototype-object)
method interface of `delete`, `get`, `has`, and `set`.
@static
@memberOf _
@since 0.1.0
@category Function
@param {Function} func The function to have its output memoized.
@param {Function} [resolver] The function to resolve the cache key.
@returns {Function} Returns the new memoized function.
@example
var object = { 'a': 1, 'b': 2 };
var othe... | function memoize(func, resolver) {
if (typeof func != 'function' || (resolver && typeof resolver != 'function')) {
throw new TypeError(FUNC_ERROR_TEXT);
}
var memoized = function() {
var args = arguments,
key = resolver ? resolver.apply(this, args) : args[0],
cache = memoized.cache;
if (cache.has(key)) {
return cache.get(key);
}
var result = func.apply(this, args);
memoized.cache = cache.set(key, result);
return result;
};
memoized.cache = new (memoize.Cache || MapCache);
return memoized;
} | 1.0 |
* Loss: [MultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `per_device_train_batch_size`: 150
- `per_device_eval_batch_size`: 150
- `num_train_epochs`: 1
- `fp16`: True
- `multi_dataset_batch_sampler`: round_robin
#### All Hyperparameters
Click to expand
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: no
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 150
- `per_device_eval_batch_size`: 150
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1
- `num_train_epochs`: 1
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.0
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: True
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: None
- `hub_always_push`: False
- `hub_revision`: None
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `include_for_metrics`: []
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `use_liger_kernel`: False
- `liger_kernel_config`: None
- `eval_use_gather_object`: False
- `average_tokens_across_devices`: False
- `prompts`: None
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: round_robin