Add files using upload-large-folder tool

README.md

@@ -0,0 +1,276 @@
+---
+language:
+- en
+- fr
+- de
+- es
+- it
+- pt
+- zh
+- ja
+- ru
+- ko
+license: other
+license_name: mrl
+inference: false
+license_link: https://mistral.ai/licenses/MRL-0.1.md
+extra_gated_prompt: '# Mistral AI Research License
+
+  If You want to use a Mistral Model, a Derivative or an Output for any purpose that
+  is not expressly authorized under this Agreement, You must request a license from
+  Mistral AI, which Mistral AI may grant to You in Mistral AI''s sole discretion.
+  To discuss such a license, please contact Mistral AI via the website contact form:
+  https://mistral.ai/contact/
+
+  ## 1. Scope and acceptance
+
+  **1.1. Scope of the Agreement.** This Agreement applies to any use, modification,
+  or Distribution of any Mistral Model by You, regardless of the source You obtained
+  a copy of such Mistral Model.
+
+  **1.2. Acceptance.** By accessing, using, modifying, Distributing a Mistral Model,
+  or by creating, using or distributing a Derivative of the Mistral Model, You agree
+  to be bound by this Agreement.
+
+  **1.3. Acceptance on behalf of a third-party.** If You accept this Agreement on
+  behalf of Your employer or another person or entity, You warrant and represent that
+  You have the authority to act and accept this Agreement on their behalf. In such
+  a case, the word "You" in this Agreement will refer to Your employer or such other
+  person or entity.
+
+  ## 2. License
+
+  **2.1. Grant of rights**.  Subject to Section 3 below, Mistral AI hereby grants
+  You a non-exclusive, royalty-free, worldwide, non-sublicensable, non-transferable,
+  limited license to use, copy, modify, and Distribute under the conditions provided
+  in Section 2.2 below, the Mistral Model and any Derivatives made by or for Mistral
+  AI and to create Derivatives of the Mistral Model.
+
+  **2.2. Distribution of Mistral Model and Derivatives made by or for Mistral AI.**
+  Subject to Section 3 below, You may Distribute copies of the Mistral Model and/or
+  Derivatives made by or for Mistral AI, under the following conditions: You must
+  make available a copy of this Agreement to third-party recipients of the Mistral
+  Models and/or Derivatives made by or for Mistral AI you Distribute, it being specified
+  that any rights to use the Mistral Models and/or Derivatives made by or for Mistral
+  AI shall be directly granted by Mistral AI to said third-party recipients pursuant
+  to the Mistral AI Research License agreement executed between these parties; You
+  must retain in all copies of the Mistral Models the following attribution notice
+  within a "Notice" text file distributed as part of such copies: "Licensed by Mistral
+  AI under the Mistral AI Research License".
+
+  **2.3. Distribution of Derivatives made by or for You.** Subject to Section 3 below,
+  You may Distribute any Derivatives made by or for You under additional or different
+  terms and conditions, provided that: In any event, the use and modification of Mistral
+  Model and/or Derivatives made by or for Mistral AI shall remain governed by the
+  terms and conditions of this Agreement; You include in any such Derivatives made
+  by or for You prominent notices stating that You modified the concerned Mistral
+  Model; and Any terms and conditions You impose on any third-party recipients relating
+  to Derivatives made by or for You shall neither limit such third-party recipients''
+  use of the Mistral Model or any Derivatives made by or for Mistral AI in accordance
+  with the Mistral AI Research License nor conflict with any of its terms and conditions.
+
+  ## 3. Limitations
+
+  **3.1. Misrepresentation.** You must not misrepresent or imply, through any means,
+  that the Derivatives made by or for You and/or any modified version of the Mistral
+  Model You Distribute under your name and responsibility is an official product of
+  Mistral AI or has been endorsed, approved or validated by Mistral AI, unless You
+  are authorized by Us to do so in writing.
+
+  **3.2. Usage Limitation.** You shall only use the Mistral Models, Derivatives (whether
+  or not created by Mistral AI) and Outputs for Research Purposes.
+
+  ## 4. Intellectual Property
+
+  **4.1. Trademarks.** No trademark licenses are granted under this Agreement, and
+  in connection with the Mistral Models, You may not use any name or mark owned by
+  or associated with Mistral AI or any of its affiliates, except (i) as required for
+  reasonable and customary use in describing and Distributing the Mistral Models and
+  Derivatives made by or for Mistral AI and (ii) for attribution purposes as required
+  by this Agreement.
+
+  **4.2. Outputs.** We claim no ownership rights in and to the Outputs. You are solely
+  responsible for the Outputs You generate and their subsequent uses in accordance
+  with this Agreement. Any Outputs shall be subject to the restrictions set out in
+  Section 3 of this Agreement.
+
+  **4.3. Derivatives.** By entering into this Agreement, You accept that any Derivatives
+  that You may create or that may be created for You shall be subject to the restrictions
+  set out in Section 3 of this Agreement.
+
+  ## 5. Liability
+
+  **5.1. Limitation of liability.** In no event, unless required by applicable law
+  (such as deliberate and grossly negligent acts) or agreed to in writing, shall Mistral
+  AI be liable to You for damages, including any direct, indirect, special, incidental,
+  or consequential damages of any character arising as a result of this Agreement
+  or out of the use or inability to use the Mistral Models and Derivatives (including
+  but not limited to damages for loss of data, loss of goodwill, loss of expected
+  profit or savings, work stoppage, computer failure or malfunction, or any damage
+  caused by malware or security breaches), even if  Mistral AI has been advised of
+  the possibility of such damages.
+
+  **5.2. Indemnification.** You agree to indemnify and hold harmless Mistral AI from
+  and against any claims, damages, or losses arising out of or related to Your use
+  or Distribution of the Mistral Models and Derivatives.
+
+  ## 6. Warranty
+
+  **6.1. Disclaimer.** Unless required by applicable law or prior agreed to by Mistral
+  AI in writing, Mistral AI provides the Mistral Models and Derivatives on an "AS
+  IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied,
+  including, without limitation, any warranties or conditions of TITLE, NON-INFRINGEMENT,
+  MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. Mistral AI does not represent
+  nor warrant that the Mistral Models and Derivatives will be error-free, meet Your
+  or any third party''s requirements, be secure or will allow You or any third party
+  to achieve any kind of result or generate any kind of content. You are solely responsible
+  for determining the appropriateness of using or Distributing the Mistral Models
+  and Derivatives and assume any risks associated with Your exercise of rights under
+  this Agreement.
+
+  ## 7. Termination
+
+  **7.1. Term.** This Agreement is effective as of the date of your acceptance of
+  this Agreement or access to the concerned Mistral Models or Derivatives and will
+  continue until terminated in accordance with the following terms.
+
+  **7.2. Termination.** Mistral AI may terminate this Agreement at any time if You
+  are in breach of this Agreement. Upon termination of this Agreement, You must cease
+  to use all Mistral Models and Derivatives and shall permanently delete any copy
+  thereof. The following provisions, in their relevant parts, will survive any termination
+  or expiration of this Agreement, each for the duration necessary to achieve its
+  own intended purpose (e.g. the liability provision will survive until the end of
+  the applicable limitation period):Sections 5 (Liability), 6(Warranty), 7 (Termination)
+  and 8 (General Provisions).
+
+  **7.3. Litigation.** If You initiate any legal action or proceedings against Us
+  or any other entity (including a cross-claim or counterclaim in a lawsuit), alleging
+  that the Model or a Derivative, or any part thereof, infringe upon intellectual
+  property or other rights owned or licensable by You, then any licenses granted to
+  You under this Agreement will immediately terminate as of the date such legal action
+  or claim is filed or initiated.
+
+  ## 8. General provisions
+
+  **8.1. Governing laws.** This Agreement will be governed by the laws of France,
+  without regard to choice of law principles, and the UN Convention on Contracts for
+  the International Sale of Goods does not apply to this Agreement.
+
+  **8.2. Competent jurisdiction.** The courts of Paris shall have exclusive jurisdiction
+  of any dispute arising out of this Agreement.
+
+  **8.3. Severability.** If any provision of this Agreement is held to be invalid,
+  illegal or unenforceable, the remaining provisions shall be unaffected thereby and
+  remain valid as if such provision had not been set forth herein.
+
+  ## 9. Definitions
+
+  "Agreement": means this Mistral AI Research License agreement governing the access,
+  use, and Distribution of the Mistral Models, Derivatives and Outputs.
+
+  "Derivative": means any (i) modified version of the Mistral Model (including but
+  not limited to any customized or fine-tuned version thereof), (ii) work based on
+  the Mistral Model, or (iii) any other derivative work thereof.
+
+  "Distribution", "Distributing", "Distribute" or "Distributed": means supplying,
+  providing or making available, by any means, a copy of the Mistral Models and/or
+  the Derivatives as the case may be, subject to Section 3 of this Agreement.
+
+  "Mistral AI", "We" or "Us": means Mistral AI, a French société par actions simplifiée
+  registered in the Paris commercial registry under the number 952 418 325, and having
+  its registered seat at 15, rue des Halles, 75001 Paris.
+
+  "Mistral Model": means the foundational large language model(s), and its elements
+  which include algorithms, software, instructed checkpoints, parameters, source code
+  (inference code, evaluation code and, if applicable, fine-tuning code) and any other
+  elements associated thereto made available by Mistral AI under this Agreement, including,
+  if any, the technical documentation, manuals and instructions for the use and operation
+  thereof.
+
+  "Research Purposes": means any use of a Mistral Model,  Derivative, or Output that
+  is solely for (a) personal, scientific or academic research, and (b) for non-profit
+  and non-commercial purposes, and not directly or indirectly connected to any commercial
+  activities or business operations. For illustration purposes, Research Purposes
+  does not include (1) any usage of the Mistral Model, Derivative or Output by individuals
+  or contractors employed in or engaged by companies in the context of (a) their daily
+  tasks, or (b) any activity (including but not limited to any testing or proof-of-concept)
+  that is intended to generate revenue, nor (2) any Distribution by a commercial entity
+  of the Mistral Model, Derivative or Output whether in return for payment or free
+  of charge, in any medium or form, including but not limited to through a hosted
+  or managed service (e.g. SaaS, cloud instances, etc.), or behind a software layer.
+
+  "Outputs": means any content generated by the operation of the Mistral Models or
+  the Derivatives from  a prompt (i.e., text instructions) provided by users. For
+  the avoidance of doubt, Outputs do not include any components of a Mistral Models,
+  such as any fine-tuned versions of the Mistral Models, the weights, or parameters.
+
+  "You": means the individual or entity entering into this Agreement with Mistral
+  AI.
+
+
+  *Mistral AI processes your personal data below to provide the model and enforce
+  its license. If you are affiliated with a commercial entity, we may also send you
+  communications about our models. For more information on your rights and data handling,
+  please see our <a href="https://mistral.ai/terms/">privacy policy</a>.*'
+extra_gated_fields:
+  First Name: text
+  Last Name: text
+  Country: country
+  Affiliation: text
+  Job title: text
+  I understand that I can only use the model, any derivative versions and their outputs for non-commercial research purposes: checkbox
+  ? I understand that if I am a commercial entity, I am not permitted to use or distribute
+    the model internally or externally, or expose it in my own offerings without a
+    commercial license
+  : checkbox
+  ? I understand that if I upload the model, or any derivative version, on any platform,
+    I must include the Mistral Research License
+  : checkbox
+  ? I understand that for commercial use of the model, I can contact Mistral or use
+    the Mistral AI API on la Plateforme or any of our cloud provider partners
+  : checkbox
+  ? By clicking Submit below I accept the terms of the license and acknowledge that
+    the information I provide will be collected stored processed and shared in accordance
+    with the Mistral Privacy Policy
+  : checkbox
+  geo: ip_location
+extra_gated_description: Mistral AI processes your personal data below to provide
+  the model and enforce its license. If you are affiliated with a commercial entity,
+  we may also send you communications about our models. For more information on your
+  rights and data handling, please see our <a href="https://mistral.ai/terms/">privacy
+  policy</a>.
+extra_gated_button_content: Submit
+library_name: mlx
+tags:
+- mlx
+base_model: mistralai/Mistral-Large-Instruct-2411
+pipeline_tag: text-generation
+---
+
+# sjug/Mistral-Large-Instruct-2411-8bit
+
+This model [sjug/Mistral-Large-Instruct-2411-8bit](https://huggingface.co/sjug/Mistral-Large-Instruct-2411-8bit) was
+converted to MLX format from [mistralai/Mistral-Large-Instruct-2411](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411)
+using mlx-lm version **0.23.2**.
+
+## Use with mlx
+
+```bash
+pip install mlx-lm
+```
+
+```python
+from mlx_lm import load, generate
+
+model, tokenizer = load("sjug/Mistral-Large-Instruct-2411-8bit")
+
+prompt = "hello"
+
+if tokenizer.chat_template is not None:
+    messages = [{"role": "user", "content": prompt}]
+    prompt = tokenizer.apply_chat_template(
+        messages, add_generation_prompt=True
+    )
+
+response = generate(model, tokenizer, prompt=prompt, verbose=True)
+```

config.json

@@ -0,0 +1,33 @@
+{
+    "architectures": [
+        "MistralForCausalLM"
+    ],
+    "attention_dropout": 0.0,
+    "bos_token_id": 1,
+    "eos_token_id": 2,
+    "head_dim": 128,
+    "hidden_act": "silu",
+    "hidden_size": 12288,
+    "initializer_range": 0.02,
+    "intermediate_size": 28672,
+    "max_position_embeddings": 131072,
+    "model_type": "mistral",
+    "num_attention_heads": 96,
+    "num_hidden_layers": 88,
+    "num_key_value_heads": 8,
+    "quantization": {
+        "group_size": 32,
+        "bits": 8
+    },
+    "quantization_config": {
+        "group_size": 32,
+        "bits": 8
+    },
+    "rms_norm_eps": 1e-05,
+    "rope_theta": 1000000.0,
+    "sliding_window": null,
+    "tie_word_embeddings": false,
+    "transformers_version": "4.46.2",
+    "use_cache": true,
+    "vocab_size": 32768
+}

model-00001-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:14fd1c378dc544b1a627570d4192b60ffa780f3a92c125006be808ce303cea20
+size 5322728466

model-00002-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5343636b227fd147b9a451408a77e8b975be1596e6a337030680ed4f343387a6
+size 5237793172

model-00003-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c231e4fcff28015b4eeec8463654d8855f8d46e5eed42402107059d2a4564b47
+size 5067923507

model-00004-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77b2a656e6267bdbbc150ddefac482ee4d85d79da4c9b4a3b889b0e648cf038b
+size 5266154845

model-00005-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e872235fb064adea7fd8e7ae23647247c47c98d9770a505a3599dff0c6dec8f5
+size 5237793253

model-00006-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd7b274f8501a59718f3407b8c220746e4a8da9300ed0840def872d8fb2a72a7
+size 5067923573

model-00007-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:734602cbac5c57885a0cc5a44b3fe0a2f1b84995ab1e187ba8573883872d22be
+size 5266154840

model-00008-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c8e462b6ee7598e17b07e61ca84b54d20c5173ff891df32e175b2519ac603420
+size 5237793243

model-00009-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4701c5f2d64f1c7d09f925951c0c0761f4df259df95308d50917282492f0ad52
+size 5067923587

model-00010-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea53edc645835f685e3df62c6384e78b8ba06c83152947176d522b2fc0a28112
+size 5266154848

model-00011-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:11307070992b974b36188bb05cdb0ac32a361011bd826108af1f8ed0bfc0030b
+size 5237793233

model-00012-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd1cf5e6849d5e964585b2d47cbbf1689290864c9c3ecd12fbe528edc619666c
+size 5067923579

model-00013-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f496fefefb11f537fa4864c27a0cbf5b02edfaa36be3a8e8a0ace3c72e0410d1
+size 5266154850

model-00014-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f201d5ab5a17629abb924356836b6ea989beaf34acfeca9897543404e3097b2e
+size 5237793241

model-00015-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95f7c0581c69baa96d0e32fbdaf02de26908c3793cd9b43b1791003307acb519
+size 5067923581

model-00016-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b4f43135b4fd819116ebd4bdbaa4b0b3b344aa49ca3de488fb9228261ccc123
+size 5266154848

model-00017-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b49a964c01d25cad7ab9c478997134786c5bacdc1821f3be44339710f2a770e2
+size 5237793247

model-00018-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40036af7a82db83a2a0a8c4906f8b0946e6da8e94deeb1d789bc8a528745a858
+size 5067923591

model-00019-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d98101db2edec930689190676a20adb37e673d6094e08a9be8ea8e7720b52cac
+size 5266154846

model-00020-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dadd9fe81a0ab228a20be324897b944e24d5aa042afbabd65d8b83733393d223
+size 5237793247

model-00021-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26f66dac04b943f4566f9a3eb1b1feee20017ff84f5b11443421379c88e51200
+size 5067923577

model-00022-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a7edc5113331c689e6825a5878b1c5210144a92a81258713a107d960fad2a413
+size 5266154864

model-00023-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:148b26358e0e14531ee5f1808863c099aefbdaa7ae4b2ce83cd94e96d2f175ae
+size 5237793249

model-00024-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9fffbbfc046906d16358e5e9f4490a2c7a913c70edb59f4361094109a705012
+size 5067923551

model-00025-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5bb8941b489491b1997bef71ae6cde2a1099d10e6d33b1053abce46063aa95cb
+size 5266154870

model-00026-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:805dafa03d43536c0c696fdb5e9297eef5a2cd77085590230de44fdf6c8240c3
+size 5237793241

model-00027-of-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eed8a8cd65b71c618d97d9e718d7f6d7c80bbdaf494812c6394821cf40eed72a
+size 2802970467

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b968b8dc352f42192367337c78ccc61e1eaddc6d641a579372d4f20694beb7a
+size 587562