measurement.json

README.md

@@ -0,0 +1,149 @@
+---
+library_name: transformers
+license: apache-2.0
+language:
+- en
+widget:
+- example_title: Reasoning
+  text: >
+    <|im_start|>system
+
+    You are Hyperion, an AI assistant developed by Sebastian Gabarain with a
+    focus in reasoning, coding, science, and other general-purpose subjects. You
+    are an AI assistant that follows instruction extremely well. Help as much as
+    you can.
+
+    <|im_end|>
+
+    <|im_start|>user
+
+    In this task, you are given a description of an object and its surroundings.
+    Your
+
+    task is to describe the motion of the object mentioned in the description
+    using
+
+    differential equations. The answer should be a mathematical expression in t.
+    Description:
+
+    A ball is thrown up at 30 ft/sec from 3 feet off the ground. Solve this
+    step-by-step,
+
+    explaining each step in detail.
+
+    <|im_end|>
+
+    <|im_start|>assistant
+  output:
+    text: >
+      Hyperion here. The task requires you to describe the motion of a ball
+      thrown up using differential equations. Here's the detailed explanation of
+      how to solve it:
+
+
+      1. Identify the given information:
+         - Initial velocity (v0): 30 ft/sec
+         - Initial height (y0): 3 feet off the ground
+
+      2. Determine the acceleration due to gravity (g) at sea level, which is
+      approximately -32.2 ft/s^2. Since we're dealing with a short distance and
+      not very high altitudes, we can consider this value of g as constant.
+
+
+      3. Use Newton's second law of motion to find the differential equation
+      that describes the motion:
+         - The net force acting on the ball is the sum of gravity (mg) and air resistance (which we will neglect for simplicity). So, Fnet = mg.
+         - Since acceleration equals force divided by mass, a = Fnet/m. In this case, m cancels out, so a = g.
+         - The motion equation becomes: dv/dt = g = -32.2 ft/s^2 (since we're moving upwards). This is the first differential equation.
+
+      4. Since we want to describe the ball's position (y) as well, we need
+      another differential equation. We can use kinematics equations:
+         - The velocity equation is v = v0 + at. Substitute the value of a from step 3:
+           dv/dt = -32.2 ft/s^2. Rewriting it as an integral:
+            ∫dv = -32.2 ft/s^2 * dt
+         - Integrating with respect to time, we get v(t) = -16.1 t + C (constant of integration).
+
+      5. Now we have two equations, one for velocity and another for position:
+         - dv/dt = -32.2 ft/s^2 (equation 1)
+         - v(t) = -16.1 t + C (equation 2)
+
+      6. We need to find the constant C using the initial conditions given in
+      the problem. We know that initially, at time t=0, the ball's velocity is
+      v0:
+         - Equation 2 becomes v0 = -16.1 * 0 + C, which simplifies to C = v0 = 30 ft/sec (initial velocity).
+
+      7. Now we have both equations with the constants filled in:
+         - dv/dt = -32.2 ft/s^2 (equation 1)
+         - v(t) = -16.1 t + 30 ft/sec (equation 2)
+
+      8. Finally, we need to find the ball's position (y) as a function of time:
+         - Use the second kinematics equation y = y0 + v0*t + ½*a*t^2 (since acceleration is constant, it can be moved outside the integral).
+         - Substitute the values for v0 and a:
+           y(t) = 3 ft + (30 ft/sec) * t + (-½ * 32.2 ft/s^2) * t^2
+
+      That's it! The differential equation describing the motion of the ball is:
+         - dv/dt = -32.2 ft/s^2 (equation 1)
+         - v(t) = -16.1 t + 30 ft/sec (equation 2)
+         - y(t) = 3 ft + (30 ft/sec) * t - (16.1 t^2) ft (equation 3)
+datasets:
+- Locutusque/hyperion-dpo-v1.0
+quantized_by: bartowski
+pipeline_tag: text-generation
+---
+
+## Exllama v2 Quantizations of Hyperion-3.0-Mistral-7B-DPO
+
+Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.0.16">turboderp's ExLlamaV2 v0.0.16</a> for quantization.
+
+<b>The "main" branch only contains the measurement.json, download one of the other branches for the model (see below)</b>
+
+Each branch contains an individual bits per weight, with the main one containing only the meaurement.json for further conversions.
+
+Original model: https://huggingface.co/Locutusque/Hyperion-3.0-Mistral-7B-DPO
+
+| Branch | Bits | lm_head bits | VRAM (4k) | VRAM (16k) | VRAM (32k) | Description |
+| ----- | ---- | ------- | ------ | ------ | ------ | ------------ |
+| [8_0](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2/tree/8_0) | 8.0 | 8.0 | 8.4 GB | 9.8 GB | 11.8 GB | Maximum quality that ExLlamaV2 can produce, near unquantized performance. |
+| [6_5](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2/tree/6_5) | 6.5 | 8.0 | 7.2 GB | 8.6 GB | 10.6 GB | Very similar to 8.0, good tradeoff of size vs performance, **recommended**. |
+| [5_0](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2/tree/5_0) | 5.0 | 6.0 | 6.0 GB | 7.4 GB |  9.4 GB | Slightly lower quality vs 6.5, but usable on 8GB cards. |
+| [4_25](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2/tree/4_25) | 4.25 | 6.0 | 5.3 GB | 6.7 GB | 8.7 GB | GPTQ equivalent bits per weight, slightly higher quality. |
+| [3_5](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2/tree/3_5) | 3.5 | 6.0 | 4.7 GB | 6.1 GB | 8.1 GB | Lower quality, only use if you have to. |
+
+## Download instructions
+
+With git:
+
+```shell
+git clone --single-branch --branch 6_5 https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2 Hyperion-3.0-Mistral-7B-DPO-exl2-6_5
+```
+
+With huggingface hub (credit to TheBloke for instructions):
+
+```shell
+pip3 install huggingface-hub
+```
+
+To download the `main` (only useful if you only care about measurement.json) branch to a folder called `Hyperion-3.0-Mistral-7B-DPO-exl2`:
+
+```shell
+mkdir Hyperion-3.0-Mistral-7B-DPO-exl2
+huggingface-cli download bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2 --local-dir Hyperion-3.0-Mistral-7B-DPO-exl2 --local-dir-use-symlinks False
+```
+
+To download from a different branch, add the `--revision` parameter:
+
+Linux:
+
+```shell
+mkdir Hyperion-3.0-Mistral-7B-DPO-exl2-6_5
+huggingface-cli download bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2 --revision 6_5 --local-dir Hyperion-3.0-Mistral-7B-DPO-exl2-6_5 --local-dir-use-symlinks False
+```
+
+Windows (which apparently doesn't like _ in folders sometimes?):
+
+```shell
+mkdir Hyperion-3.0-Mistral-7B-DPO-exl2-6.5
+huggingface-cli download bartowski/Hyperion-3.0-Mistral-7B-DPO-exl2 --revision 6_5 --local-dir Hyperion-3.0-Mistral-7B-DPO-exl2-6.5 --local-dir-use-symlinks False
+```
+
+Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski