Upload 3 files

README.md

@@ -1,3 +1,31 @@
----
-license: mit
----
+---
+license: mit
+language:
+- en
+tags:
+  - lstm
+  - text-segmentation
+---
+
+Check this [NPM package](https://github.com/orgs/the-vedantic-coder/packages/npm/stst/580080323) (built for Speech-To-Text usecase) implements the setup and inference for this model. It provides a [React app demo](https://sentence-splitter-poc.vercel.app/) and a `processDirectText` method to try direct inference on text. 
+
+The sentence splitter model is an LSTM model with around 500 B input size taken from the repository: [NNSplit](https://github.com/kornelski/nnsplit)
+
+|                        | NNSplit    | Spacy (Tagger) | Spacy (Sentencizer) |
+|------------------------|------------|----------------|---------------------|
+| Clean                  | 0.754371   | 0.853603       | 0.820934            |
+| Partial punctuation    | 0.485907   | 0.517829       | 0.249753            |
+| Partial case           | 0.761754   | 0.825119       | 0.819679            |
+| Partial punctuation and case | 0.443704 | 0.458619   | 0.249873            |
+| No punctuation and case| 0.166273   | 0.180859       | 0.00463281          |
+
+
+### Example
+No punctuation and no cases (~17% accuracy) <br>
+   **Input:** 
+  ```text
+  the difference between rest and graphql is explained as follows 
+  rest is an architectural style that exposes resources via endpoints typically following crud operations each endpoint returns a fixed data structure graphql on the other hand allows clients to specify exactly what data they need in a single query often reducing overfetching and underfetching issues
+  ```
+  **Result: 28.90ms ✅**
+  ![image](https://cdn-uploads.huggingface.co/production/uploads/687852a7f13fbe6c3d4c9974/4xF4cDfK2pqJCY2H7ugPY.png)

config.json

@@ -0,0 +1,9 @@
+{
+  "model_format": "onnx",
+  "model_id": "vinitgore/sentence-splitter",
+  "model_type": "custom",
+  "files": {
+    "onnx": "onnx/model.onnx"
+  },
+  "description": "Sentence splitter ONNX model for browser inference via Transformers.js"
+}

model.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6fa35f12d12b6cfbdd80ab45bb8134ab0bcb60e76ca1aa479ebb74b459b0362
+size 132