Bombek1 commited on
Commit
2ef9a23
·
verified ·
1 Parent(s): 78e35a0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - litert
4
+ - tflite
5
+ - on-device
6
+ - mobile-bert
7
+ license: apache-2.0
8
+ base_model: squeezebert/squeezebert-uncased
9
+ ---
10
+
11
+ # squeezebert/squeezebert-uncased - LiteRT Optimized
12
+
13
+ This is a [LiteRT](https://ai.google.dev/edge/litert) (formerly TensorFlow Lite) export of [squeezebert/squeezebert-uncased](https://huggingface.co/squeezebert/squeezebert-uncased).
14
+
15
+ It is optimized for mobile and edge inference (Android/iOS/Embedded).
16
+
17
+ ## Model Details
18
+ | Attribute | Value |
19
+ | :--- | :--- |
20
+ | **Task** | Feature Extraction |
21
+ | **Format** | `.tflite` (Float32) |
22
+ | **File Size** | 192.0 MB |
23
+ | **Input Length** | 128 tokens |
24
+ | **Output Dim** | 768 |
25
+
26
+ ## Usage
27
+
28
+ ```python
29
+ import numpy as np
30
+ from ai_edge_litert.interpreter import Interpreter
31
+ from transformers import AutoTokenizer
32
+
33
+ # Load model
34
+ interpreter = Interpreter(model_path="squeezebert_squeezebert-uncased.tflite")
35
+ interpreter.allocate_tensors()
36
+
37
+ tokenizer = AutoTokenizer.from_pretrained("squeezebert/squeezebert-uncased")
38
+
39
+ def get_embedding(text):
40
+ inputs = tokenizer(text, max_length=128, padding="max_length", truncation=True, return_tensors="np")
41
+
42
+ input_details = interpreter.get_input_details()
43
+ interpreter.set_tensor(input_details[0]['index'], inputs['input_ids'].astype(np.int64))
44
+ interpreter.set_tensor(input_details[1]['index'], inputs['attention_mask'].astype(np.int64))
45
+
46
+ interpreter.invoke()
47
+
48
+ output_details = interpreter.get_output_details()
49
+ return interpreter.get_tensor(output_details[0]['index'])[0]
50
+
51
+ emb = get_embedding("Hello world")
52
+ print(f"Embedding shape: {emb.shape}")
53
+ ```
54
+
55
+ *Converted by [Bombek1](https://huggingface.co/Bombek1) using [litert-torch](https://github.com/google-ai-edge/ai-edge-torch)*