yungisimon commited on
Commit
cc79287
·
verified ·
1 Parent(s): f62189e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +92 -14
README.md CHANGED
@@ -1,25 +1,16 @@
1
  ---
 
2
  license: other
3
  license_name: lfm1.0
4
  license_link: LICENSE
5
  language:
6
  - en
7
- - ar
8
- - zh
9
- - fr
10
- - de
11
- - ja
12
- - ko
13
- - es
14
  pipeline_tag: text-generation
15
  tags:
16
  - liquid
17
- - lfm2.5
18
  - edge
19
- - llama.cpp
20
- - gguf
21
- base_model:
22
- - LiquidAI/LFM2-2.6B-Transcript
23
  ---
24
 
25
  <div align="center">
@@ -37,7 +28,7 @@ base_model:
37
 
38
  # LFM2-2.6B-Transcript-GGUF
39
 
40
- Based on [LFM2-2.6B](https://huggingface.co/LiquidAI/LFM2-2.6B), LFM2-2.6B-Transcript is designed to **private, on-device meeting summarization**. We partnered with AMD to deliver cloud-level summary quality while running entirely locally, ensuring your meeting data never leaves your device.
41
 
42
  **Highlights**:
43
  - Cloud-level summary quality, approaching much larger models
@@ -47,10 +38,97 @@ Based on [LFM2-2.6B](https://huggingface.co/LiquidAI/LFM2-2.6B), LFM2-2.6B-Trans
47
 
48
  You can find more information about other task-specific models in this [blog post](https://www.liquid.ai/blog/introducing-liquid-nanos-frontier-grade-performance-on-everyday-devices).
49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  ## 🏃 How to run
51
 
52
  Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):
53
 
54
  ```
55
  llama-cli -hf LiquidAI/LFM2-2.6B-Transcript-GGUF
56
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
  license: other
4
  license_name: lfm1.0
5
  license_link: LICENSE
6
  language:
7
  - en
 
 
 
 
 
 
 
8
  pipeline_tag: text-generation
9
  tags:
10
  - liquid
11
+ - lfm2
12
  - edge
13
+ base_model: LiquidAI/LFM2-2.6B
 
 
 
14
  ---
15
 
16
  <div align="center">
 
28
 
29
  # LFM2-2.6B-Transcript-GGUF
30
 
31
+ Based on [LFM2-2.6B](https://huggingface.co/LiquidAI/LFM2-2.6B), LFM2-2.6B-Transcript is designed for **private, on-device meeting summarization**. We partnered with AMD to deliver cloud-level summary quality while running entirely locally, ensuring your meeting data never leaves your device.
32
 
33
  **Highlights**:
34
  - Cloud-level summary quality, approaching much larger models
 
38
 
39
  You can find more information about other task-specific models in this [blog post](https://www.liquid.ai/blog/introducing-liquid-nanos-frontier-grade-performance-on-everyday-devices).
40
 
41
+ ## 📄 Model details
42
+
43
+ **Capabilities**: The model is trained for long-form transcript summarization (30-60 minute meetings), producing clear, structured outputs including key points, decisions, and action items with consistent tone and formatting.
44
+
45
+ **Use cases**:
46
+
47
+ - Internal team meetings
48
+ - Sales calls and customer conversations
49
+ - Board meetings and executive briefings
50
+ - Regulated or sensitive environments where data can't leave the device
51
+ - Offline or low-connectivity workflows
52
+
53
+ **Generation parameters**: We strongly recommend using a lower temperature with a `temperature=0.3`.
54
+
55
+ **Supported language**: English
56
+
57
+ > [!WARNING]
58
+ > ⚠️ The model is intended for single-turn conversations with a specific format, described in the following.
59
+
60
+ **Input format**: We recommend using the following system prompt:
61
+ > You are an expert meeting analyst. Analyze the transcript carefully and provide clear, accurate information based on the content.
62
+
63
+ We use a specific formatting for the input meeting transcripts to summarize as follows:
64
+
65
+ ```
66
+ <user_prompt>
67
+
68
+ Title (example: Claims Processing training module)
69
+ Date (example: July 2, 2021)
70
+ Time (example: 1:00 PM)
71
+ Duration (example: 45 minutes)
72
+ Participants (example: Julie Franco (Training Facilitator), Amanda Newman (Subject Matter Expert))
73
+ ----------
74
+ **Speaker 1**: Message 1 (example: **Julie Franco**: Good morning, everyone. Thanks for joining me today.)
75
+ **Speaker 2**: Message 2 (example: **Amanda Newman**: Good morning, Julie. Happy to be here.)
76
+ etc.
77
+ ```
78
+
79
+ You can replace `<user_prompt>` with the following, depending on the desired summary type:
80
+
81
+ | Summary type | User prompt |
82
+ |--------------|-------------|
83
+ | Executive summary | Provide a brief executive summary (2-3 sentences) of the key outcomes and decisions from this transcript. |
84
+ | Detailed summary | Provide a detailed summary of the transcript, covering all major topics, discussions, and outcomes in paragraph form. |
85
+ | Action items | List the specific action items that were assigned during this meeting. Include who is responsible for each item when mentioned. |
86
+ | Key decisions | List the key decisions that were made during this meeting. Focus on concrete decisions and outcomes. |
87
+ | Participants | List the participants mentioned in this transcript. Include their roles or titles when available. |
88
+ | Topics discussed | List the main topics and subjects that were discussed in this meeting. |
89
+
90
+ This is freeform, and you can add several prompts or combine them into a single one, like in the following examples:
91
+
92
+ | Title | Input meeting | Model output |
93
+ |-------|---------------|--------------|
94
+ | Budget planning | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting1.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output1.txt) |
95
+ | Design review | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting2.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output2.txt) |
96
+ | Coffee chat / social hour | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting3.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output3.txt) |
97
+ | Procurement / vendor review | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting4.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output4.txt) |
98
+ | Task force meeting | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting5.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output5.txt) |
99
+
100
+
101
  ## 🏃 How to run
102
 
103
  Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):
104
 
105
  ```
106
  llama-cli -hf LiquidAI/LFM2-2.6B-Transcript-GGUF
107
+ ```
108
+
109
+
110
+ ## 📈 Performance
111
+
112
+ ### Quality
113
+
114
+ LFM2-2.6B-Transcript was benchmarked using the [GAIA Eval-Judge](https://github.com/amd/gaia/blob/main/docs/eval.md) framework on synthetic meeting transcripts across 8 meeting types.
115
+
116
+ ![2.6B-AMD Summarization Judge Score](https://cdn-uploads.huggingface.co/production/uploads/646fdf0a850a938d6c555b2a/e1nbAtmUWIg10Zb3tGMF-.png)
117
+
118
+ *Accuracy ratings from [GAIA LLM Judge](https://github.com/amd/gaia). Evaluated on 24 synthetic 1K transcripts and 32 synthetic 10K transcripts. Claude Sonnet 4 used for content generation and judging.*
119
+
120
+ ### Inference Speed
121
+
122
+ ![2.6B-Transcript - Time](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/L4Mh5cP3kX6BVepz-S1nu.png)
123
+
124
+ *Generated using [llama-bench.exe](https://github.com/ggml-org/llama.cpp) b7250 on an HP Z2 Mini G1a Next Gen AI Desktop Workstation on respective AMD Ryzen devices. We compute peak memory used during CPU inference by measuring peak memory usage of the llama-bench.exe process executing the command: `llama-bench -m <MODEL> -p 10000 -n 1000 -t 8 -r 3 -ngl 0` The llama-bench executable outputs the average inference times for preprocessing and token generation. The reported inference times are for the iGPU, enabled using the `-ngl 99` flag.*
125
+
126
+ ### Memory Usage
127
+
128
+ ![2.6B-Transcript- RAM](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/XksTBvOkZ0Xx9bBD60LyQ.png)
129
+
130
+ *Generated using [llama-bench.exe](https://github.com/ggml-org/llama.cpp) b7250 on an HP Z2 Mini G1a Next Gen AI Desktop Workstation with an AMD Ryzen AI Max+ PRO 395 processor. We compute peak memory used during CPU inference by measuring peak memory usage of the llama-bench.exe process executing the command: `llama-bench -m <MODEL> -p 10000 -n 1000 -t 8 -r 3 -ngl 0` The llama-bench executable outputs the average inference times for preprocessing and token generation. The reported inference times are for the iGPU, enabled using the `-ngl 99` flag*
131
+
132
+ ## 📬 Contact
133
+
134
+ If you are interested in custom solutions with edge deployment, please contact [our sales team](https://www.liquid.ai/contact).