yungisimon commited on
Commit
3bbeb52
ยท
verified ยท
1 Parent(s): e7cce64

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -84
README.md CHANGED
@@ -36,67 +36,7 @@ Based on [LFM2-2.6B](https://huggingface.co/LiquidAI/LFM2-2.6B), LFM2-2.6B-Trans
36
  - Fast summaries in seconds, not minutes
37
  - Runs fully locally across CPU, GPU, and NPU
38
 
39
- You can find more information about other task-specific models in this [blog post](https://www.liquid.ai/blog/introducing-liquid-nanos-frontier-grade-performance-on-everyday-devices).
40
-
41
- ## ๐Ÿ“„ Model details
42
-
43
- **Capabilities**: The model is trained for long-form transcript summarization (30-60 minute meetings), producing clear, structured outputs including key points, decisions, and action items with consistent tone and formatting.
44
-
45
- **Use cases**:
46
-
47
- - Internal team meetings
48
- - Sales calls and customer conversations
49
- - Board meetings and executive briefings
50
- - Regulated or sensitive environments where data can't leave the device
51
- - Offline or low-connectivity workflows
52
-
53
- **Generation parameters**: We strongly recommend using a lower temperature with a `temperature=0.3`.
54
-
55
- **Supported language**: English
56
-
57
- > [!WARNING]
58
- > โš ๏ธ The model is intended for single-turn conversations with a specific format, described in the following.
59
-
60
- **Input format**: We recommend using the following system prompt:
61
- > You are an expert meeting analyst. Analyze the transcript carefully and provide clear, accurate information based on the content.
62
-
63
- We use a specific formatting for the input meeting transcripts to summarize as follows:
64
-
65
- ```
66
- <user_prompt>
67
-
68
- Title (example: Claims Processing training module)
69
- Date (example: July 2, 2021)
70
- Time (example: 1:00 PM)
71
- Duration (example: 45 minutes)
72
- Participants (example: Julie Franco (Training Facilitator), Amanda Newman (Subject Matter Expert))
73
- ----------
74
- **Speaker 1**: Message 1 (example: **Julie Franco**: Good morning, everyone. Thanks for joining me today.)
75
- **Speaker 2**: Message 2 (example: **Amanda Newman**: Good morning, Julie. Happy to be here.)
76
- etc.
77
- ```
78
-
79
- You can replace `<user_prompt>` with the following, depending on the desired summary type:
80
-
81
- | Summary type | User prompt |
82
- |--------------|-------------|
83
- | Executive summary | Provide a brief executive summary (2-3 sentences) of the key outcomes and decisions from this transcript. |
84
- | Detailed summary | Provide a detailed summary of the transcript, covering all major topics, discussions, and outcomes in paragraph form. |
85
- | Action items | List the specific action items that were assigned during this meeting. Include who is responsible for each item when mentioned. |
86
- | Key decisions | List the key decisions that were made during this meeting. Focus on concrete decisions and outcomes. |
87
- | Participants | List the participants mentioned in this transcript. Include their roles or titles when available. |
88
- | Topics discussed | List the main topics and subjects that were discussed in this meeting. |
89
-
90
- This is freeform, and you can add several prompts or combine them into a single one, like in the following examples:
91
-
92
- | Title | Input meeting | Model output |
93
- |-------|---------------|--------------|
94
- | Budget planning | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting1.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output1.txt) |
95
- | Design review | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting2.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output2.txt) |
96
- | Coffee chat / social hour | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting3.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output3.txt) |
97
- | Procurement / vendor review | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting4.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output4.txt) |
98
- | Task force meeting | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/meeting5.txt) | [Link](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript/resolve/main/examples/output5.txt) |
99
-
100
 
101
  ## ๐Ÿƒ How to run
102
 
@@ -106,29 +46,6 @@ Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):
106
  llama-cli -hf LiquidAI/LFM2-2.6B-Transcript-GGUF
107
  ```
108
 
109
-
110
- ## ๐Ÿ“ˆ Performance
111
-
112
- ### Quality
113
-
114
- LFM2-2.6B-Transcript was benchmarked using the [GAIA Eval-Judge](https://github.com/amd/gaia/blob/main/docs/eval.md) framework on synthetic meeting transcripts across 8 meeting types.
115
-
116
- ![2.6B-AMD Summarization Judge Score](https://cdn-uploads.huggingface.co/production/uploads/646fdf0a850a938d6c555b2a/e1nbAtmUWIg10Zb3tGMF-.png)
117
-
118
- *Accuracy ratings from [GAIA LLM Judge](https://github.com/amd/gaia). Evaluated on 24 synthetic 1K transcripts and 32 synthetic 10K transcripts. Claude Sonnet 4 used for content generation and judging.*
119
-
120
- ### Inference Speed
121
-
122
- ![2.6B-Transcript - Time](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/L4Mh5cP3kX6BVepz-S1nu.png)
123
-
124
- *Generated using [llama-bench.exe](https://github.com/ggml-org/llama.cpp) b7250 on an HP Z2 Mini G1a Next Gen AI Desktop Workstation on respective AMD Ryzen devices. We compute peak memory used during CPU inference by measuring peak memory usage of the llama-bench.exe process executing the command: `llama-bench -m <MODEL> -p 10000 -n 1000 -t 8 -r 3 -ngl 0` The llama-bench executable outputs the average inference times for preprocessing and token generation. The reported inference times are for the iGPU, enabled using the `-ngl 99` flag.*
125
-
126
- ### Memory Usage
127
-
128
- ![2.6B-Transcript- RAM](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/XksTBvOkZ0Xx9bBD60LyQ.png)
129
-
130
- *Generated using [llama-bench.exe](https://github.com/ggml-org/llama.cpp) b7250 on an HP Z2 Mini G1a Next Gen AI Desktop Workstation with an AMD Ryzen AI Max+ PRO 395 processor. We compute peak memory used during CPU inference by measuring peak memory usage of the llama-bench.exe process executing the command: `llama-bench -m <MODEL> -p 10000 -n 1000 -t 8 -r 3 -ngl 0` The llama-bench executable outputs the average inference times for preprocessing and token generation. The reported inference times are for the iGPU, enabled using the `-ngl 99` flag*
131
-
132
  ## ๐Ÿ“ฌ Contact
133
 
134
  If you are interested in custom solutions with edge deployment, please contact [our sales team](https://www.liquid.ai/contact).
 
36
  - Fast summaries in seconds, not minutes
37
  - Runs fully locally across CPU, GPU, and NPU
38
 
39
+ You can find more information about this model [here](https://huggingface.co/LiquidAI/LFM2-2.6B-Transcript).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
40
 
41
  ## ๐Ÿƒ How to run
42
 
 
46
  llama-cli -hf LiquidAI/LFM2-2.6B-Transcript-GGUF
47
  ```
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ## ๐Ÿ“ฌ Contact
50
 
51
  If you are interested in custom solutions with edge deployment, please contact [our sales team](https://www.liquid.ai/contact).