Heewon Oh Claude Opus 4.6 commited on
Commit
0bdd82a
ยท
1 Parent(s): 2340caf

docs: add Production Enhancements section and Production Note column

Browse files

- Limitations ํ…Œ์ด๋ธ”์— Production Note ์ปฌ๋Ÿผ ์ถ”๊ฐ€ (๋ฐธ๋ฅ˜์—์ด์…˜/๊ฒ€์ƒ‰/์ถ”์ถœ)
- Production Enhancements ์„น์…˜: FnGuide, ์ฆ๊ถŒ์‚ฌ ๋ฆฌํฌํŠธ, ์žฌ๋ฌด์ œํ‘œ, ์ˆ˜๊ธ‰ ๋ฐ์ดํ„ฐ
- Gradio UI๋„ ๋™์ผํ•˜๊ฒŒ ์—…๋ฐ์ดํŠธ
- ์—”ํ„ฐํ”„๋ผ์ด์ฆˆ ๋ฌธ์˜ ์—ฐ๋ฝ์ฒ˜ ์ถ”๊ฐ€

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Files changed (2) hide show
  1. README.md +24 -12
  2. app.py +19 -10
README.md CHANGED
@@ -283,18 +283,30 @@ See [docs/METHODOLOGY.md](docs/METHODOLOGY.md) for detailed documentation on:
283
 
284
  ## Known Limitations
285
 
286
- | Category | Limitation | Impact |
287
- |----------|-----------|--------|
288
- | **Model Size** | 7B parameter model (Qwen2.5-7B base) | Complex multi-step reasoning may degrade compared to 70B+ models |
289
- | **Language** | Korean financial domain only | English/multilingual queries produce lower quality output |
290
- | **Real-time Data** | No direct market data feed (price, volume, orderbook) | Research relies on web search snippets, not live market data |
291
- | **Valuation** | No financial database integration (e.g., FnGuide, Bloomberg) | Cannot provide real-time PER/PBR/EPS; relies on news-sourced figures |
292
- | **Search Coverage** | Naver News API + DuckDuckGo only | No access to paywalled sources (์ฆ๊ถŒ์‚ฌ ๋ฆฌํฌํŠธ, ์œ ๋ฃŒ DB) |
293
- | **Content Extraction** | Top 3 sources per search step | Remaining sources provide title + snippet only (no full text) |
294
- | **Inference Speed** | ~16 tok/s (MLX 4-bit) / ~5 tok/s (CPU BF16) | Full research cycle takes 30-120 seconds depending on iterations |
295
- | **Repetition** | 7B models may exhibit output repetition | Post-processing mitigates but does not fully eliminate |
296
- | **Confidence** | Self-reported confidence (not calibrated) | Confidence scores reflect model's subjective estimate, not statistical accuracy |
297
- | **Temporal** | Training data cutoff affects domain knowledge | Recent events after training may not be reflected in reasoning quality |
 
 
 
 
 
 
 
 
 
 
 
 
298
 
299
  ### What VELA is NOT
300
 
 
283
 
284
  ## Known Limitations
285
 
286
+ > This open-source demo uses public search APIs only. See [Production Enhancements](#production-enhancements) for commercial capabilities.
287
+
288
+ | Category | Limitation | Impact | Production Note |
289
+ |----------|-----------|--------|-----------------|
290
+ | **Model Size** | 7B parameter model (Qwen2.5-7B base) | Complex multi-step reasoning may degrade compared to 70B+ models | |
291
+ | **Language** | Korean financial domain only | English/multilingual queries produce lower quality output | |
292
+ | **Real-time Data** | No direct market data feed (price, volume, orderbook) | Research relies on web search snippets, not live market data | |
293
+ | **Valuation** | No financial database integration (e.g., FnGuide, Bloomberg) | Cannot provide real-time PER/PBR/EPS; relies on news-sourced figures | FnGuide integration available |
294
+ | **Search Coverage** | Naver News API + DuckDuckGo only | No access to paywalled sources (์ฆ๊ถŒ์‚ฌ ๋ฆฌํฌํŠธ, ์œ ๋ฃŒ DB) | Securities firm reports in prod |
295
+ | **Content Extraction** | Top 3 sources per search step | Remaining sources provide title + snippet only (no full text) | Full-text extraction in prod |
296
+ | **Inference Speed** | ~16 tok/s (MLX 4-bit) / ~5 tok/s (CPU BF16) | Full research cycle takes 30-120 seconds depending on iterations | |
297
+ | **Repetition** | 7B models may exhibit output repetition | Post-processing mitigates but does not fully eliminate | |
298
+ | **Confidence** | Self-reported confidence (not calibrated) | Confidence scores reflect model's subjective estimate, not statistical accuracy | |
299
+ | **Temporal** | Training data cutoff affects domain knowledge | Recent events after training may not be reflected in reasoning quality | |
300
+
301
+ ### Production Enhancements
302
+
303
+ In commercial deployments, VELA can integrate:
304
+ - **FnGuide API**: Real-time consensus, target prices, analyst ratings (50+ firms)
305
+ - **Securities firm reports**: Full-text extraction from major Korean brokerages
306
+ - **Financial statements**: 3+ years of balance sheet, cash flow, income statement
307
+ - **Order flow data**: Institutional/foreign investor net buying (real-time)
308
+
309
+ Contact [hello@intrect.io](mailto:hello@intrect.io) for enterprise features.
310
 
311
  ### What VELA is NOT
312
 
app.py CHANGED
@@ -226,16 +226,25 @@ with gr.Blocks(title="VELA Research Agent", theme=gr.themes.Soft()) as demo:
226
  with gr.Accordion("Limitations", open=False):
227
  gr.Markdown(
228
  "### Known Limitations\n\n"
229
- "| ํ•ญ๋ชฉ | ์„ค๋ช… |\n"
230
- "|------|------|\n"
231
- "| **๋ชจ๋ธ ํฌ๊ธฐ** | 7B ํŒŒ๋ผ๋ฏธํ„ฐ โ€” ๋ณต์žกํ•œ ๋‹ค๋‹จ๊ณ„ ์ถ”๋ก ์€ ๋Œ€ํ˜• ๋ชจ๋ธ ๋Œ€๋น„ ํ’ˆ์งˆ ์ €ํ•˜ ๊ฐ€๋Šฅ |\n"
232
- "| **์–ธ์–ด** | ํ•œ๊ตญ ๊ธˆ์œต ๋„๋ฉ”์ธ ์ „์šฉ โ€” ์˜์–ด/๋‹ค๊ตญ์–ด ์ฟผ๋ฆฌ๋Š” ํ’ˆ์งˆ ์ €ํ•˜ |\n"
233
- "| **์‹ค์‹œ๊ฐ„ ๋ฐ์ดํ„ฐ** | ์ง์ ‘ ์‹œ์„ธ ์—ฐ๋™ ์—†์Œ โ€” ์›น ๊ฒ€์ƒ‰ ๊ธฐ๋ฐ˜ ๊ฐ„์ ‘ ๋ฐ์ดํ„ฐ๋งŒ ์‚ฌ์šฉ |\n"
234
- "| **๋ฐธ๋ฅ˜์—์ด์…˜** | ๊ธˆ์œต DB ๋ฏธ์—ฐ๋™ (FnGuide, Bloomberg ๋“ฑ) โ€” PER/PBR์€ ๋‰ด์Šค ์ธ์šฉ ์ˆ˜์น˜ |\n"
235
- "| **๊ฒ€์ƒ‰ ๋ฒ”์œ„** | Naver + DuckDuckGo โ€” ์œ ๋ฃŒ DB ๋ฐ ์ฆ๊ถŒ์‚ฌ ๋ฆฌํฌํŠธ ์ ‘๊ทผ ๋ถˆ๊ฐ€ |\n"
236
- "| **์ฝ˜ํ…์ธ  ์ถ”์ถœ** | ๊ฒ€์ƒ‰ ๋‹จ๊ณ„๋‹น ์ƒ์œ„ 3๊ฐœ๋งŒ ๋ณธ๋ฌธ ์ถ”์ถœ โ€” ๋‚˜๋จธ์ง€๋Š” ์ œ๋ชฉ+์š”์•ฝ๋งŒ |\n"
237
- "| **๋ฐ˜๋ณต ์ƒ์„ฑ** | 7B ๋ชจ๋ธ ํŠน์„ฑ์ƒ ์ถœ๋ ฅ ๋ฐ˜๋ณต ๊ฐ€๋Šฅ โ€” ํ›„์ฒ˜๋ฆฌ๋กœ ์™„ํ™”ํ•˜๋‚˜ ์™„์ „ ์ œ๊ฑฐ๋Š” ์•„๋‹˜ |\n"
238
- "| **์‹ ๋ขฐ๋„** | ์ž๊ธฐ ๋ณด๊ณ  ๋ฐฉ์‹ (calibrated ์•„๋‹˜) โ€” ํ†ต๊ณ„์  ์ •ํ™•๋„๊ฐ€ ์•„๋‹Œ ๋ชจ๋ธ ์ฃผ๊ด€ ์ถ”์ • |\n\n"
 
 
 
 
 
 
 
 
 
239
  "**VELA๋Š” ํˆฌ์ž ์กฐ์–ธ ๋„๊ตฌ๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค.** "
240
  "์ •๋ณด ์ œ๊ณต/๊ต์œก ๋ชฉ์ ์œผ๋กœ๋งŒ ์‚ฌ์šฉํ•˜์„ธ์š”. ํˆฌ์ž ํŒ๋‹จ์€ ์ „๋ฌธ๊ฐ€์™€ ์ƒ๋‹ดํ•˜์‹œ๊ธฐ ๋ฐ”๋ž๋‹ˆ๋‹ค."
241
  )
 
226
  with gr.Accordion("Limitations", open=False):
227
  gr.Markdown(
228
  "### Known Limitations\n\n"
229
+ "*์ด ๋ฐ๋ชจ๋Š” ๊ณต๊ฐœ ๊ฒ€์ƒ‰ API๋งŒ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. ์ƒ์šฉ ๋ฐฐํฌ์—์„œ๋Š” ์•„๋ž˜ ์ œ์•ฝ์ด ํ•ด์†Œ๋ฉ๋‹ˆ๋‹ค.*\n\n"
230
+ "| ํ•ญ๋ชฉ | ์„ค๋ช… | ์ƒ์šฉ ๋ฐฐํฌ |\n"
231
+ "|------|------|----------|\n"
232
+ "| **๋ชจ๋ธ ํฌ๊ธฐ** | 7B ํŒŒ๋ผ๋ฏธํ„ฐ โ€” ๋ณต์žกํ•œ ๋‹ค๋‹จ๊ณ„ ์ถ”๋ก ์€ ๋Œ€ํ˜• ๋ชจ๋ธ ๋Œ€๋น„ ํ’ˆ์งˆ ์ €ํ•˜ ๊ฐ€๋Šฅ | |\n"
233
+ "| **์–ธ์–ด** | ํ•œ๊ตญ ๊ธˆ์œต ๋„๋ฉ”์ธ ์ „์šฉ โ€” ์˜์–ด/๋‹ค๊ตญ์–ด ์ฟผ๋ฆฌ๋Š” ํ’ˆ์งˆ ์ €ํ•˜ | |\n"
234
+ "| **์‹ค์‹œ๊ฐ„ ๋ฐ์ดํ„ฐ** | ์ง์ ‘ ์‹œ์„ธ ์—ฐ๋™ ์—†์Œ โ€” ์›น ๊ฒ€์ƒ‰ ๊ธฐ๋ฐ˜ ๊ฐ„์ ‘ ๋ฐ์ดํ„ฐ๋งŒ ์‚ฌ์šฉ | |\n"
235
+ "| **๋ฐธ๋ฅ˜์—์ด์…˜** | ๊ธˆ์œต DB ๋ฏธ์—ฐ๋™ โ€” PER/PBR์€ ๋‰ด์Šค ์ธ์šฉ ์ˆ˜์น˜ | FnGuide ์—ฐ๋™ ๊ฐ€๋Šฅ |\n"
236
+ "| **๊ฒ€์ƒ‰ ๋ฒ”์œ„** | Naver + DuckDuckGo โ€” ์œ ๋ฃŒ DB ์ ‘๊ทผ ๋ถˆ๊ฐ€ | ์ฆ๊ถŒ์‚ฌ ๋ฆฌํฌํŠธ ์—ฐ๋™ |\n"
237
+ "| **์ฝ˜ํ…์ธ  ์ถ”์ถœ** | ๊ฒ€์ƒ‰ ๋‹จ๊ณ„๋‹น ์ƒ์œ„ 3๊ฐœ๋งŒ ๋ณธ๋ฌธ ์ถ”์ถœ | ์ „๋ฌธ ์ถ”์ถœ ๊ฐ€๋Šฅ |\n"
238
+ "| **๋ฐ˜๋ณต ์ƒ์„ฑ** | 7B ๋ชจ๋ธ ํŠน์„ฑ์ƒ ์ถœ๋ ฅ ๋ฐ˜๋ณต ๊ฐ€๋Šฅ โ€” ํ›„์ฒ˜๋ฆฌ๋กœ ์™„ํ™” | |\n"
239
+ "| **์‹ ๋ขฐ๋„** | ์ž๊ธฐ ๋ณด๊ณ  ๋ฐฉ์‹ (calibrated ์•„๋‹˜) | |\n\n"
240
+ "### Production Enhancements\n\n"
241
+ "์ƒ์šฉ ๋ฐฐํฌ์—์„œ VELA๋Š” ๋‹ค์Œ์„ ์ถ”๊ฐ€ ์—ฐ๋™ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค:\n"
242
+ "- **FnGuide API**: ์‹ค์‹œ๊ฐ„ ์ปจ์„ผ์„œ์Šค, ๋ชฉํ‘œ๊ฐ€, ์• ๋„๋ฆฌ์ŠคํŠธ ํ‰์  (50๊ฐœ+ ์ฆ๊ถŒ์‚ฌ)\n"
243
+ "- **์ฆ๊ถŒ์‚ฌ ๋ฆฌํฌํŠธ**: ์ฃผ์š” ์ฆ๊ถŒ์‚ฌ ๋ฆฌํฌํŠธ ์ „๋ฌธ ์ถ”์ถœ\n"
244
+ "- **์žฌ๋ฌด์ œํ‘œ**: 3๊ฐœ๋…„+ ๋Œ€์ฐจ๋Œ€์กฐํ‘œ, ํ˜„๊ธˆํ๋ฆ„ํ‘œ, ์†์ต๊ณ„์‚ฐ์„œ\n"
245
+ "- **์ˆ˜๊ธ‰ ๋ฐ์ดํ„ฐ**: ๊ธฐ๊ด€/์™ธ๊ตญ์ธ ์ˆœ๋งค์ˆ˜ (์‹ค์‹œ๊ฐ„)\n\n"
246
+ "์—”ํ„ฐํ”„๋ผ์ด์ฆˆ ๋ฌธ์˜: hello@intrect.io\n\n"
247
+ "---\n\n"
248
  "**VELA๋Š” ํˆฌ์ž ์กฐ์–ธ ๋„๊ตฌ๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค.** "
249
  "์ •๋ณด ์ œ๊ณต/๊ต์œก ๋ชฉ์ ์œผ๋กœ๋งŒ ์‚ฌ์šฉํ•˜์„ธ์š”. ํˆฌ์ž ํŒ๋‹จ์€ ์ „๋ฌธ๊ฐ€์™€ ์ƒ๋‹ดํ•˜์‹œ๊ธฐ ๋ฐ”๋ž๋‹ˆ๋‹ค."
250
  )