gemma-rag / README.md
bep40's picture
Update ML Intern artifact metadata
8c8ac41 verified
|
Raw
History Blame Contribute Delete
1.44 kB
metadata
title: Gemma Avatar + Product RAG
emoji: 🤖🧠
colorFrom: indigo
colorTo: purple
sdk: docker
pinned: false
app_port: 7860
tags:
  - gemma
  - rag
  - product-search
  - vietnamese
  - ml-intern

Gemma Avatar + Product RAG

3D talking-head avatar chat powered by Gemma 4 with a 12,000+ product knowledge base from V.AISTUDIO.

Features

Voice & Text Chat

  • Real-time voice conversation using HF SmolAgents realtime API
  • Gemma 4 speech-to-speech backend with lip-sync 3D avatar
  • Multiple avatar models (vuong.glb, brunette.glb, david.glb, and more)
  • Switch between avatars in real-time

Product Catalogue (11,695 products)

  • Browse brands: Malloca, Eurogold, Grob, Canzy, Demax, Hafele, Garis
  • Categories: kitchen exhaust fans, induction cooktops, refrigerators, washing machines, more
  • Keyword search with Vietnamese smart matching (synonyms, diacritics)
  • Filter by category, brand, price range, sort by price/name
  • Product detail view with specs, features, and images

RAG Semantic Search

  • Uses HF Inference API embeddings (BAAI/bge-small-en-v1.5)
  • Semantic search: ask questions about products naturally
  • Hybrid search combining keyword + semantic matching
  • Returns top matching products with scores

Tech Stack

  • Bun runtime (TypeScript)
  • Docker SDK for HF Spaces
  • 3D Avatar: talkinghead + Three.js
  • RAG: BGE embeddings + cosine similarity
  • Voice: SmolAgents HF Realtime API