WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferences
Paper • 2306.07906 • Published • 15
# Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("zai-org/WebGLM-2B", trust_remote_code=True)
model = AutoModel.from_pretrained("zai-org/WebGLM-2B", trust_remote_code=True)Quick Links
WebGLM: Towards An Efficient Web-enhanced Question Answering System with Human Preference
📃 Paper (KDD 2023) | 💻 Github Repo
Introduction
WebGLM-2B aspires to provide an efficient and cost-effective web-enhanced question-answering system using the 2-billion-parameter General Language Model (GLM). It aims to improve real-world application deployment by integrating web search and retrieval capabilities into the pre-trained language model.
WebGLM is built by the following parts:
- LLM-augmented Retriever: Enhances the retrieval of relevant web content to better aid in answering questions accurately.
- Bootstrapped Generator: Generates human-like responses to questions, leveraging the power of the GLM to provide refined answers.
- Human Preference-aware Scorer: Estimates the quality of generated responses by prioritizing human preferences, ensuring the system produces useful and engaging content.
This repo is the implementation of Bootstrap Generator.
See our Github Repo for more detailed usage.
- Downloads last month
- 12
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="zai-org/WebGLM-2B", trust_remote_code=True)