Instructions to use hassaanik/grammar-correction-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use hassaanik/grammar-correction-model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="hassaanik/grammar-correction-model")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("hassaanik/grammar-correction-model") model = AutoModelForSeq2SeqLM.from_pretrained("hassaanik/grammar-correction-model") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use hassaanik/grammar-correction-model with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "hassaanik/grammar-correction-model" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hassaanik/grammar-correction-model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/hassaanik/grammar-correction-model
- SGLang
How to use hassaanik/grammar-correction-model with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "hassaanik/grammar-correction-model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hassaanik/grammar-correction-model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "hassaanik/grammar-correction-model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hassaanik/grammar-correction-model", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use hassaanik/grammar-correction-model with Docker Model Runner:
docker model run hf.co/hassaanik/grammar-correction-model
YAML Metadata Warning:The pipeline tag "text2text-generation" is not in the official list: text-classification, token-classification, table-question-answering, question-answering, zero-shot-classification, translation, summarization, feature-extraction, text-generation, fill-mask, sentence-similarity, text-to-speech, text-to-audio, automatic-speech-recognition, audio-to-audio, audio-classification, audio-text-to-text, voice-activity-detection, depth-estimation, image-classification, object-detection, image-segmentation, text-to-image, image-to-text, image-to-image, image-to-video, unconditional-image-generation, video-classification, reinforcement-learning, robotics, tabular-classification, tabular-regression, tabular-to-text, table-to-text, multiple-choice, text-ranking, text-retrieval, time-series-forecasting, text-to-video, image-text-to-text, image-text-to-image, image-text-to-video, visual-question-answering, document-question-answering, zero-shot-image-classification, graph-ml, mask-generation, zero-shot-object-detection, text-to-3d, image-to-3d, image-feature-extraction, video-text-to-text, keypoint-detection, visual-document-retrieval, any-to-any, video-to-video, other
Summary of the Model: The Grammar Correction T5 Model is based on the T5 (Text-to-Text Transfer Transformer) architecture, leveraging the power of pre-trained models from Hugging Face. The model has been fine-tuned on grammar correction tasks, enabling it to take input text with grammatical errors and provide corrected output, along with a detailed list of corrections and their count.
Uses of the Model: The primary use case for this model is to enhance the grammatical correctness of input text. It serves as a valuable tool for content creators, writers, and individuals seeking to improve the quality of written content. The model is particularly useful in applications where clear and error-free communication is essential, such as in document preparation, content editing, and educational materials.
How to Use It: Using the Grammar Correction T5 Model is straightforward:
-Input Format: Provide a text input that contains grammatical errors. The model is designed to handle a variety of grammatical issues, including syntax, tense, and word usage errors.
-Output: The model generates corrected text, highlighting the corrections made. Additionally, it provides a list of words that were corrected and the overall count of corrections.
-Model Deployment: Deploy the model easily using the Hugging Face inference API. Users can leverage the API to integrate the grammar correction capability into their applications, websites, or text processing pipelines.
By incorporating the Grammar Correction T5 Model, users can enhance the accuracy and clarity of written content, ultimately improving the overall quality of text-based communication.
Usage
from transformers import pipeline
# Load the Grammar Correction T5 Model from Hugging Face
grammar_correction_model = pipeline(task="text2text-generation", model="hassaanik/grammar-correction-model")
# Input text with grammatical errors
input_text = "They is going to spent time together."
# Get corrected output and details
result = grammar_correction_model(input_text, max_length=200, num_beams=5, no_repeat_ngram_size=2)
# Print the corrected output
print(result)
- Downloads last month
- 84