anindya64
/

tinyllama-tensorrt

text-generation-inference

Model card Files Files and versions

tinyllama-tensorrt / README.md

anindya64's picture

Create README.md

a11e19e verified almost 2 years ago

|

history blame contribute delete

252 Bytes

	---
	license: mit
	language:
	- en
	tags:
	- text-generation-inference
	- text
	---


	## TinyLLama TensorRT LLM Edition.

	This repo contains the TensorRT LLM version of TinyLlama Model. The conversion is done to support Float16 precision on Nvidia TensorRT.