Spaces:
Sleeping
Sleeping
Premchandyadav369
feat: deploy interactive Q-TensorFormer demo with trained weights and Gradio 4 UI
67ded87 | """ | |
| Hugging Face Transformers Integration for Q-TensorFormer. | |
| Provides first-class Hugging Face ecosystem compatibility: | |
| - QTensorFormerConfig (inherits PretrainedConfig) | |
| - QTensorFormerForCausalLM (inherits PreTrainedModel, GenerationMixin) | |
| - AutoConfig & AutoModelForCausalLM registration | |
| - Generation support with past_key_values and Adaptive KV Cache | |
| - save_pretrained and from_pretrained serialization | |
| """ | |
| import sys | |
| import os | |
| # Re-export authoritative root implementations | |
| from configuration_qtensorformer import QTensorFormerConfig, factorize_dim | |
| from modeling_qtensorformer import ( | |
| QTensorFormerForCausalLM, | |
| QTensorFormerModel, | |
| QTensorFormerPreTrainedModel, | |
| QTensorFormerBlock, | |
| QTensorFormerAttention, | |
| QTensorFormerMLP, | |
| TensorTrainLinear, | |
| AdaptiveKVCache, | |
| PIDResourceController, | |
| QTensorFormerRMSNorm, | |
| ) | |
| __all__ = [ | |
| "QTensorFormerConfig", | |
| "QTensorFormerForCausalLM", | |
| "QTensorFormerModel", | |
| "QTensorFormerPreTrainedModel", | |
| "QTensorFormerBlock", | |
| "QTensorFormerAttention", | |
| "QTensorFormerMLP", | |
| "TensorTrainLinear", | |
| "AdaptiveKVCache", | |
| "PIDResourceController", | |
| "QTensorFormerRMSNorm", | |
| "factorize_dim", | |
| ] | |