# lilt-camembert-base

This repository contains **lilt-camembert-base** weights exported to `safetensors` format.

## Source

- **Layout encoder**: [`jpwang/lilt-only-base`](https://github.com/jpwang/lilt) — layout-only pretrained checkpoint
- **Text encoder**: [`camembert/camembert-base`](https://huggingface.co/camembert/camembert-base) — French language model

## Methodology

Produced by **weight merging** following the official [`gen_weight_roberta_like.py`](https://github.com/jpwang/lilt) procedure. No training or fine-tuning was performed.

Intended as a starting point for downstream fine-tuning on French document understanding tasks (NER, token classification, extractive QA…).

## Files

| File | Description |
|------|-------------|
| `model.safetensors` | Model weights |
| `pytorch_model.bin` | Model weights (PyTorch format) |
| `config.json` | Model configuration |
| `tokenizer_config.json` | Tokenizer configuration |
| `sentencepiece.bpe.model` | SentencePiece vocabulary |

## License

Weights are derived from models released under MIT and Apache-2.0 licenses.

## Acknowledgements

- [LiLT: A Simple yet Effective Language-Independent Layout Transformer](https://arxiv.org/abs/2202.13669) — Wang et al., 2022

> **Note**: This is not an official release from any of the above organizations.