Feature Extraction
Transformers
Safetensors
prism
video
representation-learning
view-invariant
cross-view
egocentric
egoexo4d
emnlp2026
custom_code
Instructions to use litcoderr/prism with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use litcoderr/prism with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="litcoderr/prism", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("litcoderr/prism", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Reframe the lead around language compositionality
Browse files
README.md
CHANGED
|
@@ -22,13 +22,13 @@ Representation Learning. EMNLP 2026, main conference.
|
|
| 22 |
|
| 23 |
[Paper][paper] 路 [Project page][project] 路 [Code][code]
|
| 24 |
|
| 25 |
-
PRISM
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
|
| 33 |
This checkpoint is trained on EgoExo4D, using both ego and exo views and captions generated
|
| 34 |
by Gemini 3.
|
|
|
|
| 22 |
|
| 23 |
[Paper][paper] 路 [Project page][project] 路 [Code][code]
|
| 24 |
|
| 25 |
+
PRISM separates what an action is from the viewpoint and scene it happens to be seen in.
|
| 26 |
+
Language is what makes that separation trainable: descriptions recombine freely, so the
|
| 27 |
+
action of one clip can be put together with the context of another into a composition that
|
| 28 |
+
never occurred in the training data, and the model is asked to predict the meaning of that
|
| 29 |
+
composition. Semantics that leaked between the two factors cannot survive the swap. What
|
| 30 |
+
this model returns is the view-invariant side of the split, so cosine similarity measures
|
| 31 |
+
what is happening rather than where the camera is.
|
| 32 |
|
| 33 |
This checkpoint is trained on EgoExo4D, using both ego and exo views and captions generated
|
| 34 |
by Gemini 3.
|