scta-scikit doc2vec 2026.10

README.md

@@ -0,0 +1,50 @@
+---
+license: cc-by-nc-sa-4.0
+language:
+- la
+tags:
+- latin
+- medieval
+- doc2vec
+- embeddings
+datasets:
+- scta/scta-corpus
+---
+
+# SCTA Doc2Vec (2026.10)
+
+Doc2Vec document vectors for the texts of the [Scholastic Commentaries and Texts Archive](https://scta.info),
+**trained on [scta/scta-corpus 2026.10](https://huggingface.co/datasets/scta/scta-corpus/tree/2026.10)**, built with [scta-scikit](https://pypi.org/project/scta-scikit/).
+Similar vectors mean similar content, even in different words. 2.1 GB.
+
+| model | |
+|---|---|
+| `semantic` | trained on the paragraph texts: a vector for each unit of every text's structure, down to paragraphs |
+| `semantic_lem` | the same, trained on the lemmatized texts |
+| `semantic_wo_paras` | `semantic` without the paragraph vectors (levels and items only; smaller) |
+
+Each is `models/<model>/vectors.npy` (300 dimensions, float32), `labels.json`
+(the SCTA resource id of each row) and `info.json`; no pickles.
+Training: PV-DM, window 10, min_count 5, negative 5, 40 epochs, seed 42.
+
+## Use
+
+```python
+import scta_scikit as sc
+sc.download(doc2vec=True)                 # these models and the corpus they were trained on
+sc.download(doc2vec=["semantic_lem"])     # one of them
+```
+Then `scta sim <resource id> --semantic`.
+
+## Versions
+
+A release is tagged with the corpus version it was trained on (`2026.10`;
+`2026.10-2` for a retraining on the same corpus), and `manifest.json` names
+that corpus. Models are released less often than the corpus: a newer corpus
+has texts these vectors don't cover.
+
+## License
+
+Derived from the SCTA corpus and published under the same license, Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0), https://creativecommons.org/licenses/by-nc-sa/4.0/.
+
+Built 2026-10-24T12:44:01Z with scta-scikit 553c3a9; see `manifest.json`.

manifest.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:478b7ef57a644f73e95b02e30255bb744581e70041ce82eeed0f0485df1f05c6
+size 2783

models/semantic/info.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0f3232914b0e092336249123d297053b40e60a23d3c45345eb46120b96da6c42
+size 229

models/semantic/labels.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54eb4c779c70ad7d6cf2a11a0faecbdc72bd5fe34d6a5594d424455b08db3558
+size 18653022

models/semantic/vectors.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f1199ad70c2e51d3e986d2dbb61454ec8a6f624c54a5f086bfa06b5d23e84be
+size 961195328

models/semantic_lem/info.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9059245dff0b34ba10ff8c4fe597f38d1deac0c570277e8521c3e9447045cbe4
+size 233

models/semantic_lem/labels.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a665271c9ee771a5d632a7566918f2cc157e47adbad3e36d78a6d885348eb970
+size 18561113

models/semantic_lem/vectors.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:88f7b42e49dcaf573cd4e7f2aa2c155b471b820c88cc03d567d1030902d35ae5
+size 956834528

models/semantic_wo_paras/info.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:993c81d182cb0231467f6c8dfc34d4fdb639516ce5aa9bc9dfb76ffbd0dc0cf7
+size 237

models/semantic_wo_paras/labels.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:adc31fc65ba58f6ccfa2b88f6ac3b02d0c9e707471b1922e835e6bf6c0fdea77
+size 2130632

models/semantic_wo_paras/vectors.npy

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7995b9a6681f1f7216202ace0c9a12861255de87649a68e87b15f333d69df3cc
+size 119154128