Steffen Kirres commited on
Commit
7e18299
·
1 Parent(s): 370879d

Add FP16 note

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -37,6 +37,8 @@ Here is an overview of the models we deliver publicly:
37
  | [vectorizer.guava](https://huggingface.co/sinequa/vectorizer.guava) | de, en, es, fr, it, ja, nl, pl, pt, zh-trad, zs | 0.616 | 12 ms | 550 MiB |
38
  | [vectorizer.banana](https://huggingface.co/sinequa/vectorizer.banana) | 100+ languages | [details](https://huggingface.co/sinequa/vectorizer.banana#scores) | 35 ms | 1450 MiB |
39
 
 
 
40
  ## Passage Ranker
41
 
42
  Passage Rankers are models which produce a relevance score given a query-passage pair and are used to order search
@@ -52,3 +54,5 @@ Here is an overview of the models we deliver publicly:
52
  | [passage-ranker.pistachio](https://huggingface.co/sinequa/passage-ranker.pistachio) | de, en, es, fr, it, ja, nl, pl, pt, zs, zh-trad | 0.474 | 65 ms | 850 MiB |
53
  | [passage-ranker.apricot](https://huggingface.co/sinequa/passage-ranker.apricot) | ar, de, en, es, fr, it, ja, kr, nl, pl, pt, zs, zh-trad | 0.449 | 13 ms | 550 MiB |
54
  | [passage-ranker.nectarine](https://huggingface.co/sinequa/passage-ranker.nectarine) | ar, de, en, es, fr, it, ja, kr, nl, pl, pt, zs, zh-trad | 0.455 | 65 ms | 850 MiB |
 
 
 
37
  | [vectorizer.guava](https://huggingface.co/sinequa/vectorizer.guava) | de, en, es, fr, it, ja, nl, pl, pt, zh-trad, zs | 0.616 | 12 ms | 550 MiB |
38
  | [vectorizer.banana](https://huggingface.co/sinequa/vectorizer.banana) | 100+ languages | [details](https://huggingface.co/sinequa/vectorizer.banana#scores) | 35 ms | 1450 MiB |
39
 
40
+ Inference times and GPU memory usage reported are for FP16 models.
41
+
42
  ## Passage Ranker
43
 
44
  Passage Rankers are models which produce a relevance score given a query-passage pair and are used to order search
 
54
  | [passage-ranker.pistachio](https://huggingface.co/sinequa/passage-ranker.pistachio) | de, en, es, fr, it, ja, nl, pl, pt, zs, zh-trad | 0.474 | 65 ms | 850 MiB |
55
  | [passage-ranker.apricot](https://huggingface.co/sinequa/passage-ranker.apricot) | ar, de, en, es, fr, it, ja, kr, nl, pl, pt, zs, zh-trad | 0.449 | 13 ms | 550 MiB |
56
  | [passage-ranker.nectarine](https://huggingface.co/sinequa/passage-ranker.nectarine) | ar, de, en, es, fr, it, ja, kr, nl, pl, pt, zs, zh-trad | 0.455 | 65 ms | 850 MiB |
57
+
58
+ Inference times and GPU memory usage reported are for FP16 models.