aalkaswan commited on
Commit
ca9ba60
·
verified ·
1 Parent(s): 644f9bf

Card: query with portraits.query (the build code now lives in one data-portraits repo)

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -20,10 +20,10 @@ Each partition is a separate revision of this repo (tag `p<i>of<k>`, branch `par
20
  | [`p0of1`](https://huggingface.co/aalkaswan/starcoder-portrait/tree/p0of1) | 863 | ada, agda, alloy, antlr, applescript, assembly, augeas, awk, batchfile, bluespec, c, c-sharp, clojure, cmake, coffeescript, common-lisp, cpp, css, cuda, dart, dockerfile, elixir, elm, emacs-lisp, erlang, f-sharp, fortran, git-commits-cleaned, github-issues-filtered-structured, glsl, go, groovy, haskell, html, idris, isabelle, java, java-server-pages, javascript, json, julia, jupyter-scripts-dedup-filtered, jupyter-structured-clean-dedup, kotlin, lean, literate-agda, literate-coffeescript, literate-haskell, lua, makefile, maple, markdown, mathematica, matlab, ocaml, pascal, perl, php, powershell, prolog, protocol-buffer, python, r, racket, restructuredtext, rmarkdown, ruby, rust, sas, scala, scheme, shell, smalltalk, solidity, sparql, sql, stan, standard-ml, stata, systemverilog, tcl, tcsh, tex, thrift, typescript, verilog, vhdl, visual-basic, xslt, yacc, yaml, zig | 17 GiB |
21
 
22
  `partitions.json` lists the exact files (pinned dataset revision) in each partition. Query with
23
- `starcoder_portrait.query`:
24
 
25
  ```python
26
- from starcoder_portrait.query import SequentialPortrait
27
  portrait = SequentialPortrait("aalkaswan/starcoder-portrait", ["p0of1"])
28
  report = portrait.contains_from_text([text], sort_chains_by_length=True)[0]
29
  ```
 
20
  | [`p0of1`](https://huggingface.co/aalkaswan/starcoder-portrait/tree/p0of1) | 863 | ada, agda, alloy, antlr, applescript, assembly, augeas, awk, batchfile, bluespec, c, c-sharp, clojure, cmake, coffeescript, common-lisp, cpp, css, cuda, dart, dockerfile, elixir, elm, emacs-lisp, erlang, f-sharp, fortran, git-commits-cleaned, github-issues-filtered-structured, glsl, go, groovy, haskell, html, idris, isabelle, java, java-server-pages, javascript, json, julia, jupyter-scripts-dedup-filtered, jupyter-structured-clean-dedup, kotlin, lean, literate-agda, literate-coffeescript, literate-haskell, lua, makefile, maple, markdown, mathematica, matlab, ocaml, pascal, perl, php, powershell, prolog, protocol-buffer, python, r, racket, restructuredtext, rmarkdown, ruby, rust, sas, scala, scheme, shell, smalltalk, solidity, sparql, sql, stan, standard-ml, stata, systemverilog, tcl, tcsh, tex, thrift, typescript, verilog, vhdl, visual-basic, xslt, yacc, yaml, zig | 17 GiB |
21
 
22
  `partitions.json` lists the exact files (pinned dataset revision) in each partition. Query with
23
+ `portraits.query`:
24
 
25
  ```python
26
+ from portraits.query import SequentialPortrait
27
  portrait = SequentialPortrait("aalkaswan/starcoder-portrait", ["p0of1"])
28
  report = portrait.contains_from_text([text], sort_chains_by_length=True)[0]
29
  ```