DrDavis's picture
Upload folder using huggingface_hub
17c6d62 verified

๐Ÿค— Transformers ๋ชจ๋ธ์„ ONNX๋กœ ๋‚ด๋ณด๋‚ด๊ธฐ[[exporting--transformers-models-to-onnx]]

๐Ÿค— ํŠธ๋žœ์Šคํฌ๋จธ๋Š” transformers.onnx ํŒจํ‚ค์ง€๋ฅผ ์ œ๊ณตํ•˜๋ฉฐ, ์ด ํŒจํ‚ค์ง€๋Š” ์„ค์ • ๊ฐ์ฒด๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๋ชจ๋ธ ์ฒดํฌํฌ์ธํŠธ๋ฅผ ONNX ๊ทธ๋ž˜ํ”„๋กœ ๋ณ€ํ™˜ํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค.

๐Ÿค— Transformers์— ๋Œ€ํ•œ ์ž์„ธํ•œ ๋‚ด์šฉ์€ ์ด ๊ฐ€์ด๋“œ๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.

ONNX ์„ค์ •[[onnx-configurations]]

๋‚ด๋ณด๋‚ด๋ ค๋Š”(export) ๋ชจ๋ธ ์•„ํ‚คํ…์ฒ˜์˜ ์œ ํ˜•์— ๋”ฐ๋ผ ์ƒ์†๋ฐ›์•„์•ผ ํ•  ์„ธ ๊ฐ€์ง€ ์ถ”์ƒ ํด๋ž˜์Šค๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค:

  • ์ธ์ฝ”๋” ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์€ [~onnx.config.OnnxConfig]์„ ์ƒ์†๋ฐ›์Šต๋‹ˆ๋‹ค.
  • ๋””์ฝ”๋” ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์€ [~onnx.config.OnnxConfigWithPast]์„ ์ƒ์†๋ฐ›์Šต๋‹ˆ๋‹ค.
  • ์ธ์ฝ”๋”-๋””์ฝ”๋” ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์€ [~onnx.config.OnnxSeq2SeqConfigWithPast]์„ ์ƒ์†๋ฐ›์Šต๋‹ˆ๋‹ค.

OnnxConfig[[transformers.onnx.OnnxConfig]]

[[autodoc]] onnx.config.OnnxConfig

OnnxConfigWithPast[[transformers.onnx.OnnxConfigWithPast]]

[[autodoc]] onnx.config.OnnxConfigWithPast

OnnxSeq2SeqConfigWithPast[[OnnxSeq2SeqConfigWithPast]]

[[autodoc]] onnx.config.OnnxSeq2SeqConfigWithPast

ONNX ํŠน์ง•[[onnx-features]]

๊ฐ ONNX ์„ค์ •์€ ๋‹ค์–‘ํ•œ ์œ ํ˜•์˜ ํ† ํด๋กœ์ง€๋‚˜ ์ž‘์—…์— ๋Œ€ํ•ด ๋ชจ๋ธ์„ ๋‚ด๋ณด๋‚ผ ์ˆ˜ ์žˆ๊ฒŒ(exporting) ํ•ด์ฃผ๋Š” features ์„ธํŠธ์™€ ์—ฐ๊ด€๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.

FeaturesManager[[transformers.onnx.FeaturesManager]]

[[autodoc]] onnx.features.FeaturesManager