AbdulElahGwaith's picture
Upload folder using huggingface_hub
a9bd396 verified
<!--Copyright 2020 The HuggingFace Team. All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
specific language governing permissions and limitations under the License.
⚠️ Note that this file is in Markdown but contain specific syntax for our doc-builder (similar to MDX) that may not be
rendered properly in your Markdown viewer.
-->
# Auto 클래슀[[auto-classes]]
λ§Žμ€ 경우, μ‚¬μš©ν•˜λ €λŠ” μ•„ν‚€ν…μ²˜λŠ” `from_pretrained()` λ©”μ†Œλ“œμ—μ„œ μ œκ³΅ν•˜λŠ” 사전 ν›ˆλ ¨λœ λͺ¨λΈμ˜ μ΄λ¦„μ΄λ‚˜ κ²½λ‘œλ‘œλΆ€ν„° μœ μΆ”ν•  수 μžˆμŠ΅λ‹ˆλ‹€. AutoClassesλŠ” 이 μž‘μ—…μ„ μœ„ν•΄ μ‘΄μž¬ν•˜λ©°, 사전 ν•™μŠ΅λœ λͺ¨λΈ κ°€μ€‘μΉ˜/ꡬ성/단어사전에 λŒ€ν•œ 이름/경둜λ₯Ό μ œκ³΅ν•˜λ©΄ μžλ™μœΌλ‘œ κ΄€λ ¨ λͺ¨λΈμ„ κ°€μ Έμ˜€λ„λ‘ λ„μ™€μ€λ‹ˆλ‹€.
[`AutoConfig`], [`AutoModel`], [`AutoTokenizer`] 쀑 ν•˜λ‚˜λ₯Ό μΈμŠ€ν„΄μŠ€ν™”ν•˜λ©΄ ν•΄λ‹Ή μ•„ν‚€ν…μ²˜μ˜ 클래슀λ₯Ό 직접 μƒμ„±ν•©λ‹ˆλ‹€. 예λ₯Ό λ“€μ–΄,
```python
model = AutoModel.from_pretrained("google-bert/bert-base-cased")
```
μœ„ μ½”λ“œλŠ” [`BertModel`]의 μΈμŠ€ν„΄μŠ€μΈ λͺ¨λΈμ„ μƒμ„±ν•©λ‹ˆλ‹€.
각 μž‘μ—…μ— λŒ€ν•΄ ν•˜λ‚˜μ˜ `AutoModel` ν΄λž˜μŠ€κ°€ 있으며, 각각의 λ°±μ—”λ“œ(PyTorch, TensorFlow λ˜λŠ” Flax)에 ν•΄λ‹Ήν•˜λŠ” ν΄λž˜μŠ€κ°€ μ‘΄μž¬ν•©λ‹ˆλ‹€.
## μžλ™ 클래슀 ν™•μž₯[[extending-the-auto-classes]]
각 μžλ™ ν΄λž˜μŠ€λŠ” μ‚¬μš©μžμ˜ μ»€μŠ€ν…€ 클래슀둜 ν™•μž₯될 수 μžˆλŠ” λ©”μ†Œλ“œλ₯Ό κ°€μ§€κ³  μžˆμŠ΅λ‹ˆλ‹€. 예λ₯Ό λ“€μ–΄, `NewModel`μ΄λΌλŠ” μ»€μŠ€ν…€ λͺ¨λΈ 클래슀λ₯Ό μ •μ˜ν–ˆλ‹€λ©΄, `NewModelConfig`λ₯Ό μ€€λΉ„ν•œ ν›„ λ‹€μŒκ³Ό 같이 μžλ™ ν΄λž˜μŠ€μ— μΆ”κ°€ν•  수 μžˆμŠ΅λ‹ˆλ‹€:
```python
from transformers import AutoConfig, AutoModel
AutoConfig.register("new-model", NewModelConfig)
AutoModel.register(NewModelConfig, NewModel)
```
μ΄ν›„μ—λŠ” 일반적으둜 μžλ™ 클래슀λ₯Ό μ‚¬μš©ν•˜λŠ” κ²ƒμ²˜λŸΌ μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€!
<Tip warning={true}>
λ§Œμ•½ `NewModelConfig`κ°€ [`~transformers.PreTrainedConfig`]의 μ„œλΈŒν΄λž˜μŠ€λΌλ©΄, ν•΄λ‹Ή `model_type` 속성이 등둝할 λ•Œ μ‚¬μš©ν•˜λŠ” ν‚€(μ—¬κΈ°μ„œλŠ” `"new-model"`)와 λ™μΌν•˜κ²Œ μ„€μ •λ˜μ–΄ μžˆλŠ”μ§€ ν™•μΈν•˜μ„Έμš”.
λ§ˆμ°¬κ°€μ§€λ‘œ, `NewModel`이 [`PreTrainedModel`]의 μ„œλΈŒν΄λž˜μŠ€λΌλ©΄, ν•΄λ‹Ή `config_class` 속성이 등둝할 λ•Œ μ‚¬μš©ν•˜λŠ” 클래슀(μ—¬κΈ°μ„œλŠ” `NewModelConfig`)와 λ™μΌν•˜κ²Œ μ„€μ •λ˜μ–΄ μžˆλŠ”μ§€ ν™•μΈν•˜μ„Έμš”.
</Tip>
## AutoConfig[[transformers.AutoConfig]]
[[autodoc]] AutoConfig
## AutoTokenizer[[transformers.AutoTokenizer]]
[[autodoc]] AutoTokenizer
## AutoFeatureExtractor[[transformers.AutoFeatureExtractor]]
[[autodoc]] AutoFeatureExtractor
## AutoImageProcessor[[transformers.AutoImageProcessor]]
[[autodoc]] AutoImageProcessor
## AutoProcessor[[transformers.AutoProcessor]]
[[autodoc]] AutoProcessor
## 일반적인 λͺ¨λΈ 클래슀[[generic-model-classes]]
λ‹€μŒ μžλ™ ν΄λž˜μŠ€λ“€μ€ νŠΉμ • ν—€λ“œ 없이 κΈ°λ³Έ λͺ¨λΈ 클래슀λ₯Ό μΈμŠ€ν„΄μŠ€ν™”ν•˜λŠ” 데 μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€.
### AutoModel[[transformers.AutoModel]]
[[autodoc]] AutoModel
## 일반적인 사전 ν•™μŠ΅ 클래슀[[generic-pretraining-classes]]
λ‹€μŒ μžλ™ ν΄λž˜μŠ€λ“€μ€ 사전 ν›ˆλ ¨ ν—€λ“œκ°€ ν¬ν•¨λœ λͺ¨λΈμ„ μΈμŠ€ν„΄μŠ€ν™”ν•˜λŠ” 데 μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€.
### AutoModelForPreTraining[[transformers.AutoModelForPreTraining]]
[[autodoc]] AutoModelForPreTraining
## μžμ—°μ–΄ 처리[[natural-language-processing]]
λ‹€μŒ μžλ™ ν΄λž˜μŠ€λ“€μ€ μ•„λž˜μ˜ μžμ—°μ–΄ 처리 μž‘μ—…μ— μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€.
### AutoModelForCausalLM[[transformers.AutoModelForCausalLM]]
[[autodoc]] AutoModelForCausalLM
### AutoModelForMaskedLM[[transformers.AutoModelForMaskedLM]]
[[autodoc]] AutoModelForMaskedLM
### AutoModelForMaskGeneration[[transformers.AutoModelForMaskGeneration]]
[[autodoc]] AutoModelForMaskGeneration
### AutoModelForSeq2SeqLM[[transformers.AutoModelForSeq2SeqLM]]
[[autodoc]] AutoModelForSeq2SeqLM
### AutoModelForSequenceClassification[[transformers.AutoModelForSequenceClassification]]
[[autodoc]] AutoModelForSequenceClassification
### AutoModelForMultipleChoice[[transformers.AutoModelForMultipleChoice]]
[[autodoc]] AutoModelForMultipleChoice
### AutoModelForNextSentencePrediction[[transformers.AutoModelForNextSentencePrediction]]
[[autodoc]] AutoModelForNextSentencePrediction
### AutoModelForTokenClassification[[transformers.AutoModelForTokenClassification]]
[[autodoc]] AutoModelForTokenClassification
### AutoModelForQuestionAnswering[[transformers.AutoModelForQuestionAnswering]]
[[autodoc]] AutoModelForQuestionAnswering
### AutoModelForTextEncoding[[transformers.AutoModelForTextEncoding]]
[[autodoc]] AutoModelForTextEncoding
## 컴퓨터 λΉ„μ „[[computer-vision]]
λ‹€μŒ μžλ™ ν΄λž˜μŠ€λ“€μ€ μ•„λž˜μ˜ 컴퓨터 λΉ„μ „ μž‘μ—…μ— μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€.
### AutoModelForDepthEstimation[[transformers.AutoModelForDepthEstimation]]
[[autodoc]] AutoModelForDepthEstimation
### AutoModelForImageClassification[[transformers.AutoModelForImageClassification]]
[[autodoc]] AutoModelForImageClassification
### AutoModelForVideoClassification[[transformers.AutoModelForVideoClassification]]
[[autodoc]] AutoModelForVideoClassification
### AutoModelForKeypointDetection[[transformers.AutoModelForKeypointDetection]]
[[autodoc]] AutoModelForKeypointDetection
### AutoModelForMaskedImageModeling[[transformers.AutoModelForMaskedImageModeling]]
[[autodoc]] AutoModelForMaskedImageModeling
### AutoModelForObjectDetection[[transformers.AutoModelForObjectDetection]]
[[autodoc]] AutoModelForObjectDetection
### AutoModelForImageSegmentation[[transformers.AutoModelForImageSegmentation]]
[[autodoc]] AutoModelForImageSegmentation
### AutoModelForImageToImage[[transformers.AutoModelForImageToImage]]
[[autodoc]] AutoModelForImageToImage
### AutoModelForSemanticSegmentation[[transformers.AutoModelForSemanticSegmentation]]
[[autodoc]] AutoModelForSemanticSegmentation
### AutoModelForInstanceSegmentation[[transformers.AutoModelForInstanceSegmentation]]
[[autodoc]] AutoModelForInstanceSegmentation
### AutoModelForUniversalSegmentation[[transformers.AutoModelForUniversalSegmentation]]
[[autodoc]] AutoModelForUniversalSegmentation
### AutoModelForZeroShotImageClassification[[transformers.AutoModelForZeroShotImageClassification]]
[[autodoc]] AutoModelForZeroShotImageClassification
### AutoModelForZeroShotObjectDetection[[transformers.AutoModelForZeroShotObjectDetection]]
[[autodoc]] AutoModelForZeroShotObjectDetection
## μ˜€λ””μ˜€[[audio]]
λ‹€μŒ μžλ™ ν΄λž˜μŠ€λ“€μ€ μ•„λž˜μ˜ μ˜€λ””μ˜€ μž‘μ—…μ— μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€.
### AutoModelForAudioClassification[[transformers.AutoModelForAudioClassification]]
[[autodoc]] AutoModelForAudioClassification
### AutoModelForAudioFrameClassification[[transformers.AutoModelForAudioFrameClassification]]
[[autodoc]] AutoModelForAudioFrameClassification
### AutoModelForCTC[[transformers.AutoModelForCTC]]
[[autodoc]] AutoModelForCTC
### AutoModelForSpeechSeq2Seq[[transformers.AutoModelForSpeechSeq2Seq]]
[[autodoc]] AutoModelForSpeechSeq2Seq
### AutoModelForAudioXVector[[transformers.AutoModelForAudioXVector]]
[[autodoc]] AutoModelForAudioXVector
### AutoModelForTextToSpectrogram[[transformers.AutoModelForTextToSpectrogram]]
[[autodoc]] AutoModelForTextToSpectrogram
### AutoModelForTextToWaveform[[transformers.AutoModelForTextToWaveform]]
[[autodoc]] AutoModelForTextToWaveform
## λ©€ν‹°λͺ¨λ‹¬[[multimodal]]
λ‹€μŒ μžλ™ ν΄λž˜μŠ€λ“€μ€ μ•„λž˜μ˜ λ©€ν‹°λͺ¨λ‹¬ μž‘μ—…μ— μ‚¬μš©ν•  수 μžˆμŠ΅λ‹ˆλ‹€.
### AutoModelForTableQuestionAnswering[[transformers.AutoModelForTableQuestionAnswering]]
[[autodoc]] AutoModelForTableQuestionAnswering
### AutoModelForDocumentQuestionAnswering[[transformers.AutoModelForDocumentQuestionAnswering]]
[[autodoc]] AutoModelForDocumentQuestionAnswering
### AutoModelForVisualQuestionAnswering[[transformers.AutoModelForVisualQuestionAnswering]]
[[autodoc]] AutoModelForVisualQuestionAnswering
## Time Series
### AutoModelForTimeSeriesPrediction[[transformers.AutoModelForTimeSeriesPrediction]]
[[autodoc]] AutoModelForTimeSeriesPrediction