Instructions to use facebook/w2v-bert-2.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use facebook/w2v-bert-2.0 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="facebook/w2v-bert-2.0")# Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("facebook/w2v-bert-2.0") model = AutoModel.from_pretrained("facebook/w2v-bert-2.0") - Notebooks
- Google Colab
- Kaggle
Issue with AutoFeatureExtractor
I am getting the error below when I try to run AutoFeatureExtractor.from_pretrained('facebook/w2v-bert-2.0')
ValueError: Unrecognized feature extractor in facebook/w2v-bert-2.0. Should have a feature_extractor_type key in its preprocessor_config.json of config.json, or one of the following model_type keys in its config.json: audio-spectrogram-transformer, beit, chinese_clip, clap, clip, clipseg, conditional_detr, convnext, cvt, data2vec-audio, data2vec-vision, deformable_detr, deit, detr, dinat, donut-swin, dpt, encodec, flava, glpn, groupvit, hubert, imagegpt, layoutlmv2, layoutlmv3, levit, maskformer, mctct, mobilenet_v1, mobilenet_v2, mobilevit, nat, owlvit, perceiver, poolformer, pop2piano, regnet, resnet, segformer, sew, sew-d, speech_to_text, speecht5, swiftformer, swin, swinv2, table-transformer, timesformer, tvlt, unispeech, unispeech-sat, van, videomae, vilt, vit, vit_mae, vit_msn, wav2vec2, wav2vec2-conformer, wavlm, whisper, xclip, yolos
I checked the preprocessor_config.json and it has a feature_extractor_type so not sure what is the issue here.
You shuld update yourtransformers version to the latest (pip install -U transformers). Let me know if that helps