Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

microsoft
/
Phi-4-multimodal-instruct

Automatic Speech Recognition
Transformers
Safetensors
phi4mm
text-generation
nlp
code
audio
speech-summarization
speech-translation
visual-question-answering
phi-4-multimodal
phi
phi-4-mini
custom_code
Eval Results
Model card Files Files and versions
xet
Community
98

Instructions to use microsoft/Phi-4-multimodal-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use microsoft/Phi-4-multimodal-instruct with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("automatic-speech-recognition", model="microsoft/Phi-4-multimodal-instruct", trust_remote_code=True)
    # pip install -U transformers accelerate
    # Load model directly
    from transformers import AutoModelForCausalLM
    model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-4-multimodal-instruct", trust_remote_code=True, device_map="auto")
  • Notebooks
  • Google Colab
  • Kaggle
Phi-4-multimodal-instruct
933 MB
Ctrl+K
Ctrl+K
  • 14 contributors
History: 29 commits
cyrilvallez's picture
cyrilvallez HF Staff
Upload folder using huggingface_hub
8bf5ecc verified over 1 year ago
  • examples
    Add examples over 1 year ago
  • figures
    Added model files over 1 year ago
  • .gitattributes
    1.61 kB
    added technical report over 1 year ago
  • CODE_OF_CONDUCT.md
    444 Bytes
    Added model files over 1 year ago
  • LICENSE
    1.14 kB
    Added model files over 1 year ago
  • README.md
    65.1 kB
    Update readme over 1 year ago
  • SECURITY.md
    2.66 kB
    Added model files over 1 year ago
  • SUPPORT.md
    1.24 kB
    Added model files over 1 year ago
  • adapter_config.json
    742 Bytes
    Upload folder using huggingface_hub over 1 year ago
  • adapter_model.safetensors
    923 MB
    xet
    Upload folder using huggingface_hub over 1 year ago
  • configuration_phi4mm.py
    11 kB
    Added model files over 1 year ago
  • merges.txt
    2.42 MB
    Added model files over 1 year ago
  • modeling_phi4mm.py
    116 kB
    fixes the asserion error when num_beams > 1 (#42) over 1 year ago
  • phi_4_mm.tech_report.02252025.pdf
    5.3 MB
    xet
    added technical report over 1 year ago
  • processing_phi4mm.py
    32.8 kB
    Added model files over 1 year ago
  • sample_finetune_speech.py
    16.7 kB
    Fix bug with safe suffix removal (#34) over 1 year ago
  • sample_finetune_vision.py
    19.6 kB
    Added model files over 1 year ago
  • sample_inference_phi4mm.py
    10.5 kB
    Added model files over 1 year ago
  • speech_conformer_encoder.py
    111 kB
    Added model files over 1 year ago
  • vision_siglip_navit.py
    78.2 kB
    Added model files over 1 year ago