Azure AI Studio Model catalog deploy Realtime Endpoint DeciLM7B instruct — 3

Balamurugan Balakreshnan
Towards Dev
Published in
3 min readMar 23, 2024

--

Introduction

  • Realtime Endpoint DeciLM7B model
  • Realtime from Model Catalog UI
  • Using Azure AI Studio Model Catalog
  • GPU compute needed
  • SKU can change based on the model
  • For PHI 2 model we need Standard_NC12s_v3 SKU

Steps

--

--