Azure AI Studio Model catalog deploy Realtime Endpoint DeciLM7B instruct — 3
Published in
3 min readMar 23, 2024
Introduction
- Realtime Endpoint DeciLM7B model
- Realtime from Model Catalog UI
- Using Azure AI Studio Model Catalog
- GPU compute needed
- SKU can change based on the model
- For PHI 2 model we need Standard_NC12s_v3 SKU
Steps
- Go to AI Studio: https://ai.azure.com
- On the left menu select Model…