Azure Open AI — showing probability of token’s predicted.

Balamurugan Balakreshnan

·

Follow

Published in

Towards Dev

·

2 min read

·

Mar 14, 2024

--

Share

Introduction

• Using Azure Open AI how to show logprobs
• Showing token predicted probability
• display for each word in the sentence

Requirements

• Azure Open AI
• Azure Subscription
• Python
• Azure Machine Learning compute instance
• Azure open ai deployment in East US or North or South central US only (as of 2024–03–14)