Prerequisites Microsoft Fabric Account Microsoft Fabric Cluster Power Admin screen will have options to enable Fabric in a corporate environment. Steps Let’s create a pipeline with data flow Go to Data Engineering -> Pipelines -> + Create Pipeline Give a name to the pipeline Drag the copy activity Moving the TPCH data…

Overview Summarize large pdf Load pdf Clean the data Load the data using Langchain Using Azure Machine learning Upload meeting transcript into a folder sample pdf is available in docs folder Code install libraries pip install pdfreader pip install langchain pip install unstructured pip install tiktoken pip install faiss-cpu pip install pypdf …

Overview Summarize Meeting converstation transcript Load Text data memory Clean the data Load the data using Langchain Using Azure Machine learning Upload meeting transcript into a folder Code install libraries pip install pdfreader pip install langchain pip install unstructured pip install tiktoken pip install faiss-cpu load libraries from langchain.embeddings.openai import OpenAIEmbeddings from langchain.text_splitter…

Use Case Do we need fine tuning? In most cases answer is no Large Language models can be used as is How to consume my companies document and use it for LLM? How do i use my own documents with Azure Open AI Introduction In this article we will see how to use…

Let’s build a Power App to use Azure Vision Cognitive service Florence Model for various use cases What’s needed Create a Azure Cognitive Service resource for vision in Azure portal Get the URI and keys to use Create a Power App To create a power app first need to create a power flow Flow is invoked by a powerapp trigger Images is passed to the flow on the default screen assign values to…

Let’s build a Power App to use Azure Open AI ChatGPT for various use cases What’s needed Register for Azure Open AI — https://learn.microsoft.com/en-us/azure/cognitive-services/openai/overview Once got approved create a azure open ai resource in Azure portal Select region as East US At the time of writing this article davinci-003 is only available in East US Create a deployment inside the resource

Pre-requisites Azure Storage Azure Machine Learning Azure Machine learning FAISS Code Go to Azure Machine learning serivce Open jupyter on the compute instance Install packages pip install faiss-cpu pip install --upgrade openai Configure open ai import os import openai openai.api_type = "azure" openai.api_base = "https://aoairesource.openai.azure.com/" openai.api_version = "2022-12-01" openai.api_key = "xxxxxxx"

Azure Open AI GPT on Azure Synapse Analytics Serverless Sql to access parquet/delta files Pre-requisites Azure Account Azure synapse analytics Azure open ai service langchain 0.0.136 is the version sql works, 0.137 has breaking changes. Note: this is work in progress and will add more soon. Azure Synapse Analytics server less sql Create a Database Load some data into underlying storage Create a master key

Using Azure Machine learning and Open AI to parse Survey data Pre-requisites Azure Storage Azure Machine Learning Azure Open AI service Sample data from Kaggle Sample data uploaded in survey/ folder in github repo Code Go to Azure Machine learning serivce Start the compute instance Open Jupyter notebook Install packages pip install openai Import libraries import pandas as pd Load the survey data …