Many organisations store their data in a centralised data lake on Azure Storage accounts. In this post we will look at a solution to scale the secure network access between the centralised data lake storage account and Azure Databricks workspaces VNets. The recommended approach to achieve a scalable and secure network access to the data lake storage is to use Private Endpoints for the storage accounts. Private Endpoint relies upon DNS resolution to automatically route the connections from the VNet to the storage account over a private link. Read more

Overview Whenever I shop online, checking the reviews of the products is a tedious task. Sometimes the low-rated reviews are based on delivery, packaging… whereas a few high-rated reviews might be on cost but not on quality. Generally, reviews/ratings are displayed without any context which results in customers needing additional time and effort to get the most value out of it. Hence, we built this prototype using Azure Open AI to present the consolidated information from all the reviews of a product. Read more

Overview While it’s possible to run the kubernetes nodes either in on-demand or spot node pools separately. We can optimize the application cost without compromising the reliability by placing the pods unevenly on spot and OnDemand VMs using the topology spread constraints. With baseline amount of pods deployed in OnDemand node pool offering reliability we can scale on spot node pool based on the load at a lower cost. In this post, we will go through step by step approach on deploying an application spread unevenly on spot and OnDemand VMs. Read more

Building an URL shortener is much easier now using the Serverless technologies in Azure. In this post, we will discuss about developing this solution. Update: My colleague (Christopher Maneu) pointed out that we could optimize the cost by using Azure Static Web Apps (SWA) for hosting the management console. I updated the design to use SWA and added another API to check what the target URL is for the specific short URL gets resolved without visiting the site. Read more

I have been using xBrowserSync for two years now with my own API Backend. In this post we will look at deploying the xBrowserSync API backedn using the serverless technologies on Microsoft Azure I used CosmosDB to persist the data, CosmosDB supports per item size of up to 2MB. Hence I set the size limit to 1.5MB and configured it to serverless mode as to pay only for the used read/write capacity units. Read more