KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#typescript #ai-agents #developer-tools #codex #claude-code #cli #react #mcp #open-source #deepseek-harness #dsh-plugin #ai

open-webui-on-azure

★ 65 Open GitHub ↗

Open WebUI on Azure with a quick start / reference code and architecture with a focus on APIM as AI gateway

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Open WebUI on Azure - Production Grade Quickstart

Deploy [Open WebUI](https://github.com/open-webui/open-webui) on Azure Container Apps with Entra ID authentication, Azure API Management (AI API Gateway), Microsoft (Azure) Foundry integration, and Application Gateway.

## Architecture

![Azure Open WebUI architecture](https://raw.githubusercontent.com/riosengineer/open-webui-on-azure/main/docs/architecture.drawio.png)
![Azure Open WebUI network flow](https://raw.githubusercontent.com/riosengineer/open-webui-on-azure/main/docs/network-flow.drawio.png)

## Features

✅ **Open WebUI** on Azure Container Apps with native OAuth/OIDC Entra ID integration  
✅ **Microsoft Foundry** with multiple models (GPT, Grok, Mistral, Llama, DeepSeek) using Managed Identity  
✅ **Application Gateway** with custom domain and SSL termination  
✅ **API Management with AI in Azure** with token tracking, limits, usage metrics, custom analytics, Entra OAuth policy validation enforcement
✅ **Azure PostgreSQL Database** for persistent storage (users, chats, settings) with private endpoint access  
✅ **No secrets!** Managed Identity + OIDC throughout*
✅ **Infrastructure as Code** using Bicep with Azure Verified Modules  
✅ **Secure by default** using internal ingresses and private endpoints

> [!NOTE]
>
> - *Azure Container Apps still [requires Storage Account Access Keys for Azure File SMB mount](https://learn.microsoft.com/en-us/azure/container-apps/storage-mounts-azure-files?tabs=bash#set-up-a-storage-account) :(
> - **Open WebUI does not support Entra authentication for PostgreSQL yet.

## Prerequisites

- Azure subscription(s) Owner access with Azure CLI and Bicep installed
- Custom domain with DNS provider (Cloudflare used in examples)
- SSL certificate (Cloudflare Origin Certificate for Full strict SSL mode and custom domain on ACA env)
- Application Developer Role (Entra)

## Deployment

> [!IMPORTANT]
> Before deploying, update the `.bicepparam` files with your values:
>
> **`infra/bicep/main.bicepparam`:**
>
> - `parApimPublisherEmail` - Your email address
> - `parApimPublisherName` - Your name
> - `parCustomDomain` - Your custom domain (e.g., `openwebui.example.com`)
> - `parLocation` - Your Azure region
>
> **`infra/bicep/app.bicepparam`:**
>
> - `parCustomDomain` - Same custom domain as above
> - `parHubResourceGroupName` - Must match `parResourceGroupName` in main.bicepparam
> - `parHubVirtualNetworkName` - Must match `parVirtualNetworkName` in main.bicepparam
>
> **Naming Convention:** The Foundry resource is named `${parNamePrefix}-foundry` where `parNamePrefix` defaults to `open-webui-app` in app.bicep. Ensure `parFoundryName` in `main.bicepparam` matches this (e.g., `open-webui-app-foundry`).

### 1. Deploy Hub Infrastructure (VNet, DNS Zones, APIM shell)

Deploy the hub first to create networking, private DNS zones, and PE subnet:

```bash
# First deploy - creates VNet, DNS zones, PE subnet
# APIM will be created but Foundry backend won't be configured yet
az deployment sub create --location uksouth --template-file infra/bicep/main.bicep --parameters infra/bicep/main.bicepparam
```

> [!NOTE]
> This first deploy uses `parConfigureFoundry=false` (default) - Foundry backend, RBAC, and Entra token validation use placeholders. We'll redeploy with `parConfigureFoundry=true` and `parOpenWebUIAppId` after the app spoke is created.

**Note the output:**

- `outAppGatewayPublicIp` - Application Gateway public IP (for DNS)

### 2. Deploy App Infrastructure (Foundry, Container Apps, PostgreSQL)

Create the PFX certificate and deploy app spoke:

**Linux/macOS:**

```bash
# Create passwordless PFX and base64 encode it
openssl pkcs12 -export -out cloudflare-origin.pfx -inkey origin.key -in origin.pem -password pass:
base64 -w0 cloudflare-origin.pfx > pfx.b64

# Deploy app spoke infrastructure (replace <YourSecurePassword> with a strong password)
az deployment sub create --location uksouth --template-file infra/bicep/app.bicep --parameters infra/bicep/app.bicepparam --parameters parCertificatePfxBase64="$(cat pfx.b64)" parPostgresAdminPassword='<YourSecurePassword>'
```

**Windows (PowerShell):**

```powershell
# Create passwordless PFX and base64 encode it
openssl pkcs12 -export -out cloudflare-origin.pfx -inkey origin.key -in origin.pem -password pass:
$pfxBase64 = [Convert]::ToBase64String([IO.File]::ReadAllBytes("cloudflare-origin.pfx"))

# Deploy app spoke infrastructure (replace <YourSecurePassword> with a strong password)
az deployment sub create --location uksouth --template-file infra/bicep/app.bicep --parameters infra/bicep/app.bicepparam --parameters parCertificatePfxBase64=$pfxBase64 parPostgresAdminPassword='<YourSecurePassword>'
```

> [!IMPORTANT]
> **PostgreSQL Password Requirements:** Must be at least 8 characters with a mix of uppercase, lowercase, numbers, and special characters. The password is stored securely in Key Vault and used by Open WebUI to connect to the database.

**Note these outputs:**

- `outContainerAppFqdn` - Container App FQDN
- `outContainerAppEnvStaticIp` - Container App Environment static IP
- `outVirtualNetworkName` - Spoke VNet name
- `outOpenWebUIAppId` - Entra ID App Registration ID

**Update `main.bicepparam` with spoke values:**

- `parContainerAppFqdn` - Use `outContainerAppFqdn`
- `parContainerAppStaticIp` - Use `outContainerAppEnvStaticIp`
- `parSpokeVirtualNetworkName` - Use `outVirtualNetworkName`
- `parOpenWebUIAppId` - Use `outOpenWebUIAppId`

**Grant Admin Consent:**

1. Azure Portal → **Entra ID** → **App registrations** → **app-open-webui**
2. **API permissions** → **Grant admin consent**

### 3. Redeploy Hub (APIM Foundry Backend, RBAC + Entra Validation)

Redeploy hub with `parConfigureFoundry=true` to configure APIM with Foundry backend, grant RBAC, and enable Entra ID token validation:

```bash
# Redeploy hub - now APIM gets Foundry endpoint, RBAC is assigned, and Entra validation is enabled
az deployment sub create --location uksouth --template-file infra/bicep/main.bicep --parameters infra/bicep/main.bicepparam --parameters parConfigureFoundry=true
```

**Configure DNS:**

- Add A record pointing to Application Gateway public IP (`outAppGatewayPublicIp`)

**If using Cloudflare:**

- Enable proxy
- Set SSL/TLS mode to **Full (strict)**

### 4. Import OpenAPI Spec to APIM

> [!NOTE]
> This step is required due to Bicep's character limit on inline content. The OpenAPI spec must be imported manually via Azure CLI.

```bash
az apim api import --resource-group <your-rg> --service-name <apim-name> --api-id openai --path "openai/v1" --specification-format OpenApiJson --specification-path infra/bicep/openapi/openai.openapi.json --display-name "Azure OpenAI v1 API" --protocols https --subscription-required true
```

## Configuration

### Connect Open WebUI to Microsoft Foundry (via APIM)

1. Navigate to Open WebUI and log in with Entra ID
2. Go to **Admin Settings** → **Connections**
3. Add OpenAI-compatible connection:
   - **API Base URL**: `https://<apim-name>.azure-api.net/openai/v1`
   - **Headers**: Get from APIM subscription

```json
   {
    "api-key": "<sub-key>"
   }
   ```

- **API Type**: `OpenAI`
   - **Auth**: `OAuth`
   - **Model Ids**: Input all models deployed to Foundry,e.g. `gpt-5-mini`

open-webui-on-azure

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README