Skip to content

CRITICAL: Both backend and frontend container images replaced with hello-world #43

@yortch

Description

@yortch

Configuration Drift Detected — Check #49 (2026-03-17 21:30 UTC)

Severity: CRITICAL — Complete Application Outage

Summary

Both ca-banking-demo-backend and ca-banking-demo-frontend container images have been replaced with the generic mcr.microsoft.com/azuredocs/containerapps-helloworld:latest image. This results in a complete outage of the Three Rivers Bank credit card comparison platform — neither the backend API nor the frontend UI are serving production code.

Drift Details

Property Backend Frontend
Current Image mcr.microsoft.com/azuredocs/containerapps-helloworld:latest mcr.microsoft.com/azuredocs/containerapps-helloworld:latest
Expected Image crbankingdemooqaqx.azurecr.io/three-rivers-bank/backend-banking-demo:azd-deploy-1773698363 crbankingdemooqaqx.azurecr.io/three-rivers-bank/frontend-banking-demo:azd-deploy-1773698383
Current Revision ca-banking-demo-backend--0000007 (was --0000006) ca-banking-demo-frontend--0000006 (was --0000005)
Resource Limits ✅ 0.5 CPU, 1Gi ✅ 0.25 CPU, 0.5Gi
Env Vars ✅ All correct ✅ VITE_API_BASE_URL corrected

Context

Impact

  • Backend API: Not serving Spring Boot application — all /api/cards endpoints return hello-world response
  • Frontend UI: Not serving React application — users see generic hello-world page
  • End Users: Complete loss of service

Recommended Remediation

Option 1 — Targeted image restore (fastest):

# Restore backend image
az containerapp update -n ca-banking-demo-backend -g rg-banking-demo \
  --subscription 529eddcc-17c4-4834-842d-73670845229b \
  --image crbankingdemooqaqx.azurecr.io/three-rivers-bank/backend-banking-demo:azd-deploy-1773698363

# Restore frontend image
az containerapp update -n ca-banking-demo-frontend -g rg-banking-demo \
  --subscription 529eddcc-17c4-4834-842d-73670845229b \
  --image crbankingdemooqaqx.azurecr.io/three-rivers-bank/frontend-banking-demo:azd-deploy-1773698383

Option 2 — Full redeploy:

azd deploy

Investigation Recommended

The repeated replacement of production images with hello-world suggests either unauthorized access, a misconfigured CI/CD pipeline, or deliberate testing. An audit of Azure Activity Logs for the rg-banking-demo resource group is recommended to identify the actor and prevent recurrence.

This issue was created by three-rivers-bank-sre--35969ff3
Tracked by the SRE agent here

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions