Containerized Hybrid Deployment Options in Dagster+

Dagster+ supports multiple containerized hybrid deployment options:

• Kubernetes (AKS on Azure, or other Kubernetes clusters)

• AWS ECS

• Docker Agent

• Azure Container Registry with Docker Agent on VM

For a lightweight containerized setup on Azure without Kubernetes:

1. Set up a Docker agent on an Azure VM

2. Configure Azure Container Registry (ACR) for image storage

3. Configure the Docker agent to pull images from ACR. Alternatively, Azure Virtual Machine Scale Sets (VMSS) can be used for scalability

While Kubernetes is a common deployment option, it's not required for containerized deployments. The Docker agent can run containers without Kubernetes orchestration, providing a lighter-weight solution for organizations that don't need the full complexity of a Kubernetes setup.

• For detailed implementation guides, refer to:

  • Docker deployment guide

  • Kubernetes deployment guide

  • AWS ECS deployment guide

  • Azure deployment guide

  • Hybrid deployment security documentation