Files

Docker build system

This folder contains the files needed to build the base llama_deploy images that can be used to simplify deployments by reducing boiler plate code.

Image Development

Images are built with BuildKit and we use bake to orchestrate the process. To build all the available images run:

docker buildx bake all

You can override any variable defined in the docker-bake.hcl file and build custom images, for example if you want to use a branch from the llama_deploy repo instead of an official release, run:

LLAMA_DEPLOY_VERSION=mybranch_or_tag docker buildx bake

Multi-Platform Builds

llama_deploy images support multiple architectures. Depending on your operating system and Docker environment, you might not be able to build all of them locally.

This is the error you might encounter:

multiple platforms feature is currently not supported for docker driver. Please switch to a different driver
(eg. “docker buildx create --use”)

Make sure containerd image store is enabled, following the instruction in the Docker documentation.

If the problem persists, one solution is to override the platform option and limit local builds to the same architecture as your computer's. For example, on an Apple M1 you can limit the builds to ARM only by invoking bake like this:

docker buildx bake control_plane --set "*.platform=linux/arm64"