On Docker Desktop, open Settings, go to AI, and enable Docker Model Runner. If you are on Windows with a supported NVIDIA GPU ...
It contains a production grade implementation including DEPLOYMENT code with CDK and a CI/CD pipeline, testing, observability and more (see Features section). Choose the architecture that you see fit, ...