Run Gemma with Ollama on Cloud Run
Deploy Google's Gemma 2B open model on Cloud Run using Ollama for CPU-based inference with this sample project, providing an accessible way to run smaller LLMs in a serverless environment.
Use these gcloud commands to give your Cloud Run service a shorter *.cloud.run URL instead of the default .run.app address.
Cloud Run instances let you run a container with built-in SSH, explicit stop and start controls, and zero compute charges while stopped.
A hands-on look at how rebaseable container images are structured on Cloud Run, using Docker and FROM scratch.