Ravi DalalandGitHub 7ae13b346a added notebooks and dockerfiles for serving open models on vertexai using vllm custom containers (#4148)
* added notebooks and dockerfiles for serving open models on vertexai using vllm customer containers

* updated official codeowners

* fixed linting errors

* fixed linting errors

* moved notebooks

* ran linter

* fixed param type

* added some formatting

* added autoscaling configuration to model deployment

* fixed a heading

* moved notebooks and docker folder under prediction

* updated notebook repo paths

* switched to raw_predict to avoid code changes and rebuild

* removed linting errors

* fixed readme lint error

* fixed links

* removed dedicated_endpoint_enabled

* updated workdir path

* fixed cell type

* added license

* fixed linting error

* using cloud build container image build

* fixed linting issues

* fixes

* cloudbuild yaml

* fixed gemini review comments

* fixed linting errors

* fixed tpu_count type

* handled invalid device type

* optimized dockerfile run command

* updated dockerfile

* addressed review comments

* fixed linting errors

* added license to cloudbuild and dockerfile

* optimized image build code

* fixed image_name variable
2025-08-08 18:01:03 +00:00
2025-08-01 14:29:14 +00:00
2021-07-02 10:28:00 -07:00
2023-03-14 21:46:43 +00:00
2021-06-01 14:55:51 -07:00
2024-07-09 02:09:34 +00:00
2021-11-12 11:32:03 -06:00

Google Cloud Google Cloud Vertex AI Samples

This repository contains notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

Overview

Vertex AI is a fully-managed, unified AI development platform for building and using generative AI. This repository is designed to help you get started with Vertex AI. Whether you're new to Vertex AI or an experienced ML practitioner, you'll find valuable resources here.

For more Vertex AI Generative AI notebook samples, please visit the Vertex AI Generative AI GitHub repository.

Explore, learn and contribute

You can explore, learn, and contribute to this repository to unleash the full potential of machine learning on Vertex AI!

Explore and learn

Explore this repository, follow the links in the header section of each of the notebooks to -

Colab Open and run the notebook in Colab
Colab Enterprise Open and run the notebook in Colab Enterprise
Workbench Open and run the notebook in Vertex AI Workbench
Github View the notebook on Github

Contribute

See the Contributing Guide.

Get started

To get started using Vertex AI, you must have a Google Cloud project.

Repository structure

├── notebooks
│   ├── official - Notebooks demonstrating use of each Vertex AI service
│   │   ├── automl
│   │   ├── custom
│   │   ├── ...
│   ├── community - Notebooks contributed by the community
│   │   ├── model_garden
│   │   ├── ...
├── community-content - Sample code and tutorials contributed by the community

Examples

Category Product Description
Model Model Garden/ Curated collection of first-party, open-source, and third-party models available on Vertex AI including Gemini, Gemma, Llama 3, Claude 3 and many more.
Data Feature Store/ Set up and manage online serving using Vertex AI Feature Store.
datasets/ Use BigQuery and Data Labeling service with Vertex AI.
Model development automl/ Train and make predictions on AutoML models
custom/ Create, deploy and serve custom models on Vertex AI
ray_on_vertex_ai/ Use Colab Enterprise and Vertex AI SDK for Python to connect to the Ray Cluster.
Deploy and use prediction/ Build, train and deploy models using prebuilt containers for custom training and prediction.
model_registry/ Use Model Registry to create and register a model.
Explainable AI/ Use Vertex Explainable AI's feature-based and example-based explanations to explain how or why a model produced a specific prediction.
ml_metadata/ Record the metadata and artifacts and query that metadata to help analyze, debug, and audit the performance of your ML system.
Tools Pipelines/ Use `Vertex AI Pipelines` and `Google Cloud Pipeline Components` to build, tune, or deploy a custom model.

Get help

Please use the Issues page to provide feedback or submit a bug report.

Disclaimer

This is not an officially supported Google product. The code in this repository is for demonstrative purposes only.

References

Languages
Jupyter Notebook 96.9%
Python 2.7%
Dockerfile 0.3%