xiaohei/model_garden
1
0
Fork 0
mirror of https://github.com/GoogleCloudPlatform/vertex-ai-samples.git synced 2026-09-26 14:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

Spark on Ray on Vertex AI notebook (#3282)

Browse Source 
* added example notebook for Spark on RoV

* added example notebook for Spark on RoV

* ran linter on spark_on_ray_on_vertex_ai.ipynb

* updated official CODEOWNERS file for spark on ray on vertex ai notebook

* fixed text

* fixed project and location variables for build

* lint run

* added docker authentication

* renamed docker repo

* added sdk version

* added quiet to docker authentication

* added explicit dependencies installation

* added google cloud aiplatform ray module installation

* added gcloud update and cleanup

* added a wait to avoid timeout error in the test build

* fixed cluster resource name in delete

* added timestamp suffix to cluster name

* added a 5 minutes wait after cluster creation

* address PR comments
This commit is contained in:
Ravi Dalal
2024-07-19 03:03:45 +00:00
committed by GitHub
parent 21864fd3a5
commit 61ea845e26
2 changed files with 1447 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/official/CODEOWNERS
+1
View File
@@ -56,3 +56,4 @@
/training/tpuv5e_gemma_peft_finetuning_and_serving.ipynb @brianchunkang
/training/tpuv5e_llama2_pytorch_finetuning_and_serving.ipynb @brianchunkang @chiefkarlin
/prediction/get_started_with_psc_private_endpoint.ipynb @tianjiaoliu
/ray_on_vertex_ai/spark_on_ray_on_vertex_ai.ipynb @ravidalal
notebooks/official/ray_on_vertex_ai/spark_on_ray_on_vertex_ai.ipynb
+1446
View File
File diff suppressed because it is too large Load Diff