Spark on Ray on Vertex AI notebook (#3282)

Browse Source

* added example notebook for Spark on RoV

* added example notebook for Spark on RoV

* ran linter on spark_on_ray_on_vertex_ai.ipynb

* updated official CODEOWNERS file for spark on ray on vertex ai notebook

* fixed text

* fixed project and location variables for build

* lint run

* added docker authentication

* renamed docker repo

* added sdk version

* added quiet to docker authentication

* added explicit dependencies installation

* added google cloud aiplatform ray module installation

* added gcloud update and cleanup

* added a wait to avoid timeout error in the test build

* fixed cluster resource name in delete

* added timestamp suffix to cluster name

* added a 5 minutes wait after cluster creation

* address PR comments

...

This commit is contained in:

Ravi Dalal

2024-07-19 03:03:45 +00:00

committed by GitHub

parent 21864fd3a5

commit 61ea845e26

2 changed files with 1447 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

notebooks/official/ray_on_vertex_ai/spark_on_ray_on_vertex_ai.ipynb

+1446

File diff suppressed because it is too large Load Diff