xiaohei/model_garden
1
0
Fork 0
mirror of https://github.com/GoogleCloudPlatform/vertex-ai-samples.git synced 2026-09-26 14:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

Spark on rov (#3429)

Browse Source 
* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

added colab enterprise logo and link

* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

hope I fixed the JSON issue

* fix: remove new changes

* Update vertex_ai_feature_store_based_llm_grounding_tutorial.ipynb

remove back ticks from product/feature names

* Update spark_on_ray_on_vertex_ai.ipynb

Edited link text and added another link to relevant documentation

* added command to install JDK

---------

Co-authored-by: Katie Nguyen <21978337+katiemn@users.noreply.github.com>
Co-authored-by: Ravi Dalal <ravidalal@google.com>
This commit is contained in:
kittyabs
2024-08-16 00:34:10 +00:00
committed by GitHub
co-authored by Katie Nguyen Ravi Dalal
parent 04cc933895
commit 1b94ad8e59
1 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/official/ray_on_vertex_ai/spark_on_ray_on_vertex_ai.ipynb
+3 -2
View File
@@ -63,7 +63,7 @@
"source": [ "source": [
"This tutorial demonstrate how Spark can be run on Ray on Vertex AI using [RayDP](https://github.com/oap-project/raydp).\n", "This tutorial demonstrate how Spark can be run on Ray on Vertex AI using [RayDP](https://github.com/oap-project/raydp).\n",
"\n", "\n",
"Learn more about [Ray on Vertex AI overview](https://cloud.google.com/vertex-ai/docs/open-source/ray-on-vertex-ai/overview)." "Learn more about [Ray on Vertex AI](https://cloud.google.com/vertex-ai/docs/open-source/ray-on-vertex-ai/overview) and [Spark on Ray on Vertex AI](https://cloud.google.com/vertex-ai/docs/open-source/ray-on-vertex-ai/run-spark-on-ray)."
] ]
}, },
{ {
@@ -325,6 +325,7 @@
"FROM us-docker.pkg.dev/vertex-ai/training/ray-cpu.2-9.py310:latest\n", "FROM us-docker.pkg.dev/vertex-ai/training/ray-cpu.2-9.py310:latest\n",
"\n", "\n",
"RUN apt-get update -y \\\n", "RUN apt-get update -y \\\n",
" && apt-get install openjdk-21-jdk -y \\\n",
" && pip install --no-cache-dir raydp pyarrow==14.0 pandas==2.1.0" " && pip install --no-cache-dir raydp pyarrow==14.0 pandas==2.1.0"
] ]
}, },
@@ -590,7 +591,7 @@
" for i in range(max_tries):\n", " for i in range(max_tries):\n",
" try:\n", " try:\n",
" print(\n", " print(\n",
" f\"Attempting to connect to Ray server {i}, sleeping for 30 seconds...\"\n", " f\"Attempting to connect to Ray server {i+1}, sleeping for 30 seconds...\"\n",
" )\n", " )\n",
" time.sleep(30)\n", " time.sleep(30)\n",
" func()\n", " func()\n",