Commit Graph
3302 Commits
Author SHA1 Message Date
c3998c9898 chore, refactor(egen): New template edits, clean up code refactor, remove future tense (#3403)
* Adapted notebook with new notebook template

* Added variable value which is used in further steps

* Added required permissions for service account

* chore, refactor: Follows new template, removes future tense, restricted links, refactors the cleaning up section

* feat: adds '-m' while deleting the cloud storage bucket

* chore: addresses the review comments

* chore: removes version mention for bison models and adds references to model versions and supported rlhf models

---------

Co-authored-by: nileshspringml <nilesh.mahajan@egen.ai>
Co-authored-by: krishr2d2 <krishna.movva@egen.ai>
2024-08-12 14:37:52 +00:00
1ab9e4b6e3 Add common fn related to image task (#3417)
Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-12 14:33:12 +00:00
8a2b41c5f1 fix, refactor, chore: Fix docker steps, Colab steps, follows new template etc. (#3385)
* chore: adds Colab Enterprise link

* fix, refactor, chore: Fixes the docker container image creation steps and predictions step, refactors the code to skip unnecessary steps and markdown text correction and simplification

* fix, chore: fixes typos in serving script, markdown text corrections, adds custom folder removal step in the cleanup section

* fix: adds --project for Colab steps and replaces the docker build and docker push with gcloud builds submit command for Colab

---------

Co-authored-by: krishr2d2 <krishna.movva@egen.ai>
2024-08-09 21:39:47 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
c3966ae8f3 chore(deps): bump tensorflow (#3381)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.7.2 to 2.12.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.7.2...v2.12.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-09 21:38:30 +00:00
Ayush AgrawalandGitHub 7b4d745853 feat: Add Slack and Jira Source file uploads and 3P embedding model config example for corpus creation (#3404)
* feat: Add Slack and Jira source file imports and Endpoint resource embedding model configuration for corpus creation

* docs: Link reference to deploying 3P models to endpoint

* fix: update linting
2024-08-09 21:29:36 +00:00
Aaron DietzandGitHub 216931b90d Update sdk_automl_tabular_binary_classification_batch_explain.ipynb (#3409)
Converted two bullet points into paragraphs because the bullets messed with how the key tasks were imported into our docs.
2024-08-09 21:28:23 +00:00
Aaron DietzandGitHub de16c7623d Minor update to text in sdk_automl_video_classification_batch.ipynb (#3410)
Converted two bullets into paragraphs because the bullets messed with how the key tasks were rendered in our docs
2024-08-09 21:27:45 +00:00
Aaron DietzandGitHub 569db62fc7 Minor update to text in sdk_automl_video_action_recognition_batch.ipynb (#3411)
Converted two bullets into paragraphs because the bullets messed with how the key tasks were rendered in our docs
2024-08-09 20:55:09 +00:00
Aaron DietzandGitHub fd8a0a2d0c Minor update to text in automl_image_classification_batch_prediction.ipynb (#3412)
Converted two bullets into paragraphs because the bullets messed with how the key tasks were rendered in our docs
2024-08-09 20:54:27 +00:00
f5366faca7 Refactor paligemma and codegemma notebooks (#3408)
* refactor: refactor paligemma and codegemma notebooks

* fix lint issues

* fix lint issues

* fix lint issues

---------

Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-09 20:53:42 +00:00
Ayush AgrawalandGitHub 170205fe08 Update model_garden_rag.ipynb notebook metadata (#3406) 2024-08-09 20:52:52 +00:00
Aaron DietzandGitHub 3ece113c7a Minor update to text in automl_tabular_classification_beans.ipynb (#3413)
Updates objectives to eliminate nested bullets (those didn't get rendered in our docs) and removes some bolding that wasn't rendering properly in our docs
2024-08-09 20:52:07 +00:00
Aaron DietzandGitHub acee2878b0 Minor update to notebook_template_review.py (#3414)
Moved a couple name/variable swaps up before "Vertex AI" so that it'll catch them.
2024-08-09 20:51:14 +00:00
Kathy YuandGitHub bb0ded3c46 Update Llama 2 evaluation notebook. (#3415) 2024-08-09 20:50:47 +00:00
nathreya-googleandGitHub 4921cbce9b Add chat completions sample for llama3 deployment. (#3407) 2024-08-08 21:35:45 +00:00
Mend RenovateandGitHub dbcdef9588 chore(deps): update dependency nbqa to v1.8.7 (#3400) 2024-08-07 09:42:49 +00:00
cc53c8e9d9 refactor: refactor mistral and mixtral deployment notebooks (#3401)
Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-07 09:29:16 +00:00
7590168238 feat: add resize image function to common util (#3399)
Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-06 17:37:14 +00:00
5cac0e6d0b refactor,chore(egen): added colab enterprise link (#3398)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 17:35:11 +00:00
c3d25502bf refactor,chore(egen): added colab enterprise link (#3394)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 05:40:54 +00:00
Kaushik KoiladaandGitHub f34deeccc5 chore, refactor(egen): tpuv5e_gemma_peft_finetuning_and_serving notebook fix (#3159)
* chore: remove boilerplate and adds colab enterprise, and changes region to location

* chore: lint run

* chore: comments addressed and lint run
2024-08-06 05:34:49 +00:00
Kaushik KoiladaandGitHub d434b5ddbc chore,refactor(egen): formats and edits notebooks/official/training/tpuv5e_llama2_pytorch_finetuning_and_serving.ipynb notebook (#3144)
* chore: reformats the copyright and run buttons. adds colab enterprise

* chore: reorders and formats markdown sections and removes boilerplate

* chore: remove boilerplate and reformats based on template

* chore,refactor: adds colab enterprise and refactors the cells according to template

* fix: rectifies issue with testing
2024-08-06 05:33:58 +00:00
42a8600aa7 chore,refactor(egen): minor changes to the automl_tabular_on_vertex_pipelines notebook (#3298)
* chore,refactor(egen): Changed REGION variable name to LOCATION, defined two variables to get the pipelines names to be used in cleanup section, added cleanup code for deletion of pipelines and models, replaced uuid with unique,removed os.getenv(IS_TESTING) from the cleanup section, refactored code according to the template guidelines and performed linter test.

* fix(egen): changed the version of google-cloud-pipeline-components and performed linter test.

* chore(egen): changed the version of google cloud pipeline components package in installation step and performed linter test.

* fix(egen): changed the model-evaluation parameter to model-evaluation-2 in get_evaluation_metrics function and performed linter test.

* fix(egen): modified the code in get_feature_attributions helper function and performed linter test.

* fix(egen): modified code in cleanup section to delete pipeline jobs and performed linter test.

* fix(egen): renamed model-upload-2 to model-upload in cleanup code of automl tabular architecture pipeline and performed linter test.

* chore(egen): changed the colab enterprise link by renaming automml to automl in link and performed linter test.

---------

Co-authored-by: sriramya2610 <sriramya.peddapally@egen.ai>
2024-08-06 04:21:51 +00:00
Kaushik KoiladaandGitHub 5ec392769a chore, refactor(egen): refactors the SDK_Custom_Training_Python_Package_Managed_Text_Dataset_Tensorflow_Serving_Container notebook (#3224)
* chore: adds colab enterprise, removes boilerplate and edits according to template

* chore: run end to end notebook

* chore, refactor: formats, runs end to end

* chore: lint

* chore: addresses comments and changes headers according to guidelines

* chore:review comments addressed

* chore: addresses review comments

* chore: lint run pass
2024-08-06 04:18:11 +00:00
a008c7b4f9 refactor, chore(egen): Removes boilerplate, heading fixes, and other corrections from template (#3092)
* refactor, chore(egen): Removes boilerplate, heading fixes, and other corrections from template

* Updated minor template related issue

* Change variable name from REGION to LOCATION

* removed unated variable

* Made variable values more redable

* Removed unwated commentes from header

* fix, chore: replaces test sample file with eval sample file, adds comments to the cleaning up section

* fix: replaces text-bison@001 with tex-bison@002, reverts the post-tuning data sample to test sample

---------

Co-authored-by: Krishna Chaithanya Movva <krishna.movva@springml.com>
Co-authored-by: krishr2d2 <krishna.movva@egen.ai>
2024-08-06 03:52:26 +00:00
e06b958cd8 refactor,chore(egen) : refactored code according to template guidelines (#3285)
* refactor,chore(egen) : refactored code according to template guidelines

* refactor,chore(egen) : added code to delete locally generated files and refactored as per template guidelines

* refactor,chore(egen) : refactored according to template guidelines

* refcator(egen): refactored notebook according to template guidelines

* refactor,chore(egen): fix %%bigquery command usage

* refactor,chore(egen): removed hardcoded value

---------

Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:47:17 +00:00
811d321451 refactor,chore(egen): added colab enterprise for custom_tabular_train_batch_pred_bq_pipeline notebook (#3387)
* refactor,chore(egen): added colab enterprise link for custom_tabular_train_batch_pred_bq_pipeline notebook

* refactor,chore(egen): added colab enterprise link for custom_tabular_train_batch_pred_bq_pipeline notebook

---------

Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:38:12 +00:00
6aff88a23f refactor,chore(egen): added colab enterprise link (#3390)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:36:50 +00:00
1b4f1ab9c5 refactor,chore(egen):added colab enterprise link (#3391)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:36:07 +00:00
8afb0dd4b3 refactor,chore(egen): added colab enterprise link (#3393)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:35:29 +00:00
94f3c08adb refactor,chore(egen): added colab enterprise link (#3392)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:34:33 +00:00
sumanvitaandGitHub 598d9b0207 typo fix in markdown (#3383) 2024-08-06 00:13:07 +00:00
ac2d168c96 refactor, chore(egen): updates dataset import process, adds gcfs library, other corrections from template (#3354)
* <refactor, chore> data is copied to project's own bucket for importing into the dataset, added gcfs library, other corrections from template

* <refactor, chore> data is copied to project's own bucket for importing into the dataset, added gcfs library, other corrections from template

* markdown edits

* markdown edits

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-08-06 00:05:48 +00:00
6bba78f9e2 refactor,chore(egen): added colab enterprise link for automl_video_classification_model_evaluation notebook (#3384)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 00:02:23 +00:00
eb8a0a93a2 refactor,chore(egen): added colab enterprise for lightweight_functions_component_io_kfp notebook (#3386)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 00:01:16 +00:00
2921efcf64 refactor,chore(egen): added colab enterprise link (#3388)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:59:33 +00:00
8b9afc3fb4 refactor,chore(egen): added colab enterprise link (#3389)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:58:43 +00:00
7d2b5ac7a4 refactor,chore(egen): added colab enterprise link (#3395)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:58:04 +00:00
db0758197f refactor,chore(egen): added colab enterprise link (#3397)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:57:25 +00:00
69518e8834 chore(egen): modified colab link, colab enterprise link, workbench link and github link in markdown and perfomed linter test. (#3378)
Co-authored-by: sriramya2610 <sriramya.peddapally@egen.ai>
2024-08-05 23:44:25 +00:00
c36e5f204d Update new job name creation format (#3377)
Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-02 20:55:38 +00:00
Mend RenovateandGitHub 0be74ddfa5 chore(deps): update dependency black to v24.8.0 (#3379) 2024-08-02 20:55:04 +00:00
sefgsefgandGitHub efd93073d0 Linear regression predictor using sklearn (#3357)
* Upload torch transformers predictor sample

This sample uses the aiplatform SDK and torch library to implement transformers predictor.

* Linear regression predictor using sklearn

Upload a linear regression predictor sample using scikit-learn lib.
2024-08-01 13:50:05 +00:00
cc2011e354 Make mistral notebook tunable (#3374)
* Make mistral notebook tunable

* make minor improvements

* make minor improvements

---------

Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-01 13:47:50 +00:00
Huguens JeanandGitHub 772881903b [MG Model Team] Add environment variable for downscaling video frames prior to prediction. (#3370) 2024-08-01 13:45:27 +00:00
Xiang XuandGitHub 04f86e647d Fix machine_type in model_garden_pytorch_llama3_1_deployment (#3373) 2024-08-01 13:44:36 +00:00
de120ccd62 refactor(egen): Colab enterprise link fix (#3368)
* <refactor, chore> Updated prebuilt container image for prediction to 1.3, scikit-learn package updated to 2.5.1, other corrections from template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 23:39:32 +00:00
0e5c1cebdf Update url to /generative ai/docs (#3319)
* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

added colab enterprise logo and link

* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

hope I fixed the JSON issue

* fix: remove new changes

* Update vertex_ai_feature_store_based_llm_grounding_tutorial.ipynb

remove back ticks from product/feature names

* Update distillation.ipynb

update url to point to /vertex-ai/generative-ai/docs

---------

Co-authored-by: Katie Nguyen <21978337+katiemn@users.noreply.github.com>
2024-07-31 23:36:29 +00:00
cb0caee3ea Update gemma2 notebook to include 2b instructions. (#3369)
Co-authored-by: Pooya Moradi <pooyam@google.com>
2024-07-31 15:21:38 +00:00
Yashika GandhiandGitHub 8eedc45652 Feat: Adding Phi-3 deployment notebook (#3364)
* Feat: Adding Phi 3 deployment notebook

* Adding Phi 3 deployment notebook

* Adding Phi 3 deployment notebook

* lint
2024-07-31 15:05:12 +00:00