Commit Graph
3287 Commits
Author SHA1 Message Date
Mend RenovateandGitHub dbcdef9588 chore(deps): update dependency nbqa to v1.8.7 (#3400) 2024-08-07 09:42:49 +00:00
cc53c8e9d9 refactor: refactor mistral and mixtral deployment notebooks (#3401)
Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-07 09:29:16 +00:00
7590168238 feat: add resize image function to common util (#3399)
Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-06 17:37:14 +00:00
5cac0e6d0b refactor,chore(egen): added colab enterprise link (#3398)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 17:35:11 +00:00
c3d25502bf refactor,chore(egen): added colab enterprise link (#3394)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 05:40:54 +00:00
Kaushik KoiladaandGitHub f34deeccc5 chore, refactor(egen): tpuv5e_gemma_peft_finetuning_and_serving notebook fix (#3159)
* chore: remove boilerplate and adds colab enterprise, and changes region to location

* chore: lint run

* chore: comments addressed and lint run
2024-08-06 05:34:49 +00:00
Kaushik KoiladaandGitHub d434b5ddbc chore,refactor(egen): formats and edits notebooks/official/training/tpuv5e_llama2_pytorch_finetuning_and_serving.ipynb notebook (#3144)
* chore: reformats the copyright and run buttons. adds colab enterprise

* chore: reorders and formats markdown sections and removes boilerplate

* chore: remove boilerplate and reformats based on template

* chore,refactor: adds colab enterprise and refactors the cells according to template

* fix: rectifies issue with testing
2024-08-06 05:33:58 +00:00
42a8600aa7 chore,refactor(egen): minor changes to the automl_tabular_on_vertex_pipelines notebook (#3298)
* chore,refactor(egen): Changed REGION variable name to LOCATION, defined two variables to get the pipelines names to be used in cleanup section, added cleanup code for deletion of pipelines and models, replaced uuid with unique,removed os.getenv(IS_TESTING) from the cleanup section, refactored code according to the template guidelines and performed linter test.

* fix(egen): changed the version of google-cloud-pipeline-components and performed linter test.

* chore(egen): changed the version of google cloud pipeline components package in installation step and performed linter test.

* fix(egen): changed the model-evaluation parameter to model-evaluation-2 in get_evaluation_metrics function and performed linter test.

* fix(egen): modified the code in get_feature_attributions helper function and performed linter test.

* fix(egen): modified code in cleanup section to delete pipeline jobs and performed linter test.

* fix(egen): renamed model-upload-2 to model-upload in cleanup code of automl tabular architecture pipeline and performed linter test.

* chore(egen): changed the colab enterprise link by renaming automml to automl in link and performed linter test.

---------

Co-authored-by: sriramya2610 <sriramya.peddapally@egen.ai>
2024-08-06 04:21:51 +00:00
Kaushik KoiladaandGitHub 5ec392769a chore, refactor(egen): refactors the SDK_Custom_Training_Python_Package_Managed_Text_Dataset_Tensorflow_Serving_Container notebook (#3224)
* chore: adds colab enterprise, removes boilerplate and edits according to template

* chore: run end to end notebook

* chore, refactor: formats, runs end to end

* chore: lint

* chore: addresses comments and changes headers according to guidelines

* chore:review comments addressed

* chore: addresses review comments

* chore: lint run pass
2024-08-06 04:18:11 +00:00
a008c7b4f9 refactor, chore(egen): Removes boilerplate, heading fixes, and other corrections from template (#3092)
* refactor, chore(egen): Removes boilerplate, heading fixes, and other corrections from template

* Updated minor template related issue

* Change variable name from REGION to LOCATION

* removed unated variable

* Made variable values more redable

* Removed unwated commentes from header

* fix, chore: replaces test sample file with eval sample file, adds comments to the cleaning up section

* fix: replaces text-bison@001 with tex-bison@002, reverts the post-tuning data sample to test sample

---------

Co-authored-by: Krishna Chaithanya Movva <krishna.movva@springml.com>
Co-authored-by: krishr2d2 <krishna.movva@egen.ai>
2024-08-06 03:52:26 +00:00
e06b958cd8 refactor,chore(egen) : refactored code according to template guidelines (#3285)
* refactor,chore(egen) : refactored code according to template guidelines

* refactor,chore(egen) : added code to delete locally generated files and refactored as per template guidelines

* refactor,chore(egen) : refactored according to template guidelines

* refcator(egen): refactored notebook according to template guidelines

* refactor,chore(egen): fix %%bigquery command usage

* refactor,chore(egen): removed hardcoded value

---------

Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:47:17 +00:00
811d321451 refactor,chore(egen): added colab enterprise for custom_tabular_train_batch_pred_bq_pipeline notebook (#3387)
* refactor,chore(egen): added colab enterprise link for custom_tabular_train_batch_pred_bq_pipeline notebook

* refactor,chore(egen): added colab enterprise link for custom_tabular_train_batch_pred_bq_pipeline notebook

---------

Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:38:12 +00:00
6aff88a23f refactor,chore(egen): added colab enterprise link (#3390)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:36:50 +00:00
1b4f1ab9c5 refactor,chore(egen):added colab enterprise link (#3391)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:36:07 +00:00
8afb0dd4b3 refactor,chore(egen): added colab enterprise link (#3393)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:35:29 +00:00
94f3c08adb refactor,chore(egen): added colab enterprise link (#3392)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 03:34:33 +00:00
sumanvitaandGitHub 598d9b0207 typo fix in markdown (#3383) 2024-08-06 00:13:07 +00:00
ac2d168c96 refactor, chore(egen): updates dataset import process, adds gcfs library, other corrections from template (#3354)
* <refactor, chore> data is copied to project's own bucket for importing into the dataset, added gcfs library, other corrections from template

* <refactor, chore> data is copied to project's own bucket for importing into the dataset, added gcfs library, other corrections from template

* markdown edits

* markdown edits

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-08-06 00:05:48 +00:00
6bba78f9e2 refactor,chore(egen): added colab enterprise link for automl_video_classification_model_evaluation notebook (#3384)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 00:02:23 +00:00
eb8a0a93a2 refactor,chore(egen): added colab enterprise for lightweight_functions_component_io_kfp notebook (#3386)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-06 00:01:16 +00:00
2921efcf64 refactor,chore(egen): added colab enterprise link (#3388)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:59:33 +00:00
8b9afc3fb4 refactor,chore(egen): added colab enterprise link (#3389)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:58:43 +00:00
7d2b5ac7a4 refactor,chore(egen): added colab enterprise link (#3395)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:58:04 +00:00
db0758197f refactor,chore(egen): added colab enterprise link (#3397)
Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-08-05 23:57:25 +00:00
69518e8834 chore(egen): modified colab link, colab enterprise link, workbench link and github link in markdown and perfomed linter test. (#3378)
Co-authored-by: sriramya2610 <sriramya.peddapally@egen.ai>
2024-08-05 23:44:25 +00:00
c36e5f204d Update new job name creation format (#3377)
Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-02 20:55:38 +00:00
Mend RenovateandGitHub 0be74ddfa5 chore(deps): update dependency black to v24.8.0 (#3379) 2024-08-02 20:55:04 +00:00
sefgsefgandGitHub efd93073d0 Linear regression predictor using sklearn (#3357)
* Upload torch transformers predictor sample

This sample uses the aiplatform SDK and torch library to implement transformers predictor.

* Linear regression predictor using sklearn

Upload a linear regression predictor sample using scikit-learn lib.
2024-08-01 13:50:05 +00:00
cc2011e354 Make mistral notebook tunable (#3374)
* Make mistral notebook tunable

* make minor improvements

* make minor improvements

---------

Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-08-01 13:47:50 +00:00
Huguens JeanandGitHub 772881903b [MG Model Team] Add environment variable for downscaling video frames prior to prediction. (#3370) 2024-08-01 13:45:27 +00:00
Xiang XuandGitHub 04f86e647d Fix machine_type in model_garden_pytorch_llama3_1_deployment (#3373) 2024-08-01 13:44:36 +00:00
de120ccd62 refactor(egen): Colab enterprise link fix (#3368)
* <refactor, chore> Updated prebuilt container image for prediction to 1.3, scikit-learn package updated to 2.5.1, other corrections from template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* <refactor> refactored notebok according to notebook template

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 23:39:32 +00:00
0e5c1cebdf Update url to /generative ai/docs (#3319)
* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

added colab enterprise logo and link

* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

hope I fixed the JSON issue

* fix: remove new changes

* Update vertex_ai_feature_store_based_llm_grounding_tutorial.ipynb

remove back ticks from product/feature names

* Update distillation.ipynb

update url to point to /vertex-ai/generative-ai/docs

---------

Co-authored-by: Katie Nguyen <21978337+katiemn@users.noreply.github.com>
2024-07-31 23:36:29 +00:00
cb0caee3ea Update gemma2 notebook to include 2b instructions. (#3369)
Co-authored-by: Pooya Moradi <pooyam@google.com>
2024-07-31 15:21:38 +00:00
Yashika GandhiandGitHub 8eedc45652 Feat: Adding Phi-3 deployment notebook (#3364)
* Feat: Adding Phi 3 deployment notebook

* Adding Phi 3 deployment notebook

* Adding Phi 3 deployment notebook

* lint
2024-07-31 15:05:12 +00:00
255b520c01 feat: add qwen2 deployment notebook (#3345)
* feat: add qwen2 deployment notebook

* fix lint issues

* Qwen2 additional minor improvements

* Fix lint issues

---------

Co-authored-by: Rayan Dasoriya <dasoriya@google.com>
2024-07-31 11:41:44 +00:00
sumanvitaandGitHub 5b079af33d fix, refactor, chore(egen): adds matplotlib library in installation step, adds code to delete locally generated files, refactors code as per new template guidelines (#3271)
* fix, refactor, chore(egen): adds matplotlib library in installation step, adds code to delete locally generated files, refactors code as per new template guidelines, contraction of words, performs linter test

* fix, refactor, chore(egen): adds matplotlib library in installation step, adds code to delete locally generated files, refactors code as per new template guidelines, contraction of words, performs linter test

* Adds deprecation note for user managed instances
2024-07-31 05:50:52 +00:00
bd89533c50 chore, feat, refactor(Egen): Clean up steps, template update etc. (#3341)
* chore, feat, refactor: Remove future tense, follows new notebook template, adds cleanup step for deleting the pipelines and models created, refactors the utility functions to fetch model resource

* fix: corrects the notebook name in the links

* chore: addresses review comments

* fix: loads the model from resource name before deletion

---------

Co-authored-by: krishr2d2 <krishna.movva@egen.ai>
2024-07-31 05:47:58 +00:00
Kaushik KoiladaandGitHub 6555569156 chore,refactor(egen): reformats get_started_with_custom_training_autologging_local_script.ipynb notebook (#3179)
* chore: lint edits

* fix: retrieval of custom job removed as there is error in the method being called and also existing job object exists
2024-07-31 05:41:54 +00:00
Kaushik KoiladaandGitHub a6aa61ae1d chore, refactor(egen):edits template of get_started_with_model_monitoring_automl_image_batch notebook (#3269)
* chore: adds the colab enterprise and formates all open in tabs

* chore: changes 'Run in colab' to 'Open in Colab'

* chore: splits content of first cell for formatting

* refactor: fixes pip  install and rectifies disable_early_stopping  parameter description

* fix: image dataset csv is changed because of permission issue when importing from the content of the csv

* chore: running end to end notebook

* chore: removes testing variables and lints

* chore: markdown edits and end to end test

* chore: lint changes

* refactor: adds try except block following all the other cell codes
2024-07-31 05:37:07 +00:00
Kaushik KoiladaandGitHub 1580c63617 chore, refactor(egen): refactors automl_image_object_detection_export_edge.ipynb notebook (#3297)
* chore, refactor: removes boilerplate, adds colab enterprise and makes changes according to template and authoring guide

* chore: lint

* fix: adds dataset copying code to fix data access issue

* chore: lint

* fix: adds gcsfs package to deal with the check error

* chore: clears outputs
2024-07-31 05:30:30 +00:00
e05e777d1d refactor, chore(egen): xgboost package version set to 1.7.1, updates serving container image to 1.7, deletes intermediate files, other fixes from template (#3306)
* <refactor, chore> xgboost package version set to 1.7.1, updates serving continer image to 1.7, deletes intermediate files, other fixes from template

* <refactor, chore> xgboost package version set to 1.7.1, updates serving continer image to 1.7, deletes intermediate files, other fixes from template

* <refactor, chore> xgboost package version set to 1.7.1, updates serving continer image to 1.7, deletes intermediate files, other fixes from template

* Colab logo fix

* Colab logo fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 05:27:40 +00:00
91efb27aea refactor,chore(egen): refactored code as per template guidelines (#3344)
* refactor,chore(egen): refactored code as per template guidelines

* refactor,chore(egen): fix region variable

* refactor(egen): refactored notebook as per template guielines

* refactor,chore(egen): performed linter test

---------

Co-authored-by: Jayakrishna2801 <jayakrishna.rajaboina@egen.ai>
2024-07-31 05:24:15 +00:00
b08b7a21f1 Fix url to gen ai (#3318)
* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

added colab enterprise logo and link

* Update build_model_experimentation_lineage_with_prebuild_code.ipynb

hope I fixed the JSON issue

* fix: remove new changes

* Update vertex_ai_feature_store_based_llm_grounding_tutorial.ipynb

remove back ticks from product/feature names

* Update tune_peft.ipynb

 “fix: update links in notebook”

* Update tune_peft.ipynb

add colab enterprise link

* Update tune_peft.ipynb

removed link

* Update tune_peft.ipynb

updated the link to /generative-ai/docs/tune_peft.ipynb and other edits

* fix: linter errors

---------

Co-authored-by: Katie Nguyen <21978337+katiemn@users.noreply.github.com>
2024-07-31 05:18:50 +00:00
3b2adb2e1d refactor(egen): Colab enterprise link fix (#3356)
* <refactor> refactored notebook according to template

* Apply edits suggested by @kittyabs

* Apply suggested edits from @kittyabs review

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 05:16:41 +00:00
472fe95430 refactor(egen): Colab enterprise link fix (#3355)
* <refactor, chore> refactored notebook according to new template

* Applied suggested edits

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 05:15:59 +00:00
cb8ec73e0a refactor(egen): Colab enterprise link fix (#3358)
* <fix, refactor> fixed and refactored notebook according to the template

* Apply suggested edits from @kittyabs

* Apply suggested edits from @kittyabs

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 05:15:22 +00:00
510e3d08ce refactor(egen): Colab enterprise link fix (#3359)
* <refactor, chore, fix> package version updates, pipeline components documentation link update, importer_node import fix, machineSpec update

* <refactor, chore, fix> package version updates, pipeline components documentation link update, importer_node import fix, machineSpec update

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 05:14:41 +00:00
9e3edfc8e4 refactor(egen): Colab enterprise link fix (#3360)
* <refactor, chore> replaces K80 GPU with T4, updates pre-built Docker container image for training and prediction to 2.13, cleansup intermediate files, updates kfp and tensorflow versions, fixes minor spelling mistakes and contracts words, removes future tense

* <refactor, chore> replaces K80 GPU with T4, updates pre-built Docker container image for training and prediction to 2.13, cleansup intermediate files, updates kfp and tensorflow versions, fixes minor spelling mistakes and contracts words, removes future tense

* <refactor, chore> replaces K80 GPU with T4, updates pre-built Docker container image for training and prediction to 2.13, cleansup intermediate files, updates kfp and tensorflow versions, fixes minor spelling mistakes and contracts words, removes future tense

* Grammar fix

* lint fix

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 05:13:43 +00:00
72c3ad3e26 refactor(egen): Colab enterprise link fix (#3361)
* <refactore, chore>refactored notebook according to the template

* refactor: Apply markdown text edit

* source distribution fix

* source distribution fix

* Colab enterprise link fix

---------

Co-authored-by: SumanthKasula99 <sumanth.kasula@egen.ai>
2024-07-31 05:12:55 +00:00