6424515b03
Migrate gsutil usage to gcloud storage ( #4339 )
...
* Migrate gsutil usage to gcloud storage
* Manual Changes
* Manual Changes
* Fix: Updated gcloud storage command without formatting
* Manual Changes
* Manual Changes
* Revert "Manual Changes"
This reverts commit a7a7bda0f9a7a7bda0f971c777d5f1bhandarivijay@google.com >
Co-authored-by: gurusai-voleti <gvoleti@google.com >
2025-12-25 15:40:00 +00:00
3239b301f2
Migrate gsutil usage to gcloud storage ( #4315 )
...
* Migrate gsutil usage to gcloud storage
* changes for 4315
* Apply automated linter fixes
* removed model_garden folder changes
---------
Co-authored-by: gurusai-voleti <gvoleti@google.com >
2025-12-24 09:41:28 -05:00
23af5373ec
Migrate gsutil usage to gcloud storage ( #4295 )
...
* Migrate gsutil usage to gcloud storage
* removed notes
* Apply automated linter fixes
* Revert "Apply automated linter fixes"
This reverts commit 3f6c4c0d36gvoleti@google.com >
2025-12-19 10:09:05 -05:00
7577c0b1fc
Migrate gsutil usage to gcloud storage ( #4292 )
...
* Migrate gsutil usage to gcloud storage
* Manual change
* update
* Update NotebookProcessors.py
* Update NotebookProcessors.py
---------
Co-authored-by: gurusai-voleti <gvoleti@google.com >
2025-12-19 15:07:50 +00:00
1867536d76
Migrate gsutil usage to gcloud storage ( #4294 )
...
* Migrate gsutil usage to gcloud storage
* updates
* removed notes added by agent
* removed note
* linter changes
---------
Co-authored-by: gurusai-voleti <gvoleti@google.com >
2025-12-18 13:59:10 +00:00
0edae683e7
Migrate gsutil usage to gcloud storage ( #4293 )
...
* Migrate gsutil usage to gcloud storage
* update
---------
Co-authored-by: gurusai-voleti <gvoleti@google.com >
2025-12-18 13:58:03 +00:00
3a55087789
Bump urllib3 ( #4257 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.4.0 to 2.5.0.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.4.0...2.5.0 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.5.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-29 16:59:52 +00:00
75236998c7
Bump torch ( #4239 )
...
Bumps [torch](https://github.com/pytorch/pytorch ) from 2.2.0 to 2.8.0.
- [Release notes](https://github.com/pytorch/pytorch/releases )
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md )
- [Commits](https://github.com/pytorch/pytorch/compare/v2.2.0...v2.8.0 )
---
updated-dependencies:
- dependency-name: torch
dependency-version: 2.8.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-10 23:33:41 +00:00
42ec0e6ad9
Bump urllib3 ( #4173 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.0.7 to 2.5.0.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.0.7...2.5.0 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.5.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-01 14:29:14 +00:00
fde3d98a2a
Bump requests ( #4174 )
...
Bumps [requests](https://github.com/psf/requests ) from 2.32.3 to 2.32.4.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.32.3...v2.32.4 )
---
updated-dependencies:
- dependency-name: requests
dependency-version: 2.32.4
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-01 14:28:53 +00:00
b83f869a44
Bump protobuf ( #4175 )
...
Bumps [protobuf](https://github.com/protocolbuffers/protobuf ) from 3.20.3 to 4.25.8.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases )
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/protobuf_release.bzl )
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.20.3...v4.25.8 )
---
updated-dependencies:
- dependency-name: protobuf
dependency-version: 4.25.8
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-01 14:28:28 +00:00
Erwin Huizenga and GitHub
66ce2fa5b7
feat: Add sample for Vertex distributed training ( #4163 )
...
* feat: Add sample for Vertex distributed training
* refactor: Move distributed training to community content and add job config
* fix: Address review comments and update files
* minor fixes in the script
* updated codeowners
2025-07-23 21:15:09 +02:00
a4b5c22aa2
Bump torch ( #4083 )
...
Bumps [torch](https://github.com/pytorch/pytorch ) from 2.2.0 to 2.7.0.
- [Release notes](https://github.com/pytorch/pytorch/releases )
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md )
- [Commits](https://github.com/pytorch/pytorch/compare/v2.2.0...v2.7.0 )
---
updated-dependencies:
- dependency-name: torch
dependency-version: 2.7.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-26 18:29:07 +00:00
e563a66114
Add support for tpu v6e quota check ( #4111 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-06-17 13:01:19 +00:00
d0fb60fb7d
Add optional support for global quota check ( #4096 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-06-06 12:20:26 +00:00
49de587b2c
Add optional support for dedicated endpoint ( #4014 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-04-28 12:03:33 +00:00
9f4d837e54
Update peft code for stable_20250409 ( #3991 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-04-15 12:29:40 +00:00
b58f02d5bf
Add polling fn to common util ( #3960 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-04-04 17:00:55 +00:00
040fc424fe
Update common util ( #3868 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-03-11 12:33:53 +00:00
b2d0a04114
Update source code for stable_20250213 peft docker image ( #3864 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-03-06 13:56:56 +00:00
Aiden010200 and GitHub
07f30dfde5
Upload a SGD classifier predictor example ( #3783 )
...
This example uses aiplatform and scikit-learn library to provide a SGD classifier.
2025-02-03 16:09:56 +00:00
0943520f8d
Update template location in dataset validation ( #3799 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-01-23 13:26:44 +00:00
1f15188b6e
Update common util and dataset validation util ( #3796 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2025-01-23 02:27:23 +00:00
Aiden010200 and GitHub
64e9a4ae06
Upload a ResNet predictor example ( #3765 )
...
This example uses aiplatform and torch library to provide a ResNet predictor.
2025-01-08 20:30:52 +00:00
sageof6path and GitHub
fadcb1e618
Peft docker fix ( #3751 )
...
* Updated util files to fix peft docker
* fix imports
* fix imports fileutils.py
2024-12-13 13:08:34 +00:00
Aiden010200 and GitHub
cc38839e2c
Upload xgbranker predictor example ( #3737 )
...
* Upload pipeline job example
* Upload pipeline example which can combine other pipeline examples.
* Upload xgbranker predictor example
This example uses aiplatform and xgboost to provide a xgbranker predictor.
2024-12-12 16:03:43 +00:00
Aiden010200 and GitHub
516c395db0
Upload pipeline job example ( #3719 )
...
* Upload pipeline example which can combine other pipeline examples.
2024-11-26 15:32:54 +00:00
Eric Dong and GitHub
1301bd2ad2
Revert "Bump deepspeed ( #3658 )" ( #3711 )
...
This reverts commit 6c9bdba210
2024-11-14 16:51:13 +00:00
5d71616e8b
Add ability to copy specific model artifacts ( #3700 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2024-11-11 13:25:24 +00:00
6c9bdba210
Bump deepspeed ( #3658 )
...
Bumps [deepspeed](https://github.com/microsoft/DeepSpeed ) from 0.14.4 to 0.15.1.
- [Release notes](https://github.com/microsoft/DeepSpeed/releases )
- [Commits](https://github.com/microsoft/DeepSpeed/compare/v0.14.4...v0.15.1 )
---
updated-dependencies:
- dependency-name: deepspeed
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-18 14:31:08 +00:00
482170765 and GitHub
f20e9590a5
Update a custom job example ( #3639 )
...
* This is a custom job example of kfp v2
2024-10-15 13:48:37 +00:00
02f66799c8
Add README.md for PEFT train docker template ( #3625 )
...
Co-authored-by: minwoopark <minwoopark@google.com >
2024-10-07 20:54:53 +00:00
482170765 and GitHub
6b10fe9636
Upload classifier predictor sample of sklearn ( #3623 )
...
Upload a classifier predictor sample using scikit-learn lib.
2024-10-07 20:54:18 +00:00
24c001eaf6
Update PEFT train docker code ( #3613 )
...
Co-authored-by: minwoopark <minwoopark@google.com >
2024-10-02 19:13:30 +00:00
sharkeshd and GitHub
dc9d1032a2
Update Dockerfile ( #3576 )
...
This multi-stage approach keeps your final image clean and lightweight.
2024-09-30 17:45:37 +00:00
0727e19520
Add vmg templates, dataset_validation_util and update common_util ( #3586 )
...
* Add vmg templates, dataset_validation_util and update common_util
* Add name to CODEOWNERS
* Update common_util.py
---------
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2024-09-26 13:16:09 +00:00
william-ChengChungChu and GitHub
b6771091fa
Upload classifier predictor sample of xgboost ( #3552 )
...
This example uses aiplatform and xgboost to provide a classifier predictor.
2024-09-16 14:57:00 +00:00
d7225f4ec7
chore(deps): bump tensorflow ( #3532 )
...
Bumps [tensorflow](https://github.com/tensorflow/tensorflow ) from 2.7.2 to 2.12.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases )
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md )
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.7.2...v2.12.1 )
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-10 13:57:47 +00:00
Coby Benveniste and GitHub
1c25cf5de1
Add Target Modules flag to allow passing in the target modules to the lora fine tuning ( #3441 )
2024-09-05 13:31:11 +00:00
Liang Long and GitHub
66e7e4effc
Upload a model evaluation example ( #3507 )
...
* Upload a model evaluation example by kfp v2.
2024-09-05 13:28:52 +00:00
2627643386
chore(deps): bump tensorflow ( #3510 )
...
Bumps [tensorflow](https://github.com/tensorflow/tensorflow ) from 2.7.2 to 2.12.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases )
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md )
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.7.2...v2.12.1 )
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-04 12:28:29 +00:00
962b0a606b
chore(deps): bump torch ( #3511 )
...
Bumps [torch](https://github.com/pytorch/pytorch ) from 1.13.1 to 2.2.0.
- [Release notes](https://github.com/pytorch/pytorch/releases )
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md )
- [Commits](https://github.com/pytorch/pytorch/compare/v1.13.1...v2.2.0 )
---
updated-dependencies:
- dependency-name: torch
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-04 12:28:09 +00:00
weiran-work and GitHub
a9e59e9626
feat: Add quota check for restricted image ( #3421 )
2024-08-13 21:32:31 +00:00
cdca4a3c2e
convert caption prompt to bool ( #3422 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2024-08-13 21:13:56 +00:00
d14e71b0ee
chore(deps): bump tensorflow ( #3405 )
...
Bumps [tensorflow](https://github.com/tensorflow/tensorflow ) from 2.7.2 to 2.12.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases )
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md )
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.7.2...v2.12.1 )
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-12 14:42:00 +00:00
1ab9e4b6e3
Add common fn related to image task ( #3417 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2024-08-12 14:33:12 +00:00
c3966ae8f3
chore(deps): bump tensorflow ( #3381 )
...
Bumps [tensorflow](https://github.com/tensorflow/tensorflow ) from 2.7.2 to 2.12.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases )
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md )
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.7.2...v2.12.1 )
---
updated-dependencies:
- dependency-name: tensorflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-09 21:38:30 +00:00
7590168238
feat: add resize image function to common util ( #3399 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2024-08-06 17:37:14 +00:00
c36e5f204d
Update new job name creation format ( #3377 )
...
Co-authored-by: Rayan Dasoriya <dasoriya@google.com >
2024-08-02 20:55:38 +00:00
sefgsefg and GitHub
efd93073d0
Linear regression predictor using sklearn ( #3357 )
...
* Upload torch transformers predictor sample
This sample uses the aiplatform SDK and torch library to implement transformers predictor.
* Linear regression predictor using sklearn
Upload a linear regression predictor sample using scikit-learn lib.
2024-08-01 13:50:05 +00:00
