xiaohei/model_garden
1
0
Fork 0
mirror of https://github.com/GoogleCloudPlatform/vertex-ai-samples.git synced 2026-09-26 14:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,278 Commits 1,765 Branches 0 Tags
98103d462f8258f067af48e05f9131b14b96bdaa
Commit Graph
91 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ivan CheungGitHubivanmkc@google.com <ivanmkc@google.com>
 		0b13475152 fix: Removed memorystore (#2173) 
Co-authored-by: ivanmkc@google.com <ivanmkc@google.com>
 2023-08-12 18:50:51 +00:00
Ivan CheungGitHubivanmkc@google.com <ivanmkc@google.com>
 		4320bf500c Added multimodal embeddings (#2164) 
* fix: Added multimodal embeddings notebook

* Fixed remaining issues

* Reverted notebooks/official/matching_engine/sdk_matching_engine_create_text_to_image_embeddings.ipynb

* Reduced QPS to 2

* Ran linter

* Added None check

* Fixed header links

* Fixed header text

* GH review fixes

* Removed outputs

* Changed title

* debug

* More fixes

---------

Co-authored-by: ivanmkc@google.com <ivanmkc@google.com>
 2023-08-11 01:30:05 +00:00
Ivan CheungGitHubivanmkc@google.com <ivanmkc@google.com>
 		2303f110da Fixed incorrect text (#1886) 
Co-authored-by: ivanmkc@google.com <ivanmkc@google.com>
 2023-05-12 23:56:48 +00:00
Ivan CheungGitHubivanmkc@google.com <ivanmkc@google.com>
 		9ba17b5227 Added Matching Engine + "Vertex Text Embedding API" notebook (#1876) 
* Added PaLM ME notebook

* Fixed import error and linted

* More cleanup

* Fixed embedding model

* Added comments

* Renamed and fixed links

* Linted

---------

Co-authored-by: ivanmkc@google.com <ivanmkc@google.com>
 2023-05-12 22:41:08 +00:00
Ivan CheungandGitHub 84d7b17098 Merge pull request #1660 from GoogleCloudPlatform/imkc--matching-engine-analytics 
Added tracking pixels to matching engine notebooks
 2023-03-27 19:00:25 +00:00
Ivan CheungandGitHub 65f5a95ac5 Merge pull request #1629 from GoogleCloudPlatform/revert-1627-imkc--tracking-pixel 
Revert "WIP analytics"
 2023-03-21 20:57:33 +00:00
Ivan CheungandGitHub 0441a3792e Revert "WIP analytics" 2023-03-21 16:46:06 -04:00
Ivan CheungandGitHub 28d29b4691 Merge pull request #1613 from GoogleCloudPlatform/imkc--stackoverflow-redis 
Added redis support to stackoverflow matching engine demo
 2023-03-17 15:43:14 +00:00
Ivan CheungandGitHub be95016723 Merge pull request #1604 from GoogleCloudPlatform/resource_reaper_official 
fix: add more cleanup
 2023-03-14 20:20:44 +00:00
Ivan CheungandGitHub 851dfb72c1 Merge pull request #1590 from GoogleCloudPlatform/imkc--matching-engine-text-to-image-fix 
Fixed broken markdown in matching engine notebooks
 2023-03-08 00:06:42 +00:00
Ivan CheungGitHubivanmkc@google.com <ivanmkc@google.com>
 		5586fd7c4d Fixed comment about GCS (#1500) 
Co-authored-by: ivanmkc@google.com <ivanmkc@google.com>
 2023-02-02 14:30:02 -08:00
Ivan CheungGitHubivanmkc@google.com <ivanmkc@google.com>
 		60e4416a7e cleanup: remove 3 deprecated notebooks (#1497) 
Co-authored-by: ivanmkc@google.com <ivanmkc@google.com>
 2023-01-31 00:07:38 -08:00
Ivan CheungGitHubivanmkc@google.com <ivanmkc@google.com>
 		9a6c36d016 Fixed cleanup code for matching engine index endpoint (#1493) 
Co-authored-by: ivanmkc@google.com <ivanmkc@google.com>
 2023-01-30 09:52:32 -05:00
Ivan CheungGitHubIvan Cheung
 		59536e9e61 Fix google-api-core version to last known working version (#1402) 
Co-authored-by: Ivan Cheung <ivanmkc@google.com>
 2023-01-05 10:30:48 -08:00
Ivan CheungGitHubIvan Cheung
 		9b5be742c1 Fixed timeout value (#1370) 
Co-authored-by: Ivan Cheung <ivanmkc@google.com>
 2022-12-19 11:41:02 -05:00
Ivan CheungGitHubAndrew Ferlitsch
 		8c265ee1ef Added matching engine resource managers (#1314) 
Co-authored-by: Andrew Ferlitsch <aferlitsch@google.com>
 2022-12-01 13:41:23 -08:00
Ivan CheungandGitHub 4ec962d277 custom-tabular-bq-managed-dataset.ipynb: Addressed comments regarding evaluation, normalization and dataset creation (#1313) 
* Address comments

* Added back BQ dataset creation
 2022-11-30 16:09:39 -05:00
Ivan CheungandGitHub 3185ca7d48 Hierarchical forecasting notebook (#664) 
This is a hierarchical forecasting notebook demonstrating the use of the new hierarchical forecasting parameters for AutoML Forecasting.

If you are opening a PR for `Official Notebooks` under the [notebooks/official](https://togithub.com/GoogleCloudPlatform/vertex-ai-samples/tree/main/notebooks/official) folder, follow this mandatory checklist:
- [x] Use the [notebook template](https://togithub.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/notebook_template.ipynb) as a starting point.
- [x] Follow the style and grammar rules outlined in the above notebook template.
- [ ] Verify the notebook runs successfully in Colab since the automated tests cannot guarantee this even when it passes.
- [x] Passes all the required automated checks. You can locally test for formatting and linting with these [instructions](https://togithub.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/CONTRIBUTING.md#code-quality-checks).
- [ ] You have consulted with a tech writer to see if tech writer review is necessary. If so, the notebook has been reviewed by a tech writer, and they have approved it.
- [x] This notebook has been added to the [CODEOWNERS](https://togithub.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/official/CODEOWNERS) file under the `Official Notebooks` section, pointing to the author or the author's team.
- [x] The Jupyter notebook cleans up any artifacts it has created (datasets, ML models, endpoints, etc) so as not to eat up unnecessary resources.
 2022-11-30 20:02:13 +00:00
Ivan CheungandGitHub 71431d5520 pipelines_intro_kfp.ipynb: Reduced boilerplate (#1307) 
Reduced boilerplate in pipelines_intro_kfp.ipynb
 2022-11-28 19:44:13 +00:00
Ivan CheungGitHubgericdong
 		095b0bd628 sdk_matching_engine_for_indexing.ipynb: Adds filtering example to matching engine notebook. (#1249) 
* Added matching engine filtering notebook

* Added filter

* Fixed typos in other notebooks and linted

* Fixed lint issues

* Added PROJECT_NUMBER retrieval

* Removed unneeded RANDOM_ID

* Linted

* Reverted changes

* Fixed review comments

Co-authored-by: gericdong <itseric@google.com>
 2022-11-25 18:04:08 -08:00
Ivan CheungandGitHub 7a1b262154 Regression notebook: Remove unneeded cells (#1297) 
Removed unneeded cells.
 2022-11-23 21:38:13 +00:00
Ivan CheungandGitHub 1ff7fc70ed custom-tabular-bq-managed-dataset.ipynb: Remove preprocessing (#1278) 
- [x] Removed pre-processing (normalization)

This simplifies the code but reduces accuracy.
 2022-11-23 16:16:42 +00:00
Ivan CheungandGitHub b45e17efc0 sdk_automl_tabular_regression_batch_bq.ipynb: Fixed unneeded concatenation (#1265) 
- [x] Fixed unneeded concatenation
- [x] Fixed incorrect service account info.
 2022-11-23 03:02:15 +00:00
Ivan CheungandGitHub 6ccad69a18 Reduce boilerplate for custom tabular bq notebook (#1207) 
* Reduced boilerplate

Ran linter and fixed install

Added pyarrow

Fixed pip install

Reverted unneeded changes

Fixed pip install

Linted code and added missing preprocessor call

Fixed preprocessor

Default to us-central1

* Ran linter

* Simplified service account section
 2022-11-10 17:47:13 -05:00
Ivan CheungandGitHub eb605b7943 Linted file (#1231) 2022-11-09 15:30:41 -05:00
Ivan CheungandGitHub 35d71b410e Boilerplate reduction: Notebook template (#1204) 
* Reduced notebook boilerplate

* Fixed lint issues

* Added unique suffix note

* Added unique string processor and moved tests to own folder

* Fixed broken link

* Added message about updating links

* Fixed typo

* Added missing import

* Added back useful instructions

* Addressed comments

* Removed matching engine

* Fixed comments
 2022-11-08 14:10:50 -05:00
Ivan CheungandGitHub 0b7831b0f4 Added Dockerfile for linter (#975) 
Updated Dockerfile
 2022-09-21 09:26:42 -07:00
Ivan CheungandGitHub 84fd10f408 fix: Fixed kernel spec by forcing it to use python3 (#889) 2022-08-19 18:43:07 -07:00
Ivan CheungandGitHub b129c0bf43 Update CODEOWNERS (#864) 
Use proper Github username.
 2022-08-12 17:21:39 -04:00
Ivan CheungGitHubAndrew Ferlitsch
 		2885a7a70f Migrated matching engine notebook to official and added VPC network support to CI (#836) 
* Added matching engine notebook official

* Ran linter

* Added matching engine to .cloud-build/test_notebook_vm.txt

Co-authored-by: Andrew Ferlitsch <aferlitsch@google.com>
 2022-08-11 18:30:22 -07:00
Ivan CheungandGitHub aeaeddcc75 Update PULL_REQUEST_TEMPLATE.md (#860) 
Updated PR template to emphasize need for a summary and checklist. Otherwise, people tend to skip this standard practice.
 2022-08-11 16:18:54 -04:00
Ivan CheungandGitHub 8c7fb38136 Added missing dependency (#814) 2022-08-04 14:53:17 -04:00
Ivan CheungandGitHub 2226e915c0 Update CODEOWNERS 2022-07-25 16:24:10 -04:00
Ivan CheungandGitHub cd9f8b1d89 Update CODEOWNERS 2022-07-25 15:01:46 -04:00
Ivan CheungandGitHub aae9ad0422 Update CODEOWNERS 2022-07-25 15:00:33 -04:00
Ivan CheungandGitHub 89d50579a6 Add @GoogleCloudPlatform/caiis-tw to CODEOWNERS 
Add @GoogleCloudPlatform/caiis-tw to default.
 2022-07-25 15:00:01 -04:00
Ivan CheungandGitHub 2d6afa8313 Added better download instructions (#738) 
* Improve download instruc
tions

* Added web download to notebook results list
 2022-07-22 18:21:05 -04:00
Ivan CheungandGitHub 00cfb20c36 Notebook CI: Fixed variable replacement to handle numbers (#739) 
* Removed replacement of variable comparisons

* Fixed issue with numbers in replacement content
 2022-07-22 11:50:39 -04:00
Ivan CheungandGitHub 14c87ae702 Removed replacement of variable comparisons (#737) 2022-07-21 19:21:02 -04:00
Ivan CheungandGitHub 145cdd0928 Added a service account injection (#695) 
* Added a service account injection

* Revert this

* Added service account injection

* Fixed cloud build file

* Added gcloud version debug info

* Fixed sa injection

* Removed test file

* Revert CODEOWNERS
 2022-07-21 15:04:10 -04:00
Ivan CheungandGitHub be785d0389 Allow outputs (#733) 2022-07-20 17:31:12 -04:00
Ivan CheungandGitHub a575528b11 Tweaks to matching engine notebook (#701) 
* Tweaks to notebook

* Ran linter

* More tweaks
 2022-06-30 11:59:05 -04:00
Ivan CheungandGitHub 37c52abc11 Added a virtualenv to the notebook execution tests which should help with dependency issues (#693) 
* Added a virtualenv

* Added a virtualenv for the single yaml

* Debug

* Fixed diff logic for all notebooks case

* Added missing -c
 2022-06-26 13:31:52 -04:00
Ivan CheungandGitHub c8320c8764 Revert "Add notebook for co-hosting model (#666)" (#692) 
This reverts commit aa5464151d.
 2022-06-24 18:26:28 -04:00
Ivan CheungGitHubKarl Weinmeister
 		dffdb15c17 Add default kernel_name for notebook execution (#497) 
Currently, there is no kernel_name. Hence, the execution test cannot run for notebooks that don't have kernels defined in their .ipynb file.

Side-note: We should use lint to remove the kernel_name from .ipynb as well, as it could include info specific to the author's environment.

Co-authored-by: Karl Weinmeister <11586922+kweinmeister@users.noreply.github.com>
 2022-06-23 19:18:49 -04:00
Ivan CheungandGitHub 881a2b45c5 Improved git diff logic (#687) 2022-06-22 21:49:09 -04:00
Ivan CheungandGitHub 8f0c73b32c Fixed cleanup scripts (#676) 2022-06-21 20:13:37 -07:00
Ivan CheungandGitHub 271c949a71 Update README.md (#642) 2022-06-17 14:59:05 -07:00
Ivan CheungandGitHub e422dbdef2 Added official version of tabular regression batch bq (#331) 
* Added official version of tabular regression batch bq

* Ran linter

* Fixed cleanup

* Additional cleanup

* Added working version

* Refactored and made work

* Ran linter and cleaned up

* Renamed aip to aiplatform

* Replaced online with batch

* Renamed notebook

* Ran linter and cleaned up

* Fixed bug

* Fixed SQL by adding backticks

* Install google-cloud-bigquery[all]

* Refactored datasets

* Ran linter

* Removed GCS cells

* Fixed import file

* Fixed SQL issues and added cleanup of training dataset

* Fixed hardcorded table

* Fixed brand names

* Fixed header

* Fixed results table

* Addressed tech writing review comments

* Ran linter
 2022-06-14 14:14:06 -04:00
Ivan CheungandGitHub d3a6475580 Fixed mistake in batch prediction request section (#617) 
* Fixed mistake in batch prediction request section

* Fixed linter requirements
 2022-06-10 17:13:45 -04:00
Ivan CheungandGitHub 0250879f65 Added notebook substitution for common case of 1 notebook (#625) 2022-06-10 14:44:43 -04:00
Ivan CheungandGitHub a109cb6d44 fix: Added explanations output to forecasting notebook (#613) 
* Added explanations output to forecasting notebook

* Simplified and added XAI

* Fix conflicts

* Ran linter

* Fixed batch prediction request explanation
 2022-06-06 10:00:07 -07:00
Ivan CheungandGitHub f730d6b9de Added ability to test a single notebook (#608) 
* Added ability to test a single notebook

* Added output_url to table

* Removed ML Ops notebooks
 2022-06-06 10:30:31 -04:00
Ivan CheungandGitHub edffdf34b7 Pin protobuf version to avoid broken dependencies. 2022-06-02 17:25:28 -04:00
Ivan CheungandGitHub 4fca7d98b2 Increases notebook concurrency and linted CI files (#512) 
* Fixed private pool issues

* Ran linter

* Added worker timeouts

* Tweaked timeout

* Removed gcloud requirement

* Removed unneeded file
 2022-05-18 18:58:54 -04:00
Ivan CheungandGitHub f22f97f680 fix: Updated matching engine dependency and fixed cases (#557) 
* fix: Updated dependency and fixed cases

* Ran linter

* Renamed to Vertex AI Workbench notebook

* Additional text fixes
 2022-05-16 13:06:04 -04:00
Ivan CheungandGitHub 45430bb010 Fixed minor issues (#345) 2022-03-01 14:56:50 -06:00
Ivan CheungandGitHub be2a139ade Delete notebooks/community/feature_store/assets directory 2022-02-28 20:21:17 -05:00
Ivan CheungandGitHub 50c25d6d7b Revert "A notebook that shows Vertex AI feature store capabilities in a real-world scenario (#296)" (#338) 
This reverts commit 5bcdc0bc64.
 2022-02-28 11:01:39 -05:00
Ivan CheungandGitHub 186c08e8c3 Update sdk_matching_engine_for_indexing.ipynb 2022-02-24 17:47:53 -05:00
Ivan CheungandGitHub 7721aa0def Added matching engine with SDK notebook (#327) 
* Matching engine

* Added notebook

* Updated CODEOWNERS

* Fixed links

* Added logo

* Renamed Workbench
 2022-02-24 14:57:16 -05:00
Ivan CheungandGitHub c4d53108af Matching Engine: Updated location for data (#322) 
Switched to gs://cloud-samples-data/vertex-ai/matching_engine/glove-100-angular.hdf5
 2022-02-23 12:03:48 -05:00
Ivan CheungGitHubKarl WeinmeisterAndrew Ferlitsch
 		031a9190c3 automl-tabular-classification.ipynb: Added missing code and removed unneeded text (#255) 
* Added missing code and removed unneeded text

* Ran linter

* Ran linter

Co-authored-by: Karl Weinmeister <11586922+kweinmeister@users.noreply.github.com>
Co-authored-by: Andrew Ferlitsch <aferlitsch@google.com>
 2022-02-17 08:03:16 -08:00
Ivan CheungandGitHub f05ca4d06a Added project to BQ client instantiation (#285) 2022-02-16 16:27:08 -05:00
Ivan CheungandGitHub c41ec1fabd Cleaned up cleanup section (#291) 2022-02-16 10:28:42 -05:00
Ivan CheungandGitHub 273c91882e Delete setup_env.md 2022-02-15 20:45:06 -05:00
Ivan CheungandGitHub ad6b5e5830 Update test_notebook_vm.txt 2022-02-15 18:17:11 -05:00
Ivan CheungandGitHub d441eb9d7a Update test_notebook_vm.txt 2022-02-15 18:14:37 -05:00
Ivan CheungandGitHub 4ab2cfb713 feat: Added test_notebook_vm.txt to only test fast-running notebooks. Also fix private_pool not being used for tests. (#248) 
* feat: Added test_notebook_vm.txt

* Propagate private pool to child builds

* Fixed workerpool issue

* Removed private pool requirement

* Added default pool

* Fixed private pool region issue

* Added comment

* Made private_pool_id arg optionally present

* Fixed when private pool is optional

* Fix regional issue bug

* Fixed pandas requirement

* Removed flaky notebook
 2022-02-03 15:48:40 -05:00
Ivan CheungGitHubKarl Weinmeister
 		de5f8b0653 Removed unneeded lines in linter (#257) 
Co-authored-by: Karl Weinmeister <11586922+kweinmeister@users.noreply.github.com>
 2022-02-01 12:19:19 -05:00
ivanmkc b35cd42015 Added exception check for deletion method 2022-01-27 11:54:29 -05:00
Ivan CheungandGitHub 5e323993db [WIP] Relax requirements for DLVM's (#238) 
* Update requirements.txt

* Relax all CI requirements
 2022-01-26 16:47:09 -05:00
Ivan CheungandGitHub 3733b28772 Updated requirements (#235) 2022-01-24 14:54:31 -05:00
Ivan CheungandGitHub 85984f1173 Fixed broken Colab link 2022-01-20 17:52:56 -05:00
Ivan CheungandGitHub 92bb40349f Cleaned up cloud build by renaming files and moving methods around (#219) 
* Cleaned up cloud build

* Fixed bug

* More renaming and comment cleanup

* Added helper file

* Fixed missing return
 2022-01-20 15:55:38 -05:00
Ivan CheungGitHubAndrew FerlitschKarl Weinmeister
 		9f9526b722 Delete Dockerfile (#198) 
Co-authored-by: Andrew Ferlitsch <aferlitsch@google.com>
Co-authored-by: Karl Weinmeister <11586922+kweinmeister@users.noreply.github.com>
 2022-01-14 14:28:30 -05:00
Ivan CheungandGitHub 267684b7c3 Added private pool to cloud build config (#211) 2022-01-14 14:27:34 -05:00
Ivan CheungGitHubAndrew Ferlitsch
 		096e3e1090 Moved forecasting to official folder (#84) 
* Added forecasting notebook

* Fixed forecasting notebook

* Ran linter

* Small fix

* Fixed dataset variable name conflict

* Ran linter

* Fixed cleanup bug

* fix: remove online prediction reference

* fix: rephrase title to just AutoML tabular forecasting

* fix: update training time to one hour

Co-authored-by: Andrew Ferlitsch <aferlitsch@google.com>
 2021-11-16 16:24:06 -08:00
Ivan CheungandGitHub a2ae130378 Fixed edge case where no notebooks are detected (#152) 2021-11-15 13:11:17 -06:00
Ivan CheungandGitHub 740958005a Parallel custom job notebook execution (#120) 
* Initial commit

* Added parallel execution
 2021-11-12 18:31:36 -05:00
Ivan CheungandGitHub c04bab95d7 Renamed migration notebooks (#125) 
* Renamed migration notebooks

* Removed 'unified' from filename

* Fixed names
 2021-11-08 11:54:48 -05:00
Ivan CheungandGitHub ae7529241f Renamed brand names (#123) 
* Renamed brand names

* Fixed duplicate 'Vertex AI'

* Fixed user managed notebooks reference

* Renamed to Vertex AI AutoML Image Object Detection
 2021-11-03 17:48:17 -04:00
Ivan CheungandGitHub d5d8a3de5f Update CODEOWNERS 2021-11-02 16:11:23 -04:00
Ivan CheungandGitHub 07f2385ea9 Create CODEOWNERS 2021-10-25 14:30:15 -04:00
Ivan CheungandGitHub 9ac6cf64d7 Update CODEOWNERS 2021-10-25 14:28:10 -04:00
Ivan CheungandGitHub b12a08642b Delete CODEOWNERS 2021-10-25 14:26:39 -04:00
Ivan CheungandGitHub 5fa713d851 Update CODEOWNERS 2021-10-25 14:26:25 -04:00
Ivan CheungandGitHub 3f72b5249e Update run_linter.sh 2021-10-07 17:35:12 -04:00
Ivan CheungandGitHub cc89c86bcb Update run_linter.sh 2021-10-07 13:07:59 -04:00
Ivan CheungandGitHub 434dbf20b8 Create delete_this_placeholder.txt 2021-09-15 11:10:34 -04:00
Ivan CheungandGitHub 4f67c3dad9 Update CODEOWNERS 2021-08-31 12:16:16 -04:00