xiaohei/model_garden
1
0
Fork 0
mirror of https://github.com/GoogleCloudPlatform/vertex-ai-samples.git synced 2026-09-26 14:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

Move the openllama 7b benchmark report to the centralized place. (#2559)

Browse Source
This commit is contained in:
weigary
2023-12-01 22:43:34 +00:00
committed by GitHub
parent f36ab8ef40
commit 1354c74058
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/community/model_garden/model_garden_openllama_7b_finetune_tutorial.md → community-content/vertex_vision_model_garden/benchmarking_reports/pytorch_openllama_7b_finetune_benchmark_report.md
+2 -2
View File
@@ -1,4 +1,4 @@
# Tutorial on fine tuning the OpenLLaMA 7B model on Google Cloud Vertex Model Garden
# Benchmark report on fine tuning the OpenLLaMA 7B model on Google Cloud Vertex Model Garden
## Introduction
@@ -20,7 +20,7 @@ approximate this larger matrix are fine-tuned. QLoRA is an even more
memory-efficient version of LoRA, where the pretrained model is loaded to GPU
memory as quantized 4-bit weights, while preserving similar effectiveness to
LoRA. We also provide simple scripts and parameter settings to reproduce the
results reported in this tutorial.
results reported in this report.
In general, there are many factors that affect the performance of fine-tuning
experiments, such as hardware settings, parameters, cost, and accuracy. It is