Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions ci/build_test_OnCommit.groovy
Original file line number Diff line number Diff line change
Expand Up @@ -340,7 +340,7 @@ pipeline {
sh "pwd"
def pwd = sh(returnStdout:true, script: "pwd").strip()
def ovms_c_repo_path = sh(returnStdout:true, script: "cd .. && pwd").strip()
def test_doc_files_str = test_doc_files_linux.split('\n').join(' or ')
def test_doc_files_str = test_doc_files_linux.split('\n').collect { 'U-' + it }.join(' or ')
sh "make create-venv && rm -f tests/functional && ln -s ${pwd}/../tests/functional tests/functional"
def cmd_venv_activate = ". .venv/bin/activate"
def cmd_export = "export TT_OVMS_C_REPO_PATH=../ && export TT_RUN_REGRESSION_TESTS=True && export TT_REGRESSION_WEEKLY_TESTS=True && export TT_TARGET_DEVICE=CPU,GPU,NPU && export TT_ENABLE_UAT_TESTS=True && export TT_ENABLE_SMOKE_TESTS=False && export TT_OVMS_C_REPO_PATH=${ovms_c_repo_path} && export TT_LOGGING_LEVEL_OVMS=DEBUG && export TT_WAIT_FOR_MESSAGES_TIMEOUT=1500 && export CORE_BRANCH=${env.CHANGE_BRANCH ?: 'main'}"
Expand Down Expand Up @@ -403,7 +403,7 @@ pipeline {
script {
dir ('documentation_tests') {
checkout scmGit(branches: [[name: validation_branch]], userRemoteConfigs: [[credentialsId: 'workflow-lab', url: 'https://github.com/intel-innersource/frameworks.ai.openvino.model-server.tests.git']])
def test_doc_files_str = test_doc_files_windows.split('\n').join(' or ')
def test_doc_files_str = test_doc_files_windows.split('\n').collect { 'U-' + it }.join(' or ')
def current_path = bat(returnStdout: true, script: 'cd').trim().split('\n').last().trim()
def ovms_c_repo_path = bat(returnStdout: true, script: 'cd .. && cd').trim().split('\n').last().trim()
def cmd_link_ovms = "(if exist ${current_path}\\tests\\functional rmdir ${current_path}\\tests\\functional) && mklink /D ${current_path}\\tests\\functional ${ovms_c_repo_path}\\tests\\functional"
Expand Down
2 changes: 1 addition & 1 deletion demos/age_gender_recognition/python/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ Assuming you have unpacked model server package, make sure to:

as mentioned in [deployment guide](../../../docs/deploying_server_baremetal.md), in every new shell that will start OpenVINO Model Server.
```bat
ovms --model_path model --model_name age_gender --port 9000 --rest_port 8000
ovms --model_path model --model_name age_gender --port 9000 --rest_port 8000 --target_device CPU
```
:::
#### Requesting the Service
Expand Down
1 change: 1 addition & 0 deletions demos/common/python/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
futures==3.1.1
opencv-python>=4.8.1.78
requests==2.34.2
tritonclient[grpc]
numpy<2.0.0
2 changes: 1 addition & 1 deletion demos/face_detection/python/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ Assuming you have unpacked model server package, make sure to:

as mentioned in [deployment guide](../../../docs/deploying_server_baremetal.md), in every new shell that will start OpenVINO Model Server.
```bat
ovms --model_path model --model_name face-detection --port 9000 --shape auto
ovms --model_path model --model_name face-detection --port 9000 --shape auto --target_device CPU
```
:::
Run the client:
Expand Down
2 changes: 1 addition & 1 deletion demos/universal-sentence-encoder/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ on every shell that will start OpenVINO Model Server.

And start Model Server using the following command:
```bat
ovms --model_name usem --model_path universal-sentence-encoder-multilingual/ --plugin_config "{\"NUM_STREAMS\": 1}" --port 9000 --rest_port 8000
ovms --model_name usem --model_path universal-sentence-encoder-multilingual/ --plugin_config "{\"NUM_STREAMS\": 1}" --port 9000 --rest_port 8000 --target_device CPU
```

## Send string data as inference request
Expand Down
9 changes: 6 additions & 3 deletions docs/image_generation/reference.md
Original file line number Diff line number Diff line change
Expand Up @@ -223,7 +223,7 @@ Each individual adapter can optionally specify a default alpha weight by appendi

The alpha value controls how strongly the adapter influences generation (default: `1.0`). Examples:

```bash
```text
# Linux - adapter with alpha 0.6
--source_loras="pokemon=/models/loras/pokemon.safetensors:0.6"

Expand All @@ -240,11 +240,14 @@ The alpha value controls how strongly the adapter influences generation (default

**Example:**
```bash
ovms --rest_port 8000 \
mkdir -p ${HOME}/models
docker run -d -p 8000:8000 --rm --user $(id -u):$(id -g) -v ${HOME}/models:/models:rw \
openvino/model_server:latest \
--rest_port 8000 \
--model_repository_path /models/ \
--task image_generation \
--source_model stabilityai/stable-diffusion-xl-base-1.0 \
--source_loras "xray=DoctorDiffusion/doctor-diffusion-s-xray-xl-lora@DD-xray-v1.safetensors,ukiyo=KappaNeuro/ukiyo-e-art@Ukiyo-e Art.safetensors,vector=DoctorDiffusion/doctor-diffusion-s-controllable-vector-art-xl-lora@DD-vector-v2.safetensors"
--source_loras "xray=DoctorDiffusion/doctor-diffusion-s-xray-xl-lora@DD-xray-v1.safetensors,ukiyo=KappaNeuro/ukiyo-e-art@Ukiyo-e%20Art.safetensors,vector=DoctorDiffusion/doctor-diffusion-s-controllable-vector-art-xl-lora@DD-vector-v2.safetensors"
```

> **Important:** LoRA adapters must be compatible with the base model architecture. For example, SDXL adapters can only be used with an SDXL base model.
Expand Down
2 changes: 1 addition & 1 deletion docs/model_server_rest_api_tokenizer.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ Example usage:

Deploy OVMS with LLM, VLM or embedding model:
```bash
mkdir models
mkdir -p ${HOME}/models
# in case GPU is available
export GPU_ARGS=$(if ls /dev/dri/render* >/dev/null 2>&1; then echo "--device /dev/dri --group-add $(stat -c '%g' /dev/dri/render* | head -n1)"; fi)

Expand Down