You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -28,7 +28,7 @@ A few key features:
28
28
-[Model reshaping](docs/shape_and_batch_size.md). The server supports reshaping models in runtime.
29
29
-[Directed Acyclic Graph Scheduler](docs/dag_scheduler.md) Connect multiple models to deploy complex processing solutions and reduce overhead of sending data back and forth.
30
30
31
-
**Note:** OVMS has been tested on CentOS* and Ubuntu*. Publically released docker images are based on CentOS.
31
+
**Note:** OVMS has been tested on CentOS* and Ubuntu*. Publicly released docker images are based on CentOS.
32
32
33
33
34
34
## Run OpenVINO Model Server
@@ -78,7 +78,7 @@ Learn more about tests in the [developer guide](docs/developer_guide.md)
78
78
79
79
* All contributed code must be compatible with the [Apache 2](https://www.apache.org/licenses/LICENSE-2.0) license.
80
80
81
-
* All changes needs to have pass linter, unit and functional tests.
81
+
* All changes have to have pass style, unit and functional tests.
If you already have a model repository you may use that with this helm chart. If you don't, you can use any model
18
-
from https://download.01.org/opencv/2021/openvinotoolkit/2021.1/open_model_zoo/models_bin/.
18
+
from the [models zoo](https://download.01.org/opencv/2021/openvinotoolkit/2021.2/open_model_zoo/models_bin/).
19
19
20
20
Model Server requires a repository of models to execute inference requests. For example, you can
21
21
use a Google Cloud Storage (GCS) bucket:
@@ -39,9 +39,8 @@ are needed and you can proceed to _Deploy the Model Server_ section.
39
39
Bucket permissions can be set with the _GOOGLE_APPLICATION_CREDENTIALS_ environment variable. Please follow the steps below:
40
40
41
41
* Generate Google service account JSON file with permissions: _Storage Legacy Bucket Reader_, _Storage Legacy Object Reader_, _Storage Object Viewer_. Name a file for example: _gcp-creds.json_
42
-
(you can follow these instructions to create a Service Account and download JSON:
(you can follow these [instructions](https://cloud.google.com/docs/authentication/getting-started#creating_a_service_account) to create a Service Account and download a JSON file)
The server exposes an gRPC endpoint on 8080 port and REST endpoint on 8081 port.
115
114
116
-
Follow the instructions here: https://github.com/openvinotoolkit/model_server/tree/master/example_client#submitting-grpc-requests-based-on-a-dataset-from-a-list-of-jpeg-files
115
+
Follow the [instructions](https://github.com/openvinotoolkit/model_server/tree/master/example_client#submitting-grpc-requests-based-on-a-dataset-from-a-list-of-jpeg-files)
117
116
to create an image classification client that can be used to perform inference with models being exposed by the server. For example:
Copy file name to clipboardExpand all lines: docs/architecture.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -14,7 +14,7 @@
14
14
15
15
**<divalign="center">Figure 1: Docker Container (VM or Bare Metal Host)</div>**
16
16
17
-
- OpenVINO™ Model Server requires the models to be present in the local file system or they could be hosted remotely on object storage services. Both Google Cloud Storage and S3 compatible storage are supported. Refer to [Preparing the Models Repository](./models_repository.md) for more details.
17
+
- OpenVINO™ Model Server requires the models to be present in the local file system or they could be hosted remotely on object storage services. Google Cloud, S3 and Azure compatible storage is supported. Refer to [Preparing the Models Repository](./models_repository.md) for more details.
18
18
19
19
- OpenVINO™ Model Server is suitable for landing in Kubernetes environment. It can be also hosted on a bare metal server, virtual machine or inside a docker container.
Copy file name to clipboardExpand all lines: docs/ovms_quickstart.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
# OpenVINO™ Model Server Quickstart
2
2
3
-
The OpenVINO Model Server requires a trained model in Intermediate Representation (IR) format on which it performs inference. Options to download appropriate models include:
3
+
The OpenVINO Model Server requires a trained model in Intermediate Representation (IR) or ONNX format on which it performs inference. Options to download appropriate models include:
4
4
5
5
- Downloading models from the [Open Model Zoo](https://download.01.org/opencv/2021/openvinotoolkit/2021.1/open_model_zoo/models_bin/)
6
6
- Using the [Model Optimizer](https://docs.openvinotoolkit.org/latest/_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide.html) to convert models to the IR format from formats like TensorFlow*, ONNX*, Caffe*, MXNet* or Kaldi*.
0 commit comments