Skip to content

Commit f29bfee

Browse files
author
Randall Zhuo
committed
Update RK3562/RK3566/RK3568/RK3588/RV1103/RV1106 NPU SDK to 1.5.2
Signed-off-by: Randall Zhuo <randall.zhuo@rock-chips.com>
1 parent 4e2101a commit f29bfee

File tree

101 files changed

+2786
-474
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

101 files changed

+2786
-474
lines changed

README.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,15 @@ Note:
2020

2121
## ReleaseLog
2222

23-
# 1.5.0
23+
### 1.5.2
24+
- Improved dynamic shape support
25+
- Improved matmul api support
26+
- Add GPU back-end implementations for some operators such as matmul
27+
- Improve transformer support
28+
- Reduce rknn_init memory usage
29+
- Optimize rknn_init time-consuming
30+
31+
### 1.5.0
2432

2533
- Support RK3562
2634
- Support more NPU operator fuse, such as Conv-Silu/Conv-Swish/Conv-Hardswish/Conv-sigmoid/Conv-HardSwish/Conv-Gelu ..
Binary file not shown.
Binary file not shown.

doc/RKNN_Dynamic_Shape_Usage.md

Lines changed: 8 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@
4848

4949

5050
## 4.设置输入形状
51-
加载动态形状输入RKNN模型后,您可以在运行时动态修改输入的形状。通过调用rknn_set_input_shape接口,传入包含形状信息的rknn_tensor_attr指针可以设置当前次推理的形状。例如,使用rknn_query获取的输入形状设置输入时,您可以使用以下代码:
51+
加载动态形状输入RKNN模型后,您可以在运行时动态修改输入的形状。通过调用rknn_set_input_shapes接口,传入所有输入的rknn_tensor_attr数组,可以设置当前次推理的形状。例如,使用rknn_query获取的输入形状设置输入时,您可以使用以下代码:
5252

5353
```
5454
for (int s = 0; s < shape_num; ++s)
@@ -59,17 +59,16 @@
5959
{
6060
input_attrs[i].dims[j] = shape_range[i].dyn_range[s][j];
6161
}
62-
63-
ret = rknn_set_input_shape(ctx, &input_attrs[i]);
64-
if (ret < 0)
65-
{
66-
fprintf(stderr, "rknn_set_input_shape error! ret=%d\n", ret);
67-
return -1;
68-
}
62+
}
63+
ret = rknn_set_input_shapes(ctx, io_num.n_input, input_attrs);
64+
if (ret < 0)
65+
{
66+
fprintf(stderr, "rknn_set_input_shapes error! ret=%d\n", ret);
67+
return -1;
6968
}
7069
}
7170
```
72-
其中,shape_num是支持的形状个数,shape_range[i]是第i个输入的rknn_input_range结构体,input_attrs[i]是第i个输入的rknn_tensor_attr结构体
71+
其中,shape_num是支持的形状个数,shape_range[i]是第i个输入的rknn_input_range结构体,io_num.n_input是输入数量,input_attrs是模型所有输入的rknn_tensor_attr结构体数组
7372

7473
在设置输入形状后,可以再次调用rknn_query查询当前次推理成功设置后的输入和输出形状,例如,您可以使用以下代码:
7574
```
-5.74 MB
Binary file not shown.
Binary file not shown.
1.98 MB
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.

0 commit comments

Comments
 (0)