Rock3/dev/npu-run-test - Revision history

Naoki at 02:03, 7 February 2023

2023-02-07T02:03:00Z

Stephen at 04:18, 28 July 2022

2022-07-28T04:18:44Z

Stephen: /* Hardware supported */

2022-01-18T11:51:32Z

‎Hardware supported

Stephen: /* Step 2: Get Prebuilt RKNN2 SSD DEMO */

2021-12-28T03:25:51Z

‎Step 2: Get Prebuilt RKNN2 SSD DEMO

Stephen at 02:57, 28 December 2021

2021-12-28T02:57:28Z

Stephen: /* Step4: Run Your Own Built RKNPU Demo */

2021-12-09T07:03:30Z

‎Step4: Run Your Own Built RKNPU Demo

Stephen at 07:01, 9 December 2021

2021-12-09T07:01:31Z

Stephen: /* Step 2: Get RKNN2 SSD DEMO */

2021-12-09T06:59:16Z

‎Step 2: Get RKNN2 SSD DEMO

Stephen: /* Step 2: Get RKNN2 SSD DEMO */

2021-12-09T06:55:46Z

‎Step 2: Get RKNN2 SSD DEMO

Stephen at 06:51, 9 December 2021

2021-12-09T06:51:50Z

@@ Line 7: / Line 7: @@
 === Description ===
-SoC RK3568 is equipped with 0.8TOPS NPU. This tutorial shows how to make the NPU run on ROCK 3 A, and provides an example and test results.
+SoC RK3568 is equipped with 0.8TOPS NPU. This tutorial shows how to make the NPU run on ROCK 3A, and provides an example and test results.
 === Hardware supported ===
@@ Line 23: / Line 23: @@
 ==== Step 1: Get system image  ====
-You can get system image from [https://github.com/radxa/rock-3-images-released/releases ROCK 3 A System images].
+You can get system image from [https://github.com/radxa/rock-3-images-released/releases ROCK 3A System images].
 Here we are concerned about the kernel version. Make sure that kernel is at least  4.19.193-25-rockchip.

@@ Line 61: / Line 61: @@
 And extract it.
- root@rock-3a:/home/rock# curl https://dl.radxa.com/rock3/npu/rknn_ssd_demo_linux_20211228.tar.gz > rknn_ssd_demo_linux_20211228.tar.gz
+<pre>
- root@rock-3a:/home/rock# md5sum rknn_ssd_demo_linux_20211228.tar.gz
+root@rock-3a:/home/rock# curl https://dl.radxa.com/rock3/npu/rknn_ssd_demo_linux_20220728.tar.gz > rknn_ssd_demo_linux_20220728.tar.gz
-  b03a1b3c236b83def933090c846d24f5  rknn_ssd_demo_linux_20211228.tar.gz
+root@rock-3a:/home/rock# md5sum rknn_ssd_demo_linux_20220728.tar.gz
- root@rock-3a:/home/rock# tar zxvf rknn_ssd_demo_linux_20211228.tar.gz
+f8ed06c1409155ab0bbe08dc27430463  rknn_ssd_demo_linux_20220728.tar.gz
-Check RKNN runtime version. Here it is '''1.1.0'''.
+Check RKNN runtime version. Here it is '''1.3.0'''.
 <pre>
 root@rock-3a:/home/rock# cd rknn_ssd_demo_Linux
 root@rock-3a:/home/rock/rknn_ssd_demo_Linux# strings lib/librknnrt.so | grep version
-librknnrt version: 1.1.0 (8a9d6f66@2021-08-19T15:09:11)
+librknnrt version: 1.3.0 (9b36d4d74@2022-05-04T20:17:01)
 rknn_query, info_len(%d) != sizeof(rknn_sdk_version)(%d)!
-RKNN Driver Information: version: %d.%d.%d
+model version < 3, cannot query RKNN_QUERY_NATIVE_NHWC_OUTPUT_ATTR
-Mismatch driver version, %s requires driver version >= %d.%d.%d, but you have driver version: %d.%d.%d which is incompatible!
+unsupported file format version
-Current driver version: %d.%d.%d, recommend to upgrade the driver to the new version: >= %d.%d.%d
-wrong version
 Invalid RKNN model version
 RKNN Model version: %d.%d.%d not match with rknn runtime version: %d.%d.%d
 Generated from compiler version:
 (compiler version:
 incompatible version
 .gnu.version
@@ Line 93: / Line 98: @@
 <pre>
 root@rock-3a:/home/rock/rknn_ssd_demo_Linux# export LD_LIBRARY_PATH=./lib/
-root@rock-3a:/home/rock/rknn_ssd_demo_Linux# ./rknn_ssd_demo model/ssd_inception_v2.rknn model/road.bmp
+root@rock-3a:/home/rock/rknn_ssd_demo_Linux# ./rknn_ssd_demo model/RK356X/ssd_inception_v2.rknn model/bus.jpg
 Loading model ...
 rknn_init ...
 model input num: 1, output num: 2
 input tensors:
-index=0 name=Preprocessor/sub:0 n_dims=4 dims=[1 300 300 3] n_elems=270000 size=270000 fmt=0 type=3 qnt_type=2 fl=0 zp=0 scale=0.007812
+  index=0, name=Preprocessor/sub:0, n_dims=4, dims=[1, 300, 300, 3], n_elems=270000, size=270000, fmt=NHWC, type=UINT8, qnt_type=AFFINE, zp=0, scale=0.007812
 output tensors:
-index=0 name=concat:0 n_dims=4 dims=[1 1917 1 4] n_elems=7668 size=30672 fmt=0 type=0 qnt_type=2 fl=0 zp=53 scale=0.089455
+  index=0, name=concat:0, n_dims=4, dims=[1, 1917, 1, 4], n_elems=7668, size=30672, fmt=NCHW, type=FP32, qnt_type=AFFINE, zp=53, scale=0.089455
-index=1 name=concat_1:0 n_dims=4 dims=[1 1917 91 1] n_elems=174447 size=697788 fmt=0 type=0 qnt_type=2 fl=0 zp=53 scale=0.143593
+  index=1, name=concat_1:0, n_dims=4, dims=[1, 1917, 91, 1], n_elems=174447, size=697788, fmt=NCHW, type=FP32, qnt_type=AFFINE, zp=53, scale=0.143593
 rknn_run
 loadLabelName
 ssd - loadLabelName ./model/coco_labels_list.txt
 loadBoxPriors
-person @ (13 125 59 212) 0.984696
+person @ (107 241 217 532) 0.994344
-person @ (110 119 152 197) 0.969119
+bus @ (87 132 567 433) 0.989999
-bicycle @ (171 165 278 234) 0.969119
+person @ (211 225 290 513) 0.829137
-person @ (206 113 256 216) 0.964519
-car @ (146 133 216 170) 0.959264
-person @ (49 133 58 156) 0.606060
-person @ (83 134 92 158) 0.606060
-person @ (96 135 106 162) 0.464163
-root@rock-3a:/home/rock/rknn_ssd_demo_Linux
 </pre>
 You would also get the output image, out.jpg, under /home/rock/rknn_ssd_demo_Linux directory.
-[[File:rock3a-npu-test-road-out.jpg | 440px ]]
+[[File:rock-3a-npu-test-bus-out.jpg | 440px ]]
 ==== Step4: Run Your Own Built RKNPU Demo ====

@@ Line 11: / Line 11: @@
 === Hardware supported ===
-* ROCK 3 A
+* ROCK 3A
 * Radxa CM3 IO Board
 * Radxa E23
 Now follow me to make the NPU run.

@@ Line 56: / Line 56: @@
   root@rock-3a:/home/rock# apt install -y curl
-Get rknn_ssd_demo_Linux.zip package,  check the md5 of file. It should be 51d85886553225923790dd1ab895f54f.
+Get rknn_ssd_demo_Linux.zip package,  check the md5 of file. It should be b03a1b3c236b83def933090c846d24f5.
 And extract it.

@@ Line 23: / Line 23: @@
 You can get system image from [https://github.com/radxa/rock-3-images-released/releases ROCK 3 A System images].
-Here we are concerned about the kernel version. Make sure that kernel is at least  4.19.193-17-rockchip.
+Here we are concerned about the kernel version. Make sure that kernel is at least  4.19.193-25-rockchip.
-  root@rock-3a:/home/rock# uname -a
+  root@rock-3a:/home/rock# uname -r
-  Linux rock-3a 4.19.193-17-rockchip-ga4e78ea509f7 #rockchip SMP Fri Nov 19 16:59:52 CST 2021 aarch64 GNU/Linux
+.19.193-25-rockchip-g56fae2db273e
 If not, try to upgrade the kernel via the following commands.
@@ Line 59: / Line 59: @@
 And extract it.
-  root@rock-3a:/home/rock# curl https://dl.radxa.com/rock3/npu/rknn_ssd_demo_Linux.zip > rknn_ssd_demo_Linux.zip
+  root@rock-3a:/home/rock# curl https://dl.radxa.com/rock3/npu/rknn_ssd_demo_linux_20211228.tar.gz > rknn_ssd_demo_linux_20211228.tar.gz
-  root@rock-3a:/home/rock# md5sum rknn_ssd_demo_Linux.zip
+  root@rock-3a:/home/rock# md5sum rknn_ssd_demo_linux_20211228.tar.gz
-d85886553225923790dd1ab895f54f  rknn_ssd_demo_Linux.zip
+  b03a1b3c236b83def933090c846d24f5  rknn_ssd_demo_linux_20211228.tar.gz
-  root@rock-3a:/home/rock# unzip rknn_ssd_demo_Linux.zip
+  root@rock-3a:/home/rock# tar zxvf rknn_ssd_demo_linux_20211228.tar.gz
 Check RKNN runtime version. Here it is '''1.1.0'''.
@@ Line 91: / Line 91: @@
 <pre>
 root@rock-3a:/home/rock/rknn_ssd_demo_Linux# export LD_LIBRARY_PATH=./lib/
 root@rock-3a:/home/rock/rknn_ssd_demo_Linux# ./rknn_ssd_demo model/ssd_inception_v2.rknn model/road.bmp
 Loading model ...

@@ Line 122: / Line 122: @@
 ==== Step4: Run Your Own Built RKNPU Demo ====
-You can get more rknpu demo from [https://github.com/radxa/rknpu2/commits/main RK356X NPU SDK].
+You can get more rknpu demo from [https://github.com/radxa/rknpu2 RK356X NPU SDK].
 === Troubleshooting ===
 Check [[rock3/FAQs |ROCK 3 FAQs]] first, if it doesn't help, start a new post on the forum https://forum.radxa.com/c/rock3.

@@ Line 49: / Line 49: @@
 Use command 'uname -a' to check the kernel verison again.
-==== Step 2: Get RKNN2 SSD DEMO ====
+==== Step 2: Get Prebuilt RKNN2 SSD DEMO ====
 Install curl tool.

@@ Line 51: / Line 51: @@
 ==== Step 2: Get RKNN2 SSD DEMO ====
-Install 7z and curl tools.
+Install curl tool.
   root@rock-3a:/home/rock# apt update

@@ Line 25: / Line 25: @@
 Here we are concerned about the kernel version. Make sure that kernel is at least  4.19.193-17-rockchip.
-  root@rock-3-a:/home/rock# uname -a
+  root@rock-3a:/home/rock# uname -a
-  Linux rock-3-a 4.19.193-17-rockchip-ga4e78ea509f7 #rockchip SMP Fri Nov 19 16:59:52 CST 2021 aarch64 GNU/Linux
+  Linux rock-3a 4.19.193-17-rockchip-ga4e78ea509f7 #rockchip SMP Fri Nov 19 16:59:52 CST 2021 aarch64 GNU/Linux
 If not, try to upgrade the kernel via the following commands.
@@ Line 43: / Line 43: @@
 After saving that file, now we install the latest kernel packages.
-  root@rock-3-a:/home/rock# apt update
+  root@rock-3a:/home/rock# apt update
-  root@rock-3-a:/home/rock# apt install -y linux-4.19-rock-3-latest
+  root@rock-3a:/home/rock# apt install -y linux-4.19-rock-3-latest
 Then reboot the device.
@@ Line 53: / Line 53: @@
 Install 7z and curl tools.
-  root@rock-3-a:/home/rock# apt update
+  root@rock-3a:/home/rock# apt update
-  root@rock-3-a:/home/rock# apt install -y p7zip-full curl
+  root@rock-3a:/home/rock# apt install -y curl
-Get rknn2_ssd_demo_Linux.7z package,  check the md5 of file. It should be 3855ac87205e5d11b9484441b983fcd7.
+Get rknn_ssd_demo_Linux.zip package,  check the md5 of file. It should be 51d85886553225923790dd1ab895f54f.
 And extract it.
-  root@rock-3-a:/home/rock# curl https://dl.radxa.com/rock3/npu/rknn2_ssd_demo_Linux.7z > rknn2_ssd_demo_Linux.7z
+  root@rock-3a:/home/rock# curl https://dl.radxa.com/rock3/npu/rknn_ssd_demo_Linux.zip > rknn_ssd_demo_Linux.zip
-  root@rock-3-a:/home/rock# md5sum rknn2_ssd_demo_Linux.7z
+  root@rock-3a:/home/rock# md5sum rknn_ssd_demo_Linux.zip
-ac87205e5d11b9484441b983fcd7  rknn2_ssd_demo_Linux.7z
+d85886553225923790dd1ab895f54f  rknn_ssd_demo_Linux.zip
-  root@rock-3-a:/home/rock# 7z x rknn2_ssd_demo_Linux.7z
+  root@rock-3a:/home/rock# unzip rknn_ssd_demo_Linux.zip
-Thanks to [https://forum.radxa.com/u/zhongdechan zhongdechan], he provided the rknn2_ssd_demo_Linux.7z.
+Check RKNN runtime version. Here it is '''1.1.0'''.
 ==== Step3: Run RKNN2 SSD DEMO ====
@@ Line 71: / Line 90: @@
 <pre>
-root@rock-3-a:/home/rock# cd rknn2_ssd_demo_Linux
+root@rock-3a:/home/rock/rknn_ssd_demo_Linux# export LD_LIBRARY_PATH=./lib/
-root@rock-3-a:/home/rock/rknn2_ssd_demo_Linux# export LD_LIBRARY_PATH=./lib
+root@rock-3a:/home/rock/rknn_ssd_demo_Linux# chmod +x rknn_ssd_demo
-root@rock-3-a:/home/rock/rknn2_ssd_demo_Linux# ./rknn_ssd_demo model/ssd_inception_v2.rknn model/road.bmp
+root@rock-3a:/home/rock/rknn_ssd_demo_Linux# ./rknn_ssd_demo model/ssd_inception_v2.rknn model/road.bmp
 Loading model ...
 rknn_init ...
 model input num: 1, output num: 2
 input tensors:
@@ Line 95: / Line 113: @@
 person @ (83 134 92 158) 0.606060
 person @ (96 135 106 162) 0.464163
 </pre>
-You would also get the output image, out.jpg, under /home/rock/rknn2_ssd_demo_Linux directory.
+You would also get the output image, out.jpg, under /home/rock/rknn_ssd_demo_Linux directory.
 [[File:rock3a-npu-test-road-out.jpg | 440px ]]