mirror of
https://github.com/sipeed/sipeed_wiki.git
synced 2026-11-09 17:44:31 -06:00
update
This commit is contained in:
wonderfullook
Binary file not shown.
|
After Width: | Height: | Size: 69 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 44 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 16 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 17 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 28 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 34 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 25 KiB |
419
docs/hardware/en/maixIII/ax-pi/dev_prepare.md
Normal file
419
docs/hardware/en/maixIII/ax-pi/dev_prepare.md
Normal file
@@ -0,0 +1,419 @@
|
||||
---
|
||||
title: Maix-III AXera-Pi SDK development
|
||||
---
|
||||
|
||||
> Before reading, it's necessary to know basic usage about `gcc` and `make`.
|
||||
|
||||
## Preparation
|
||||
|
||||
We have told basic operation like burning system and using AXera-Pi in previous article, which help you know how to use AXera-Pi.
|
||||
|
||||
For embedded linux, we usually use cross-compile technology to compile out the application for target linux device.
|
||||
|
||||
A cross compiler is a compiler capable of creating executable code for a platform other than the one on which the compiler is running. For example, a cross compiler executes on machine X and produces machine code for machine Y.
|
||||
|
||||
Normally our computer have better performance than target embedded linux device, compiling the executable on our computer, then run the application on target embedded linux device. This saves more time than compiling and running on target embedded linux device.
|
||||
|
||||
For example, `ax-sample` takes more than 10 minutes to be compiled on AXera-Pi, but it takes less than one minute on your computer.
|
||||
|
||||
Above all, for embedded development, coree-compile technology is commom and it's necessary to know about this if you want to save your time.
|
||||
|
||||
## Transfer files
|
||||
|
||||
Compiling out the application on our computer, we need send the application to AXera-Pi.
|
||||
|
||||
- `SSH` (Secure Shell) enables secure system administration and file transfers over insecure networks.
|
||||
- `Serial` application tool is OK to transfer files but it's too slow.
|
||||
|
||||
### Transfer file with SSH
|
||||
|
||||
There are many good SSH application on Windows, here we use [Mobaxterm](https://mobaxterm.mobatek.net/) to login AXera-Pi and Transfer file.
|
||||
|
||||
[Mobaxterm Usage Demo](https://mobaxterm.mobatek.net/demo.html)
|
||||
|
||||
|
||||
|
||||
Besides, [Vscode](https://code.visualstudio.com/) is also a gooe idea for transfering file. Install the [Remote - SSH](https://marketplace.visualstudio.com/items?itemName=ms-vscode-remote.remote-ssh) and [Remote Explorer](https://marketplace.visualstudio.com/items?itemName=ms-vscode.remote-explorer) extensions, then login to AXera-Pi via vscode SSH.
|
||||
|
||||
|
||||
|
||||
### Transfer file with scp
|
||||
|
||||
scp means `ssh + cp`.
|
||||
|
||||
Here is the command to transfer file.
|
||||
|
||||
```bash
|
||||
scp [option] /path/to/source/file user@server-ip:/path/to/destination/directory
|
||||
```
|
||||
|
||||
- `/path/to/source/file` Target file/folder sent from host to device
|
||||
- `user@server-ip` : Remote target device IP address.
|
||||
- `/path/to/destination/directory` Target device directory to receive the file/folder
|
||||
|
||||
### Use card reader
|
||||
|
||||
Because of different file system, it's only suggested to use this way if operating system of your computer is Linux.
|
||||
|
||||
### Transfer file with UART
|
||||
|
||||
For linux users, install `lrzsz` first (`sudo apt-git install lrzsz`) and use it to finish this
|
||||
|
||||
Windows user can use Mobaxterm to transfer file between computer and AXera-Pi via USB-UART connection.
|
||||
|
||||
## Compile on AXera-Pi
|
||||
|
||||
Here we tell how to compile application on AXera-Pi.
|
||||
|
||||
### Vscode remote
|
||||
|
||||
We have told how to login to AXera-Pi via SSH with vscode, login to AXera-Pi by Vscode first, make sure not install [C/C++](https://marketplace.visualstudio.com/items?itemName=ms-vscode.cpptools) extension of vscode on AXera-Pi, this extension may close SSH connnection.
|
||||
|
||||
Click ① and ② to open a SSH connection.
|
||||
|
||||
|
||||
|
||||
Here we take `192.168.233.1` IP address as example, make sure not forget add username `root` at first.
|
||||
|
||||
`root@IP_address`
|
||||
|
||||
|
||||
|
||||
Choose platform `Linux` and `Continue`.
|
||||
|
||||
<img alt="vscode_ssh_connect_linux_platform" src="./assets/dev_prepare/vscode_ssh_connect_linux_platform.jpg" width="45%">
|
||||
<img alt="vscode_ssh_connect_continue" src="./assets/dev_prepare/vscode_ssh_connect_continue.jpg" width="45%">
|
||||
|
||||
Eenter password `root` to login
|
||||
|
||||
|
||||
|
||||
Succeed logining to AXera-Pi.
|
||||
|
||||
|
||||
|
||||
Click `Open Folder` to see your AXera-Pi directory structure.
|
||||
|
||||
|
||||
|
||||
接着就可以在 vscode 里编译运行 linux 系统的程序了，幸运的是在 debian 系统上可以直接通过 apt 得到本机的编译工具链，而不用交叉编译就可以直接编译运行程序，这些都已经提前准备好了，对用户来说可以节省不少搭建内部开发环境的时间。
|
||||
|
||||
所以可以直接在板子里编译运行 libmaix 项目：
|
||||
|
||||
```bash
|
||||
cd /home/libmaix/examples/axpi/
|
||||
python3 project.py build
|
||||
fbon
|
||||
./dist/start_app.sh
|
||||
```
|
||||
|
||||
> 按 ctrl + c 中断停止程序直到退出。
|
||||
|
||||
<!-- 附图： -->
|
||||
|
||||
### mobaxterm
|
||||
|
||||
在 Windows 上可以用 mobaxterm 这样的工具连接到板子进行 linux 服务器管理，但编译还是需要在 linux 系统上进行。
|
||||
|
||||
|
||||
|
||||
## 交叉编译上传程序再运行
|
||||
|
||||
在这之前需要有本地编译的认知，然后发现本地内存和性能不能满足自身开发需求的时候，就要准备交叉编译程序了，此时程序是在另一台更强的 x86 linux 系统上完成的，并且编译出来的程序需要拷贝到板子里运行。
|
||||
|
||||
> **[20221010 现提供一种借助 docker qemu arm 虚拟机来实现在 x86 机器上实现本地编译 arm 程序的方法，这种方法既提高了编译效率又不用配环境的方法值得一试！](https://www.cnblogs.com/juwan/p/16769237.html)**
|
||||
|
||||
首先得有一台 linux 系统，如 ubuntu20.04 这样的桌面计算机，接着和上面一样，也可以在这台计算机上安装 vscode remote 或 idea clion 这类开发工具直接连接到板子里，这可以方便你编辑代码或传输文件。
|
||||
|
||||
想要在 x86 的机器上编译出 arm 架构的程序，想要先配置专用的交叉编译工具链，例如这里使用的是 arm-linux-gnueabihf 这个工具链，这个编译链可以直接通过 apt 安装。
|
||||
|
||||
- `sudo apt install gcc-arm-linux-gnueabihf`
|
||||
|
||||
安装完成后，可以在 /usr/bin 目录下找到 `arm-linux-gnueabihf-gcc` 这个交叉编译工具，这个工具可以用来编译 linux 系统的程序。
|
||||
|
||||
```bash
|
||||
juwan@juwan-n85-dls:~$ /usr/bin/arm-linux-gnueabihf-gcc -v
|
||||
Using built-in specs.
|
||||
COLLECT_GCC=arm-linux-gnueabihf-gcc
|
||||
COLLECT_LTO_WRAPPER=/usr/lib/gcc-cross/arm-linux-gnueabihf/9/lto-wrapper
|
||||
Target: arm-linux-gnueabihf
|
||||
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 9.4.0-1ubuntu1~20.04.1' --with-bugurl=file:///usr/share/doc/gcc-9/README.Bugs --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,gm2 --prefix=/usr --with-gcc-major-version-only --program-suffix=-9 --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-libitm --disable-libquadmath --disable-libquadmath-support --enable-plugin --enable-default-pie --with-system-zlib --without-target-system-zlib --enable-libpth-m2 --enable-multiarch --enable-multilib --disable-sjlj-exceptions --with-arch=armv7-a --with-fpu=vfpv3-d16 --with-float=hard --with-mode=thumb --disable-werror --enable-multilib --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=arm-linux-gnueabihf --program-prefix=arm-linux-gnueabihf- --includedir=/usr/arm-linux-gnueabihf/include
|
||||
Thread model: posix
|
||||
gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.1)
|
||||
```
|
||||
|
||||
|
||||
|
||||
本地与交叉编译唯一不同的地方就是需要把将编译出来的程序，上传到板子运行，而不能直接运行程序。
|
||||
|
||||
以 libmaix 这个项目为例：在 x86 的机器上编译时需要修改本机的交叉编译链，如：python3 project.py --board=axpi --toolchain /usr/bin --toolchain-prefix arm-linux-gnueabihf- config 之中的编译链可能会发生改变，这里需要根据你的实际情况进行修改，比如本机环境下可能有多个编译链，但一般来说是不需要修改的。
|
||||
|
||||
除了修改交叉编译链，如果出现编译失败，还需要修改编译配置中所需要的依赖文件或头文件的路径：
|
||||
|
||||
```
|
||||
list(APPEND ADD_INCLUDE "lib/arch/axpi/joint"
|
||||
"lib/arch/axpi/opt/include"
|
||||
"lib/arch/axpi/opt/include/opencv4"
|
||||
)
|
||||
"/lib/aarch64-linux-gnu/libm.so"
|
||||
"/lib/aarch64-linux-gnu/libpthread.so"
|
||||
"/lib/aarch64-linux-gnu/libopencv_videoio.so"
|
||||
"/lib/aarch64-linux-gnu/libopencv_highgui.so"
|
||||
"/lib/aarch64-linux-gnu/libopencv_imgcodecs.so"
|
||||
"/lib/aarch64-linux-gnu/libopencv_imgproc.so"
|
||||
"/lib/aarch64-linux-gnu/libopencv_core.so"
|
||||
"/lib/aarch64-linux-gnu/libopencv_freetype.so"
|
||||
```
|
||||
|
||||
当换了编译链后也要修改到其他路径下的链接库：
|
||||
|
||||
```
|
||||
list(APPEND ADD_INCLUDE "lib/arch/axpi/joint"
|
||||
"/opt/include"
|
||||
"/usr//local/include/opencv4"
|
||||
)
|
||||
"/lib/arm-linux-gnueabihf/libm.so"
|
||||
"/lib/arm-linux-gnueabihf/libpthread.so"
|
||||
"/lib/arm-linux-gnueabihf/libopencv_videoio.so"
|
||||
"/lib/arm-linux-gnueabihf/libopencv_highgui.so"
|
||||
"/lib/arm-linux-gnueabihf/libopencv_imgcodecs.so"
|
||||
"/lib/arm-linux-gnueabihf/libopencv_imgproc.so"
|
||||
"/lib/arm-linux-gnueabihf/libopencv_core.so"
|
||||
"/lib/arm-linux-gnueabihf/libopencv_freetype.so"
|
||||
```
|
||||
|
||||
简而言之，更换了桌面系统和编译链，那源码中对应的一些依赖文件肯定也会发生改变，这需要看所用的 sdk 是如何解决这个问题的，通常来说只需要换交叉编译链和修改链接目录即可。
|
||||
|
||||
上文介绍了如何在 linux 系统上编译运行 libmaix 项目，以及如何在 linux 系统上交叉编译 libmaix 项目，希望对大家有所帮助，只要掌握了如何管理开发环境和如何编译运行 linux 的程序，接下来就可以基于我们提供的 sdk 开发属于自己的项目了。
|
||||
|
||||
在这里「大佬鼠」推荐自己的开发流程和方法，最开始就是先在板子上本地编译测试现有的代码和功能，然后根据 [[maixpy3 axpi] 编辑发布 debian 镜像与在 PC 上交叉编译程序 ](https://www.cnblogs.com/juwan/p/16769237.html) 来安装 docker arm 虚拟机。
|
||||
|
||||
接着，将之前烧录到板子里的根文件系统（.img）通过 losetup + mount + chroot 挂载（.img）出来，这时候你就会得到和板子一样的 arm 虚拟机环境，就可以直接本地编译啦！不过，这个方法需要学习 docker 的安装喔，包括后面的模型开发也上会用到 docker 的。
|
||||
|
||||
> 如果你不嫌麻烦的话，可以选择配置交叉编译链、板子依赖的头文件、第三方链接库后才能进行程序的编译，但这个 docker arm 虚拟机的方法是最省事的，甚至还可以通过读卡器（或网络）挂载板子里的根文件系统进行编译。
|
||||
|
||||
* [什么是交叉编译？](https://cn.bing.com/search?q=%E4%BB%80%E4%B9%88%E6%98%AF%E4%BA%A4%E5%8F%89%E7%BC%96%E8%AF%91%EF%BC%9F)
|
||||
* [超详细解答vscode如何远程连接Linux以及可能会出现的一些问题](https://blog.csdn.net/cxn15335120506/article/details/123238233)
|
||||
* [vscode remote](https://code.visualstudio.com/docs/remote/remote-overview)
|
||||
* [ssh scp 是什么？](https://cn.bing.com/search?q=ssh+scp+%E6%98%AF%E4%BB%80%E4%B9%88%EF%BC%9F)
|
||||
* [libmaix](https://github.com/sipeed/libmaix)
|
||||
* [mobaxterm](https://mobaxterm.mobatek.net)
|
||||
* [arm-linux-gnueabihf-gcc](https://packages.ubuntu.com/focal/gcc-arm-linux-gnueabihf)
|
||||
|
||||
## 获取 SDK 源码
|
||||
|
||||
前文介绍了基础的开发环境搭建和使用方法，你应该了解什么是本地编译和交叉编译，下面开始介绍如何使用这些 sdk 源码开发程序。
|
||||
|
||||
- [libmaix](https://github.com/sipeed/libmaix)
|
||||
|
||||
由 sipeed 提供在 linux 平台统一的嵌入式开发环境，主要有摄像头、屏幕、视觉、图像处理、NPU pipiline 相关的实机部署例程，适合刚入门嵌入式 linux 开发的同学使用。
|
||||
|
||||
- [ax-sample](https://github.com/AXERA-TECH/ax-samples)
|
||||
|
||||
由爱芯提供 AI 模型的开发与评估验证，提供给有经验的 AI 开发者使用，不涉及任何硬件外设有关的内容。
|
||||
|
||||
- [axpi_bsp_sdk](https://github.com/sipeed/axpi_bsp_sdk)
|
||||
|
||||
芯片商用时所用的 bsp 开发包，这里主要提供的是芯片的原始开发资料，如 uboot 、 linux 、 msp 、msp 等工程代码，这个部分是逐步开源的，你可以从这里得到商业评估用的代码，例如 ipcdemo 这样的程序，但这些代码会很复杂且高耦合，适合有经验的同行出于商业落地的目的使用。
|
||||
|
||||
- [ax-pipeline](https://github.com/AXERA-TECH/ax-pipeline)
|
||||
|
||||
基于 axpi_bsp_sdk 制作的 AI 部署高性能仓库，在这里主要用于该项目基于 AXera-Pi 展示 ISP、图像处理、NPU、编码、显示 等功能模块软件调用方法，方便社区开发者进行快速评估和二次开发自己的多媒体应用。
|
||||
|
||||
### libmaix
|
||||
|
||||
这是一个适用于 sipeed 所用 linux 芯片开发的 C/C++ 基础开发框架，使用 cmake 构建，提供了许多开箱参考的案例，还有一些第三方库代码的链接，如 opencv openmv 这些视觉库的链接。
|
||||
|
||||
SDK 源码在 [libmaix](https://github.com/sipeed/libmaix)， 需要使用 git 命令下载：
|
||||
|
||||
```bash
|
||||
git clone https://github.com/sipeed/libmaix.git --recursive
|
||||
```
|
||||
>! 注意这里`--recursive` 参数是必须的，用来下载仓库里面的子模块，如果没有这个参数，代码会不完整，导致编译出错。
|
||||
|
||||
> 中国国内可能下载速度较慢，可以多取消重试几次，可能会遇到速度快的节点，当然最好还是通过设置代理来加速下载。
|
||||
|
||||
另外， AI 模型及例程在 [MaixHub 模型库](https://maixhub.com/model/zoo) 可以找到， 以及 [AXERA-TECH/ax-samples](https://github.com/AXERA-TECH/ax-samples) 仓库。
|
||||
|
||||
## 编译 SDK 源码
|
||||
|
||||
回顾一下前文的内容，编译有两种方式：
|
||||
|
||||
* 直接在开发板上编译：编译速度较慢，但是不需要额外的环境配置。
|
||||
* 在 PC 上编译，然后拷贝可执行文件到开发板，也就是交叉编译： 编译速度更快，但是需要额外的环境配置。
|
||||
|
||||
### [libmaix](https://github.com/sipeed/libmaix)
|
||||
|
||||
> /home/ 目录已预置，可以 git pull 联网拉取更新。
|
||||
|
||||
对于 `libmaix`， 按照其`README.md` 文件描述的方法编译即可， 不过需要在`menuconfig`命令中选择 `AXera-Pi` 作为编译目标。
|
||||
|
||||
这里简要介绍一下编译过程（libmaix 目前还未稳定，未来可能会有大的更新），实际以[libmaix 仓库](https://github.com/sipeed/libmaix)代码和说明为准。
|
||||
|
||||
* 先安装依赖
|
||||
```
|
||||
apt install build-essential cmake python3 sshpass git
|
||||
```
|
||||
> sshpass 也可以不安装， build-essential, cmake, git, python3 必须安装
|
||||
|
||||
* 克隆仓库到本地或者开发板
|
||||
```
|
||||
git clone https://github.com/sipeed/libmaix --recursive
|
||||
```
|
||||
>! 注意 `--recursive` 参数是必须的，用以克隆子模块，否则会缺代码。
|
||||
|
||||
这里以在开发板上编译为例：
|
||||
|
||||
```bash
|
||||
cd /home/libmaix # git clone https://github.com/sipeed/libmaix --recursive
|
||||
cd examples/axpi
|
||||
python3 project.py distclean
|
||||
# python3 project.py menuconfig # 可以配置相关参数
|
||||
python3 project.py build # 如果增加文件了，需要 python3 project.py rebuild 命令
|
||||
./dist/start_app.sh # 运行示例程序
|
||||
```
|
||||
|
||||
### [ax-samples](https://github.com/AXERA-TECH/ax-samples)
|
||||
|
||||
> /home/ 目录已预置，可以 git pull 联网拉取更新。
|
||||
|
||||
[ax-samples](https://github.com/AXERA-TECH/ax-samples) 是爱芯官方提供的例程，包含了一些 AI 模型和运行代码，编译完能直接在开发板上运行，只不过输入是图片，不是摄像头。
|
||||
进入开发板终端，执行以下代码：
|
||||
|
||||
```bash
|
||||
cd /home/ax-samples # git clone https://github.com/AXERA-TECH/ax-samples.git
|
||||
mkdir build
|
||||
cd build
|
||||
cmake ..
|
||||
make install
|
||||
```
|
||||
|
||||
然后就能在`ax-samples/build/install/bin/`目录下找到编译好的可执行文件。
|
||||
|
||||
### [axpi_bsp_sdk](https://github.com/sipeed/axpi_bsp_sdk)
|
||||
|
||||
回到芯片原厂开发的环境，这需要有经验的嵌入式 Linux 开发者来操作，直接看 readme 进行操作，文档在 docs 目录下。
|
||||
|
||||
#### What is this?
|
||||
|
||||
this is a ax620 linux bsp sdk form AX620_R1.22.2801_Sipeed. currently it is application layer open source.
|
||||
|
||||
```bash
|
||||
juwan@juwan-n85-dls:~/GIT_AX620_SDK_V0.31.0_P23/sipeed/axpi_bsp_sdk$ tree -L 1
|
||||
.
|
||||
├── app
|
||||
├── build
|
||||
├── msp
|
||||
├── readme.md
|
||||
├── rootfs
|
||||
└── third-party
|
||||
|
||||
5 directories, 1 file
|
||||
```
|
||||
|
||||
#### ready arm gcc
|
||||
|
||||
```bash
|
||||
git clone https://github.com/sipeed/axpi_bsp_sdk.git
|
||||
|
||||
cd axpi_bsp_sdk
|
||||
|
||||
wget http://releases.linaro.org/components/toolchain/binaries/latest-7/arm-linux-gnueabihf/gcc-linaro-7.5.0-2019.12-x86_64_arm-linux-gnueabihf.tar.xz
|
||||
|
||||
sudo tar -xvf gcc-linaro-7.5.0-2019.12-x86_64_arm-linux-gnueabihf.tar.xz -C /opt/
|
||||
|
||||
```
|
||||
|
||||
#### how to compile
|
||||
|
||||
- bsp msp sample
|
||||
|
||||
```bash
|
||||
|
||||
cd msp/sample/
|
||||
|
||||
export PATH="/opt/gcc-linaro-7.5.0-2019.12-x86_64_arm-linux-gnueabihf/bin/:$PATH" && make p=AX620_demo all install
|
||||
|
||||
```
|
||||
|
||||
- third-party libs
|
||||
|
||||
```bash
|
||||
|
||||
cd third-party
|
||||
|
||||
export PATH="/opt/gcc-linaro-7.5.0-2019.12-x86_64_arm-linux-gnueabihf/bin/:$PATH" && make p=AX620_demo all install
|
||||
|
||||
```
|
||||
|
||||
- bsp app ipcdemo
|
||||
|
||||
```bash
|
||||
|
||||
cd app/
|
||||
|
||||
export PATH="/opt/gcc-linaro-7.5.0-2019.12-x86_64_arm-linux-gnueabihf/bin/:$PATH" && make p=AX620_demo all install
|
||||
|
||||
```
|
||||
|
||||
- bsp msp component lib, such as `cd app/msp/component/common && make xxxx`.
|
||||
|
||||
```
|
||||
juwan@juwan-n85-dls:~/GIT_AX620_SDK_V0.31.0_P23/sipeed/axpi_bsp_sdk/msp/component$ tree -L 1
|
||||
.
|
||||
├── axsyslog
|
||||
├── common
|
||||
└── thermal
|
||||
|
||||
4 directories, 0 files
|
||||
```
|
||||
|
||||
#### run your program
|
||||
|
||||
- on pc
|
||||
|
||||
```
|
||||
sshpass -p root scp ./vo_fb/sample_vo_fb root@192.168.233.1:/opt/bin/sample_vo_fb
|
||||
```
|
||||
|
||||
- on board
|
||||
|
||||
```
|
||||
|
||||
chmod 777 /opt/bin/sample_vo_fb
|
||||
|
||||
/opt/bin/sample_vo_fb -v dsi0@480x854@60 -m 0 &
|
||||
|
||||
fbv /home/examples/480x360.jpg
|
||||
|
||||
killall sample_vo_fb
|
||||
|
||||
```
|
||||
|
||||
## 组合 SDK 和 AI 模型例程
|
||||
|
||||
比如我们要跑一个视觉 AI 模型，需要用到摄像头，屏幕，还有 AI 模型，你需要借助以下仓库代码完成这个目标。
|
||||
|
||||
### 借助 libmaix 实现（开发难度最小，适合验证）
|
||||
|
||||
基于 libmaix 的 axpi 项目进行开源快速验证效果，代码简单易懂，基于在线服务完成模型部署，只用于新手上路，与 ax-sample 的模型一起被支持。
|
||||
|
||||
- [axpi](https://github.com/sipeed/libmaix/tree/release/examples/axpi)
|
||||
- [axpi_classification_cam](https://github.com/sipeed/libmaix/tree/release/examples/axpi_classification_cam)
|
||||
- [axpi_yolov5_cam](https://github.com/sipeed/libmaix/tree/release/examples/axpi_yolov5_cam)
|
||||
|
||||
> 20221113 目前仓库只保证用户初次上手时能够不报错的安全调用 AI 模型，不代表芯片的最好效果。
|
||||
|
||||
### 借助 ax-pipeline 实现（开发难度适中，适合优化）
|
||||
|
||||
到了这里要有基本的芯片 bsp sdk 开发的基础（axpi_bsp_sdk），这部分会略显专业一些，这个仓库目前追求最高性能的效果。
|
||||
|
||||
- [准备编译环境](https://github.com/AXERA-TECH/ax-pipeline/blob/main/docs/compile.md)
|
||||
- [如何更换自己训练的 yolov5 模型？](https://github.com/AXERA-TECH/ax-pipeline/blob/main/docs/how_to_deploy_custom_yolov5_model.md)
|
||||
- [如何部署自己的其他模型](https://github.com/AXERA-TECH/ax-pipeline/blob/main/docs/how_to_deploy_custom_model.md)
|
||||
|
||||
### 借助 ipcdemo 实现（开发难度最大，适合落地）
|
||||
|
||||
基于 axpi_bsp_sdk 的 ipcdemo 商用视频推流应用，由于源码过于复杂，需要有上述基础才能介入。
|
||||
|
||||
- [axpi_bsp_sdk/app/IPCDemo](https://github.com/sipeed/axpi_bsp_sdk/tree/main/app/IPCDemo)
|
||||
@@ -470,9 +470,18 @@
|
||||
"source": [
|
||||
"As the log of running yolov5s above, object detection result parameters are printed out. And the detection picture is shown onboard screen.\n",
|
||||
"\n",
|
||||
"We can also using different `.so` library or other `AI` models to do more AI usages.\n",
|
||||
"> All examples in this document are run on `GC4653` camera sensor, change code `'-c', '2'` into `'-c', '0'` if you use `OS04A10` night enhanced camera sensor.\n",
|
||||
"\n",
|
||||
"> All examples in this document are run on `GC4653` camera sensor, visit [Maix-III AXera-Pi (FAQ)](https://wiki.sipeed.com/hardware/en/maixIII/ax-pi/faq_axpi.html) to see how to switch camera sensor if you use `OS04A10` night enhanced camera sensor.\n",
|
||||
"```python\n",
|
||||
" pipeline.load([\n",
|
||||
" 'libsample_vin_ivps_joint_venc_rtsp_vo_sipy.so',\n",
|
||||
" '-p', '/home/config/yolov5s.json',\n",
|
||||
" '-c', '2', # GC4653 camera sensor\n",
|
||||
" # '-c', '0', # OS04A10 camera sensor\n",
|
||||
" ])\n",
|
||||
"```\n",
|
||||
"\n",
|
||||
"We can also using different `.so` library or other `AI` models to do more AI usages. There are also useful information on [ax-pipeline-api](https://github.com/junhuanchen/ax-pipeline-api).\n",
|
||||
"\n",
|
||||
"- Here are the `ibxxx*.so` library in AXera-Pi:\n",
|
||||
"\n",
|
||||
@@ -529,7 +538,7 @@
|
||||
"id": "controlled-hands",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## FAce dectection on yolov5s_face"
|
||||
"## Face dectection on yolov5s_face"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -572,7 +581,7 @@
|
||||
"id": "atmospheric-generic",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 yolov5s-seg 实现实例分割"
|
||||
"## Instance segmentation on yolov5s-seg"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -616,7 +625,7 @@
|
||||
"id": "hazardous-ecology",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 PP_Humanseg 实现人体分割"
|
||||
"## Human segmentation on PP_Humanseg"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -651,7 +660,7 @@
|
||||
"id": "statutory-graham",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 ax-poes-ppl 实现人体姿态检测"
|
||||
"## Human posture detection on ax-poes-ppl"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -694,7 +703,7 @@
|
||||
"id": "behind-powder",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 HandPose 实现手势姿态检测"
|
||||
"## Gesture detection on HandPose"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -737,7 +746,7 @@
|
||||
"id": "outside-discretion",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 animal-pose 实现动物姿态检测"
|
||||
"## Animal posture detection on animal-pose"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -786,7 +795,7 @@
|
||||
"id": "bearing-jefferson",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 yolov5s Pillow 实现图像检测处理"
|
||||
"## Image detection processing on yolov5s Pillow"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -857,7 +866,7 @@
|
||||
"id": "distributed-stewart",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 ax-poes-ppl Pillow 实现人体姿态检测"
|
||||
"## Human posture detection on ax-poes-ppl Pillow"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -924,11 +933,11 @@
|
||||
"id": "covered-founder",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 Pillow 进行图像处理并显示\n",
|
||||
"## Image processing and displaying based on Pillow\n",
|
||||
"\n",
|
||||
"> **Pillow（PIL）**是 Python 常用的图像处理库，而 Pillow 是 PIL 支，提供了广泛的文件格式支持，强大的图像处理能力，主要包括图像储存、图像显示、格式转换以及基本的图像处理操作等。\n",
|
||||
"> **Pillow（PIL）** is the Python Imaging Library, is used for image processing purposes like image store, image display and format conversion.\n",
|
||||
"\n",
|
||||
"**使用以下的例子来说明如何使用 Python Pillow:**"
|
||||
"**Here is a example to use Python Pillow:**"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -986,7 +995,7 @@
|
||||
"id": "residential-husband",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"- **关于 Pillow 更多的使用资料请[点击](https://www.itcodar.com/python/how-to-show-pil-image-in-ipython-notebook.html)查看。**\n"
|
||||
"- [Click me](https://www.itcodar.com/python/how-to-show-pil-image-in-ipython-notebook.html) to know more usage about Pillow"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -994,11 +1003,11 @@
|
||||
"id": "harmful-quarter",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 Numpy 进行数组计算\n",
|
||||
"## Calculation on Numpy\n",
|
||||
"\n",
|
||||
"> NumPy (Numerical Python) 是 Python 语言的一个扩展程序库，支持大量的维度数组与矩阵运算，此外也是针对数组运算提供大量的数学函数库。\n",
|
||||
"\n",
|
||||
"**使用以下的例子来说明如何调用 Numpy：**"
|
||||
"> NumPy (Numerical Python) is the fundamental package for scientific computing in Python. It is a Python library that provides a multidimensional array object, various derived objects (such as masked arrays and matrices), and an assortment of routines for fast operations on arrays, including mathematical, logical, shape manipulation, sorting, selecting, I/O, discrete Fourier transforms, basic linear algebra, basic statistical operations, random simulation and much more.\n",
|
||||
"> \n",
|
||||
"**We can use Numpy on AXera-Pi：**"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1017,7 +1026,7 @@
|
||||
],
|
||||
"source": [
|
||||
"import numpy as np\n",
|
||||
"# int8, int16, int32, int64 四种数据类型可以使用字符串 'i1', 'i2','i4','i8' 代替\n",
|
||||
"# 'i1', 'i2','i4','i8' are same as int8, int16, int32, int64\n",
|
||||
"dt = np.dtype('i4')\n",
|
||||
"print(dt)"
|
||||
]
|
||||
@@ -1027,7 +1036,7 @@
|
||||
"id": "convertible-elevation",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"- **关于 Numpy 的更多资料例程请[点击](https://www.runoob.com/numpy/numpy-tutorial.html)查看。**"
|
||||
"- Visit [Numpy](https://numpy.org/) for more information"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1035,14 +1044,11 @@
|
||||
"id": "continuing-judgment",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 Opencv 读取 USB 摄像头拍照并显示到屏幕\n",
|
||||
"## Use USB camera with Opencv\n",
|
||||
"\n",
|
||||
"**运行程序前先准备材料并接好线，把 USB 摄像头接入转接头的 USB 口，再把转接头的 Type-c 口接入设备板载的 OTG 口，使用 Type-c 数据线连接设备板载的 UART 口及电脑端进行上电操作。**\n",
|
||||
"Connect USB camera with USB-OTG port of your AXera-Pi first.\n",
|
||||
"\n",
|
||||
"- 一个 USB 摄像头及 Type-c USB 转接头\n",
|
||||
"- 一台 AXera-Pi 设备以及 Type-c 数据线\n",
|
||||
"\n",
|
||||
"**在编辑框运行以下代码即可调用 Opencv 使用 USB 摄像头拍照。**\n"
|
||||
"**This is the Opencv example**, take and display the photo via USB camera."
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1074,7 +1080,7 @@
|
||||
"source": [
|
||||
"\n",
|
||||
"\n",
|
||||
"> 运行出现报错请移步[Maix-III 系列 AXera-Pi 常见问题(FAQ)](https://wiki.sipeed.com/hardware/zh/maixIII/ax-pi/faq_axpi.html)进行查询。"
|
||||
"> Visit [Maix-III AXera-Pi Q&A](https://wiki.sipeed.com/hardware/en/maixIII/ax-pi/faq_axpi.html) if failing running"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1082,13 +1088,13 @@
|
||||
"id": "current-hierarchy",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 播放音视频\n",
|
||||
"## Play media\n",
|
||||
"\n",
|
||||
"- [如何使用 Python 播放音视频](https://wiki.sipeed.com/soft/maixpy3/zh/usage/Audio/play_mp4.html)\n",
|
||||
"- [Play media by Python](https://wiki.sipeed.com/soft/maixpy3/zh/usage/Audio/play_mp4.html)\n",
|
||||
"\n",
|
||||
"## 发起 Http 请求或 MQTT 通信\n",
|
||||
"## Use Http or MQTT\n",
|
||||
"\n",
|
||||
"- [如何发起 Http 请求或 MQTT 通信](https://wiki.sipeed.com/soft/maixpy3/zh/usage/net.html)\n"
|
||||
"- [Click me](https://wiki.sipeed.com/soft/maixpy3/zh/usage/net.html)"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1096,17 +1102,13 @@
|
||||
"id": "consecutive-karen",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 调用 PinPong 库控制 Microbit \n",
|
||||
"## Use Microbit with PinPong on AXera-Pi \n",
|
||||
"\n",
|
||||
"> PinPong 库是一套控制开源硬件主控板的 Pyhton 库，基于 Firmata 协议并兼容 MicroPython 语法。\n",
|
||||
"> [PinPong](https://pinpong.readthedocs.io/zh_CN/latest/) is an open source hardware control python library, is based on Firmata protocol and support MicroPython language.\n",
|
||||
"\n",
|
||||
"**使用前请先准备材料并按步骤接线，使用 Micro usb 数据线连接 Microbit，然后把另一端接入转接头的 USB 口，再把转接头的 Type-c 口接入设备的 OTG 口，使用 Type-c 数据线连接设备的 UART 口及 PC 端通电。**\n",
|
||||
"Connect Microbit with USB-OTG port of your AXera-Pi first.\n",
|
||||
"\n",
|
||||
"- 一个 Type-c USB 转接头\n",
|
||||
"- 一台 Microbit 以及 Micro usb 数据线\n",
|
||||
"- 一台 AXera-Pi 设备以及 Type-c 数据线\n",
|
||||
"\n",
|
||||
"可直接在 `Python3` 环境运行下方代码即可连接 microbit 掌控版并会看到 `hello world` 亮灯效果。"
|
||||
"Run following example code on AXera-Pi, there is `hello world` scroll text on microbit."
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1158,7 +1160,7 @@
|
||||
"id": "finnish-custody",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"- **点击 [Microbit 传送门](https://pinpong.readthedocs.io/zh_CN/latest/2.pinpong%E7%A4%BA%E4%BE%8B/index1.html) 查看更多的相关例程资料。**"
|
||||
"- **Visit [PINPONG](https://pinpong.readthedocs.io/zh_CN/latest/index.html) for more information**"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1166,15 +1168,11 @@
|
||||
"id": "approved-grove",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"## 使用 PinPong 库控制 Arduino UNO \n",
|
||||
"## Control Arduino UNO with PinPong on AXera-Pi \n",
|
||||
"\n",
|
||||
"**使用前请先准备材料按步骤接线，先用 Type-B 数据线连接 Arduino UNO，接着把另一端接入转接头的 USB 口，再把转接头的 Type-c 口接入设备板载的 OTG 口，使用 Type-c 数据线连接设备板载的 UART 口及电脑端进行上电操作。**\n",
|
||||
"Connect Arduino UNO with USB-OTG port of your AXera-Pi first.\n",
|
||||
"\n",
|
||||
"- 一个 Type-c USB 转接头\n",
|
||||
"- 一台 Arduino UNO 以及 Type-b 数据线\n",
|
||||
"- 一台 AXera-Pi 设备以及 Type-c 数据线\n",
|
||||
"\n",
|
||||
"直接在编辑框运行以下代码控制 Arduino UNO 板点亮外接的 **LED** 灯以及板载也会亮起。"
|
||||
"Run following example code on AXera-Pi, LED on Arduino UNO blinks."
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1230,16 +1228,16 @@
|
||||
"import time\n",
|
||||
"from pinpong.board import Board,Pin\n",
|
||||
"Board(\"uno\",\"/dev/ttyUSB0\").begin() \n",
|
||||
"led = Pin(Pin.D13, Pin.OUT) #引脚初始化为电平输出\n",
|
||||
"led = Pin(Pin.D13, Pin.OUT) # Init pin direction\n",
|
||||
"\n",
|
||||
"while True:\n",
|
||||
" led.value(1) #输出高电平\n",
|
||||
" print(\"1\") #终端打印信息\n",
|
||||
" time.sleep(1) #等待1秒 保持状态\n",
|
||||
" led.value(1) # High voltage output\n",
|
||||
" print(\"1\") # Print information\n",
|
||||
" time.sleep(1) # Wait 1 second\n",
|
||||
"\n",
|
||||
" led.value(0) #输出低电平 \n",
|
||||
" print(\"0\") #终端打印信息\n",
|
||||
" time.sleep(1) #等待1秒 保持状态"
|
||||
" led.value(0) # Low voltage output \n",
|
||||
" print(\"0\") # Print information\n",
|
||||
" time.sleep(1) # Wait 1 second"
|
||||
]
|
||||
},
|
||||
{
|
||||
@@ -1260,7 +1258,7 @@
|
||||
"id": "quiet-philadelphia",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"- **点击 [Arduino UNO 传送门](https://pinpong.readthedocs.io/zh_CN/latest/2.pinpong%E7%A4%BA%E4%BE%8B/index1.html) 查看更多的相关例程资料。**"
|
||||
"- **[Click me](https://pinpong.readthedocs.io/zh_CN/latest/2.pinpong%E7%A4%BA%E4%BE%8B/%E7%A4%BA%E4%BE%8B%E7%A8%8B%E5%BA%8F-blink.html) to see more information.**"
|
||||
]
|
||||
}
|
||||
],
|
||||
|
||||
@@ -199,11 +199,12 @@
|
||||
"file": "maixIII/ax-pi/flash_system.md"
|
||||
},
|
||||
{
|
||||
"label": "Python programming(Building)",
|
||||
"label": "Python programming",
|
||||
"file": "maixIII/ax-pi/python_api.ipynb"
|
||||
},
|
||||
{
|
||||
"label": "C/C++ programming(Building)"
|
||||
"label": "C/C++ programming(Building)",
|
||||
"file": "maixIII/ax-pi/dev_prepare.md"
|
||||
},
|
||||
{
|
||||
"label": "AI development guide",
|
||||
|
||||
@@ -89,7 +89,7 @@ Maix-III AXera-Pi 开发板的 Linux debian11 系统默认使用 root 用户登
|
||||
|
||||
|
||||
|
||||
系统默认开启了 usb rndis 虚拟以太网，用户可通过板载 USB OTG 口连接 usb0 网卡的 IP `192.168.233.` 进行 ssh 登录操作。使用 ssh 登录前需要先登陆板子通过 `ifconfig -a` 命令得到板子 IP 后再使用 IP 进行 ssh 登录上 Linux 系统，下图的 IP 地址（除 `127.0.0.1` 外）都能登陆板子。
|
||||
系统默认开启了 usb rndis 虚拟以太网，用户可通过板载 USB OTG 口连接 usb0 网卡的 IP `192.168.233.1` 进行 ssh 登录操作。使用 ssh 登录前需要先登陆板子通过 `ifconfig -a` 命令得到板子 IP 后再使用 IP 进行 ssh 登录上 Linux 系统，下图的 IP 地址（除 `127.0.0.1` 外）都能登陆板子。
|
||||
|
||||
|
||||
|
||||
|
||||
File diff suppressed because one or more lines are too long
BIN
news/MaixPy3/camera_resize/assets/command_blue.jpg
Normal file
BIN
news/MaixPy3/camera_resize/assets/command_blue.jpg
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 4.1 KiB |
BIN
news/MaixPy3/camera_resize/assets/edit_green.jpg
Normal file
BIN
news/MaixPy3/camera_resize/assets/edit_green.jpg
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 4.7 KiB |
@@ -15,19 +15,25 @@ tags: MaixPy3, resize, teedoc
|
||||
- 每一个框框都被称之为单元格
|
||||
|
||||
- 单元格左方会有 蓝色 或者 绿色 两种颜色。绿色表示编辑模式；蓝色表示命令模式。
|
||||
- 通用：
|
||||
- Shift+ Enter ：运行单元格，且以命令模式切换到下一个单元格
|
||||
- Ctrl + Enter ：运行单元格，且进入命令模式
|
||||
- 编辑模式中：
|
||||
- Esc ：进入命令模式
|
||||
- 命令模式中：
|
||||
- **h :打开帮助**
|
||||
- Enter :进入编辑模式
|
||||
- x :剪切单元格
|
||||
- c :复制单元格
|
||||
- v :粘贴单元格
|
||||
- dd :删除整个单元格
|
||||
- ii :终止运行
|
||||
|
||||
**编辑模式**
|
||||
|
||||
**命令模式**
|
||||
|
||||
|
||||
- 通用操作：
|
||||
- Shift+ Enter ：运行单元格，且以命令模式切换到下一个单元格
|
||||
- Ctrl + Enter ：运行单元格，且进入命令模式
|
||||
- 编辑模式操作：
|
||||
- Esc ：进入命令模式
|
||||
- 命令模式操作：
|
||||
- **h :打开帮助**
|
||||
- Enter :进入编辑模式
|
||||
- x :剪切单元格
|
||||
- c :复制单元格
|
||||
- v :粘贴单元格
|
||||
- dd :删除整个单元格
|
||||
- ii :终止运行
|
||||
|
||||
## 开始演示效果
|
||||
|
||||
|
||||
Reference in New Issue
Block a user