x86 or amd平台利用 qemu-user-static 实现 arm64 平台 docker 镜像的运行和构建

前言

因国产化趋势，新的信创环境CPU大部分使用ARM架构。因暂无arm环境，自己买 arm 平台的 CPU，这个成本着实吃不消，于是尝试 x86 平台运行 arm 平台的容器来降本增效。

关于 docker 版本

docker 运行其他平台容器，需要使用 --platform 参数来指定平台
docker 19.03.9 及以上的版本才支持 --platform 参数
默认没有开启 --platform 参数，需要手动开启。

开启experimental 功能配置：

参考：https://199604.com/2865

查看是否开启 experimental 功能

--platform 参数需要 experimental 为 true，通过下面的命令可以验证是否开启:

docker info | grep -i 'experimental'

拉取一个 arm 平台的容器测试

docker pull --platform arm64 debian:stable-slim

#查看镜像使用的平台
docker inspect debian:stable-slim | grep -i 'architecture'

如果不加 --platform 参数，默认拉取自己当前 CPU 平台的镜像

如果本地有相同 tag 的镜像，只是平台不同的情况下，需要注意区分 tag ，不然直接 docker pull 就会覆盖掉之前的镜像，之前的镜像 tag 会变为 <none>

配置qemu-user-static依赖

注册可支持的架构解释器

docker run --rm \
--privileged \
multiarch/qemu-user-static:register \
--reset

# 执行成功后，会返回类似如下的结果来表明支持的架构解析器
Setting /usr/bin/qemu-alpha-static as binfmt interpreter for alpha
Setting /usr/bin/qemu-arm-static as binfmt interpreter for arm
Setting /usr/bin/qemu-armeb-static as binfmt interpreter for armeb
Setting /usr/bin/qemu-sparc-static as binfmt interpreter for sparc
Setting /usr/bin/qemu-sparc32plus-static as binfmt interpreter for sparc32plus
Setting /usr/bin/qemu-sparc64-static as binfmt interpreter for sparc64
Setting /usr/bin/qemu-ppc-static as binfmt interpreter for ppc
Setting /usr/bin/qemu-ppc64-static as binfmt interpreter for ppc64
Setting /usr/bin/qemu-ppc64le-static as binfmt interpreter for ppc64le
Setting /usr/bin/qemu-m68k-static as binfmt interpreter for m68k
Setting /usr/bin/qemu-mips-static as binfmt interpreter for mips
Setting /usr/bin/qemu-mipsel-static as binfmt interpreter for mipsel
Setting /usr/bin/qemu-mipsn32-static as binfmt interpreter for mipsn32
Setting /usr/bin/qemu-mipsn32el-static as binfmt interpreter for mipsn32el
Setting /usr/bin/qemu-mips64-static as binfmt interpreter for mips64
Setting /usr/bin/qemu-mips64el-static as binfmt interpreter for mips64el
Setting /usr/bin/qemu-sh4-static as binfmt interpreter for sh4
Setting /usr/bin/qemu-sh4eb-static as binfmt interpreter for sh4eb
Setting /usr/bin/qemu-s390x-static as binfmt interpreter for s390x
Setting /usr/bin/qemu-aarch64-static as binfmt interpreter for aarch64
Setting /usr/bin/qemu-aarch64_be-static as binfmt interpreter for aarch64_be
Setting /usr/bin/qemu-hppa-static as binfmt interpreter for hppa
Setting /usr/bin/qemu-riscv32-static as binfmt interpreter for riscv32
Setting /usr/bin/qemu-riscv64-static as binfmt interpreter for riscv64
Setting /usr/bin/qemu-xtensa-static as binfmt interpreter for xtensa
Setting /usr/bin/qemu-xtensaeb-static as binfmt interpreter for xtensaeb
Setting /usr/bin/qemu-microblaze-static as binfmt interpreter for microblaze
Setting /usr/bin/qemu-microblazeel-static as binfmt interpreter for microblazeel
Setting /usr/bin/qemu-or1k-static as binfmt interpreter for or1k
Setting /usr/bin/qemu-hexagon-static as binfmt interpreter for hexagon

不指定 CPU 平台，使用 register 来注册可支持的架构解析器

下载 `qemu-aarch64-static`

qemu-user-static下载地址：https://github.com/multiarch/qemu-user-static/releases

wget https://github.com/multiarch/qemu-user-static/releases/download/v7.2.0-1/qemu-aarch64-static

chmod +x qemu-aarch64-static

运行一个 arm 平台的容器

在没有 qemu-user-static 的帮助下，单靠 --platform 参数是无法启动非本机平台的镜像的，如下：

docker run --platform arm64 -t --rm debian:stable-slim uname -m

# 返回的报错如下:
# standard_init_linux.go:211: exec user process caused "exec format error"

需要启动容器时将 qemu-aarch64-static 带入到容器内

注意 qemu-aarch64-static 二进制文件的路径，可以自己归纳到指定的路径，只需要带入到容器内的 /usr/bin 目录下就好了
ll /usr/local/sbin/qemu-aarch64-static
-rwxr-xr-x 1 root root 10402960 1月  17 2023 /usr/local/sbin/qemu-aarch64-static
Bash

docker run -it \
--rm \
--platform arm64 \
-v /usr/local/sbin/qemu-aarch64-static:/usr/bin/qemu-aarch64-static \
debian:stable-slim \
uname -m

# 返回结果
aarch64

同理，参试其他cpu架构平台也是一样下载qemu-xxxx-static

构建一个 arm64 镜像

准备一个 Dockerfile
需要将 qemu-aarch64-static 带入到容器内的 /usr/bin 目录下才可以实现构建
不然会返回 standard_init_linux.go:211: exec user process caused "no such file or directory" 这样的报错

Dockerfile

# https://blog.csdn.net/qq_34718871/article/details/134218667
# docker build --platform arm64 -t reg-hub.gzeport.com/gzeport/jdk/debian-jdk11-arm:20240529 .
FROM debian:stable-slim

MAINTAINER guoliangjun<post@199604.com>
# 设置aarch64环境
COPY ./qemu-aarch64-static /usr/bin/qemu-aarch64-static

# Support Chinese
ENV TIME_ZONE="Asia/Shanghai" \
    LANG=zh_CN.UTF-8 \
    LANGUAGE=zh_CN.UTF-8

# 切换apt源为清华源，并安装vim ping telnet命令
RUN apt-get update && apt install -y apt-transport-https ca-certificates \
    && sed -i 's@deb.debian.org@mirrors.tuna.tsinghua.edu.cn@g' /etc/apt/sources.list.d/debian.sources \
    && apt-get clean  \
    && apt-get update  \
    && apt-get install -y iputils-ping fontconfig tzdata ttf-dejavu* curl net-tools \
    && cp /usr/share/zoneinfo/$TIME_ZONE /etc/localtime \
    && echo $TIME_ZONE > /etc/timezone \
    && apt-get remove tzdata -y \
    && addgroup --gid 2888 gzapps \
    && adduser --uid 2888 --gid 2888 --home /AppHome --disabled-password --gecos --no-create-home gzapps

# Install JDK11 注意是linux aarch64
ADD jdk-11.0.21_linux-aarch64_bin.tar.gz /usr/local/jdk
ENV JAVA_HOME=/usr/local/jdk/jdk-11.0.21
ENV PATH=$JAVA_HOME/bin:$PATH

WORKDIR /AppHome
USER gzapps

开始构建

docker build --platform arm64 -t reg-hub.gzeport.com/gzeport/jdk/debian-jdk11-arm:20240529 .

构建完成后

[root@localhost arm-x64]# docker inspect reg-hub.gzeport.com/gzeport/jdk/debian-jdk11-arm:20240529 | grep -i 'architecture'
        "Architecture": "arm64",

方式二：使用buildx在x86机器上面编译arm64架构的Docker镜像

因为 Centos 7 的内核太老，使用buildx暂时不支持，只做记录

参考：

1.https://blog.yasking.org/a/docker-multi-arch-with-buildx.html

2.https://www.cnblogs.com/jinanxiaolaohu/p/17409839.html

参考

1.https://www.cnblogs.com/chen2ha/p/17180287.html

发送评论编辑评论