From patchwork Wed Dec 18 16:20:36 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 851716 Delivered-To: patch@linaro.org Received: by 2002:a5d:4888:0:b0:385:e875:8a9e with SMTP id g8csp1014108wrq; Wed, 18 Dec 2024 08:22:20 -0800 (PST) X-Forwarded-Encrypted: i=2; AJvYcCU4sguAfXrnsqc45CBQOB/LSqsCG60rZYv7faeL8lkid7iMpFf7+Jr5SZ6BIJ/VQH8GrSvxeQ==@linaro.org X-Google-Smtp-Source: AGHT+IEVFTdTT9BHvpZeVs/QGlwTZ4pKCSAVVBZ9WC2/sIP8Soq9LOt5iYt1qTSmGUR8RIphZoI7 X-Received: by 2002:a05:6214:19e2:b0:6d8:8874:2127 with SMTP id 6a1803df08f44-6dd14b9307bmr4337816d6.5.1734538940170; Wed, 18 Dec 2024 08:22:20 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1734538940; cv=none; d=google.com; s=arc-20240605; b=jZ4ooqsz1yZYFLmRLhj/lyJr75CCgNcE/tzWchxD8dns01DE47m2vcckLBFyd71jTd xXdHjE9Dz2xodRfaj95ZFkwVKFUMu/pFblr7xjp8/WnulDcPuvi1oNg8gl6wE7GyJts+ 4GDy2LHjeGmzX/4LRPk2l889z3IfIP6Q+5wSVNcSPksqfjMpTbHgY5DMFB+qsqmh/T2C YzK1gCIPp3bBKeu8QP8TcHQrXYPHI+RJ0VuE5IMNyQr75LYBQha/ixbuj3Y55xvXKf0S FjtnAhlAVmr2if/AU5yRNMzo0ETd30ekRk0IfDEeYWaiDOu2SBRrFNVXi99CWOohSbQc VHVw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=sender:errors-to:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:cc:to:from:dkim-signature; bh=mFxtokJTmV9YXqorDmZaKi+Dd7+RY6QHS5xgjxfqOhY=; fh=3B3x+qnzafPmOtds1UJSYk2V7VBmDf107HX3/Dfv0XA=; b=AHB7+N+WfYGDIO6Ii1ntIMDQgW7qArJFSHJDEWwuOvOT2pLiZ98SA8DwI1LnEe7z2g Tp94eOp7PPaeRIf0Qybyg0Ym2QRlHX4AU/WQK2i8IrF0E9ECjsJh1ih1xfXBrpjEz/FK PHMkvw30UxRGpw25fkJh7/epnEgPilOng0khQe6lexwA8iY+7J4qUdgDugztbEI8z2f5 D/+HGDQkpb/y2+O56VE4lGInMtTjxlG6oTCe8u79o6FqxBRwLm66jWXhMMi/rI6Xm0yy TTO+WbDFQBlohNDpzBZIKQ/nY9x3Z9JpNIaD/1vJUjHeAgLClPytiP82lnkyZWz7RJTh M50g==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=hy3B+jOG; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org; dara=neutral header.i=@linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id 6a1803df08f44-6dccd1ba6fesi130145656d6.46.2024.12.18.08.22.19 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Wed, 18 Dec 2024 08:22:20 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=hy3B+jOG; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org; dara=neutral header.i=@linaro.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1tNwnU-0007S4-Pi; Wed, 18 Dec 2024 11:21:16 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tNwnS-0007Q7-LD for qemu-devel@nongnu.org; Wed, 18 Dec 2024 11:21:14 -0500 Received: from mail-ed1-x530.google.com ([2a00:1450:4864:20::530]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1tNwnN-0006cg-Ji for qemu-devel@nongnu.org; Wed, 18 Dec 2024 11:21:14 -0500 Received: by mail-ed1-x530.google.com with SMTP id 4fb4d7f45d1cf-5d3f57582a2so1708514a12.1 for ; Wed, 18 Dec 2024 08:21:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1734538868; x=1735143668; darn=nongnu.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=mFxtokJTmV9YXqorDmZaKi+Dd7+RY6QHS5xgjxfqOhY=; b=hy3B+jOGyPio1YofV1MqDlImRojtiWrqBLFqFbBhZNWi64KOjzz8w/79146dvoC2Om okb0FqJpQ0J6yULt7AHw1UhrDtGKTt8QxeQsAuAjSAF/PLssp2tqSjTTUK2yoUtiCkUg FIjTuGg2WyS0851GBNwLBOkzipETP8IdPmQU0/9pbJLmuFkgDDmct03bwZVkO9kw2++x hwIr4zsXOjsLVMewhu/0+YSrcB7oMvgZLoMuQL6NEacaKRu94TMgD0zqbj1bRYhq4Iw3 EW2BlHN2jNMYzmCA/GS83vzhgywWWdVKP1cjfps7Ycqbffzn2YnE7hgWNpQ0kE/RdefM NdCw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1734538868; x=1735143668; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=mFxtokJTmV9YXqorDmZaKi+Dd7+RY6QHS5xgjxfqOhY=; b=Ug16YvpuWdNTZcjnNSczMV7gHtLU0tXh23XxXvhSZSBBotbq0ytGMzLzHdK9bTTSSY ooSDs7YS3lfjklalEKSx6ljoyz9sTc9rdrXae+SDmy4jeQoue6BWTRgFEPxe7jTT4gBo 1dZxp/XLv8JifbsMgSNt22Yioxf258cm2t49wiqdz4XgFCwJmObUlws1Uow1Z3Y+COni G/lKUTKTgH6OpmvUiliryvWb2LkkcdNE1RGSMOQZcnd4G5sEoc9dcWU3+uCyL1kWn4Lu 4jqf2WQKy0LBvig0PaqSSGJiCvnUff4CLmXsl7G7WtD/2aPKAyfCaIKxWJ3O4bfoLrL2 Q9+g== X-Gm-Message-State: AOJu0YwhTV/awpzAmv2niti2tjxi/5RTihc1q7pCp7VCeuKqohAAk7yF MAEW6LF4Mw1uNIT1/9sTsYQzut4yzgGMPg5hfIXIYKhoRgx8cSO0PtFAAbwD1+8= X-Gm-Gg: ASbGncuDXOOHIjVlxQHW2w0wRPxvy4MTPZJWtyc5mnI+m1/H8C6EKTy/OtQbNAoF5GQ 8cYfKk5NAZ1JRNF8R+ST+Rx++QQ8rdAW4dL/VHzdS4nUaWfqa6J1HldRJY9NvrMv4VPMGzkL86C uEg6oUKmVM5NaOBJONSF0Vs8HrnSAv2ztY1KmoRuBpD48ro2dnjSVX6BRTgCmo+yN2cyuv0qjOC dYMJ5BeXMhdO8dUvuztwBA0TUnZE9/pMk3uby7w3dpwHbXfpp36ARw= X-Received: by 2002:a17:906:794c:b0:a9a:e0b8:5bac with SMTP id a640c23a62f3a-aabdcba2655mr548405766b.23.1734538867631; Wed, 18 Dec 2024 08:21:07 -0800 (PST) Received: from draig.lan ([85.9.250.243]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-aab96359831sm569381466b.95.2024.12.18.08.21.04 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 18 Dec 2024 08:21:05 -0800 (PST) Received: from draig.lan (localhost [IPv6:::1]) by draig.lan (Postfix) with ESMTP id 18E245F796; Wed, 18 Dec 2024 16:21:04 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: =?utf-8?q?Daniel_P=2E_Berrang=C3=A9?= , Ed Maste , Eric Farman , Thomas Huth , Li-Wen Hsu , Daniel Henrique Barboza , Aurelien Jarno , Fabiano Rosas , Radoslaw Biernacki , Mark Cave-Ayland , =?utf-8?q?Marc-Andr=C3=A9?= =?utf-8?q?_Lureau?= , =?utf-8?q?Philippe_Mathi?= =?utf-8?q?eu-Daud=C3=A9?= , qemu-riscv@nongnu.org, Nicholas Piggin , Joel Stanley , Beraldo Leal , Markus Armbruster , Jiaxun Yang , Weiwei Li , Peter Maydell , Cleber Rosa , Leif Lindholm , Christian Borntraeger , John Snow , Marcel Apfelbaum , Palmer Dabbelt , Bin Meng , Daniel Henrique Barboza , Paolo Bonzini , Liu Zhiwei , Wainer dos Santos Moschetta , Laurent Vivier , Pavel Dovgalyuk , Richard Henderson , Marcin Juszkiewicz , Halil Pasic , qemu-arm@nongnu.org, Harsh Prateek Bora , qemu-ppc@nongnu.org, Bernhard Beschow , "Michael S. Tsirkin" , qemu-s390x@nongnu.org, Laurent Vivier , Alistair Francis , =?utf-8?q?Alex_Benn=C3=A9e?= Subject: [PATCH v2 00/27] testing/next: functional tests, qtest clocks, vm and keymaps Date: Wed, 18 Dec 2024 16:20:36 +0000 Message-Id: <20241218162104.3493551-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 Received-SPF: pass client-ip=2a00:1450:4864:20::530; envelope-from=alex.bennee@linaro.org; helo=mail-ed1-x530.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: qemu-devel-bounces+patch=linaro.org@nongnu.org There are number of parts to this series. The first is the updated images for all the guests that didn't make it into 9.2. There are also some new functional tests for virtio-gpu along with some other clean-ups. The qtest patches focus on ensuring things calling clock_step and clock_set actually pay attention to return values. Currently only the virtio tests needed a little re-jigging although arguably the timeout loops aren't needed at all. We bump libvirt-ci so we can move the riscv64 cross container to testing/trixie which will hopefully make the image less prone to sid breakages. Finally we make a few tweaks to tests/vm which were helpful when chasing the keymap issue. I still think there is a race condition in there somewhere as I can't reliably build the FreeBSD VMs from scratch. The pc-bios dependency fixup I think addresses the failure but I'm a little unsure about the meason stuff. For v2 - add test/vm and lcitool updates - don't move clock_step, remove them for virtio tests I was planning on on making this a pre-PR but as I'm off for Christmas this may as well percolate on the list for now. If any of the other testing maintainers want to cherry-pick stuff into their PRs then be my guest. The following still need review: pc-bios: ensure keymaps dependencies set vnc tests tests/vm: allow interactive login as root tests/vm: partially un-tabify help output tests/vm: fix build_path based path tests/docker: move riscv64 cross container from sid to trixie tests/lcitool: bump to latest version of libvirt-ci tests/functional: extend test_aarch64_virt with vulkan test tests/functional: remove hacky sleep from the tests system/qtest: properly feedback results of clock_[step|set] tests/qtest: remove clock_steps from virtio tests util/qemu-timer: fix indentation Alex. Alex Bennée (25): tests/functional: update the arm tuxrun tests tests/functional: update the i386 tuxrun tests tests/functional: add a m68k tuxrun tests tests/functional: update the mips32 tuxrun tests tests/functional: update the mips32el tuxrun tests tests/functional: update the mips64 tuxrun tests tests/functional: update the mips64el tuxrun tests tests/functional: update the ppc32 tuxrun tests tests/functional: update the ppc64 tuxrun tests tests/functional: update the riscv32 tuxrun tests tests/functional: update the riscv64 tuxrun tests tests/functional: update the s390x tuxrun tests tests/functional: update the sparc64 tuxrun tests tests/functional: update the x86_64 tuxrun tests util/qemu-timer: fix indentation tests/qtest: remove clock_steps from virtio tests system/qtest: properly feedback results of clock_[step|set] tests/functional: remove hacky sleep from the tests tests/functional: extend test_aarch64_virt with vulkan test tests/lcitool: bump to latest version of libvirt-ci tests/docker: move riscv64 cross container from sid to trixie tests/vm: fix build_path based path tests/vm: partially un-tabify help output tests/vm: allow interactive login as root pc-bios: ensure keymaps dependencies set vnc tests Daniel P. Berrangé (1): tests/lcitool: remove temp workaround for debian mips64el Pierrick Bouvier (1): tests/functional/aarch64: add tests for FEAT_RME MAINTAINERS | 1 + system/qtest.c | 23 ++-- tests/qtest/libqos/virtio.c | 4 - util/qemu-timer.c | 2 +- .gitlab-ci.d/cirrus/freebsd-14.vars | 2 +- pc-bios/keymaps/meson.build | 17 ++- .../dockerfiles/debian-mips64el-cross.docker | 9 ++ .../dockerfiles/debian-riscv64-cross.docker | 4 +- tests/functional/meson.build | 5 + tests/functional/test_aarch64_rme_sbsaref.py | 70 +++++++++++ tests/functional/test_aarch64_rme_virt.py | 100 ++++++++++++++++ tests/functional/test_aarch64_virt.py | 113 +++++++++++++++--- tests/functional/test_arm_tuxrun.py | 28 ++--- tests/functional/test_i386_tuxrun.py | 8 +- tests/functional/test_m68k_tuxrun.py | 34 ++++++ tests/functional/test_mips64_tuxrun.py | 8 +- tests/functional/test_mips64el_tuxrun.py | 8 +- tests/functional/test_mips_tuxrun.py | 8 +- tests/functional/test_mipsel_tuxrun.py | 8 +- tests/functional/test_ppc64_tuxrun.py | 16 +-- tests/functional/test_ppc_tuxrun.py | 8 +- tests/functional/test_riscv32_tuxrun.py | 8 +- tests/functional/test_riscv64_tuxrun.py | 16 +-- tests/functional/test_s390x_tuxrun.py | 8 +- tests/functional/test_sparc64_tuxrun.py | 8 +- tests/functional/test_x86_64_tuxrun.py | 8 +- tests/lcitool/libvirt-ci | 2 +- tests/lcitool/mappings.yml | 29 ----- tests/lcitool/refresh | 4 +- tests/qtest/meson.build | 2 +- tests/vm/Makefile.include | 29 ++--- tests/vm/basevm.py | 12 +- tests/vm/generated/freebsd.json | 2 +- 33 files changed, 441 insertions(+), 163 deletions(-) create mode 100755 tests/functional/test_aarch64_rme_sbsaref.py create mode 100755 tests/functional/test_aarch64_rme_virt.py create mode 100644 tests/functional/test_m68k_tuxrun.py