July 2022 - Libguestfs - libguestfs List Archives

[PATCH] Add simple parsing logic for hostname file.
by Dawid Zamirski 20 Jul '22

20 Jul '22

There are some linux systems in the wild where the /etc/hostname file does not contain the configured hostname as sole line in that file. This file actually allows for comments [1] starting with "#" and the original logic would extract the comment line instead of the hostname on such systems. This patch fixes this by filtering out the comment lines and any empty lines. [1] https://www.freedesktop.org/software/systemd/man/hostname.html --- Please keep in mind that this is my first attempt at OCaml after taking a quick crash-course to get familiar with the language to produce this patch. Therefore, the patch may be very suboptimal and break guidelines, so please be forgiving :-) daemon/inspect_fs_unix.ml | 22 +++++++++++++++++----- 1 file changed, 17 insertions(+), 5 deletions(-) diff --git a/daemon/inspect_fs_unix.ml b/daemon/inspect_fs_unix.ml index 63cb279d0..533ef71b2 100644 --- a/daemon/inspect_fs_unix.ml +++ b/daemon/inspect_fs_unix.ml @@ -556,11 +556,23 @@ and check_hostname_from_file filename = let chroot = let name = sprintf "check_hostname_from_file: %s" filename in Chroot.create ~name () in - - let hostname = Chroot.f chroot read_small_file filename in - match hostname with - | None | Some [] | Some [""] -> None - | Some (hostname :: _) -> Some hostname + try + let lines = Chroot.f chroot read_small_file filename in + let lines = match lines with + | None -> raise Not_found + | Some lines -> List.map String.trim lines in + let rec loop = function + | [] -> raise Not_found + | line :: _ when String.length line > 0 && + not (String.is_prefix line "#") -> + line + | _ :: lines -> + loop lines + in + let hostname = loop lines in + Some hostname + with + Not_found -> None (* Parse the hostname from /etc/sysconfig/network. This must be * called from the 'with_augeas' wrapper. Note that F18+ and -- 2.36.1

4 4

nbdkit test-checkwrite.sh failing occasionally on ppc64le
by Richard W.M. Jones 20 Jul '22

20 Jul '22

It's not 100% reproducible, but it seems to happen reasonably often. Unfortunately it only happens on ppc64le (so far). The error message lacks sufficient detail to tell what's going on. nbdkit: backend.c:624: backend_pread: Assertion `backend_valid_range (c, offset, count)' failed. nbdkit: backend.c:624: backend_pread: Assertion `backend_valid_range (c, offset, count)' failed. Full log attached. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com virt-p2v converts physical machines to virtual machines. Boot with a live CD or over the network (PXE) and turn machines into KVM guests. http://libguestfs.org/virt-v2v

3 12

[PATCH] always 'max' for the appliance CPU model on all targes except ppc
by Daniel P. Berrangé 20 Jul '22

20 Jul '22

The current logic for selecting CPU model to use with the appliance selects 'max' for all architectures except for ppc64le and aarch64. On aarch64, it selects 'host' if KVM is available which is identical to 'max'. For TCG it selects 'cortex-a57'. The 'max' model is a superset of 'cortex-a57', so it is reasonable to use 'max' for TCG too. On ppc64, it selects no CPU model due to a historical bug where using 'host' would break ability to fallback to TCG. Unfortunately we can't use 'max' on PPC as this is actually an old G4 vintage 32-bit model, rather than a synonym for 'host' / all-TCG-features as on other targets. We can at least simplify the code to use 'max' in all scenarios for appliance CPU model, and simply skip a CPU model for PPC. Signed-off-by: Daniel P. Berrangé <berrange(a)redhat.com> --- docs/C_SOURCE_FILES | 1 - lib/Makefile.am | 1 - lib/appliance-cpu.c | 93 ------------------------------------------ lib/guestfs-internal.h | 3 -- lib/launch-direct.c | 25 +++++------- lib/launch-libvirt.c | 40 ++++++++---------- po/POTFILES | 1 - 7 files changed, 27 insertions(+), 137 deletions(-) delete mode 100644 lib/appliance-cpu.c diff --git a/docs/C_SOURCE_FILES b/docs/C_SOURCE_FILES index a367c93a0..a26487d99 100644 --- a/docs/C_SOURCE_FILES +++ b/docs/C_SOURCE_FILES @@ -283,7 +283,6 @@ lib/actions-6.c lib/actions-support.c lib/actions-variants.c lib/alloc.c -lib/appliance-cpu.c lib/appliance-kcmdline.c lib/appliance-uefi.c lib/appliance.c diff --git a/lib/Makefile.am b/lib/Makefile.am index 212bcb94a..40a4c9ac3 100644 --- a/lib/Makefile.am +++ b/lib/Makefile.am @@ -71,7 +71,6 @@ libguestfs_la_SOURCES = \ actions-variants.c \ alloc.c \ appliance.c \ - appliance-cpu.c \ appliance-kcmdline.c \ appliance-uefi.c \ available.c \ diff --git a/lib/appliance-cpu.c b/lib/appliance-cpu.c deleted file mode 100644 index 54ac6e2e3..000000000 --- a/lib/appliance-cpu.c +++ /dev/null @@ -1,93 +0,0 @@ -/* libguestfs - * Copyright (C) 2009-2020 Red Hat Inc. - * - * This library is free software; you can redistribute it and/or - * modify it under the terms of the GNU Lesser General Public - * License as published by the Free Software Foundation; either - * version 2 of the License, or (at your option) any later version. - * - * This library is distributed in the hope that it will be useful, - * but WITHOUT ANY WARRANTY; without even the implied warranty of - * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU - * Lesser General Public License for more details. - * - * You should have received a copy of the GNU Lesser General Public - * License along with this library; if not, write to the Free Software - * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA - */ - -/** - * The appliance choice of CPU model. - */ - -#include <config.h> - -#include <stdio.h> -#include <stdlib.h> - -#include "guestfs.h" -#include "guestfs-internal.h" - -/** - * Return the right CPU model to use as the qemu C<-cpu> parameter or - * its equivalent in libvirt. This returns: - * - * =over 4 - * - * =item C<"host"> - * - * The literal string C<"host"> means use C<-cpu host>. - * - * =item C<"max"> - * - * The literal string C<"max"> means use C<-cpu max> (the best - * possible). This requires awkward translation for libvirt. - * - * =item some string - * - * Some string such as C<"cortex-a57"> means use C<-cpu cortex-a57>. - * - * =item C<NULL> - * - * C<NULL> means no C<-cpu> option at all. Note returning C<NULL> - * does not indicate an error. - * - * =back - * - * This is made unnecessarily hard and fragile because of two stupid - * choices in QEMU: - * - * =over 4 - * - * =item * - * - * The default for C<qemu-system-aarch64 -M virt> is to emulate a - * C<cortex-a15> (WTF?). - * - * =item * - * - * We don't know for sure if KVM will work, but C<-cpu host> is broken - * with TCG, so we almost always pass a broken C<-cpu> flag if KVM is - * semi-broken in any way. - * - * =back - */ -const char * -guestfs_int_get_cpu_model (int kvm) -{ -#if defined(__aarch64__) - /* With -M virt, the default -cpu is cortex-a15. Stupid. */ - if (kvm) - return "host"; - else - return "cortex-a57"; -#elif defined(__powerpc64__) - /* See discussion in https://bugzilla.redhat.com/show_bug.cgi?id=1605071 */ - return NULL; -#else - /* On most architectures we can use "max" to get the best possible CPU. - * For recent qemu this should work even on TCG. - */ - return "max"; -#endif -} diff --git a/lib/guestfs-internal.h b/lib/guestfs-internal.h index 16755cfb3..33037a26d 100644 --- a/lib/guestfs-internal.h +++ b/lib/guestfs-internal.h @@ -718,9 +718,6 @@ extern const char *guestfs_int_drive_protocol_to_string (enum drive_protocol pro /* appliance.c */ extern int guestfs_int_build_appliance (guestfs_h *g, char **kernel, char **initrd, char **appliance); -/* appliance-cpu.c */ -const char *guestfs_int_get_cpu_model (int kvm); - /* appliance-kcmdline.c */ extern char *guestfs_int_appliance_command_line (guestfs_h *g, const char *appliance, int flags); #define APPLIANCE_COMMAND_LINE_IS_TCG 1 diff --git a/lib/launch-direct.c b/lib/launch-direct.c index ff0eaeb62..f41711353 100644 --- a/lib/launch-direct.c +++ b/lib/launch-direct.c @@ -354,7 +354,6 @@ launch_direct (guestfs_h *g, void *datav, const char *arg) int force_tcg; int force_kvm; const char *accel_val = "kvm:tcg"; - const char *cpu_model; CLEANUP_FREE char *append = NULL; CLEANUP_FREE_STRING_LIST char **argv = NULL; @@ -517,20 +516,18 @@ launch_direct (guestfs_h *g, void *datav, const char *arg) #endif } end_list (); - cpu_model = guestfs_int_get_cpu_model (has_kvm && !force_tcg); - if (cpu_model) { -#if defined(__x86_64__) - /* Temporary workaround for RHBZ#2082806 */ - if (STREQ (cpu_model, "max")) { - start_list ("-cpu") { - append_list (cpu_model); - append_list ("la57=off"); - } end_list (); - } - else + /* + * Can't use 'max' on ppc64 since it is an old G4 model + * Also can't use 'host' due to TCG fallback issues + * https://bugzilla.redhat.com/show_bug.cgi?id=1605071 + */ +#if !defined(__powerpc64__) +# if defined(__x86_64__) + arg ("-cpu", "max,la57=off"); +# else + arg ("-cpu", "max"); +# endif #endif - arg ("-cpu", cpu_model); - } if (g->smp > 1) arg_format ("-smp", "%d", g->smp); diff --git a/lib/launch-libvirt.c b/lib/launch-libvirt.c index 03d69e027..b97c91566 100644 --- a/lib/launch-libvirt.c +++ b/lib/launch-libvirt.c @@ -1161,8 +1161,6 @@ construct_libvirt_xml_cpu (guestfs_h *g, const struct libvirt_xml_params *params, xmlTextWriterPtr xo) { - const char *cpu_model; - start_element ("memory") { attribute ("unit", "MiB"); string_format ("%d", g->memsize); @@ -1173,30 +1171,24 @@ construct_libvirt_xml_cpu (guestfs_h *g, string_format ("%d", g->memsize); } end_element (); - cpu_model = guestfs_int_get_cpu_model (params->data->is_kvm); - if (cpu_model) { - start_element ("cpu") { - if (STREQ (cpu_model, "host")) { - attribute ("mode", "host-passthrough"); - start_element ("model") { - attribute ("fallback", "allow"); - } end_element (); - } - else if (STREQ (cpu_model, "max")) { - /* https://bugzilla.redhat.com/show_bug.cgi?id=1935572#c11 */ - attribute ("mode", "maximum"); + /* + * Can't use 'max' on ppc64 since it is an old G4 model + * Also can't use 'host' due to TCG fallback issues + * https://bugzilla.redhat.com/show_bug.cgi?id=1605071 + */ +#if !defined(__powerpc64__) + start_element ("cpu") { + /* https://bugzilla.redhat.com/show_bug.cgi?id=1935572#c11 */ + attribute ("mode", "maximum"); #if defined(__x86_64__) - /* Temporary workaround for RHBZ#2082806 */ - start_element ("feature") { - attribute ("policy", "disable"); - attribute ("name", "la57"); - } end_element (); -#endif - } - else - single_element ("model", cpu_model); + /* Temporary workaround for RHBZ#2082806 */ + start_element ("feature") { + attribute ("policy", "disable"); + attribute ("name", "la57"); } end_element (); - } +#endif + } end_element (); +#endif single_element_format ("vcpu", "%d", g->smp); diff --git a/po/POTFILES b/po/POTFILES index 32b975a04..67cdffb29 100644 --- a/po/POTFILES +++ b/po/POTFILES @@ -329,7 +329,6 @@ lib/actions-6.c lib/actions-support.c lib/actions-variants.c lib/alloc.c -lib/appliance-cpu.c lib/appliance-kcmdline.c lib/appliance-uefi.c lib/appliance.c -- 2.36.1

5 14

libnbd | Failed pipeline for master | 325030dd
by GitLab 17 Jul '22

17 Jul '22

Pipeline #589867507 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: 325030dd ( https://gitlab.com/nbdkit/libnbd/-/commit/325030dd22f09c08f50908c1ed27c9e9c… ) Commit Message: Version 1.13.7. Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #589867507 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/589867507 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 3 failed jobs. Job #2732262672 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2732262672/raw ) Stage: builds Name: x86_64-freebsd-12 Job #2732262663 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2732262663/raw ) Stage: builds Name: x86_64-fedora-36 Job #2732262666 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2732262666/raw ) Stage: builds Name: x86_64-opensuse-leap-153 -- You're receiving this email because of your account on gitlab.com.

1 0

libnbd | Failed pipeline for master | 681872c4
by GitLab 16 Jul '22

16 Jul '22

Pipeline #589532615 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: 681872c4 ( https://gitlab.com/nbdkit/libnbd/-/commit/681872c4094019df5bbbf5609dbfd5f6d… ) Commit Message: copy: Remove advice about using nbdcopy + cmp t... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #589532615 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/589532615 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 2 failed jobs. Job #2730847910 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730847910/raw ) Stage: builds Name: x86_64-freebsd-12 Job #2730847904 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730847904/raw ) Stage: builds Name: x86_64-opensuse-leap-153 -- You're receiving this email because of your account on gitlab.com.

1 0

libnbd | Failed pipeline for master | 50263227
by GitLab 16 Jul '22

16 Jul '22

Pipeline #589518886 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: 50263227 ( https://gitlab.com/nbdkit/libnbd/-/commit/5026322725abfaa332e29222dcf840724… ) Commit Message: build: Print full versions of nbdkit and qemu-n... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #589518886 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/589518886 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 2 failed jobs. Job #2730791907 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730791907/raw ) Stage: builds Name: x86_64-opensuse-leap-153 Job #2730791913 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730791913/raw ) Stage: builds Name: x86_64-freebsd-12 -- You're receiving this email because of your account on gitlab.com.

1 0

libnbd | Failed pipeline for master | 379e7d69
by GitLab 16 Jul '22

16 Jul '22

Pipeline #589513777 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: 379e7d69 ( https://gitlab.com/nbdkit/libnbd/-/commit/379e7d698d91cdca17a659ab7559aeeb4… ) Commit Message: tests: Add tests/connect-uri-nbd-vsock.sh to EX... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #589513777 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/589513777 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 3 failed jobs. Job #2730773405 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730773405/raw ) Stage: builds Name: x86_64-freebsd-12 Job #2730773399 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730773399/raw ) Stage: builds Name: x86_64-opensuse-leap-153 Job #2730773391 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730773391/raw ) Stage: builds Name: x86_64-centos-stream-8 -- You're receiving this email because of your account on gitlab.com.

1 0

libnbd | Failed pipeline for master | d11ddb6b
by GitLab 16 Jul '22

16 Jul '22

Pipeline #589493913 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: d11ddb6b ( https://gitlab.com/nbdkit/libnbd/-/commit/d11ddb6b583743c2dee4e6bb54ef3db11… ) Commit Message: tests: Test nbd+vsock:// support I realised th... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #589493913 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/589493913 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 19 failed jobs. Job #2730695254 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695254/raw ) Stage: builds Name: x86_64-debian-11 Job #2730695248 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695248/raw ) Stage: builds Name: x86_64-alpine-314 Job #2730695249 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695249/raw ) Stage: builds Name: x86_64-almalinux-8 Job #2730695262 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695262/raw ) Stage: builds Name: x86_64-ubuntu-1804 Job #2730695261 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695261/raw ) Stage: builds Name: x86_64-opensuse-tumbleweed Job #2730695257 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695257/raw ) Stage: builds Name: x86_64-fedora-36 Job #2730695252 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695252/raw ) Stage: builds Name: x86_64-centos-stream-8 Job #2730695253 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695253/raw ) Stage: builds Name: x86_64-debian-10 Job #2730695260 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695260/raw ) Stage: builds Name: x86_64-opensuse-leap-153 Job #2730695255 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695255/raw ) Stage: builds Name: x86_64-debian-sid Job #2730695259 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695259/raw ) Stage: builds Name: x86_64-fedora-rawhide-clang Job #2730695263 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695263/raw ) Stage: builds Name: x86_64-ubuntu-2004 Job #2730695264 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695264/raw ) Stage: builds Name: i686-debian-10 Job #2730695258 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695258/raw ) Stage: builds Name: x86_64-fedora-rawhide Job #2730695265 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695265/raw ) Stage: builds Name: i686-debian-11 Job #2730695266 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695266/raw ) Stage: builds Name: x86_64-freebsd-12 Job #2730695256 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695256/raw ) Stage: builds Name: x86_64-fedora-35 Job #2730695251 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695251/raw ) Stage: builds Name: x86_64-alpine-edge Job #2730695250 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2730695250/raw ) Stage: builds Name: x86_64-almalinux-8-clang -- You're receiving this email because of your account on gitlab.com.

2 1

[PATCH virt-v2v v3 2/2] -o rhv: Wait for the NBD server to exit to avoid a race with unmounting
by Richard W.M. Jones 15 Jul '22

15 Jul '22

Less churn version as described here: https://listman.redhat.com/archives/libguestfs/2022-July/029483.html

2 4

[PATCH virt-v2v 0/2] -o rhv: Wait for the NBD server to exit to avoid race with unmounting
by Richard W.M. Jones 15 Jul '22

15 Jul '22

This is an alternative approach to https://listman.redhat.com/archives/libguestfs/2022-July/029461.html This doesn't include a timeout. We expect that the NBD servers will exit when killed, if not it's a serious bug somewhere. Rich.

1 3