August 2022 - Libguestfs - libguestfs List Archives

[PATCH nbdkit] ci: Expire artifacts after 1 week
by Richard W.M. Jones 10 Aug '22

10 Aug '22

nbdkit uses about 1.1G of storage for artifacts. I have personally never looked at anything other than the artifacts of the latest failed job, so I don't believe we need to keep these around for long. This commit proposes expiring (and thus deleting) artifacts after 1 week. https://gitlab.com/nbdkit/nbdkit/-/usage_quotas If accepted I will make a similar change for libnbd. Martin, Dan - I don't know a lot about this and I know you've looked into this area a lot more. What do you think of this change? Rich.

2 5

Rust build failure on debian-11 (was: Fwd: nbdkit | Failed pipeline for master | 539ee349)
by Richard W.M. Jones 10 Aug '22

10 Aug '22

Hi Alan, https://gitlab.com/nbdkit/nbdkit/-/jobs/2835506354 cargo build --release Updating crates.io index Downloading crates ... Downloaded bitflags v1.3.2 Downloaded libc v0.2.128 error: failed to parse manifest at `/root/.cargo/registry/src/github.com-1ecc6299db9ec823/libc-0.2.128/Cargo.toml` Caused by: feature `resolver` is required consider adding `cargo-features = ["resolver"]` to the manifest I tried to fix this by adding the supposedly missing line, but it didn't seem to make any difference. Rich. ----- Forwarded message from GitLab <gitlab(a)mg.gitlab.com> ----- Date: Tue, 09 Aug 2022 22:04:08 +0000 From: GitLab <gitlab(a)mg.gitlab.com> To: rjones(a)redhat.com Subject: nbdkit | Failed pipeline for master | 539ee349 Pipeline #608763670 has failed! Project: nbdkit ( https://gitlab.com/nbdkit/nbdkit ) Branch: master ( https://gitlab.com/nbdkit/nbdkit/-/commits/master ) Commit: 539ee349 ( https://gitlab.com/nbdkit/nbdkit/-/commit/539ee34920c36ff23967fbc4b0c819b45… ) Commit Message: rust: Add resolver feature On Debian 11: carg... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #608763670 ( https://gitlab.com/nbdkit/nbdkit/-/pipelines/608763670 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 2 failed jobs. Job #2835506354 ( https://gitlab.com/nbdkit/nbdkit/-/jobs/2835506354/raw ) Stage: builds Name: x86_64-debian-11 Job #2835506352 ( https://gitlab.com/nbdkit/nbdkit/-/jobs/2835506352/raw ) Stage: builds Name: x86_64-centos-stream-8 -- You're receiving this email because of your account on gitlab.com. ----- End forwarded message ----- -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com libguestfs lets you edit virtual machines. Supports shell scripting, bindings from many languages. http://libguestfs.org

1 0

libnbd | Failed pipeline for master | cf3ad353
by GitLab 06 Aug '22

06 Aug '22

Pipeline #606461227 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: cf3ad353 ( https://gitlab.com/nbdkit/libnbd/-/commit/cf3ad353e2bfcfcbb978b68dd9101a029… ) Commit Message: info: Tone down the colours in nbdinfo normal o... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #606461227 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/606461227 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 2 failed jobs. Job #2823163643 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2823163643/raw ) Stage: builds Name: x86_64-freebsd-12 Job #2823163637 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2823163637/raw ) Stage: builds Name: x86_64-opensuse-leap-153 -- You're receiving this email because of your account on gitlab.com.

1 0

[v2v PATCH] convert_linux: remove LVM2 "devices file"
by Laszlo Ersek 05 Aug '22

05 Aug '22

A recent feature of LVM2 is the "devices file" <https://man7.org/linux/man-pages/man8/lvmdevices.8.html>. It speeds up LVM2 PV discovery on a normal system, but an old devices file in a converted domain (with different hardware) can prevent the assembly of volume groups. In particular, when converting a physical system to a guest with virt-p2v, the original system will have used "sys_wwid"-type identifiers in the LVM2 devices file, and those are guaranteed not to match any virtio-blk disks in the output domain. We've seen a similar issue in the past under RHBZ#1164853, so just extend the same scrubbing with the new pathname. Bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=2112801 Signed-off-by: Laszlo Ersek <lersek(a)redhat.com> --- convert/convert_linux.ml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/convert/convert_linux.ml b/convert/convert_linux.ml index a66ff1e45a57..2aaa438e42ac 100644 --- a/convert/convert_linux.ml +++ b/convert/convert_linux.ml @@ -1402,11 +1402,11 @@ let convert (g : G.guestfs) source inspect keep_serial_console _ = * device names. blkid will rebuild these on demand. * * Delete the LVM cache since it will contain references to the - * old devices (RHBZ#1164853). + * old devices (RHBZ#1164853, RHBZ#2112801). *) List.iter g#rm_f [ "/etc/blkid/blkid.tab"; "/etc/blkid.tab"; - "/etc/lvm/cache/.cache" + "/etc/lvm/cache/.cache"; "/etc/lvm/devices/system.devices" ]; in -- 2.19.1.3.g30247aa5d201

2 3

libnbd | Failed pipeline for master | 38eabf6d
by GitLab 04 Aug '22

04 Aug '22

Pipeline #604838910 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: 38eabf6d ( https://gitlab.com/nbdkit/libnbd/-/commit/38eabf6df05fae109212a4ce9afc9c0fe… ) Commit Message: tests/make-pki.sh: Use Subject Alternative Name... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #604838910 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/604838910 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 4 failed jobs. Job #2814046572 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2814046572/raw ) Stage: builds Name: x86_64-freebsd-13 Job #2814046571 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2814046571/raw ) Stage: builds Name: x86_64-freebsd-12 Job #2814046577 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2814046577/raw ) Stage: builds Name: x86_64-macos-11 Job #2814046555 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2814046555/raw ) Stage: builds Name: x86_64-opensuse-leap-153 -- You're receiving this email because of your account on gitlab.com.

1 0

libnbd | Failed pipeline for master | 74d5818d
by GitLab 02 Aug '22

02 Aug '22

Pipeline #602734531 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: 74d5818d ( https://gitlab.com/nbdkit/libnbd/-/commit/74d5818d42a1e09e6f6f1dccda8254fb8… ) Commit Message: info: Improve error message when the export may... Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #602734531 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/602734531 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 3 failed jobs. Job #2802312607 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2802312607/raw ) Stage: builds Name: x86_64-debian-11 Job #2802312648 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2802312648/raw ) Stage: builds Name: x86_64-freebsd-12 Job #2802312630 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2802312630/raw ) Stage: builds Name: x86_64-opensuse-leap-153 -- You're receiving this email because of your account on gitlab.com.

1 0

ANNOUNCE: nbdkit 1.32 and libnbd 1.14 released
by Richard W.M. Jones 01 Aug '22

01 Aug '22

nbdkit is a Network Block Device (NBD) server with stable plugin ABI and permissive license. libnbd is an NBD client library. I'm pleased to announce the latest stable releases of both projects: nbdkit 1.32.0 and libnbd 1.14.0. You can download both from the download directories here: https://download.libguestfs.org/nbdkit/ https://download.libguestfs.org/libnbd/ Release notes are online here and attached below: https://libguestfs.org/nbdkit-release-notes-1.32.1.html https://libguestfs.org/libnbd-release-notes-1.14.1.html Thanks to all those who contributed to these releases: Alan Somers, Eric Blake, Laszlo Ersek, Martin Kletzander, Nikolaus Rath, and Nir Soffer. Rich. ---------------------------------------------------------------------- nbdkit-release-notes-1.32 - release notes for nbdkit 1.32 DESCRIPTION These are the release notes for nbdkit stable release 1.32. This describes the major changes since 1.30. nbdkit 1.32.0 was released on 1 August 2022. Security There were no security issues found. All past security issues and information about how to report new ones can be found in nbdkit-security(1). Plugins nbdkit-ssh-plugin(1) has new "create=(true|false)", "create-size" and "create-mode" parameters to allow remote files to be created. nbdkit-S3-plugin(1) was largely rewritten and should have better performance and compatibility. It also supports splitting/concatenating multiple S3 objects into one virtual disk. (Nikolaus Rath) Filters New nbdkit-luks-filter(1) allows you to open, read and write LUKSv1 disk images. It is compatible with qemu and dm-crypt. New nbdkit-scan-filter(1) which simply scans across the disk issuing prefetches. nbdkit-readahead-filter(1) has been completely rewritten so now it uses prefetching from a parallel thread. The old readahead filter was deprecated, but if you are using it you should carefully read the new documentation because it may require changes. nbdkit-stats-filter(1) now summarises block size and alignment of requests (Nikolaus Rath). nbdkit-blocksize-filter(1) now handles parallel writes without losing writes because of overlapping read-modify-write cycles. If you are using the blocksize filter it is recommended to upgrade. (Eric Blake) nbdkit-rate-filter(1) has a new "burstiness" parameter allowing the bucket capacity to be adjusted, which helps with smoothing out large, lumpy client requests. Language bindings Add "nbdkit.parse_size()" binding for Python (Nikolaus Rath). Compatibility with OCaml 4.14. Compatibility with Perl 5.36. Server kTLS should now work (transparently) when available in the kernel and GnuTLS. Use of kTLS will be indicated in debug output. (Daiki Ueno, František Krenželok) Bug fixes nbdkit-sh-plugin(3) now handles inline scripts correctly on non-glibc platforms (Martin Kletzander). Catch the case where nbdkit ends up linked to OpenSSL (because of a transient dependency through GnuTLS) which broke nbdkit-vddk-plugin(1). For more details see https://bugzilla.redhat.com/2057490. Fix memory leak in nbdkit-python-plugin(3) which would lead to large amounts of memory being leaked if your plugin implemented "list_exports" or "extents" callbacks (Eric Blake). The nbdkit-curl-plugin(1) cookie/header scripts feature now generates an error properly if the shell script fails. Fix further "phone home" messages in nbdkit-vddk-plugin(1) (thanks Ming Xie). Improve error message from nbdkit-vddk-plugin(1) when the thumbprint parameter is wrong (Laszlo Ersek). Fix "NBDKIT_CACHE_EMULATE" and "NBDKIT_ZERO_EMULATE" in filters. These could cause assertion failures before. (Eric Blake) Fix nbdkit-protect-filter(1) test if dependencies are missing (thanks Jim Fehlig). Fix a bounds error in nbdkit-checkwrite-filter(1). The server will now fail and exit early if the --tls-verify-peer option is used on platforms which do not support it. Previously it would only fail when a client connected using TLS. Various bugs found by Coverity were analysed and fixed (Eric Blake). Documentation Document how to write plugins and filters in C++. This has always been possible, but was never documented before. Document how to run nbdkit from inetd or xinetd superservers. Fix how verbatim paragraphs in the documentation are rendered in HTML. Document how to use nbdkit + TLS with nbd-client(1). Tests Various enhancements to fuzzing including supporting AFL++, AFL++ clang-LTO. Add "./configure --disable-linker-script" which is needed to use ASAN, and document how to use ASAN when fuzzing. Improve runtime of linuxdisk test (Eric Blake). Add interoperability tests with nbd-client(1), the Linux kernel client, including TLS support. Build Add GitLab continuous integration (CI) at https://gitlab.com/nbdkit/nbdkit/-/pipelines and many miscellaneous build fixes (Martin Kletzander). There are now "string_vector" and "const_string_vector" defined under common/utils and used consistently throughout the code. Microsoft Visual Studio Code formatting settings are available (in .vscode/) (Nikolaus Rath). Remove scripts/vddk-open.sh. It is now available as a separate project: https://gitlab.com/nbdkit/vddk-remote "ARRAY_SIZE" macro added to simplify static array sizing (thanks Laszlo Ersek). SEE ALSO nbdkit(1). AUTHORS Authors of nbdkit 1.32: Alan Somers Eric Blake Laszlo Ersek Martin Kletzander Nikolaus Rath Richard W.M. Jones COPYRIGHT Copyright (C) 2013-2022 Red Hat Inc. LICENSE Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: • Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. • Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. • Neither the name of Red Hat nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED BY RED HAT AND CONTRIBUTORS ''AS IS'' AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL RED HAT OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. ---------------------------------------------------------------------- libnbd-release-notes-1.14 - release notes for libnbd 1.14 DESCRIPTION These are the release notes for libnbd stable release 1.14. This describes the major changes since 1.12. libnbd 1.14.0 was released on 1 August 2022. Security No security issues were found in this release. If you find a security issue, please read SECURITY in the source (online here: https://gitlab.com/nbdkit/libnbd/blob/master/SECURITY) To find out about previous security issues in libnbd, see libnbd-security(3). New APIs No new APIs were added in this release. Enhancements to existing APIs Optimizations to nbd_pread_structured(3) (Eric Blake). Many performance enhancements in the Python bindings: "nbd.pread" now avoids an extra memory allocation and copy. Buffers can now be passed to "nbd.Buffer.from_bytearray". New methods "nbd.Buffer.{to,from}_buffer" allow control over copying and sharing "nbd.Buffer". Any buffer-like object can be used in "nbd.aio_{pread,pwrite}". "len(nbd.Buffer(n))" now works. Improve error messages when the wrong types are passed to several APIs. Fix usage of "PyGILState". (Eric Blake) Golang "AioBuffer" now calls panic on invalid usage (Nir Soffer). In golang tests, use "GOTRACEBACK=crash" so we get full core dumps on failures. kTLS should now work (transparently) when available in the kernel and GnuTLS. Use of kTLS will be indicated in debug output. (Daiki Ueno, František Krenželok) Tools New nbddump(1) tool which can efficiently hexdump the contents of an NBD server. nbdcopy(1) now obeys the NBD server minimum/preferred block size when copying, which should make it more efficient and avoids issues with some qemu-nbd configurations where the minimum block size must be obeyed for correct operation. Tests New tests for "nbd+vsock://" URI support. Other improvements and bug fixes Fixed rare TLS deadlock when reading from slow servers, and support for clean shutdown when connecting to qemu-nbd over TLS (thanks Michael Ablassmeier). The library now uses the GnuTLS flag "GNUTLS_NO_SIGNAL" (if available) which ensures that TLS connections should not cause the main program to exit with "SIGPIPE" in certain cases of server failure. (Libnbd has long used "MSG_NOSIGNAL" on non-TLS connections which has a similar effect.) Various enhancements to fuzzing were made, including support for AFL++ clang-LTO mode, ASAN, allowing seed test cases to be captured, and extended testing of APIs. Tests were fixed so they should pass on RHEL 7 and FreeBSD. Documentation No changes in this release. Build "ARRAY_SIZE" macro added to simplify static array sizing (thanks Laszlo Ersek). Various errors found by Coverity were fixed. SEE ALSO libnbd(3). AUTHORS Eric Blake Nir Soffer Richard W.M. Jones COPYRIGHT Copyright (C) 2019-2022 Red Hat Inc. LICENSE This library is free software; you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This library is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser General Public License for more details. You should have received a copy of the GNU Lesser General Public License along with this library; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com nbdkit - Flexible, fast NBD server with plugins https://gitlab.com/nbdkit/nbdkit

1 0

libnbd | Failed pipeline for master | 51483fd0
by GitLab 01 Aug '22

01 Aug '22

Pipeline #602007115 has failed! Project: libnbd ( https://gitlab.com/nbdkit/libnbd ) Branch: master ( https://gitlab.com/nbdkit/libnbd/-/commits/master ) Commit: 51483fd0 ( https://gitlab.com/nbdkit/libnbd/-/commit/51483fd0f577e22e40620dfe1d1ffc4a5… ) Commit Message: Version 1.14.0. Commit Author: Richard W_M_ Jones ( https://gitlab.com/rwmjones ) Pipeline #602007115 ( https://gitlab.com/nbdkit/libnbd/-/pipelines/602007115 ) triggered by Richard W_M_ Jones ( https://gitlab.com/rwmjones ) had 2 failed jobs. Job #2798307508 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2798307508/raw ) Stage: builds Name: x86_64-opensuse-leap-153 Job #2798307527 ( https://gitlab.com/nbdkit/libnbd/-/jobs/2798307527/raw ) Stage: builds Name: x86_64-freebsd-12 -- You're receiving this email because of your account on gitlab.com.

1 0