> That's the guestfish temporary files, nothing to do with the appliance
> cache.  Try removing /tmp/.guestfs-* and/or /var/tmp/.guestfs-* instead.
Sorry, that was a typo. I did remove /tmp/.guestfs-*

> This looks good to me, except that from your original trace[1] the
> path would have been /usr/*local*/lib/...
Hmmm. I did a build on Monday, which matches the time stamp of /usr/lib, and a build yesterday which matches the timestamp of /usr/local/lib.
I can't think of any reason for the difference. cpio on /usr/local/lib/guestfs/supermin.d/init.img gives the same output as on /usr/lib/guestfs/supermin.d/init.img. I moved /usr/lib/guestfs out of the way with no noticeable difference, but not to say its presence could be indicative of other weirdness.

Below is the log from a run right after removing /tmp/.guestfs.

new guestfs handle 0x9d2f958
===== Test starts here =====
LIBGUESTFS_DEBUG=1
library version: 1.8.4
guestfs_get_append: (null)
guestfs_get_autosync: 1
guestfs_get_memsize: 500
guestfs_get_path: /usr/local/lib/guestfs
guestfs_get_qemu: /usr/bin/kvm
guestfs_get_verbose: 1
Launching appliance, timeout set to 120 seconds.
[00000ms] febootstrap-supermin-helper --verbose -f checksum '/usr/local/lib/guestfs/supermin.d' i686
supermin helper [00000ms] whitelist = (not specified), host_cpu = i686, kernel = (null), initrd = (null), appliance = (null)
supermin helper [00006ms] inputs[0] = /usr/local/lib/guestfs/supermin.d
checking modpath /lib/modules/2.6.32-24-generic is a directory
picked vmlinuz-2.6.32-24-generic because modpath /lib/modules/2.6.32-24-generic exists
checking modpath /lib/modules/2.6.36-020636-generic is a directory
picked vmlinuz-2.6.36-020636-generic because modpath /lib/modules/2.6.36-020636-generic exists
supermin helper [00006ms] finished creating kernel
supermin helper [00008ms] visiting /usr/local/lib/guestfs/supermin.d
supermin helper [00008ms] visiting /usr/local/lib/guestfs/supermin.d/base.img
supermin helper [00009ms] visiting /usr/local/lib/guestfs/supermin.d/daemon.img
supermin helper [00009ms] visiting /usr/local/lib/guestfs/supermin.d/hostfiles
supermin helper [00079ms] visiting /usr/local/lib/guestfs/supermin.d/init.img
supermin helper [00286ms] finished creating appliance
[00299ms] begin building supermin appliance
[00300ms] run febootstrap-supermin-helper
[00302ms] febootstrap-supermin-helper \
    --verbose \
    -f ext2 /usr/local/lib/guestfs/supermin.d i686 /tmp/guestfs.7yEBV3/kernel /tmp/guestfs.7yEBV3/initrd /tmp/guestfs.7yEBV3/root
supermin helper [00000ms] whitelist = (not specified), host_cpu = i686, kernel = /tmp/guestfs.7yEBV3/kernel, initrd = /tmp/guestfs.7yEBV3/initrd, appliance = /tmp/guestfs.7yEBV3/root
supermin helper [00001ms] inputs[0] = /usr/local/lib/guestfs/supermin.d
checking modpath /lib/modules/2.6.32-24-generic is a directory
picked vmlinuz-2.6.32-24-generic because modpath /lib/modules/2.6.32-24-generic exists
checking modpath /lib/modules/2.6.36-020636-generic is a directory
picked vmlinuz-2.6.36-020636-generic because modpath /lib/modules/2.6.36-020636-generic exists
supermin helper [00002ms] finished creating kernel
supermin helper [03075ms] finished mke2fs
supermin helper [03076ms] visiting /usr/local/lib/guestfs/supermin.d
supermin helper [03077ms] visiting /usr/local/lib/guestfs/supermin.d/base.img
supermin helper [03101ms] visiting /usr/local/lib/guestfs/supermin.d/daemon.img
supermin helper [03134ms] visiting /usr/local/lib/guestfs/supermin.d/hostfiles
supermin helper [04155ms] visiting /usr/local/lib/guestfs/supermin.d/init.img
supermin helper [18630ms] finished creating appliance
[18951ms] finished building supermin appliance
[18951ms] begin testing qemu features
[21649ms] finished testing qemu features
accept_from_daemon: 0x9d2f958 g->state = 1
/dev/kvm: No such file or directory
[21666ms] /usr/bin/kvm \
    -drive file=/tmp/libguestfs-test-tool-sda-T6QcbC,cache=off,format=raw,if=virtio \
    -drive file=/tmp/libguestfs-test-tool-iso-wA9iro,snapshot=on,format=raw,if=virtio \
    -nodefconfig \
    -nodefaults \
    -nographic \
    -m 500 \
    -no-reboot \
    -no-hpet \
    -device virtio-serial \
    -serial stdio \
    -chardev socket,path=/tmp/libguestfssJy6UP/guestfsd.sock,id=channel0 \
    -device virtserialport,chardev=channel0,name=org.libguestfs.channel.0 \
    -kernel /tmp/.guestfs-1001/kernel.5377 \
    -initrd /tmp/.guestfs-1001/initrd.5377 \
    -append 'panic=1 console=ttyS0 udevtimeout=300 noapic acpi=off printk.time=1 cgroup_disable=memory selinux=0 guestfs_verbose=1 TERM=xterm ' \
    -drive file=/tmp/.guestfs-1001/root.5377,snapshot=on,if=virtio,cache=unsafe
recv_from_daemon: 0x9d2f958 g->state = 1, size_rtn = 0xbfe9640c, buf_rtn = 0xbfe96408
open /dev/kvm: No such file or directory
Could not initialize KVM, will disable KVM support
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.36-020636-generic (root@zinc) (gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7)) #201010210905 SMP Thu Oct 21 10:17:53 UTC 2010
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
[    0.000000]  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
[    0.000000]  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 000000001f3fd000 (usable)
[    0.000000]  BIOS-e820: 000000001f3fd000 - 000000001f400000 (reserved)
[    0.000000]  BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
[    0.000000] Notice: NX (Execute Disable) protection cannot be enabled: non-PAE kernel!
[    0.000000] DMI 2.4 present.
[    0.000000] last_pfn = 0x1f3fd max_arch_pfn = 0x100000
[    0.000000] x86 PAT enabled: cpu 0, old 0x0, new 0x7010600070106
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] modified physical RAM map:
[    0.000000]  modified: 0000000000000000 - 0000000000001000 (reserved)
[    0.000000]  modified: 0000000000001000 - 0000000000002000 (usable)
[    0.000000]  modified: 0000000000002000 - 0000000000010000 (reserved)
[    0.000000]  modified: 0000000000010000 - 000000000009f400 (usable)
[    0.000000]  modified: 000000000009f400 - 00000000000a0000 (reserved)
[    0.000000]  modified: 00000000000f0000 - 0000000000100000 (reserved)
[    0.000000]  modified: 0000000000100000 - 000000001f3fd000 (usable)
[    0.000000]  modified: 000000001f3fd000 - 000000001f400000 (reserved)
[    0.000000]  modified: 00000000fffc0000 - 0000000100000000 (reserved)
[    0.000000] found SMP MP-table at [c00f8990] f8990
[    0.000000] init_memory_mapping: 0000000000000000-000000001f3fd000
[    0.000000] RAMDISK: 1f27f000 - 1f3f0000
[    0.000000] 0MB HIGHMEM available.
[    0.000000] 499MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 1f3fd000
[    0.000000]   low ram: 0 - 1f3fd000
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000001 -> 0x00001000
[    0.000000]   Normal   0x00001000 -> 0x0001f3fd
[    0.000000]   HighMem  empty
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[3] active PFN ranges
[    0.000000]     0: 0x00000001 -> 0x00000002
[    0.000000]     0: 0x00000010 -> 0x0000009f
[    0.000000]     0: 0x00000100 -> 0x0001f3fd
[    0.000000] Using APIC driver default
[    0.000000] SFI: Simple Firmware Interface v0.81 http://simplefirmware.org
[    0.000000] Intel MultiProcessor Specification v1.4
[    0.000000]     Virtual Wire compatibility mode.
[    0.000000] MPTABLE: OEM ID: BOCHSCPU
[    0.000000] MPTABLE: Product ID: 0.1        
[    0.000000] MPTABLE: APIC at: 0xFEE00000
[    0.000000] Processor #0 (Bootup-CPU)
[    0.000000] I/O APIC #1 Version 17 at 0xFEC00000.
[    0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
[    0.000000] Processors: 1
[    0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: 0000000000002000 - 0000000000010000
[    0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
[    0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 1f400000 (gap: 1f400000:e0bc0000)
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] PERCPU: Embedded 14 pages/cpu @c1400000 s32896 r0 d24448 u4194304
[    0.000000] pcpu-alloc: s32896 r0 d24448 u4194304 alloc=1*4194304
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 126885
[    0.000000] Kernel command line: panic=1 console=ttyS0 udevtimeout=300 noapic acpi=off printk.time=1 cgroup_disable=memory selinux=0 guestfs_verbose=1 TERM=xterm
[    0.000000] Disabling memory control group subsystem
[    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
[    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Enabling fast FPU save and restore... done.
[    0.000000] Enabling unmasked SIMD FPU exception support... done.
[    0.000000] Initializing CPU#0
[    0.000000] Subtract (40 early reservations)
[    0.000000]   #1 [0000001000 - 0000002000]   EX TRAMPOLINE
[    0.000000]   #2 [0000100000 - 00009d5824]   TEXT DATA BSS
[    0.000000]   #3 [001f27f000 - 001f3f0000]         RAMDISK
[    0.000000]   #4 [00009d6000 - 00009d9049]             BRK
[    0.000000]   #5 [000009f400 - 00000f8990]   BIOS reserved
[    0.000000]   #6 [00000f8990 - 00000f89a0]    MP-table mpf
[    0.000000]   #7 [00000f8a90 - 0000100000]   BIOS reserved
[    0.000000]   #8 [00000f89a0 - 00000f8a90]    MP-table mpc
[    0.000000]   #9 [0000010000 - 0000011000]      TRAMPOLINE
[    0.000000]   #10 [0000011000 - 0000015000]     ACPI WAKEUP
[    0.000000]   #11 [0000015000 - 0000016000]         PGTABLE
[    0.000000]   #12 [0001000000 - 0001001000]         BOOTMEM
[    0.000000]   #13 [0001001000 - 00013e9000]         BOOTMEM
[    0.000000]   #14 [00013e9000 - 00013e9004]         BOOTMEM
[    0.000000]   #15 [00013e9040 - 00013e9100]         BOOTMEM
[    0.000000]   #16 [00013e9100 - 00013e9130]         BOOTMEM
[    0.000000]   #17 [00013e9140 - 00013ea940]         BOOTMEM
[    0.000000]   #18 [00013ea940 - 00013ea967]         BOOTMEM
[    0.000000]   #19 [00013ea980 - 00013eaa7c]         BOOTMEM
[    0.000000]   #20 [00013eaa80 - 00013eaac0]         BOOTMEM
[    0.000000]   #21 [00013eaac0 - 00013eab00]         BOOTMEM
[    0.000000]   #22 [00013eab00 - 00013eab40]         BOOTMEM
[    0.000000]   #23 [00013eab40 - 00013eab80]         BOOTMEM
[    0.000000]   #24 [00013eab80 - 00013eabc0]         BOOTMEM
[    0.000000]   #25 [00013eabc0 - 00013eac00]         BOOTMEM
[    0.000000]   #26 [00013eac00 - 00013eac10]         BOOTMEM
[    0.000000]   #27 [00013eac40 - 00013eac50]         BOOTMEM
[    0.000000]   #28 [00013eac80 - 00013ead02]         BOOTMEM
[    0.000000]   #29 [00013ead40 - 00013eadc2]         BOOTMEM
[    0.000000]   #30 [0001400000 - 000140e000]         BOOTMEM
[    0.000000]   #31 [00013ece00 - 00013ece04]         BOOTMEM
[    0.000000]   #32 [00013ece40 - 00013ece44]         BOOTMEM
[    0.000000]   #33 [00013ece80 - 00013ece84]         BOOTMEM
[    0.000000]   #34 [00013ecec0 - 00013ecec4]         BOOTMEM
[    0.000000]   #35 [00013ecf00 - 00013ecfb0]         BOOTMEM
[    0.000000]   #36 [00013ecfc0 - 00013ed068]         BOOTMEM
[    0.000000]   #37 [00013eae00 - 00013ece00]         BOOTMEM
[    0.000000]   #38 [000140e000 - 000144e000]         BOOTMEM
[    0.000000]   #39 [000144e000 - 000146e000]         BOOTMEM
[    0.000000] Initializing HighMem for node 0 (00000000:00000000)
[    0.000000] Memory: 496508k/511988k available (5000k kernel code, 15032k reserved, 2406k data, 740k init, 0k highmem)
[    0.000000] virtual kernel memory layout:
[    0.000000]     fixmap  : 0xfff16000 - 0xfffff000   ( 932 kB)
[    0.000000]     pkmap   : 0xff800000 - 0xffc00000   (4096 kB)
[    0.000000]     vmalloc : 0xdfbfd000 - 0xff7fe000   ( 508 MB)
[    0.000000]     lowmem  : 0xc0000000 - 0xdf3fd000   ( 499 MB)
[    0.000000]       .init : 0xc083c000 - 0xc08f5000   ( 740 kB)
[    0.000000]       .data : 0xc05e2039 - 0xc083bb28   (2406 kB)
[    0.000000]       .text : 0xc0100000 - 0xc05e2039   (5000 kB)
[    0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok.
[    0.000000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]     RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000]     RCU-based detection of stalled CPUs is disabled.
[    0.000000]     Verbose stalled-CPUs detection is disabled.
[    0.000000] NR_IRQS:2304 nr_irqs:256
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] Fast TSC calibration failed
[    0.000000] TSC: Unable to calibrate against PIT
[    0.000000] TSC: No reference (HPET/PMTIMER) available
[    0.000000] Marking TSC unstable due to could not calculate TSC khz
[    0.048000] Calibrating delay loop... 171.52 BogoMIPS (lpj=343040)
[    0.132000] pid_max: default: 32768 minimum: 301
[    0.136000] Security Framework initialized
[    0.160000] AppArmor: AppArmor initialized
[    0.168000] Mount-cache hash table entries: 512
[    0.216000] Initializing cgroup subsys ns
[    0.220000] Initializing cgroup subsys cpuacct
[    0.224000] Initializing cgroup subsys memory
[    0.232000] Initializing cgroup subsys devices
[    0.236000] Initializing cgroup subsys freezer
[    0.240000] Initializing cgroup subsys net_cls
[    0.260000] mce: CPU supports 10 MCE banks
[    0.264000] Performance Events: AMD PMU driver.
[    0.268000] ... version:                0
[    0.272000] ... bit width:              48
[    0.276000] ... generic registers:      4
[    0.280000] ... value mask:             0000ffffffffffff
[    0.288000] ... max period:             00007fffffffffff
[    0.292000] ... fixed-purpose events:   0
[    0.292000] ... event mask:             000000000000000f
[    0.328000] SMP alternatives: switching to UP code
[    0.512000] Freeing SMP alternatives: 20k freed
[    0.520000] ftrace: converting mcount calls to 0f 1f 44 00 00
[    0.528000] ftrace: allocating 26011 entries in 51 pages
[    0.572000] Enabling APIC mode:  Flat.  Using 1 I/O APICs
[    0.576000] ------------[ cut here ]------------
[    0.584000] WARNING: at /home/kernel-ppa/COD/linux/arch/x86/kernel/apic/apic.c:1238 setup_local_APIC+0x3a5/0x3e0()
[    0.592000] Hardware name: Bochs
[    0.596000] Modules linked in:
[    0.604000] Pid: 1, comm: swapper Not tainted 2.6.36-020636-generic #201010210905
[    0.608000] Call Trace:
[    0.616000]  [<c05d5ab5>] ? setup_local_APIC+0x3a5/0x3e0
[    0.620000]  [<c014e4e1>] warn_slowpath_common+0x81/0xa0
[    0.620000]  [<c05d5ab5>] ? setup_local_APIC+0x3a5/0x3e0
[    0.624000]  [<c014e522>] warn_slowpath_null+0x22/0x30
[    0.628000]  [<c05d5ab5>] setup_local_APIC+0x3a5/0x3e0
[    0.632000]  [<c084c950>] ? verify_local_APIC+0x170/0x1a0
[    0.636000]  [<c0124d7c>] ? default_get_apic_id+0x1c/0x40
[    0.640000]  [<c084abb3>] native_smp_prepare_cpus+0x123/0x210
[    0.644000]  [<c0141f9e>] ? set_cpus_allowed_ptr+0x8e/0x120
[    0.652000]  [<c0102c46>] ? ret_from_fork+0x6/0x1c
[    0.656000]  [<c083cbb3>] kernel_init+0x63/0x110
[    0.656000]  [<c083cb50>] ? kernel_init+0x0/0x110
[    0.664000]  [<c010327e>] kernel_thread_helper+0x6/0x10
[    0.672000] ---[ end trace a7919e7f17c0a725 ]---
[    0.676000] CPU0: AMD QEMU Virtual CPU version 0.14.0 stepping 03
[    0.860000] APIC timer disabled due to verification failure
[    0.892000] Brought up 1 CPUs
[    0.896000] Total of 1 processors activated (171.52 BogoMIPS).
[    0.920000] devtmpfs: initialized
[    0.956000] regulator: core version 0.5
[    0.960000] Time: 16:50:16  Date: 04/08/11
[    0.968000] NET: Registered protocol family 16
[    0.984000] EISA bus registered
[    0.996000] PCI: PCI BIOS revision 2.10 entry at 0xffe77, last bus=0
[    1.000000] PCI: Using configuration type 1 for base access
[    1.044000] bio: create slab <bio-0> at 0
[    1.056000] ACPI: Interpreter disabled.
[    1.068000] vgaarb: loaded
[    1.084000] SCSI subsystem initialized
[    1.096000] usbcore: registered new interface driver usbfs
[    1.100000] usbcore: registered new interface driver hub
[    1.104000] usbcore: registered new device driver usb
[    1.120000] PCI: Probing PCI hardware
[    1.132000] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    1.136000] pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB
[    1.164000] pci 0000:00:01.0: PIIX/ICH IRQ router [8086:7000]
[    1.172000] NetLabel: Initializing
[    1.176000] NetLabel:  domain hash size = 128
[    1.180000] NetLabel:  protocols = UNLABELED CIPSOv4
[    1.184000] NetLabel:  unlabeled traffic allowed by default
[    1.192000] Switching to clocksource pit
[    1.383907] AppArmor: AppArmor Filesystem Enabled
[    1.388022] pnp: PnP ACPI: disabled
[    1.390539] PnPBIOS: Scanning system for PnP BIOS support...
[    1.396956] PnPBIOS: Found PnP BIOS installation structure at 0xc00f7e40
[    1.400977] PnPBIOS: PnP BIOS version 1.0, entry 0xf0000:0xdf15, dseg 0xf0000
[    1.409686] PnPBIOS: dev_node_info: function not supported on this system
[    1.414844] PnPBIOS: Unable to get node info.  Aborting.
[    1.469793] NET: Registered protocol family 2
[    1.478205] IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
[    1.494906] TCP established hash table entries: 16384 (order: 5, 131072 bytes)
[    1.499729] TCP bind hash table entries: 16384 (order: 5, 131072 bytes)
[    1.502236] TCP: Hash tables configured (established 16384 bind 16384)
[    1.506418] TCP reno registered
[    1.513592] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    1.517809] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    1.522807] NET: Registered protocol family 1
[    1.527469] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    1.531407] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    1.535734] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    1.549509] Trying to unpack rootfs image as initramfs...
[    1.637436] Freeing initrd memory: 1476k freed
[    1.660048] platform rtc_cmos: registered platform RTC device (no PNP device found)
[    1.673110] cpufreq-nforce2: No nForce2 chipset.
[    1.681147] Scanning for low memory corruption every 60 seconds
[    1.702778] audit: initializing netlink socket (disabled)
[    1.706709] type=2000 audit(1302281412.704:1): initialized
[    1.814098] HugeTLB registered 4 MB page size, pre-allocated 0 pages
[    1.858764] VFS: Disk quotas dquot_6.5.2
[    1.862937] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    1.881013] fuse init (API version 7.15)
[    1.887120] msgmni has been set to 972
[    1.930885] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    1.940654] io scheduler noop registered
[    1.944231] io scheduler deadline registered
[    1.948090] io scheduler cfq registered (default)
[    1.953134] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    1.961525] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    1.997425] isapnp: Scanning for PnP cards...
[    2.326093] isapnp: No Plug & Play device found
[    2.334114] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    2.346828] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    2.401621] brd: module loaded
[    2.427441] loop: module loaded
[    2.449618] scsi0 : ata_piix
[    2.456970] scsi1 : ata_piix
[    2.471175] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc000 irq 14
[    2.475264] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc008 irq 15
[    2.521596] Fixed MDIO Bus: probed
[    2.533904] PPP generic driver version 2.4.2
[    2.538533] tun: Universal TUN/TAP device driver, 1.6
[    2.542206] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    2.550186] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    2.554465] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    2.557271] uhci_hcd: USB Universal Host Controller Interface driver
[    2.568465] PNP: No PS/2 controller found. Probing ports directly.
[    2.575010] serio: i8042 KBD port at 0x60,0x64 irq 1
[    2.580054] serio: i8042 AUX port at 0x60,0x64 irq 12
[    2.588286] mice: PS/2 mouse device common for all mice
[    2.597210] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[    2.606040] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    2.621048] rtc0: alarms up to one day, 114 bytes nvram
[    2.634733] device-mapper: uevent: version 1.0.3
[    2.645838] device-mapper: ioctl: 4.18.0-ioctl (2010-06-29) initialised: dm-devel@redhat.com
[    2.678347] device-mapper: multipath: version 1.1.1 loaded
[    2.681322] device-mapper: multipath round-robin: version 1.0.0 loaded
[    2.690306] EISA: Probing bus 0 at eisa.0
[    2.698672] EISA: Detected 0 cards.
[    2.702480] cpuidle: using governor ladder
[    2.705479] cpuidle: using governor menu
[    2.717593] TCP cubic registered
[    2.734994] NET: Registered protocol family 10
[    2.748965] lo: Disabled Privacy Extensions
[    2.765383] NET: Registered protocol family 17
[    2.769384] Registering the dns_resolver key type
[    2.773864] powernow-k8: Processor cpuid 623 not supported
[    2.777645] Using IPI No-Shortcut mode
[    2.787047] registered taskstats version 1
[    2.789974]   Magic number: 7:73:843
[    2.801157] rtc_cmos rtc_cmos: setting system clock to 2011-04-08 16:50:20 UTC (1302281420)
[    2.806875] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    2.810574] EDD information not available.
[    2.823599] Freeing unused kernel memory: 740k freed
[    2.874467] Write protecting the kernel text: 5004k
[    2.879850] Write protecting the kernel read-only data: 2048k
/proc/uptime: No such file or directory
febootstrap: ext2 mini initrd starting up
febootstrap: mounting /sys
febootstrap: insmod crc-ccitt.ko
febootstrap: insmod crc-itu-t.ko
febootstrap: insmod crc32c-intel.ko
insmod: error inserting 'crc32c-intel.ko': -1 No such device
insmod: wait: File exists
febootstrap: insmod crc32c.ko
febootstrap: insmod crc7.ko
febootstrap: insmod libcrc32c.ko
febootstrap: insmod scsi_transport_spi.ko
febootstrap: insmod virtio.ko
febootstrap: insmod virtio_ring.ko
febootstrap: insmod sym53c8xx.ko
febootstrap: insmod virtio_pci.ko
[    3.610220] virtio-pci 0000:00:02.0: found PCI INT A -> IRQ 10
[    3.629275] virtio-pci 0000:00:03.0: found PCI INT A -> IRQ 11
[    3.633601] virtio-pci 0000:00:04.0: found PCI INT A -> IRQ 11
[    3.639019] virtio-pci 0000:00:05.0: found PCI INT A -> IRQ 10
febootstrap: insmod virtio-rng.ko
febootstrap: insmod virtio_net.ko
febootstrap: insmod virtio_blk.ko
[    3.886935]  vda: unknown partition table
[    3.909493]  vdb: unknown partition table
[    3.930714]  vdc: unknown partition table
febootstrap: insmod virtio_console.ko
febootstrap: insmod virtio_balloon.ko
febootstrap: picked /sys/block/vdc/dev as root device
febootstrap: creating /dev/root as block special 251:32
febootstrap: mounting new root on /root
febootstrap: chroot
/proc/uptime: No such file or directory
execl: /init: No such file or directory
[    4.217919] Kernel panic - not syncing: Attempted to kill init!
[    4.226647] Pid: 1, comm: init Tainted: G        W   2.6.36-020636-generic #201010210905
[    4.231469] Call Trace:
[    4.231469]  [<c014e62f>] panic+0x5f/0x190
[    4.231469]  [<c01506b1>] find_new_reaper+0x91/0xa0
[    4.235493]  [<c0151174>] forget_original_parent+0x34/0x180
[    4.235493]  [<c01b1c72>] ? call_rcu_sched+0x12/0x20
[    4.239851]  [<c01512d3>] exit_notify+0x13/0x140
[    4.242398]  [<c01529d5>] do_exit+0x1e5/0x340
[    4.248054]  [<c021f4e0>] ? vfs_write+0x140/0x160
[    4.248905]  [<c03e5c30>] ? redirected_tty_write+0x0/0x90
[    4.248905]  [<c0152b68>] do_group_exit+0x38/0xa0
[    4.248905]  [<c0152be4>] sys_exit_group+0x14/0x20
[    4.248905]  [<c05da8c4>] syscall_call+0x7/0xb
[    4.256391] Rebooting in 1 seconds..libguestfs: error: unexpected end of file when reading from daemon
child_cleanup: 0x9d2f958: child process died
libguestfs-test-tool: failed to launch appliance
closing guestfs handle 0x9d2f958 (state 0)


From: Richard W.M. Jones <rjones@redhat.com>
To: Chris Willmore <chris.willmore@yahoo.com>
Cc: "libguestfs@redhat.com" <libguestfs@redhat.com>
Sent: Friday, April 8, 2011 5:45 PM
Subject: Re: [Libguestfs] Guestfish errors (Running in VirtualBox)

On Fri, Apr 08, 2011 at 07:33:24AM -0700, Chris Willmore wrote:
> I removed /tmp/.guestfish-* and getting same error (ostensibly same
> error output).

That's the guestfish temporary files, nothing to do with the appliance
cache.  Try removing /tmp/.guestfs-* and/or /var/tmp/.guestfs-* instead.

Note that in your original trace[1] the appliance had already been
cached, so w didn't get to see any errors from the build.  Therefore
if it is still failing after removing the cached appliance, post the
output of libguestfs-test-tool on the first run after doing that
'rm -r'.

> willmore@sm-vm:~$ cpio -itv < /usr/lib/guestfs/supermin.d/init.img
> -rwxr-xr-x   1 willmore willmore     3280 Dec 10 19:34 init
> 7 blocks

This looks good to me, except that from your original trace[1] the
path would have been /usr/*local*/lib/....  Is it odd that this path
has changed?  Are you running matching versions of the library and the
appliance?  Do you have another version installed from some previous
attempt?

Rich.

[1] https://www.redhat.com/archives/libguestfs/2011-April/msg00028.html

--
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
virt-df lists disk usage of guests without needing to install any
software inside the virtual machine.  Supports Linux and Windows.
http://et.redhat.com/~rjones/virt-df/