A few errors with virt-p2v-image-builder
I just now ran into some traceback messages and other errors running virt-p2v-image-builder 0.8.5.1. Anything to worry about? . . . Installing: passwd ##################### [305/307] Installing: syslinux ##################### [306/307] Installing: vim-minimal ##################### [307/307] Note: Forwarding request to 'systemctl enable NetworkManager.service'. error reading information on service auditd: No such file or directory Starting Kickstart Post Creating shadow files Forcing C locale [Errno 2] No such file or directory: '/var/tmp/imgcreate-vC5xTf/install_root/usr/share/locale' ignoring %post failure (code 1) Removing python source files Customizing boot menu Creating manifest....done Traceback (most recent call last): File "/usr/lib/python2.7/site.py", line 563, in <module> File "/usr/lib/python2.7/site.py", line 545, in main File "/usr/lib/python2.7/site.py", line 278, in addusersitepackages File "/usr/lib/python2.7/site.py", line 253, in getusersitepackages File "/usr/lib/python2.7/site.py", line 243, in getuserbase File "/usr/lib/python2.7/sysconfig.py", line 520, in get_config_var File "/usr/lib/python2.7/sysconfig.py", line 419, in get_config_vars File "/usr/lib/python2.7/sysconfig.py", line 298, in _init_posix IOError: invalid Python installation: unable to open /usr/include/python2.7/pyconfig-32.h (No such file or directory) I: -input-charset not specified, using utf-8 (detected in locale settings) Using MANIF000.TXT;1 for /manifest-srpm.txt (manifest-license.txt) Using MANIF001.TXT;1 for /manifest-license.txt (manifest-rpm.txt) Using MANIF000.BZ2;1 for /manifest-owns.txt.bz2 (manifest-deps.txt.bz2) Using MANIF001.BZ2;1 for /manifest-deps.txt.bz2 (manifest-dir.txt.bz2) Using MANIF002.BZ2;1 for /manifest-dir.txt.bz2 (manifest-file.txt.bz2) Using LIVEC000.;1 for /var/tmp/imgcreate-vC5xTf/iso-FsojFr/LiveOS/livecd-iso-to-pxeboot (livecd-iso-to-disk) Size of boot image is 4 sectors -> No emulation 9.95% done, estimate finish Fri Dec 9 21:58:54 2011 19.86% done, estimate finish Fri Dec 9 21:58:54 2011 29.80% done, estimate finish Fri Dec 9 21:58:54 2011 39.72% done, estimate finish Fri Dec 9 21:58:54 2011 49.66% done, estimate finish Fri Dec 9 21:58:56 2011 59.57% done, estimate finish Fri Dec 9 21:58:55 2011 69.51% done, estimate finish Fri Dec 9 21:58:55 2011 79.43% done, estimate finish Fri Dec 9 21:58:55 2011 89.36% done, estimate finish Fri Dec 9 21:58:55 2011 99.29% done, estimate finish Fri Dec 9 21:58:55 2011 Total translation table size: 2048 Total rockridge attributes bytes: 2239 Total directory bytes: 4096 Path table size(bytes): 40 Max brk space used 1b000 50365 extents written (98 MB) Inserting md5sum into iso image... md5 = 846fe73d65f185cc939262f022874f02 Inserting fragment md5sums into iso image... fragmd5 = 24359bb7fa6345fb8826d2b789a326cbcaff94b4d7c221e3b8d99f8ea23d frags = 20 Setting supported flag to 0 umount: /var/tmp/imgcreate-vC5xTf/install_root/sys/fs/selinux/load: not found [root@Fedora16P2V gregs]# [root@Fedora16P2V gregs]# [root@Fedora16P2V gregs]# ls -al | grep iso -rw-r--r--. 1 root root 103809024 Dec 9 21:58 Virt-P2V.iso [root@Fedora16P2V gregs]# Thanks - Greg
Woops, I didn't document how I ran virt-p2v-image-builder: virt-p2v-image-builder -a http://download.fedora.redhat.com/pub/fedora/linux/updates/testing/16/i3 86 I'll leave the original email intact below because it looks less garbled than the one that just posted to the list. - Greg -----Original Message----- From: libguestfs-bounces@redhat.com [mailto:libguestfs-bounces@redhat.com] On Behalf Of Greg Scott Sent: Friday, December 09, 2011 10:16 PM To: libguestfs@redhat.com; Matthew Booth Subject: [Libguestfs] A few errors with virt-p2v-image-builder I just now ran into some traceback messages and other errors running virt-p2v-image-builder 0.8.5.1. Anything to worry about? . . . Installing: passwd ##################### [305/307] Installing: syslinux ##################### [306/307] Installing: vim-minimal ##################### [307/307] Note: Forwarding request to 'systemctl enable NetworkManager.service'. error reading information on service auditd: No such file or directory Starting Kickstart Post Creating shadow files Forcing C locale [Errno 2] No such file or directory: '/var/tmp/imgcreate-vC5xTf/install_root/usr/share/locale' ignoring %post failure (code 1) Removing python source files Customizing boot menu Creating manifest....done Traceback (most recent call last): File "/usr/lib/python2.7/site.py", line 563, in <module> File "/usr/lib/python2.7/site.py", line 545, in main File "/usr/lib/python2.7/site.py", line 278, in addusersitepackages File "/usr/lib/python2.7/site.py", line 253, in getusersitepackages File "/usr/lib/python2.7/site.py", line 243, in getuserbase File "/usr/lib/python2.7/sysconfig.py", line 520, in get_config_var File "/usr/lib/python2.7/sysconfig.py", line 419, in get_config_vars File "/usr/lib/python2.7/sysconfig.py", line 298, in _init_posix IOError: invalid Python installation: unable to open /usr/include/python2.7/pyconfig-32.h (No such file or directory) I: -input-charset not specified, using utf-8 (detected in locale settings) Using MANIF000.TXT;1 for /manifest-srpm.txt (manifest-license.txt) Using MANIF001.TXT;1 for /manifest-license.txt (manifest-rpm.txt) Using MANIF000.BZ2;1 for /manifest-owns.txt.bz2 (manifest-deps.txt.bz2) Using MANIF001.BZ2;1 for /manifest-deps.txt.bz2 (manifest-dir.txt.bz2) Using MANIF002.BZ2;1 for /manifest-dir.txt.bz2 (manifest-file.txt.bz2) Using LIVEC000.;1 for /var/tmp/imgcreate-vC5xTf/iso-FsojFr/LiveOS/livecd-iso-to-pxeboot (livecd-iso-to-disk) Size of boot image is 4 sectors -> No emulation 9.95% done, estimate finish Fri Dec 9 21:58:54 2011 19.86% done, estimate finish Fri Dec 9 21:58:54 2011 29.80% done, estimate finish Fri Dec 9 21:58:54 2011 39.72% done, estimate finish Fri Dec 9 21:58:54 2011 49.66% done, estimate finish Fri Dec 9 21:58:56 2011 59.57% done, estimate finish Fri Dec 9 21:58:55 2011 69.51% done, estimate finish Fri Dec 9 21:58:55 2011 79.43% done, estimate finish Fri Dec 9 21:58:55 2011 89.36% done, estimate finish Fri Dec 9 21:58:55 2011 99.29% done, estimate finish Fri Dec 9 21:58:55 2011 Total translation table size: 2048 Total rockridge attributes bytes: 2239 Total directory bytes: 4096 Path table size(bytes): 40 Max brk space used 1b000 50365 extents written (98 MB) Inserting md5sum into iso image... md5 = 846fe73d65f185cc939262f022874f02 Inserting fragment md5sums into iso image... fragmd5 = 24359bb7fa6345fb8826d2b789a326cbcaff94b4d7c221e3b8d99f8ea23d frags = 20 Setting supported flag to 0 umount: /var/tmp/imgcreate-vC5xTf/install_root/sys/fs/selinux/load: not found [root@Fedora16P2V gregs]# [root@Fedora16P2V gregs]# [root@Fedora16P2V gregs]# ls -al | grep iso -rw-r--r--. 1 root root 103809024 Dec 9 21:58 Virt-P2V.iso [root@Fedora16P2V gregs]# Thanks - Greg _______________________________________________ Libguestfs mailing list Libguestfs@redhat.com https://www.redhat.com/mailman/listinfo/libguestfs
Trying to do a P2V; booted from the latest 0.8.5 CD and it immediately died. What in the world does this error mean? [root@Fedora16-64P2V log]# more virt-p2v-server.1323724282.log libguestfs: trace: close virt-v2v: Can't use string ("/tmp/9_NlkdocoV/f76c1443-10d8-49"...) as a HASH ref while "strict ref s" in use at /usr/share/perl5/vendor_perl/Sys/VirtConvert/GuestfsHandle.pm line 80, <> line 5. [root@Fedora16-64P2V log]# I'm running the latest virt-p2v-server [root@Fedora16-64P2V log]# ls -al /usr/bin | grep p2v -rwxr-xr-x. 1 root root 15705 Dec 9 22:02 virt-p2v-server [root@Fedora16-64P2V log]# /usr/bin/virt-p2v-server VIRT_P2V_SERVER 0.8.5 ^C [root@Fedora16-64P2V log]# This was an upgrade from the temporary 0.8.4.1 version. I'll try completely removing virt-v2v and reinstalling it. - Greg
On 12/12/2011 09:28 PM, Greg Scott wrote:
Trying to do a P2V; booted from the latest 0.8.5 CD and it immediately died. What in the world does this error mean?
[root@Fedora16-64P2V log]# more virt-p2v-server.1323724282.log libguestfs: trace: close virt-v2v: Can't use string ("/tmp/9_NlkdocoV/f76c1443-10d8-49"...) as a HASH ref while "strict ref s" in use at /usr/share/perl5/vendor_perl/Sys/VirtConvert/GuestfsHandle.pm line 80,<> line 5. [root@Fedora16-64P2V log]#
It means you found a bug :) It looks like there's a bug which affects format/allocation conversions in recent builds. Are you doing a format/allocation conversion with your P2V? I.e. does your profile specify an allocation policy of sparse, or a format of qcow2? The immediate workaround would be to not do that. The bug is simple to fix. I'll try to do it today as the impact is pretty severe. Matt -- Matthew Booth, RHCA, RHCSS Red Hat Engineering, Virtualisation Team GPG ID: D33C3490 GPG FPR: 3733 612D 2D05 5458 8A8A 1600 3441 EA19 D33C 3490
does your profile specify an allocation policy of sparse, or a format of qcow2?
This profile produces the problem: < <profile name="Stylmark-rhev-sparse"> < <method>rhev</method> < <storage format='qcow2' allocation='sparse'> < 175.10.0.95:/home/RHEVexports < </storage> < <network type="default"> < <network type="network" name="rhevm"/> < </network> < </profile> This one starts a P2V, although the P2V died a little more than an hour into it. < <profile name="Stylmark-rhev-preallocated"> < <method>rhev</method> < <storage format='raw' allocation='preallocated'> < 175.10.0.95:/home/RHEVexports < </storage> < <network type="default"> < <network type="network" name="rhevm"/> < </network> < </profile> - Greg
On 12/13/2011 12:06 PM, Greg Scott wrote:
does your profile specify an allocation policy of sparse, or a format of qcow2?
This profile produces the problem:
< <profile name="Stylmark-rhev-sparse"> < <method>rhev</method> < <storage format='qcow2' allocation='sparse'> < 175.10.0.95:/home/RHEVexports < </storage> < <network type="default"> < <network type="network" name="rhevm"/> < </network> < </profile>
This one starts a P2V, although the P2V died a little more than an hour into it.
How did it die? Is that the one that just hung? Matt -- Matthew Booth, RHCA, RHCSS Red Hat Engineering, Virtualisation Team GPG ID: D33C3490 GPG FPR: 3733 612D 2D05 5458 8A8A 1600 3441 EA19 D33C 3490
How did it die? Is that the one that just hung?
No. The sparse profile died right away with the error. The preallocated profile ran for a long time and then hung. - Greg -----Original Message----- From: Matthew Booth [mailto:mbooth@redhat.com] Sent: Tuesday, December 13, 2011 6:14 AM To: Greg Scott Cc: libguestfs@redhat.com; Fredy Hernandez; Joey Bertalan Subject: Re: The latest v2v-server 0.8.5.1 blows up On 12/13/2011 12:06 PM, Greg Scott wrote:
does your profile specify an allocation policy of sparse, or a format of qcow2?
This profile produces the problem:
< <profile name="Stylmark-rhev-sparse"> < <method>rhev</method> < <storage format='qcow2' allocation='sparse'> < 175.10.0.95:/home/RHEVexports < </storage> < <network type="default"> < <network type="network" name="rhevm"/> < </network> < </profile>
This one starts a P2V, although the P2V died a little more than an hour into it.
How did it die? Is that the one that just hung? Matt -- Matthew Booth, RHCA, RHCSS Red Hat Engineering, Virtualisation Team GPG ID: D33C3490 GPG FPR: 3733 612D 2D05 5458 8A8A 1600 3441 EA19 D33C 3490
On the hanging P2V - I wonder if it's another NFS problem since the UID.GIDs show nobody.nobody on the conversion server and 36.36 on the NFS server. The P2V docs say to export a RHEV Export domain with nothing fancy, like this: /path * (rw) But I wonder if I should try something like: /path * (rw,no_root_squash,anonuid=36,anongid=36) Although why virt-p2v-server would run for more than an hour and write tons of stuff before hanging is beyond me. I also see I left /etc/selinux/config with SELINUX=enforcing on the conversion server and I just now changed to SELINUX=permissive. Although, if this is the reason for the hang, why it would work all this time is a mystery. - Greg
On 12/13/2011 09:46 AM, Matthew Booth wrote:
On 12/12/2011 09:28 PM, Greg Scott wrote:
Trying to do a P2V; booted from the latest 0.8.5 CD and it immediately died. What in the world does this error mean?
[root@Fedora16-64P2V log]# more virt-p2v-server.1323724282.log libguestfs: trace: close virt-v2v: Can't use string ("/tmp/9_NlkdocoV/f76c1443-10d8-49"...) as a HASH ref while "strict ref s" in use at /usr/share/perl5/vendor_perl/Sys/VirtConvert/GuestfsHandle.pm line 80,<> line 5. [root@Fedora16-64P2V log]#
It means you found a bug :)
It looks like there's a bug which affects format/allocation conversions in recent builds. Are you doing a format/allocation conversion with your P2V? I.e. does your profile specify an allocation policy of sparse, or a format of qcow2? The immediate workaround would be to not do that. The bug is simple to fix. I'll try to do it today as the impact is pretty severe.
virt-v2v-0.8.5-2 should hit updates-testing shortly. Please try again with this new build. There's no need to rebuild your P2V image as it hasn't changed. Please add yourself to https://bugzilla.redhat.com/show_bug.cgi?id=767197 if you want to follow its progress through testing to stable. If you have a Fedora login, you can help it reach stable faster by adding a WorksForMe comment to https://admin.fedoraproject.org/updates/virt-v2v-0.8.5-2.fc16. Matt -- Matthew Booth, RHCA, RHCSS Red Hat Engineering, Virtualisation Team GPG ID: D33C3490 GPG FPR: 3733 612D 2D05 5458 8A8A 1600 3441 EA19 D33C 3490
OK thanks. As of a few minutes ago 0.8.5.2 hadn't made it to updates-testing yet so in the meantime I'm trying one more P2V with 0.8.5.1 and the NFS and SELINUX changes I put in first. This is how we're exporting the NFS share now: [root@IT dom_md]# exportfs -v /home/RHEVexports <world>(rw,wdelay,no_root_squash,no_subtree_check,anonuid=36,anongid=36) /home/testnfs <world>(rw,wdelay,no_root_squash,no_subtree_check,anonuid=36,anongid=36) [root@IT dom_md]# - Greg
Aw nuts, we're back to this again: [root@Fedora16-64P2V log]# more virt-p2v-server.1323794812.log virt-v2v: Error receiving data: [root@Fedora16-64P2V log]# Suggesting either the NFS server or conversion server is dropping offline intermittently. - Greg
Suggesting either the NFS server or conversion server is dropping offline intermittently.
Well, no. Twice today, the source server's console froze at 85 percent. I'll bet it's frozen again this time at 85 percent. So this time while the P2V was in progress I set up pings to/from the conversion server and to/from the NFS server. No packet loss, nothing ugly looking with round trip times. Average RTT from both was round 0.2 ms, with max at about 1.3 ms. So the network is good. The diagnostic log file on the conversion server doesn't give much for clues: [root@Fedora16-64P2V log]# more virt-p2v-server.1323814661.log virt-v2v: Error receiving data: [root@Fedora16-64P2V log]# I wonder if either the source server or NFS server has a bad block on a HDD? - Greg
On 12/14/2011 01:01 AM, Greg Scott wrote:
Suggesting either the NFS server or conversion server is dropping offline intermittently.
Well, no. Twice today, the source server's console froze at 85 percent. I'll bet it's frozen again this time at 85 percent. So this time while the P2V was in progress I set up pings to/from the conversion server and to/from the NFS server. No packet loss, nothing ugly looking with round trip times. Average RTT from both was round 0.2 ms, with max at about 1.3 ms. So the network is good.
The diagnostic log file on the conversion server doesn't give much for clues:
[root@Fedora16-64P2V log]# more virt-p2v-server.1323814661.log virt-v2v: Error receiving data:
[root@Fedora16-64P2V log]#
I wonder if either the source server or NFS server has a bad block on a HDD?
If you go to source server (running P2V) you can switch to console 2 (Ctrl-Alt-F2) to get a terminal. You could check dmesg on there. I think I may also have included strace on the image, so you could attach to the running P2V process with strace -p to get an idea what it's doing. Matt -- Matthew Booth, RHCA, RHCSS Red Hat Engineering, Virtualisation Team GPG ID: D33C3490 GPG FPR: 3733 612D 2D05 5458 8A8A 1600 3441 EA19 D33C 3490
participants (2)
-
Greg Scott -
Matthew Booth