11:57 p.m.
Here's some more ugly behavior. The P2V we started several hours ago with 0.8.5.1
looks like it's hung. It copied most of the source server and then apparently decided
to go on strike. The diagnostic log file is empty.
I'm going to paste in what I see from both the migration server and the Fedora 16
server hosting the NFS service.
First the migration server. Notice the ownership on the directory in the Export domain.
The migration server shows it as nobody.nobody, while the NFS server shows it as 36.36.
What's up with that? And then look at the permissions - that explains the Permission
Denied errors.
And then because the ownership from the NFS export is somehow messed up, the NFS client /
migration server seizes up and here we sit. But how/why would the ownership become messed
up most of the way through it?
[root@Fedora16-64P2V log]# df -h
Filesystem Size Used Avail Use% Mounted on
rootfs 47G 4.4G 41G 10% /
devtmpfs 2.0G 0 2.0G 0% /dev
tmpfs 2.0G 72K 2.0G 1% /dev/shm
tmpfs 2.0G 48M 1.9G 3% /run
/dev/mapper/vg_fedora1664p2v-lv_root 47G 4.4G 41G 10% /
tmpfs 2.0G 48M 1.9G 3% /run
tmpfs 2.0G 0 2.0G 0% /sys/fs/cgroup
tmpfs 2.0G 0 2.0G 0% /media
/dev/vda2 485M 81M 379M 18% /boot
175.10.0.95:/home/RHEVexports 212G 66G 136G 33% /tmp/aR_fSTb7EL
[root@Fedora16-64P2V log]# cd /tmp/aR_fSTb7EL
[root@Fedora16-64P2V aR_fSTb7EL]# ls
f76c1443-10d8-49a0-a140-2c0a2085acbe
[root@Fedora16-64P2V aR_fSTb7EL]# cd f76c1443-10d8-49a0-a140-2c0a2085acbe
-bash: cd: f76c1443-10d8-49a0-a140-2c0a2085acbe: Permission denied
[root@Fedora16-64P2V aR_fSTb7EL]# ls -al
total 12
drwxr-xr-x. 3 nobody nobody 4096 Dec 6 04:25 .
drwxrwxrwt. 16 root root 4096 Dec 12 15:42 ..
drwxrwx---. 6 nobody nobody 4096 Dec 12 15:40 f76c1443-10d8-49a0-a140-2c0a2085acbe
[root@Fedora16-64P2V aR_fSTb7EL]# ls -al -R
.:
total 12
drwxr-xr-x. 3 nobody nobody 4096 Dec 6 04:25 .
drwxrwxrwt. 16 root root 4096 Dec 12 15:42 ..
drwxrwx---. 6 nobody nobody 4096 Dec 12 15:40 f76c1443-10d8-49a0-a140-2c0a2085acbe
ls: cannot open directory ./f76c1443-10d8-49a0-a140-2c0a2085acbe: Permission denied
[root@Fedora16-64P2V aR_fSTb7EL]#
[root@Fedora16-64P2V aR_fSTb7EL]#
[root@Fedora16-64P2V aR_fSTb7EL]# ps ax | grep p2v
4893 ? Ss 6:14 /usr/bin/perl /usr/bin/virt-p2v-server
5206 pts/0 S+ 0:00 grep --color=auto p2v
[root@Fedora16-64P2V aR_fSTb7EL]#
And now the NFS server hosting the Export domain:
[root@IT ~]#
[root@IT ~]# more /etc/exports
/home/RHEVexports *(rw)
/home/testnfs *(rw)
[root@IT ~]# cd /home/RHEVexports
[root@IT RHEVexports]# ls -al -R
.:
total 12
drwxr-xr-x. 3 36 36 4096 Dec 6 04:25 .
drwxr-xr-x. 7 root root 4096 Dec 7 22:19 ..
drwxrwx---. 6 36 36 4096 Dec 12 15:40 f76c1443-10d8-49a0-a140-2c0a2085acbe
./f76c1443-10d8-49a0-a140-2c0a2085acbe:
total 24
drwxrwx---. 6 36 36 4096 Dec 12 15:40 .
drwxr-xr-x. 3 36 36 4096 Dec 6 04:25 ..
drwxrwx---. 2 36 36 4096 Dec 6 11:02 dom_md
drwxrwx---. 2 36 36 4096 Dec 9 16:49 images
drwxr-x---. 4 36 36 4096 Dec 5 20:30 master
drwx------. 3 36 36 4096 Dec 12 15:40 v2v.3R3Eo5HD
./f76c1443-10d8-49a0-a140-2c0a2085acbe/dom_md:
total 16
drwxrwx---. 2 36 36 4096 Dec 6 11:02 .
drwxrwx---. 6 36 36 4096 Dec 12 15:40 ..
-rw-rw----. 1 36 36 8388608 Dec 5 20:27 ids
-rw-rw----. 1 36 36 16777216 Dec 5 20:27 inbox
-rw-rw----. 1 36 36 2147483648 Dec 6 11:02 leases
-rw-rw----. 1 36 36 393 Dec 6 11:02 metadata
-rw-rw----. 1 36 36 16777216 Dec 5 20:27 outbox
./f76c1443-10d8-49a0-a140-2c0a2085acbe/images:
total 8
drwxrwx---. 2 36 36 4096 Dec 9 16:49 .
drwxrwx---. 6 36 36 4096 Dec 12 15:40 ..
./f76c1443-10d8-49a0-a140-2c0a2085acbe/master:
total 16
drwxr-x---. 4 36 36 4096 Dec 5 20:30 .
drwxrwx---. 6 36 36 4096 Dec 12 15:40 ..
drwxrwx---. 2 36 36 4096 Dec 5 20:30 tasks
drwxrwx---. 2 36 36 4096 Dec 9 16:49 vms
./f76c1443-10d8-49a0-a140-2c0a2085acbe/master/tasks:
total 8
drwxrwx---. 2 36 36 4096 Dec 5 20:30 .
drwxr-x---. 4 36 36 4096 Dec 5 20:30 ..
./f76c1443-10d8-49a0-a140-2c0a2085acbe/master/vms:
total 8
drwxrwx---. 2 36 36 4096 Dec 9 16:49 .
drwxr-x---. 4 36 36 4096 Dec 5 20:30 ..
./f76c1443-10d8-49a0-a140-2c0a2085acbe/v2v.3R3Eo5HD:
total 12
drwx------. 3 36 36 4096 Dec 12 15:40 .
drwxrwx---. 6 36 36 4096 Dec 12 15:40 ..
drwxr-xr-x. 2 36 36 4096 Dec 12 15:40 ac8f73a6-6515-4797-91a4-fd2fc4bc4f56
./f76c1443-10d8-49a0-a140-2c0a2085acbe/v2v.3R3Eo5HD/ac8f73a6-6515-4797-91a4-fd2fc4bc4f56:
total 67043348
drwxr-xr-x. 2 36 36 4096 Dec 12 15:40 .
drwx------. 3 36 36 4096 Dec 12 15:40 ..
-rw-r--r--. 1 36 36 80000000000 Dec 12 17:19 7dccc45e-a86e-4056-b567-db36786cc03e
[root@IT RHEVexports]#
I wonder if that P2V would pick back up again if I liberalized the permissions by hand?
- Greg