Bug 254176 - Full-virt 32 bit Solaris and FreeBSD guests disk I/O errors under load
Full-virt 32 bit Solaris and FreeBSD guests disk I/O errors under load
Status: CLOSED WORKSFORME
Product: Red Hat Enterprise Linux 5
Classification: Red Hat
Component: xen (Show other bugs)
5.1
i386 Linux
low Severity low
: ---
: ---
Assigned To: Xen Maintainance List
Virtualization Bugs
:
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2007-08-24 12:27 EDT by Richard W.M. Jones
Modified: 2011-05-17 19:20 EDT (History)
0 users

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed: 2008-09-09 09:54:42 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)

  None (edit)
Description Richard W.M. Jones 2007-08-24 12:27:05 EDT
Description of problem:

When installing and/or running certain non-Linux operating systems,
fully virtualised, 32-bit, we see disk I/O errors.

The disk I/O errors happen much more frequently when the system is
generally under I/O load (eg. other guests or the dom0 has processes
doing a lot of I/O).  The errors are very rare when the host is
idle.

Version-Release number of selected component (if applicable):

RHEL 5.1
xen-3.0.3-36.el5
kernel-xen-2.6.18-43.el5

Solaris 10 U3, 32-bit, i386
FreeBSD 6.2, 32-bit, i386

How reproducible:

Easily reproducible if there is load on the system.

Steps to Reproduce:
1. Download a Solaris 10 U3 DVD ISO.
2. Begin the install from the ISO using virt-manager
  (tip: make sure to give Solaris at least 8 GB of space).
3. Start disk load in dom0 and/or other guests.

Actual results:

Solaris installer crashes.  The characteristic message for
Solaris 10 is:

"/a/var/sadm/launcher: I/O error"

You may also see other I/O related errors.

Expected results:

Solaris should install.

Additional info:

For the FreeBSD case please see bug 240009 comment 9.

I have only tried this with file-backed disks, not with raw
disk partitions.
Comment 1 Richard W.M. Jones 2007-08-28 16:58:38 EDT
Solaris install seems a lot happier under Fedora 7 (xen-3.1.0-2.fc8),
giving a preliminary indication that fixes in the upstream qemu-dm
may have improved disk I/O for fullvirt domains.
Comment 2 Richard W.M. Jones 2007-08-29 04:52:38 EDT
Ignore comment 2.  After overnight testing (getting the installed Solaris
to apply updates, while the host was under a moderate load), I found that
the Solaris guest had crashed with a severely corrupted disk.  So Fedora 7
is better but certainly not working.
Comment 3 Richard W.M. Jones 2007-08-29 08:18:29 EDT
I also tested this with a partition-backed block device instead
of file-backed and the same thing corruption happens (Solaris 32 bit full virt
guest, Fedora 7 host).
Comment 4 RHEL Product and Program Management 2007-10-15 23:44:10 EDT
This request was evaluated by Red Hat Product Management for inclusion in a Red
Hat Enterprise Linux maintenance release.  Product Management has requested
further review of this request by Red Hat Engineering, for potential
inclusion in a Red Hat Enterprise Linux Update release for currently deployed
products.  This request is not yet committed for inclusion in an Update
release.
Comment 5 Richard W.M. Jones 2007-11-16 12:08:11 EST
Today I retested Solaris and FreeBSD under QEMU (CVS version)
and KVM-36 (Fedora 8 version) in order to see whether upstream
versions of the QEMU device model might fix this.

Results are mixed-to-good.

FreeBSD
-------

FreeBSD appears to run perfectly under both QEMU (CVS) and
KVM-36.  The QEMU case isn't very surprising or interesting
because FreeBSD is running so much more slowly, so any race
conditions are less likely to occur.  However I think the
KVM case is significant and may indicate that some different
between the old QEMU in Xen & the new(er) QEMU in KVM has fixed
this problem.

Solaris
-------

Solaris also installs and runs perfectly under QEMU.  No disk errors
shown, again not very surprising because everything is going much
more slowly.

Under KVM, Solaris does not boot, although I think this is a different
problem.  It can boot to a shell in single user mode.  However a normal
boot hangs with a black screen (no messages).


(Note that tests are continuing, and early results like this don't
necessarily indicate that the problem has completely gone away).
Comment 6 Richard W.M. Jones 2007-11-19 04:34:14 EST
I tested FreeBSD under load for 4 days (KVM-36 again) with no
disk errors in that time.
Comment 7 RHEL Product and Program Management 2008-03-11 15:42:02 EDT
This request was previously evaluated by Red Hat Product Management
for inclusion in the current Red Hat Enterprise Linux release, but
Red Hat was unable to resolve it in time.  This request will be
reviewed for a future Red Hat Enterprise Linux release.

Note You need to log in before you can comment on or make changes to this bug.