Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 909574

Summary: ovirt-node doesn't remove /lib/dracut/modules.d/91ovirtnode on uninstallation. Breaks stuff bad.
Product: [Retired] oVirt Reporter: Mohammed Arafa <bugzilla>
Component: ovirt-nodeAssignee: Joey Boggs <jboggs>
Status: CLOSED NOTABUG QA Contact: bugs <bugs>
Severity: low Docs Contact:
Priority: low    
Version: unspecifiedCC: acathrow, fdeutsch, gansalmon, hadong, itamar, jboggs, jonathan, kernel-maint, leiwang, madhu.chinakonda, marianne, mgoldboi, ovirt-bugs, ovirt-maint, pjones
Target Milestone: ---   
Target Release: 3.4.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: node
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-04-30 12:18:33 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
screenshot of laptop with kernel panic
none
grub2.cfg none

Description Mohammed Arafa 2013-02-09 14:24:29 UTC
Description of problem:

kernel-3.7.6-201.fc18.x86_64 gives kernel panic
i got 2 physical boxes.  a desktop and a laptop and both kernel panic'd after today's kernel update

Version-Release number of selected component (if applicable):


How reproducible:
everytime

Steps to Reproduce:
1.install kernel
2.reboot
3.panic!
  
Actual results:


Expected results:


Additional info:

Comment 1 Mohammed Arafa 2013-02-09 20:21:02 UTC
just updated my f18 vm - no issues

Comment 2 Josh Boyer 2013-02-11 12:40:55 UTC
We'll need to actually see the kernel panic.  There's nothing we can do with this bug at the moment.

Comment 3 Mohammed Arafa 2013-02-12 00:51:52 UTC
ok .. so how do i collect data for a kernel panic?

Comment 4 Josh Boyer 2013-02-12 12:43:52 UTC
If you have a serial console, you can log the output to that.  Or you can transcribe the text from the screen by hand.  Otherwise, a digital picture of the panic on the screen is better than nothing.

If the panic is scrolling off the screen, you can use the pause_on_oops=30 kernel parameter to make it pause first.  Just add that to the kernel parameters in the grub configuration file for that kernel.

Comment 5 Mohammed Arafa 2013-02-15 12:28:27 UTC
Created attachment 697751 [details]
screenshot of laptop with kernel panic

let me know if you need another picture. i can recreate it at will

Comment 6 Mohammed Arafa 2013-02-15 12:33:06 UTC
oh and let me know if i need to add pause_on_oops=30 kernel parameter and if i do need to do that, how to do it with grub2. i am a little behind with technology ;)

Comment 7 Mohammed Arafa 2013-02-16 15:02:26 UTC
in today's version too. kernel-3.7.7-201.fc18.x86_64

Comment 8 Josh Boyer 2013-02-18 14:48:00 UTC
All the picture is showing is that the kernel cannot find the rootfs.  Can you attach the grub.cfg file?

Also, do /boot/initramfs-3.7.6-201.fc18.x86_64.img and /boot/initramfs-3.7.7-201.fc18.x86_64.img exist?

Comment 9 Mohammed Arafa 2013-02-18 22:43:59 UTC
i had an enlightening moment and uninstalled 3.7.6. i only have 3.7.7 on my desktop now.
[marafa@desktop ~]$ rpm -qa | grep kernel-3.7
kernel-3.7.4-204.fc18.x86_64
kernel-3.7.5-201.fc18.x86_64
kernel-3.7.2-204.fc18.x86_64
kernel-3.7.7-201.fc18.x86_64
[marafa@desktop ~]$ yum erase ^C
[marafa@desktop ~]$ cd /boot/initramfs-3.*
bash: cd: /boot/initramfs-3.6.10-2.fc17.x86_64.img: Not a directory
[marafa@desktop ~]$ ll /boot/initramfs-3.*
-rw------- 1 root root 20M Dec 16 03:14 /boot/initramfs-3.6.10-2.fc17.x86_64.img
-rw------- 1 root root 20M Jan  5 12:15 /boot/initramfs-3.6.11-1.fc17.x86_64.img
-rw------- 1 root root 20M Jan 20 23:04 /boot/initramfs-3.7.2-204.fc18.x86_64.img
-rw------- 1 root root 20M Jan 27 03:20 /boot/initramfs-3.7.4-204.fc18.x86_64.img
-rw------- 1 root root 20M Feb  5 07:37 /boot/initramfs-3.7.5-201.fc18.x86_64.img
[marafa@desktop ~]$ ll /boot/initramfs-3.7*
-rw------- 1 root root 20M Jan 20 23:04 /boot/initramfs-3.7.2-204.fc18.x86_64.img
-rw------- 1 root root 20M Jan 27 03:20 /boot/initramfs-3.7.4-204.fc18.x86_64.img
-rw------- 1 root root 20M Feb  5 07:37 /boot/initramfs-3.7.5-201.fc18.x86_64.img
[marafa@desktop ~]$ df -h
Filesystem                      Size  Used Avail Use% Mounted on
devtmpfs                        3.9G     0  3.9G   0% /dev
tmpfs                           3.9G  2.2M  3.9G   1% /dev/shm
tmpfs                           3.9G   20M  3.9G   1% /run
tmpfs                           3.9G     0  3.9G   0% /sys/fs/cgroup
/dev/mapper/vg_desktop-lv_root  453G  351G   79G  82% /
tmpfs                           3.9G   21M  3.9G   1% /tmp
/dev/sda1                       485M  159M  301M  35% /boot
[marafa@desktop ~]$ rpm -qil kernel-3.7.7-201.fc18.x86_64|grep initramfs
/boot/initramfs-3.7.7-201.fc18.x86_64.img

[marafa@desktop ~]$ sudo ls -ltr /etc/grub*
[sudo] password for marafa: 
lrwxrwxrwx. 1 root root   22 May 30  2011 /etc/grub.conf -> ../boot/grub/grub.conf
lrwxrwxrwx  1 root root   22 Jan 17 21:37 /etc/grub2.cfg -> ../boot/grub2/grub.cfg

Comment 10 Mohammed Arafa 2013-02-18 22:47:41 UTC
Created attachment 699186 [details]
grub2.cfg

grub2.cfg

Comment 11 Josh Boyer 2013-02-18 23:20:24 UTC
OK.  So you have neither the initramfs file for 3.7.7, nor does the grub2.cfg file list an initrd entry for it.  I'm going to go ahead and guess that 3.7.6 was a similar case.  That explains why it can't find the rootfs.

This looks like a grubby bug of some sort.  As a workaround, you can regenerate the initramfs by doing:

sudo dracut /boot/initramfs-3.7.7-201.fc18.x86_64.img 3.7.7-201.fc18.x86_64

and then adding the corresponding initrd line to grub2.cfg.

As an aside, I'm not sure why you have more than 3 kernels installed.  Perhaps you changed the default number that yum keeps, which is normally three.

Comment 12 Mohammed Arafa 2013-02-18 23:51:03 UTC
[marafa@desktop tmp]$ sudo rpm -ivh kernel-3.7.8-202.fc18.x86_64.rpm --force
[sudo] password for marafa: 
Preparing...                          ################################# [100%]
Updating / installing...
   1:kernel-3.7.8-202.fc18            ################################# [100%]
grubby fatal error: unable to find a suitable template
F: installkernel failed in module ovirtnode
mkinitrd failed
warning: %posttrans(kernel-3.7.8-202.fc18.x86_64) scriptlet failed, exit status 1

yes, i changed it a while back to 10 so i can always have a working kernel ;)

Comment 13 Josh Boyer 2013-02-19 00:31:22 UTC
(In reply to comment #12)
> [marafa@desktop tmp]$ sudo rpm -ivh kernel-3.7.8-202.fc18.x86_64.rpm --force
> [sudo] password for marafa: 
> Preparing...                          #################################
> [100%]
> Updating / installing...
>    1:kernel-3.7.8-202.fc18            #################################
> [100%]
> grubby fatal error: unable to find a suitable template
> F: installkernel failed in module ovirtnode
> mkinitrd failed
> warning: %posttrans(kernel-3.7.8-202.fc18.x86_64) scriptlet failed, exit
> status 1

Have you been seeing this the entire time?  Because if you had, that would have been some really good information to include in the initial bug report instead of making us ask for info piecemeal and try to figure out what's wrong.

> yes, i changed it a while back to 10 so i can always have a working kernel ;)

yum won't remove the running kernel, so just boot into whatever a "good" kernel is you won't run the risk of being left without something booting (unless you don't use yum).

Comment 14 Mohammed Arafa 2013-02-19 02:23:42 UTC
seeing this? no. its a cron job at 3am :D

10 is to make sure i always have a "good" kernel. 

and also i uninstalled ovirt about a month back.

Comment 15 Mohammed Arafa 2013-02-19 12:27:48 UTC
hi

[marafa@notebook 91ovirtnode]$ pwd
/lib/dracut/modules.d/91ovirtnode
[marafa@notebook 91ovirtnode]$ ls
[marafa@notebook 91ovirtnode]$ 
[marafa@notebook 91ovirtnode]$ sudo dracut /boot/initramfs-3.7.7-201.fc18.x86_64.img 3.7.7-201.fc18.x86_64
[sudo] password for marafa: 
F: installkernel failed in module ovirtnode
[marafa@notebook 91ovirtnode]$ cd ..
[marafa@notebook modules.d]$ sudo rm -rf 91ovirtnode/
[marafa@notebook modules.d]$ sudo dracut /boot/initramfs-3.7.7-201.fc18.x86_64.img 3.7.7-201.fc18.x86_64
[marafa@notebook modules.d]$ 

[root@notebook ~]# grub2-mkconfig -o /boot/grub2/grub.cfg
Generating grub.cfg ...
Found linux image: /boot/vmlinuz-3.7.8-202.fc18.x86_64
Found linux image: /boot/vmlinuz-3.7.7-201.fc18.x86_64
Found initrd image: /boot/initramfs-3.7.7-201.fc18.x86_64.img
Found linux image: /boot/vmlinuz-3.7.5-201.fc18.x86_64
Found initrd image: /boot/initramfs-3.7.5-201.fc18.x86_64.img
Found memtest image: /boot/elf-memtest86+-4.20
done

looks like this is problem with ovirtnode uninstallation. as it was not complete.

Comment 16 Mohammed Arafa 2013-02-19 22:34:32 UTC
@josh thanks for taking the trouble to walk me through it

Comment 17 Sandro Bonazzola 2014-03-04 09:17:26 UTC
This is an automated message.
Re-targeting all non-blocker bugs still open on 3.4.0 to 3.4.1.

Comment 18 Fabian Deutsch 2014-04-30 12:18:33 UTC
Closing this, as ovirt-node is not intended to get installed on a regular host.

Please reopen if necessary.