Attachment 298978 Details for Bug 437076 – part of /var/log/messages

part of /var/log/messages

messages (text/plain), 11.80 KB, created by Eugenij Shkrigunov on 2008-03-25 06:35:21 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Eugenij Shkrigunov

Created: 2008-03-25 06:35:21 UTC

Size: 11.80 KB

patch

obsolete

>Mar 24 15:05:50 lts2 ccsd[6083]: Starting ccsd 2.02.00:
>Mar 24 15:05:50 lts2 ccsd[6083]:  Built: Mar 11 2008 09:54:19
>Mar 24 15:05:50 lts2 ccsd[6083]:  Copyright (C) Red Hat, Inc.  2004-2007  All rights reserved.
>Mar 24 15:05:50 lts2 ccsd[6083]: /etc/cluster/cluster.conf (cluster name = cluster1, version = 8) found.
>Mar 24 15:06:31 lts2 ccsd[6083]: Initial status:: Quorate
>Mar 24 15:08:09 lts2 kernel: gnbd: registered device at major 252
>Mar 24 15:08:19 lts2 gnbd_monitor[7087]: gnbd_monitor started. Monitoring device #0
>Mar 24 15:08:19 lts2 gnbd_recvd[7090]: gnbd_recvd started
>Mar 24 15:08:19 lts2 kernel: resending requests
>Mar 24 15:08:57 lts2 kernel: dlm: Using TCP for communications
>Mar 24 15:08:57 lts2 kernel: dlm: got connection from 1
>Mar 24 15:08:58 lts2 clvmd: Cluster LVM daemon started - connected to CMAN
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "cluster1:home"
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: Joined cluster. Now mounting FS...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=0, already locked for use
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=0: Looking at journal...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=0: Done
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=1: Trying to acquire journal lock...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=1: Looking at journal...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=1: Done
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=2: Trying to acquire journal lock...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=2: Looking at journal...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=2: Done
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=3: Trying to acquire journal lock...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=3: Looking at journal...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=3: Done
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=4: Trying to acquire journal lock...
>Mar 24 15:35:01 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=4: Looking at journal...
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=4: Done
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=5: Trying to acquire journal lock...
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=5: Looking at journal...
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=5: Done
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=6: Trying to acquire journal lock...
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=6: Looking at journal...
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: jid=6: Done
>Mar 24 15:35:02 lts2 kernel: GFS2: fsid=cluster1:home.0: found 5 quota changes
>Mar 24 19:35:05 lts2 kernel: original: gfs2_rindex_hold+0x2a/0x18d [gfs2]
>Mar 24 19:35:05 lts2 kernel: pid : 7291
>Mar 24 19:35:05 lts2 kernel: lock type : 2 lock state : 3
>Mar 24 19:35:05 lts2 kernel: new: gfs2_rindex_hold+0x2a/0x18d [gfs2]
>Mar 24 19:35:05 lts2 kernel: pid : 7291
>Mar 24 19:35:05 lts2 kernel: lock type : 2 lock state : 3
>Mar 24 19:35:05 lts2 kernel: ------------[ cut here ]------------
>Mar 24 19:35:05 lts2 kernel: kernel BUG at fs/gfs2/glock.c:1119!
>Mar 24 19:35:05 lts2 kernel: invalid opcode: 0000 [#1] SMP 
>Mar 24 19:35:05 lts2 kernel: Modules linked in: gnbd(U) fuse lock_dlm gfs2 dlm configfs ipip tunnel4 8021q dm_multipath iTCO_wdt iTCO_vendor_support e1000 i5000_edac edac_core button pcspkr i2c_i801 i2c_core sg sr_mod cdrom dm_snapshot dm_zero dm_mirror dm_mod ata_piix pata_acpi ata_generic libata sd_mod scsi_mod raid456 async_xor async_memcpy async_tx xor raid1 ext3 jbd mbcache uhci_hcd ohci_hcd ehci_hcd
>Mar 24 19:35:05 lts2 kernel: 
>Mar 24 19:35:05 lts2 kernel: Pid: 7291, comm: gfs2_quotad Not tainted (2.6.24.3-34.fc8PAE #1)
>Mar 24 19:35:05 lts2 kernel: EIP: 0060:[<f8ba13f9>] EFLAGS: 00010292 CPU: 2
>Mar 24 19:35:05 lts2 kernel: EIP is at gfs2_glock_nq+0x109/0x1a4 [gfs2]
>Mar 24 19:35:05 lts2 kernel: EAX: 00000020 EBX: ddde55f0 ECX: 00000046 EDX: 00000000
>Mar 24 19:35:05 lts2 kernel: ESI: ddde55f0 EDI: c9e55910 EBP: c9e55910 ESP: de556df8
>Mar 24 19:35:05 lts2 kernel:  DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
>Mar 24 19:35:05 lts2 kernel: Process gfs2_quotad (pid: 7291, ti=de556000 task=ed8433b0 task.ti=de556000)
>Mar 24 19:35:05 lts2 kernel: Stack: f8bb76ac 00000002 00000003 f5c2b000 00000000 c9e55910 f5c2b000 ddde4ce0 
>Mar 24 19:35:05 lts2 kernel:        d9505e34 f8bb1782 ddde55f0 f8ba12de 0001f500 00000000 ddde55f0 f8bb60a0 
>Mar 24 19:35:05 lts2 kernel:        00001c7b ddde5614 c9e55cb0 c9e55cb0 f8ba1465 00000020 00000020 0000e7ec 
>Mar 24 19:35:05 lts2 kernel: Call Trace:
>Mar 24 19:35:05 lts2 kernel:  [<f8bb1782>] gfs2_rindex_hold+0x33/0x18d [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8ba12de>] glock_wait_internal+0x1e5/0x1f7 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8ba1465>] gfs2_glock_nq+0x175/0x1a4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8bb21ab>] gfs2_inplace_reserve_i+0xa2/0x572 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<c062d9ba>] down_read+0x17/0x25
>Mar 24 19:35:05 lts2 kernel:  [<f8ba5ca5>] gfs2_log_reserve+0x106/0x117 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8bb5573>] gfs2_trans_begin+0xda/0x10e [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8baf154>] do_sync+0x2c4/0x5d4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8ba770d>] gfs2_meta_wait+0x24/0x87 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8baea1e>] bh_get+0x189/0x193 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8baef9a>] do_sync+0x10a/0x5d4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8bafd2a>] gfs2_quota_sync+0x1fe/0x281 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8b99545>] gfs2_quotad+0xb1/0x140 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8b99494>] gfs2_quotad+0x0/0x140 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8b99494>] gfs2_quotad+0x0/0x140 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<c043fd30>] kthread+0x38/0x60
>Mar 24 19:35:05 lts2 kernel:  [<c043fcf8>] kthread+0x0/0x60
>Mar 24 19:35:05 lts2 kernel:  [<c0405e0b>] kernel_thread_helper+0x7/0x10
>Mar 24 19:35:05 lts2 kernel:  =======================
>Mar 24 19:35:05 lts2 kernel: Code: 0c c7 04 24 9f 76 bb f8 89 44 24 04 e8 d3 f0 88 c7 8b 47 20 8b 57 14 89 44 24 08 89 54 24 04 c7 04 24 ac 76 bb f8 e8 b9 f0 88 c7 <0f> 0b eb fe 39 58 0c 74 0e 89 d0 8b 10 0f 18 02 90 39 c8 75 ef 
>Mar 24 19:35:05 lts2 kernel: EIP: [<f8ba13f9>] gfs2_glock_nq+0x109/0x1a4 [gfs2] SS:ESP 0068:de556df8
>Mar 24 19:35:05 lts2 kernel: ---[ end trace fc38f829f18bfa6f ]---
>Mar 24 19:35:05 lts2 kernel: ------------[ cut here ]------------
>Mar 24 19:35:05 lts2 kernel: kernel BUG at fs/jbd/transaction.c:275!
>Mar 24 19:35:05 lts2 kernel: invalid opcode: 0000 [#2] SMP 
>Mar 24 19:35:05 lts2 kernel: Modules linked in: gnbd(U) fuse lock_dlm gfs2 dlm configfs ipip tunnel4 8021q dm_multipath iTCO_wdt iTCO_vendor_support e1000 i5000_edac edac_core button pcspkr i2c_i801 i2c_core sg sr_mod cdrom dm_snapshot dm_zero dm_mirror dm_mod ata_piix pata_acpi ata_generic libata sd_mod scsi_mod raid456 async_xor async_memcpy async_tx xor raid1 ext3 jbd mbcache uhci_hcd ohci_hcd ehci_hcd
>Mar 24 19:35:05 lts2 kernel: 
>Mar 24 19:35:05 lts2 kernel: Pid: 7291, comm: gfs2_quotad Tainted: G      D (2.6.24.3-34.fc8PAE #1)
>Mar 24 19:35:05 lts2 kernel: EIP: 0060:[<f8860b01>] EFLAGS: 00010283 CPU: 2
>Mar 24 19:35:05 lts2 kernel: EIP is at journal_start+0x2f/0xa9 [jbd]
>Mar 24 19:35:05 lts2 kernel: EAX: f8baf082 EBX: f70f3ba0 ECX: f7bcbe00 EDX: 00000002
>Mar 24 19:35:05 lts2 kernel: ESI: f7373000 EDI: f582d668 EBP: 00000002 ESP: de556a10
>Mar 24 19:35:05 lts2 kernel:  DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
>Mar 24 19:35:05 lts2 kernel: Process gfs2_quotad (pid: 7291, ti=de556000 task=ed8433b0 task.ti=de556000)
>Mar 24 19:35:05 lts2 kernel: Stack: f70f3ba0 f582d668 f70f3ba0 f582d668 f7bcbe00 f8893302 f582d668 00000000 
>Mar 24 19:35:05 lts2 kernel:        f582d668 00000001 000c4b00 c04a407f f581da18 f7bcbe00 000001ff 000c4b00 
>Mar 24 19:35:05 lts2 kernel:        00000000 c043396f 7fffd000 000001ff 000c4b00 00000000 c046b491 00000000 
>Mar 24 19:35:05 lts2 kernel: Call Trace:
>Mar 24 19:35:05 lts2 kernel:  [<f8893302>] ext3_dirty_inode+0x24/0x6d [ext3]
>Mar 24 19:35:05 lts2 kernel:  [<c04a407f>] __mark_inode_dirty+0x24/0x139
>Mar 24 19:35:05 lts2 kernel:  [<c043396f>] current_fs_time+0x13/0x15
>Mar 24 19:35:05 lts2 kernel:  [<c046b491>] __generic_file_aio_write_nolock+0x346/0x4f0
>Mar 24 19:35:05 lts2 kernel:  [<c040b0be>] sched_clock+0x8/0x18
>Mar 24 19:35:05 lts2 kernel:  [<c0446b5b>] clockevents_program_event+0xf2/0x101
>Mar 24 19:35:05 lts2 kernel:  [<c046b690>] generic_file_aio_write+0x55/0xb3
>Mar 24 19:35:05 lts2 kernel:  [<c044783e>] tick_program_event+0x33/0x52
>Mar 24 19:35:05 lts2 kernel:  [<f888efc4>] ext3_file_write+0x24/0x8f [ext3]
>Mar 24 19:35:05 lts2 kernel:  [<c048ba81>] do_sync_write+0xc7/0x10a
>Mar 24 19:35:05 lts2 kernel:  [<c043fdf9>] autoremove_wake_function+0x0/0x35
>Mar 24 19:35:05 lts2 kernel:  [<c04fde4c>] __next_cpu+0x12/0x21
>Mar 24 19:35:05 lts2 kernel:  [<c0508573>] __percpu_counter_sum+0x37/0x4a
>Mar 24 19:35:05 lts2 kernel:  [<c0444b71>] getnstimeofday+0x30/0xbf
>Mar 24 19:35:05 lts2 kernel:  [<c0454305>] do_acct_process+0x586/0x5ad
>Mar 24 19:35:05 lts2 kernel:  [<c04545a6>] acct_process+0x3b/0x45
>Mar 24 19:35:05 lts2 kernel:  [<c04327e2>] do_exit+0x21c/0x695
>Mar 24 19:35:05 lts2 kernel:  [<c04304cd>] printk+0x1b/0x1f
>Mar 24 19:35:05 lts2 kernel:  [<c0406785>] die+0x21d/0x224
>Mar 24 19:35:05 lts2 kernel:  [<c04069ab>] do_invalid_op+0x0/0x8a
>Mar 24 19:35:05 lts2 kernel:  [<c0406a2c>] do_invalid_op+0x81/0x8a
>Mar 24 19:35:05 lts2 kernel:  [<f8ba13f9>] gfs2_glock_nq+0x109/0x1a4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<c042ff90>] release_console_sem+0x187/0x1a0
>Mar 24 19:35:05 lts2 kernel:  [<c062d66d>] __wait_on_bit+0x50/0x58
>Mar 24 19:35:05 lts2 kernel:  [<c04a7f75>] sync_buffer+0x0/0x33
>Mar 24 19:35:05 lts2 kernel:  [<c04a7f75>] sync_buffer+0x0/0x33
>Mar 24 19:35:05 lts2 kernel:  [<c062d6d8>] out_of_line_wait_on_bit+0x63/0x6b
>Mar 24 19:35:05 lts2 kernel:  [<c043fe2e>] wake_bit_function+0x0/0x3c
>Mar 24 19:35:05 lts2 kernel:  [<c062e7d2>] error_code+0x72/0x78
>Mar 24 19:35:05 lts2 kernel:  [<f8ba13f9>] gfs2_glock_nq+0x109/0x1a4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8bb1782>] gfs2_rindex_hold+0x33/0x18d [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8ba12de>] glock_wait_internal+0x1e5/0x1f7 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8ba1465>] gfs2_glock_nq+0x175/0x1a4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8bb21ab>] gfs2_inplace_reserve_i+0xa2/0x572 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<c062d9ba>] down_read+0x17/0x25
>Mar 24 19:35:05 lts2 kernel:  [<f8ba5ca5>] gfs2_log_reserve+0x106/0x117 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8bb5573>] gfs2_trans_begin+0xda/0x10e [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8baf154>] do_sync+0x2c4/0x5d4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8ba770d>] gfs2_meta_wait+0x24/0x87 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8baea1e>] bh_get+0x189/0x193 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8baef9a>] do_sync+0x10a/0x5d4 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8bafd2a>] gfs2_quota_sync+0x1fe/0x281 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8b99545>] gfs2_quotad+0xb1/0x140 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8b99494>] gfs2_quotad+0x0/0x140 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<f8b99494>] gfs2_quotad+0x0/0x140 [gfs2]
>Mar 24 19:35:05 lts2 kernel:  [<c043fd30>] kthread+0x38/0x60
>Mar 24 19:35:05 lts2 kernel:  [<c043fcf8>] kthread+0x0/0x60
>Mar 24 19:35:05 lts2 kernel:  [<c0405e0b>] kernel_thread_helper+0x7/0x10
>Mar 24 19:35:05 lts2 kernel:  =======================
>Mar 24 19:35:05 lts2 kernel: Code: 56 89 c6 53 bb e2 ff ff ff 83 ec 04 64 a1 00 10 79 c0 8b 80 d8 05 00 00 85 f6 89 04 24 74 7e 85 c0 74 11 89 c3 8b 00 39 30 74 04 <0f> 0b eb fe ff 43 08 eb 69 a1 08 9e 86 f8 ba 50 00 00 00 bb f4 
>Mar 24 19:35:05 lts2 kernel: EIP: [<f8860b01>] journal_start+0x2f/0xa9 [jbd] SS:ESP 0068:de556a10
>Mar 24 19:35:05 lts2 kernel: ---[ end trace fc38f829f18bfa6f ]---
>Mar 24 19:35:05 lts2 kernel: Fixing recursive fault but reboot is needed!

Actions: View

Attachments on bug 437076: 298978