Description of problem: Since the yum upgrade from Fedora 14 to 15, auto-mounted directories occasionally produce problems when they get remounted. Version-Release number of selected component (if applicable): kernel-2.6.38.8-35.fc15.x86_64 autofs-5.0.5-38.fc15.x86_64 How reproducible: Infrequently Steps to Reproduce: 1. Access an auto-mounted directory at /net/hostname. Actual results: cd: /net/hostname/directory: No such file or directory Expected results: The directory should be mounted. Additional info: The NFS server is a large NAS with an old Linux kernel (2.6.18-53.1.14-i686). I've seen suggestions to use /usr/sbin/nfsidmap in /etc/request-key.conf but unfortunately I'm not familiar with configuring the kernel and don't know how to select NFS_USE_NEW_IDMAPPER. The kernel stack trace indicates the lack of memory but there seems to be plenty of memory available (8GB RAM; 2GB swap). Aug 3 02:15:02 photo1 kernel: [303079.933543] mount.nfs: page allocation failure. order:4, mode:0xc0d0 Aug 3 02:15:02 photo1 kernel: [303079.933547] Pid: 29043, comm: mount.nfs Not tainted 2.6.38.8-35.fc15.x86_64 #1 Aug 3 02:15:02 photo1 kernel: [303079.933549] Call Trace: Aug 3 02:15:02 photo1 kernel: [303079.933562] [<ffffffff810df12e>] __alloc_pages_nodemask+0x6f5/0x77f Aug 3 02:15:02 photo1 kernel: [303079.933568] [<ffffffff81108755>] alloc_pages_current+0xbe/0xd8 Aug 3 02:15:02 photo1 kernel: [303079.933590] [<ffffffffa024777e>] ? nfs_create_rpc_client+0xa8/0xee [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933594] [<ffffffff810dbbf2>] __get_free_pages+0xe/0x4a Aug 3 02:15:02 photo1 kernel: [303079.933597] [<ffffffff8110fa4c>] kmalloc_order_trace+0x2c/0x5e Aug 3 02:15:02 photo1 kernel: [303079.933615] [<ffffffffa0271d44>] nfs_idmap_new+0x32/0xed [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933623] [<ffffffffa02484e4>] nfs4_set_client+0xee/0x267 [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933631] [<ffffffffa0248e4e>] nfs4_create_server+0xef/0x210 [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933640] [<ffffffffa0251977>] nfs4_remote_mount+0x75/0x1f1 [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933645] [<ffffffff81123404>] vfs_kern_mount+0xaa/0x1f6 Aug 3 02:15:02 photo1 kernel: [303079.933655] [<ffffffffa0251d65>] nfs_do_root_mount+0x7b/0x9a [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933664] [<ffffffffa0252126>] nfs4_try_mount+0x5b/0xb2 [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933674] [<ffffffffa02530b1>] nfs_get_sb+0x4e5/0x742 [nfs] Aug 3 02:15:02 photo1 kernel: [303079.933677] [<ffffffff8112342f>] vfs_kern_mount+0xd5/0x1f6 Aug 3 02:15:02 photo1 kernel: [303079.933680] [<ffffffff811235b8>] do_kern_mount+0x4d/0xdf Aug 3 02:15:02 photo1 kernel: [303079.933684] [<ffffffff81139c3a>] do_mount+0x6a2/0x6f6 Aug 3 02:15:02 photo1 kernel: [303079.933686] [<ffffffff811394fd>] ? copy_mount_options+0xcb/0x12e Aug 3 02:15:02 photo1 kernel: [303079.933689] [<ffffffff81139f10>] sys_mount+0x88/0xc2 Aug 3 02:15:02 photo1 kernel: [303079.933693] [<ffffffff81009bc2>] system_call_fastpath+0x16/0x1b Aug 3 02:15:02 photo1 kernel: [303079.933695] Mem-Info: Aug 3 02:15:02 photo1 kernel: [303079.933696] Node 0 DMA per-cpu: Aug 3 02:15:02 photo1 kernel: [303079.933699] CPU 0: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933701] CPU 1: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933703] CPU 2: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933705] CPU 3: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933706] CPU 4: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933708] CPU 5: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933710] CPU 6: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933712] CPU 7: hi: 0, btch: 1 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933713] Node 0 DMA32 per-cpu: Aug 3 02:15:02 photo1 kernel: [303079.933715] CPU 0: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933717] CPU 1: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933719] CPU 2: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933721] CPU 3: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933723] CPU 4: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933724] CPU 5: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933726] CPU 6: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933728] CPU 7: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933729] Node 0 Normal per-cpu: Aug 3 02:15:02 photo1 kernel: [303079.933732] CPU 0: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933733] CPU 1: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933735] CPU 2: hi: 186, btch: 31 usd: 21 Aug 3 02:15:02 photo1 kernel: [303079.933737] CPU 3: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933739] CPU 4: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933741] CPU 5: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933743] CPU 6: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933744] CPU 7: hi: 186, btch: 31 usd: 0 Aug 3 02:15:02 photo1 kernel: [303079.933749] active_anon:606436 inactive_anon:108771 isolated_anon:0 Aug 3 02:15:02 photo1 kernel: [303079.933750] active_file:257218 inactive_file:258293 isolated_file:0 Aug 3 02:15:02 photo1 kernel: [303079.933751] unevictable:0 dirty:37 writeback:0 unstable:0 Aug 3 02:15:02 photo1 kernel: [303079.933752] free:131269 slab_reclaimable:625667 slab_unreclaimable:6091 Aug 3 02:15:02 photo1 kernel: [303079.933753] mapped:5692 shmem:1575 pagetables:7989 bounce:0 Aug 3 02:15:02 photo1 kernel: [303079.933755] Node 0 DMA free:15852kB min:128kB low:160kB high:192kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15676kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Aug 3 02:15:02 photo1 kernel: [303079.933764] lowmem_reserve[]: 0 3255 8053 8053 Aug 3 02:15:02 photo1 kernel: [303079.933767] Node 0 DMA32 free:377096kB min:27268kB low:34084kB high:40900kB active_anon:493324kB inactive_anon:112932kB active_file:124116kB inactive_file:124208kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3333728kB mlocked:0kB dirty:0kB writeback:0kB mapped:3224kB shmem:1776kB slab_reclaimable:2076664kB slab_unreclaimable:1412kB kernel_stack:168kB pagetables:1144kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Aug 3 02:15:02 photo1 kernel: [303079.933777] lowmem_reserve[]: 0 0 4797 4797 Aug 3 02:15:02 photo1 kernel: [303079.933780] Node 0 Normal free:132128kB min:40184kB low:50228kB high:60276kB active_anon:1932420kB inactive_anon:322152kB active_file:904756kB inactive_file:908964kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:4912640kB mlocked:0kB dirty:148kB writeback:0kB mapped:19544kB shmem:4524kB slab_reclaimable:426004kB slab_unreclaimable:22936kB kernel_stack:3472kB pagetables:30812kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Aug 3 02:15:02 photo1 kernel: [303079.933790] lowmem_reserve[]: 0 0 0 0 Aug 3 02:15:02 photo1 kernel: [303079.933793] Node 0 DMA: 1*4kB 1*8kB 0*16kB 1*32kB 1*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15852kB Aug 3 02:15:02 photo1 kernel: [303079.933801] Node 0 DMA32: 15714*4kB 12520*8kB 12972*16kB 183*32kB 10*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 377064kB Aug 3 02:15:02 photo1 kernel: [303079.933808] Node 0 Normal: 33212*4kB 18*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 133008kB Aug 3 02:15:02 photo1 kernel: [303079.933816] 519896 total pagecache pages Aug 3 02:15:02 photo1 kernel: [303079.933818] 2780 pages in swap cache Aug 3 02:15:02 photo1 kernel: [303079.933819] Swap cache stats: add 70758, delete 67978, find 23957/25003 Aug 3 02:15:02 photo1 kernel: [303079.933821] Free swap = 1860444kB Aug 3 02:15:02 photo1 kernel: [303079.933822] Total swap = 2096476kB Aug 3 02:15:02 photo1 kernel: [303079.977534] 2097136 pages RAM Aug 3 02:15:02 photo1 kernel: [303079.977538] 48755 pages reserved Aug 3 02:15:02 photo1 kernel: [303079.977542] 463242 pages shared Aug 3 02:15:02 photo1 kernel: [303079.977545] 1478287 pages non-shared
even though you have memory free, the problem is that it can't find _contiguous_ memory free. The 'order: 4' part is key here. That means it was trying to do an allocation of 64K Looks like an f15 variant of bug 593035, which has been around for over a year against f14 (2.6.35).
http://permalink.gmane.org/gmane.linux.nfs/41686 suggests turning on CONFIG_NFS_USE_NEW_IDMAPPER Steve, is that stable enough for us to do in f14 & f15 ?
*** This bug has been marked as a duplicate of bug 593035 ***