[Eisfair] E1 friert ein wg. Speicherleck
Jürgen Witt
j-witt at web.de
Do Feb 18 15:47:38 CET 2016
Hallo NG,
Am 12.02.2016 um 13:22 schrieb Jürgen Witt:
>
> Auf dem zweiten System (mit CAPI) ist es nach dem einmaligen Einfrieren
> am Montag Abend bisher zu keinen weiteren Vorfällen gekommen. Dort läuft
> weiterhin der aktuelle Kernel 3.2.75. Auch die Meckereien bzgl. der CAPI
> sind in /var/log/messages nicht wieder aufgetaucht.
Gestern Mittag hat sich der zweite Server wieder aufgehängt. Dieser
hatte sich letzten Montag schon einmal aufgehängt, aber hat sich nach
einem Reboot unauffällig verhalten.
Hier ein Auszug aus /var/log/messages kurz vor dem Crash:
Feb 17 12:32:02 server kernel: INFO: rcu_sched detected stall on CPU 2
(t=1636111 jiffies)
Feb 17 12:32:02 server kernel: Pid: 2565, comm: smbd Tainted: P
O 3.2.75-eisfair-1-SMP #1
Feb 17 12:32:02 server kernel: Call Trace:
Feb 17 12:32:02 server kernel: [__rcu_pending+0x64/0x28f]
__rcu_pending+0x64/0x28f
Feb 17 12:32:02 server kernel: [rcu_check_callbacks+0x6d/0x98]
rcu_check_callbacks+0x6d/0x98
Feb 17 12:32:02 server kernel: [update_process_times+0x2d/0x58]
update_process_times+0x2d/0x58
Feb 17 12:32:02 server kernel: [tick_sched_timer+0x13f/0x166]
tick_sched_timer+0x13f/0x166
Feb 17 12:32:03 server kernel: [__run_hrtimer.isra.27+0x3d/0x91]
__run_hrtimer.isra.27+0x3d/0x91
Feb 17 12:32:03 server kernel: [hrtimer_interrupt+0xe2/0x1cb]
hrtimer_interrupt+0xe2/0x1cb
Feb 17 12:32:03 server kernel: [smp_apic_timer_interrupt+0x67/0x7a]
smp_apic_timer_interrupt+0x67/0x7a
Feb 17 12:32:03 server kernel: [apic_timer_interrupt+0x2a/0x30]
apic_timer_interrupt+0x2a/0x30
Feb 17 12:32:03 server kernel: [any_slab_objects+0x15/0x1b] ?
any_slab_objects+0x15/0x1b
Feb 17 12:32:03 server kernel: [_raw_spin_lock+0x16/0x1c] ?
_raw_spin_lock+0x16/0x1c
Feb 17 12:32:03 server kernel: [unix_state_double_lock+0x3d/0x41]
unix_state_double_lock+0x3d/0x41
Feb 17 12:32:03 server kernel: [unix_dgram_connect+0x83/0x153]
unix_dgram_connect+0x83/0x153
Feb 17 12:32:03 server kernel: [sys_connect+0x63/0x88]
sys_connect+0x63/0x88
Feb 17 12:32:03 server kernel: [sys_socketcall+0x76/0x192]
sys_socketcall+0x76/0x192
Feb 17 12:32:03 server kernel: [syscall_after_call+0x0/0x04]
syscall_call+0x7/0x7
Feb 17 12:32:03 server kernel: [mcheck_cpu_init+0x137/0x2d2] ?
mcheck_cpu_init+0x137/0x2d2
Feb 17 12:34:13 server imapd[3605]: imap service init from 192.168.1.42
Feb 17 12:34:13 server imapd[3605]: Authenticated user=nina
host=buero-03.wulksfelde [192.168.1.42] mech=CRAM-MD5
Feb 17 12:35:02 server kernel: INFO: rcu_sched detected stall on CPU 2
(t=1681142 jiffies)
Feb 17 12:35:02 server kernel: Pid: 2565, comm: smbd Tainted: P
O 3.2.75-eisfair-1-SMP #1
Feb 17 12:35:02 server kernel: Call Trace:
Feb 17 12:35:02 server kernel: [__rcu_pending+0x64/0x28f]
__rcu_pending+0x64/0x28f
Feb 17 12:35:03 server kernel: [rcu_check_callbacks+0x6d/0x98]
rcu_check_callbacks+0x6d/0x98
Feb 17 12:35:03 server kernel: [update_process_times+0x2d/0x58]
update_process_times+0x2d/0x58
Feb 17 12:35:03 server kernel: [tick_sched_timer+0x13f/0x166]
tick_sched_timer+0x13f/0x166
Feb 17 12:35:03 server kernel: [__run_hrtimer.isra.27+0x3d/0x91]
__run_hrtimer.isra.27+0x3d/0x91
Feb 17 12:35:03 server kernel: [hrtimer_interrupt+0xe2/0x1cb]
hrtimer_interrupt+0xe2/0x1cb
Feb 17 12:35:03 server kernel: [smp_apic_timer_interrupt+0x67/0x7a]
smp_apic_timer_interrupt+0x67/0x7a
Feb 17 12:35:03 server kernel: [apic_timer_interrupt+0x2a/0x30]
apic_timer_interrupt+0x2a/0x30
Feb 17 12:35:03 server kernel: [any_slab_objects+0x15/0x1b] ?
any_slab_objects+0x15/0x1b
Feb 17 12:35:03 server kernel: [_raw_spin_lock+0x16/0x1c] ?
_raw_spin_lock+0x16/0x1c
Feb 17 12:35:03 server kernel: [unix_state_double_lock+0x3d/0x41]
unix_state_double_lock+0x3d/0x41
Feb 17 12:35:03 server kernel: [unix_dgram_connect+0x83/0x153]
unix_dgram_connect+0x83/0x153
Feb 17 12:35:03 server kernel: [sys_connect+0x63/0x88]
sys_connect+0x63/0x88
Feb 17 12:35:03 server kernel: [sys_socketcall+0x76/0x192]
sys_socketcall+0x76/0x192
Feb 17 12:35:03 server kernel: [syscall_after_call+0x0/0x04]
syscall_call+0x7/0x7
Feb 17 12:35:03 server kernel: [mcheck_cpu_init+0x137/0x2d2] ?
mcheck_cpu_init+0x137/0x2d2
Feb 17 12:35:26 server imapd[3661]: imap service init from 192.168.1.48
Feb 17 12:35:26 server imapd[3661]: Authenticated user=lieferservice
host=XXX [192.168.1.48] mech=CRAM-MD5
Feb 17 12:35:46 server imapd[3662]: imap service init from 192.168.1.48
Feb 17 12:35:46 server imapd[3662]: Authenticated user=lieferservice
host=XXX [192.168.1.48] mech=CRAM-MD5
Feb 17 12:36:47 server kernel: smbd invoked oom-killer: gfp_mask=0xd0,
order=1, oom_adj=0, oom_score_adj=0
Feb 17 12:36:48 server kernel: Pid: 21039, comm: smbd Tainted: P
O 3.2.75-eisfair-1-SMP #1
Feb 17 12:36:48 server kernel: Call Trace:
Feb 17 12:36:48 server kernel: [dump_header.isra.8+0x55/0x156]
dump_header.isra.8+0x55/0x156
Feb 17 12:36:48 server kernel: [___ratelimit+0x93/0xac] ?
___ratelimit+0x93/0xac
Feb 17 12:36:48 server kernel:
[oom_kill_process.constprop.13+0x26/0x1ef]
oom_kill_process.constprop.13+0x26/0x1ef
Feb 17 12:36:48 server kernel: [has_capability_noaudit+0x19/0x25] ?
has_capability_noaudit+0x19/0x25
Feb 17 12:36:48 server kernel: [out_of_memory+0x1f1/0x259]
out_of_memory+0x1f1/0x259
Feb 17 12:36:48 server kernel: [__alloc_pages_nodemask+0x458/0x536]
__alloc_pages_nodemask+0x458/0x536
Feb 17 12:36:48 server kernel: [copy_process.part.44+0x56/0xd05]
copy_process.part.44+0x56/0xd05
Feb 17 12:36:48 server kernel: [do_fork+0x10e/0x287] do_fork+0x10e/0x287
Feb 17 12:36:48 server kernel: [set_current_blocked+0x27/0x38] ?
set_current_blocked+0x27/0x38
Feb 17 12:36:48 server kernel: [copy_to_user+0x23/0x2c] ?
copy_to_user+0x23/0x2c
Feb 17 12:36:48 server kernel: [sys_clone+0x1b/0x20] sys_clone+0x1b/0x20
Feb 17 12:36:48 server kernel: [ptregs_clone+0x15/0x40]
ptregs_clone+0x15/0x40
Feb 17 12:36:48 server kernel: [syscall_after_call+0x0/0x04] ?
syscall_call+0x7/0x7
Feb 17 12:36:48 server kernel: [mcheck_cpu_init+0x1b2/0x2d2] ?
mcheck_cpu_init+0x1b2/0x2d2
Feb 17 12:36:48 server kernel: Mem-Info:
Feb 17 12:36:48 server kernel: DMA per-cpu:
Feb 17 12:36:49 server kernel: CPU 0: hi: 0, btch: 1 usd: 0
Feb 17 12:36:49 server kernel: CPU 1: hi: 0, btch: 1 usd: 0
Feb 17 12:36:49 server kernel: CPU 2: hi: 0, btch: 1 usd: 0
Feb 17 12:36:49 server kernel: CPU 3: hi: 0, btch: 1 usd: 0
Feb 17 12:36:49 server kernel: Normal per-cpu:
Feb 17 12:36:49 server kernel: CPU 0: hi: 186, btch: 31 usd: 0
Feb 17 12:36:49 server kernel: CPU 1: hi: 186, btch: 31 usd: 0
Feb 17 12:36:49 server kernel: CPU 2: hi: 186, btch: 31 usd: 0
Feb 17 12:36:49 server kernel: CPU 3: hi: 186, btch: 31 usd: 30
Feb 17 12:36:49 server kernel: HighMem per-cpu:
Feb 17 12:36:50 server kernel: CPU 0: hi: 186, btch: 31 usd: 0
Feb 17 12:36:50 server kernel: CPU 1: hi: 186, btch: 31 usd: 0
Feb 17 12:36:50 server kernel: CPU 2: hi: 186, btch: 31 usd: 0
Feb 17 12:36:50 server kernel: CPU 3: hi: 186, btch: 31 usd: 0
Feb 17 12:36:50 server kernel: active_anon:36550 inactive_anon:11475
isolated_anon:0
Feb 17 12:36:50 server kernel: active_file:61889 inactive_file:31703
isolated_file:22
Feb 17 12:36:50 server kernel: unevictable:0 dirty:0 writeback:0 unstable:0
Feb 17 12:36:50 server kernel: free:590612 slab_reclaimable:47082
slab_unreclaimable:96211
Feb 17 12:36:50 server kernel: mapped:7404 shmem:32 pagetables:1146
bounce:0
Feb 17 12:36:50 server kernel: DMA free:3528kB min:64kB low:80kB
high:96kB active_anon:0kB inactive_anon:0kB active_file:0kB
inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15748kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
slab_reclaimable:8940kB slab_unreclaimable:1656kB kernel_stack:1736kB
pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0
all_unreclaimable? yes
Feb 17 12:36:50 server kernel: lowmem_reserve[]: 0 863 3477 3477
Feb 17 12:36:50 server kernel: Normal free:230508kB min:3724kB
low:4652kB high:5584kB active_anon:0kB inactive_anon:0kB
active_file:392kB inactive_file:244kB unevictable:0kB isolated(anon):0kB
isolated(file):88kB present:883896kB mlocked:0kB dirty:40kB
writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:179388kB
slab_unreclaimable:383188kB kernel_stack:49656kB pagetables:4584kB
unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:7087
all_unreclaimable? yes
Feb 17 12:36:50 server kernel: lowmem_reserve[]: 0 0 20912 20912
Feb 17 12:36:50 server kernel: HighMem free:2128412kB min:512kB
low:3332kB high:6152kB active_anon:146200kB inactive_anon:45900kB
active_file:247164kB inactive_file:126568kB unevictable:0kB
isolated(anon):0kB isolated(file):0kB present:2676780kB mlocked:0kB
dirty:0kB writeback:0kB mapped:29612kB shmem:128kB slab_reclaimable:0kB
slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB
bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Feb 17 12:36:50 server kernel: lowmem_reserve[]: 0 0 0 0
Feb 17 12:36:50 server kernel: DMA: 2*4kB 106*8kB 1*16kB 3*32kB 4*64kB
6*128kB 2*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 3528kB
Feb 17 12:36:50 server kernel: Normal: 57374*4kB 22*8kB 2*16kB 4*32kB
3*64kB 0*128kB 2*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 230536kB
Feb 17 12:36:50 server kernel: HighMem: 4296*4kB 25238*8kB 20305*16kB
14739*32kB 8656*64kB 3192*128kB 557*256kB 15*512kB 0*1024kB 0*2048kB
0*4096kB = 2128448kB
Feb 17 12:36:50 server kernel: 93846 total pagecache pages
Feb 17 12:36:50 server kernel: 148 pages in swap cache
Feb 17 12:36:50 server kernel: Swap cache stats: add 648, delete 500,
find 124/160
Feb 17 12:36:50 server kernel: Free swap = 528920kB
Feb 17 12:36:50 server kernel: Total swap = 530044kB
Feb 17 12:36:51 server kernel: imapd
Feb 17 12:36:51 server kernel: [24059] 2007 24059 1751 733 0
0 0 imapd
Feb 17 12:36:51 server kernel: [24061] 2188 24061 1561 510 0
0 0 imapd
Feb 17 12:36:51 server kernel: [25941] 2017 25941 1689 658 0
0 0 imapd
Feb 17 12:36:51 server kernel: [25952] 0 25952 24531 5140 0
0 0 smbd
Feb 17 12:36:51 server kernel: [26055] 2102 26055 22479 5154 0
0 0 smbd
Feb 17 12:36:51 server kernel: [26058] 2086 26058 1614 575 0
0 0 imapd
Feb 17 12:36:51 server kernel: [26059] 2029 26059 1561 524 1
0 0 imapd
Feb 17 12:36:51 server kernel: [26060] 2025 26060 1561 530 1
0 0 imapd
Feb 17 12:36:51 server kernel: [26061] 2216 26061 1560 508 1
0 0 imapd
Feb 17 12:36:51 server kernel: [26077] 2086 26077 1540 507 0
0 0 imapd
Feb 17 12:36:51 server kernel: [26131] 2017 26131 1540 461 0
0 0 imapd
Feb 17 12:36:51 server kernel: [26170] 2017 26170 1540 460 0
0 0 imapd
Feb 17 12:36:51 server kernel: [26175] 2179 26175 1609 599 0
0 0 imapd
Feb 17 12:36:51 server kernel: [26176] 2102 26176 1565 568 3
0 0 imapd
Feb 17 12:36:51 server kernel: [26178] 2086 26178 1540 461 0
0 0 imapd
Feb 17 12:36:51 server kernel: [26185] 2017 26185 1573 460 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26342] 2210 26342 1573 461 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26347] 2028 26347 1540 461 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26348] 2028 26348 1540 461 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26352] 2017 26352 1540 460 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26394] 2130 26394 1562 510 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26395] 2029 26395 1562 531 1
0 0 imapd
Feb 17 12:36:52 server kernel: [26396] 2025 26396 1561 559 3
0 0 imapd
Feb 17 12:36:52 server kernel: [26397] 2024 26397 1560 509 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26398] 2216 26398 1560 508 1
0 0 imapd
Feb 17 12:36:52 server kernel: [26399] 2130 26399 1540 461 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26452] 2130 26452 1540 461 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26454] 2073 26454 1627 563 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26562] 2129 26562 1563 527 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26736] 2028 26736 1562 497 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26738] 2102 26738 1540 461 1
0 0 imapd
Feb 17 12:36:52 server kernel: [26772] 2210 26772 1540 491 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26781] 2074 26781 1540 492 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26795] 2102 26795 1540 516 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26890] 30 26890 20939 4590 1
0 0 httpd
Feb 17 12:36:52 server kernel: [26896] 2172 26896 1573 519 0
0 0 imapd
Feb 17 12:36:52 server kernel: [26949] 2074 26949 1573 461 0
0 0 imapd
Feb 17 12:36:52 server kernel: [27328] 0 27328 16356 4970 0
0 0 smbd
Feb 17 12:36:52 server kernel: [29578] 30 29578 21285 5187 0
0 0 httpd
Feb 17 12:36:52 server kernel: [29651] 0 29651 16278 4721 0
0 0 smbd
Feb 17 12:36:52 server kernel: [29702] 30 29702 19998 4157 0
0 0 httpd
Feb 17 12:36:52 server kernel: [29935] 0 29935 16243 3725 3
0 0 smbd
Feb 17 12:36:53 server kernel: [30217] 2086 30217 1540 511 0
0 0 imapd
Feb 17 12:36:53 server kernel: [30259] 2075 30259 1573 526 0
0 0 imapd
Feb 17 12:36:53 server kernel: [30273] 2028 30273 1592 525 1
0 0 imapd
Feb 17 12:36:53 server kernel: [32364] 30 32364 21281 4963 0
0 0 httpd
Feb 17 12:36:53 server kernel: [32621] 0 32621 16193 2227 0
0 0 smbd
Feb 17 12:36:53 server kernel: [32627] 2198 32627 1573 525 0
0 0 imapd
Feb 17 12:36:53 server kernel: [32631] 0 32631 16373 4570 0
0 0 smbd
Feb 17 12:36:53 server kernel: [32717] 2086 32717 1573 527 0
0 0 imapd
Feb 17 12:36:53 server kernel: [ 301] 2019 301 1569 520 0
0 0 imapd
Feb 17 12:36:53 server kernel: [ 477] 30 477 21281 5001 1
0 0 httpd
Feb 17 12:36:54 server kernel: [ 528] 30 528 19994 3953 0
0 0 httpd
Feb 17 12:36:54 server kernel: [ 643] 2129 643 1776 659 0
0 0 imapd
Feb 17 12:36:54 server kernel: [ 656] 2019 656 1540 461 0
0 0 imapd
Feb 17 12:36:55 server kernel: [ 701] 65534 701 16196 2304 1
0 0 smbd
Feb 17 12:36:55 server kernel: [ 71 0 0 imapd
Feb 17 12:36:56 server kernel: [23804] 2025 23804 1562 515 1
0 0 imapd
Feb 17 12:36:56 server kernel: [23805] 2024 23805 1560 508 0
0 0 imapd
Feb 17 12:36:57 server kernel: [23806] 2172 23806 1701 627 0
0 0 imapd
Feb 17 12:36:57 server kernel: [23807] 2216 23807 1560 507 0
0 0 imapd
Feb 17 12:36:58 server kernel: [23903] 0 23903 22433 4794 0
0 0 smbd
Feb 17 12:36:58 server kernel: [23945] 2198 23945 1774 742 0
0 0 imapd
Feb 17 12:36:58 server kernel: [23946] 2028 23946 1596 579 0
0 0 imapd
Feb 17 12:36:59 server kernel: [24058] 2210 24058 1782 737 0
0 0 imapd
Feb 17 12:36:59 server kernel: [24059] 2007 24059 1751 733 0
0 0 imapd
Feb 17 12:37:00 server kernel: [24061] 2188 24061 1561 510 0
0 0 imapd
Feb 17 12:37:00 server kernel: [25941] 2017 25941 1689 658 0
0 0 imapd
Feb 17 12:37:00 server kernel: [25952] 0 25952 24531 5140 0
0 0 smbd
Feb 17 12:37:00 server kernel: [26055] 2102 26055 22479 5154 0
0 0 smbd
Feb 17 12:37:01 server kernel: [26058] 2086 26058 1614 575 0
0 0 imapd
Feb 17 12:37:01 server kernel: [26059] 2029 26059 1561 524 1
0 0 imapd
Feb 17 12:37:01 server kernel: [26060] 2025 26060 1561 530 1
0 0 imapd
Feb 17 12:37:02 server kernel: [26061] 2216 26061 1560 508 1
0 0 imapd
Feb 17 12:37:02 server kernel: [26077] 2086 26077 1540 507 0
0 0 imapd
Feb 17 12:37:03 server kernel: [26131] 2017 26131 1540 461 0
0 0 imapd
Feb 17 12:37:04 server kernel: [26170] 2017 26170 1540 460 0
0 0 imapd
Feb 17 12:37:04 server kernel: [26175] 2179 26175 1609 599 0
0 0 imapd
Feb 17 12:37:04 server kernel: [26176] 2102 26176 1565 568 3
0 0 imapd
Feb 17 12:37:04 server kernel: [26178] 2086 26178 1540 461 0
0 0 imapd
Feb 17 12:37:05 server kernel: [26185] 2017 26185 1573 460 0
0 0 imapd
Feb 17 12:37:05 server kernel: [26342] 2210 26342 1573 461 0
0 0 imapd
Feb 17 12:37:06 server kernel: [26347] 2028 26347 1540 461 0
0 0 imapd
Feb 17 12:37:06 server kernel: [26348] 2028 26348 1540 461 0
0 0 imapd
Feb 17 12:37:07 server kernel: [26352] 2017 26352 1540 460 0
0 0 imapd
Feb 17 12:37:07 server kernel: [26394] 2130 26394 1562 510 0
0 0 imapd
Feb 17 12:37:08 server kernel: [26395] 2029 26395 1562 531 1
0 0 imapd
Feb 17 12:37:08 server kernel: [26396] 2025 26396 1561 559 3
0 0 imapd
Feb 17 12:37:10 server kernel: [26397] 2024 26397 1560 509 0
0 0 imapd
Feb 17 12:37:10 server kernel: [26398] 2216 26398 1560 508 1
0 0 imapd
Feb 17 12:37:11 server kernel: [26399] 2130 26399 1540 461 0
0 0 imapd
Feb 17 12:37:11 server kernel: [26452] 2130 26452 1540 461 0
0 0 imapd
Sollte ich hier auch den von Tom bereit gestellten Testkernel
installieren, oder liegt hier ein anderes Problem vor? Sind noch weitere
Information erforderlich?
Danke und Gruß
Jürgen
Mehr Informationen über die Mailingliste Eisfair