[Eisfair] E1 friert ein wg. Speicherleck

Jürgen Witt j-witt at web.de
Mo Feb 8 14:29:49 CET 2016


Hallo NG,

ich habe auf einem E1 gestern das Update auf den aktuellen Kernel
installiert. Seit heute morgen ist der Server schon 3x komplett
eingefroren. D.h. selbst am Server selber konnte ich mich nicht mehr
anmelden.

Der Server ist gerade wieder eingefroren, während ich mir die
Informationen aus /var/log/messages kopierte.

Hier ein Auszug aus /var/log/messages - leider sehr lang.

Feb  8 13:03:05 eis kernel: lowmem_reserve[]: 0 865 2999 2999
Feb  8 13:03:05 eis kernel: Normal free:13128kB min:3728kB low:4660kB
high:5592kB active_anon:0kB inactive_anon:0kB active_file:336kB
 inactive_file:488kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:885944kB mlocked:0kB dirty:32kB writeback:8kB
mapp
ed:4kB shmem:0kB slab_reclaimable:16908kB slab_unreclaimable:397520kB
kernel_stack:423032kB pagetables:2296kB unstable:0kB bounce:0kB
 writeback_tmp:0kB pages_scanned:3285 all_unreclaimable? yes
Feb  8 13:03:05 eis kernel: lowmem_reserve[]: 0 0 17078 17078
Feb  8 13:03:05 eis kernel: HighMem free:1666716kB min:512kB low:2812kB
high:5112kB active_anon:320652kB inactive_anon:80248kB active
_file:49668kB inactive_file:82736kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:2185992kB mlocked:0kB dirty:36kB wr
iteback:0kB mapped:27468kB shmem:376kB slab_reclaimable:0kB
slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounc
e:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Feb  8 13:03:05 eis kernel: lowmem_reserve[]: 0 0 0 0
Feb  8 13:03:05 eis kernel: DMA: 5*4kB 1*8kB 1*16kB 1*32kB 0*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3532kB
Feb  8 13:03:05 eis kernel: Normal: 2858*4kB 109*8kB 1*16kB 1*32kB
1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 13184k
B
Feb  8 13:03:05 eis kernel: HighMem: 2551*4kB 1162*8kB 489*16kB 227*32kB
146*64kB 56*128kB 35*256kB 16*512kB 7*1024kB 5*2048kB 386*40
96kB = 1666716kB
Feb  8 13:03:05 eis kernel: 33381 total pagecache pages
Feb  8 13:03:05 eis kernel: 0 pages in swap cache
Feb  8 13:03:05 eis kernel: Swap cache stats: add 0, delete 0, find 0/0
Feb  8 13:03:05 eis kernel: Free swap  = 4192188kB
Feb  8 13:03:05 eis kernel: Total swap = 4192188kB
Feb  8 13:03:05 eis kernel: 778112 pages RAM
Feb  8 13:03:05 eis kernel: 550802 pages HighMem
Feb  8 13:03:05 eis kernel: 7592 pages reserved
Feb  8 13:03:05 eis kernel: 76528 pages shared
Feb  8 13:03:05 eis kernel: 281691 pages non-shared
Feb  8 13:03:05 eis kernel: [ pid ]   uid  tgid total_vm      rss cpu
oom_adj oom_score_adj name
Feb  8 13:03:05 eis kernel: [ 1805]     0  1805      520      147   0
    0             0 syslogd
Feb  8 13:03:06 eis kernel: [ 1818]     0  1818      853      504   0
    0             0 klogd
Feb  8 13:03:06 eis kernel: [ 1862]     0  1862      992      218   0
    0             0 rpcbind
Feb  8 13:03:06 eis kernel: [ 1873]     0  1873      688       93   0
    0             0 rpc.idmapd
Feb  8 13:03:06 eis kernel: [ 1883]     0  1883     1327      482   0
    0             0 rpc.mountd
Feb  8 13:03:06 eis kernel: [ 1892] 65534  1892     1057      332   1
    0             0 rpc.statd
Feb  8 13:03:06 eis kernel: [ 1959]     0  1959      716      221   0
    0             0 xinetd
Feb  8 13:03:06 eis kernel: [ 1967]     0  1967     1460      247   0
  -17         -1000 sshd
Feb  8 13:03:06 eis kernel: [ 1975]     0  1975      632       89   0
    0             0 atd
Feb  8 13:03:06 eis kernel: [ 1983]     0  1983      836      178   0
    0             0 fcron
Feb  8 13:03:06 eis kernel: [ 2097]     0  2097      517      144   0
    0             0 pptpd
Feb  8 13:03:06 eis kernel: [ 2254]     0  2254     1182      696   0
    0             0 brute_force_blo
Feb  8 13:03:06 eis kernel: [ 2726]     0  2726    19738     4569   0
    0             0 httpd
Feb  8 13:03:06 eis kernel: [ 2758]     0  2758     2373      297   0
    0             0 exim
Feb  8 13:03:06 eis kernel: [ 2761]    30  2761    19780     4148   0
    0             0 httpd
Feb  8 13:03:06 eis kernel: [ 2762]    30  2762    21027     4586   1
    0             0 httpd
Feb  8 13:03:06 eis kernel: [ 2763]    30  2763    21084     4680   0
    0             0 httpd
Feb  8 13:03:06 eis kernel: [ 2764]    30  2764    19745     4052   1
    0             0 httpd
Feb  8 13:03:06 eis kernel: [ 2765]    30  2765    19980     4336   1
    0             0 httpd
Feb  8 13:03:06 eis kernel: [ 2871]     0  2871     3717      567   0
    0             0 nmbd
Feb  8 13:03:06 eis kernel: [ 2873]     0  2873     5989     1147   0
    0             0 smbd
Feb  8 13:03:06 eis kernel: [ 2892]     0  2892    14283      590   0
    0             0 smbd
Feb  8 13:03:06 eis kernel: [ 2897]     0  2897      687      214   0
    0             0 mdadm
Feb  8 13:03:06 eis kernel: [ 2919]     0  2919     6500      592   0
    0             0 smbd
Feb  8 13:03:06 eis kernel: [ 3170]     0  3170      884      191   0
    0             0 smartd
Feb  8 13:03:06 eis kernel: [ 3339]     0  3339     1271      195   1
    0             0 mini_httpd
Feb  8 13:03:06 eis kernel: [ 3361]     0  3361     9369      254   0
    0             0 apcupsd
Feb  8 13:03:07 eis kernel: [ 3401]     0  3401     1134      202   1
    0             0 mingetty
Feb  8 13:03:07 eis kernel: [ 3402]     0  3402     1134      202   0
    0             0 mingetty
Feb  8 13:03:07 eis kernel: [ 3403]     0  3403     1134      202   1
    0             0 mingetty
Feb  8 13:03:07 eis kernel: [ 4143]     0  4143     3696      929   1
    0             0 login
Feb  8 13:03:07 eis kernel: [ 4357]     0  4357     1742      443   0
    0             0 bash
Feb  8 13:03:07 eis kernel: [ 4808]     0  4808     8660     1716   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7287]     0  7287     8570     1629   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7719]     0  7719    10514     1539   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [16027]    30 16027    19745     4051   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [16233]    30 16233    21021     4579   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [18232]    30 18232    19738     3686   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [18233]    30 18233    19738     3686   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [18234]    30 18234    19738     3686   0
    0             0 httpd
Feb  8 13:03:07 eis kernel: [ 2611]     0  2611     8440     1469   1
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 2613]     0  2613      573      188   0
    0             0 pptpctrl
Feb  8 13:03:07 eis kernel: [ 2614]     0  2614      692      314   0
    0             0 pppd
Feb  8 13:03:07 eis kernel: [ 5358]  2003  5358     6051     1218   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 6364]  2003  6364     6051     1218   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7619]  2003  7619     6051     1219   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 8820]  2003  8820     6051     1216   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [10016]  2003 10016     6051     1218   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [10814]     0 10814     6048     1247   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [20906]     0 20906      573      188   0
    0             0 pptpctrl
Feb  8 13:03:07 eis kernel: [20907]     0 20907      692      312   0
    0             0 pppd
Feb  8 13:03:07 eis kernel: [24124]     0 24124   258494    89233   0
    0             0 java
Feb  8 13:03:07 eis kernel: [  493]     0   493     6115     1280   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 4614]     0  4614     6088     1317   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7623]     0  7623      573      186   0
    0             0 pptpctrl
Feb  8 13:03:08 eis kernel: [ 7624]     0  7624      692      312   0
    0             0 pppd
Feb  8 13:03:08 eis kernel: [10502]  2003 10502     6716     1507   0
    0             0 smbd
Feb  8 13:03:08 eis kernel: [11898]     0 11898     4595     1337   0
    0             0 sshd
Feb  8 13:03:08 eis kernel: [12109]     0 12109     1742      442   0
    0             0 bash
Feb  8 13:03:08 eis kernel: [12142]     0 12142     1697      360   0
    0             0 top
Feb  8 13:03:08 eis kernel: [13141]  2003 13141     6146     1263   0
    0             0 smbd
Feb  8 13:03:08 eis kernel: [15742]     0 15742     6631     1361   0
    0             0 smbd
Feb  8 13:03:08 eis kernel: [21199]     0 21199      573      187   0
    0             0 pptpctrl
Feb  8 13:03:08 eis kernel: [21200]     0 21200      692      314   0
    0             0 pppd
Feb  8 13:03:08 eis kernel: [22454]     0 22454      573      186   0
    0             0 pptpctrl
Feb  8 13:03:08 eis kernel: [22455]     0 22455      692      312   0
    0             0 pppd
Feb  8 13:03:08 eis kernel: [25451]     0 25451      827      271   0
    0             0 grep
Feb  8 13:03:08 eis kernel: [25452]     0 25452      827      270   0
    0             0 grep
Feb  8 13:03:08 eis kernel: [25453]     0 25453      528      134   0
    0             0 sed
Feb  8 13:03:08 eis kernel: [25454]     0 25454      827      270   0
    0             0 grep
Feb  8 13:03:08 eis kernel: [25455]     0 25455      528      133   0
    0             0 sed
Feb  8 13:03:08 eis kernel: [25456]     0 25456      528      134   0
    0             0 sed
Feb  8 13:03:08 eis kernel: [25457]     0 25457      655      207   0
    0             0 in.grep
Feb  8 13:03:08 eis kernel: Out of memory: Kill process 24124 (java)
score 48 or sacrifice child
Feb  8 13:03:08 eis kernel: Killed process 24124 (java)
total-vm:1033976kB, anon-rss:345804kB, file-rss:11128kB
Feb  8 13:03:13 eis kernel: INFO: rcu_sched detected stall on CPU 1
(t=690450 jiffies)
Feb  8 13:03:13 eis kernel: Pid: 2611, comm: smbd Not tainted
3.2.75-eisfair-1-SMP #1
Feb  8 13:03:13 eis kernel: Call Trace:
Feb  8 13:03:13 eis kernel:  [__rcu_pending+0x64/0x28f]
__rcu_pending+0x64/0x28f
Feb  8 13:03:13 eis kernel:  [rcu_check_callbacks+0x6d/0x98]
rcu_check_callbacks+0x6d/0x98
Feb  8 13:03:13 eis kernel:  [update_process_times+0x2d/0x58]
update_process_times+0x2d/0x58
Feb  8 13:03:13 eis kernel:  [tick_sched_timer+0x13f/0x166]
tick_sched_timer+0x13f/0x166
Feb  8 13:03:13 eis kernel:  [__run_hrtimer.isra.27+0x3d/0x91]
__run_hrtimer.isra.27+0x3d/0x91
Feb  8 13:03:14 eis kernel:  [hrtimer_interrupt+0xe2/0x1cb]
hrtimer_interrupt+0xe2/0x1cb
Feb  8 13:03:14 eis kernel:  [smp_apic_timer_interrupt+0x67/0x7a]
smp_apic_timer_interrupt+0x67/0x7a
Feb  8 13:03:14 eis kernel:  [apic_timer_interrupt+0x2a/0x30]
apic_timer_interrupt+0x2a/0x30
Feb  8 13:03:14 eis kernel:  [ipv6:_raw_spin_lock+0x14/0x80] ?
_raw_spin_lock+0x14/0x1c
Feb  8 13:03:14 eis kernel:  [unix_state_double_lock+0x3d/0x41]
unix_state_double_lock+0x3d/0x41
Feb  8 13:03:14 eis kernel:  [unix_dgram_connect+0x83/0x153]
unix_dgram_connect+0x83/0x153
Feb  8 13:03:14 eis kernel:  [sys_connect+0x63/0x88] sys_connect+0x63/0x88
Feb  8 13:03:14 eis kernel:  [syscall_after_call+0x0/0x04]
syscall_call+0x7/0x7
Feb  8 13:04:34 eis kernel: kworker/u:6 invoked oom-killer:
gfp_mask=0xd0, order=1, oom_adj=0, oom_score_adj=0
Feb  8 13:04:35 eis kernel: Pid: 1245, comm: kworker/u:6 Not tainted
3.2.75-eisfair-1-SMP #1
Feb  8 13:04:35 eis kernel: Call Trace:
Feb  8 13:04:36 eis kernel:  [dump_header.isra.8+0x55/0x156]
dump_header.isra.8+0x55/0x156
Feb  8 13:04:36 eis kernel:  [___ratelimit+0x93/0xac] ?
___ratelimit+0x93/0xac
Feb  8 13:04:36 eis kernel:  [oom_kill_process.constprop.13+0x26/0x1ef]
oom_kill_process.constprop.13+0x26/0x1ef
Feb  8 13:04:36 eis kernel:  [has_capability_noaudit+0x19/0x25] ?
has_capability_noaudit+0x19/0x25
Feb  8 13:04:36 eis kernel:  [out_of_memory+0x1f1/0x259]
out_of_memory+0x1f1/0x259
Feb  8 13:04:36 eis kernel:  [ipv6:__alloc_pages_nodemask+0x458/0x2f11]
__alloc_pages_nodemask+0x458/0x536
Feb  8 13:04:36 eis kernel:  [copy_process.part.44+0x56/0xd05]
copy_process.part.44+0x56/0xd05
Feb  8 13:04:36 eis kernel:  [do_fork+0x10e/0x287] do_fork+0x10e/0x287
Feb  8 13:04:39 eis kernel:  [wait_for_helper+0x0/0x85] ?
umh_complete+0x1c/0x1c
Feb  8 13:04:39 eis kernel:  [kernel_thread+0x6e/0x76]
kernel_thread+0x6e/0x76
Feb  8 13:04:39 eis kernel:  [wait_for_helper+0x0/0x85] ?
umh_complete+0x1c/0x1c
Feb  8 13:04:39 eis kernel:  [kernel_thread_helper+0x0/0x0d] ?
common_interrupt+0x30/0x30
Feb  8 13:04:39 eis kernel:  [__call_usermodehelper+0x28/0x66]
__call_usermodehelper+0x28/0x66
Feb  8 13:04:39 eis kernel:  [process_one_work+0x165/0x26b]
process_one_work+0x165/0x26b
Feb  8 13:04:39 eis kernel:  [worker_thread+0x12d/0x1ee]
worker_thread+0x12d/0x1ee
Feb  8 13:04:39 eis kernel:  [worker_thread+0x0/0x1ee] ?
process_scheduled_works+0x21/0x21
Feb  8 13:04:39 eis kernel:  [kthread+0x63/0x68] kthread+0x63/0x68
Feb  8 13:04:39 eis kernel:  [kthread+0x0/0x68] ?
kthread_worker_fn+0x107/0x107
Feb  8 13:04:39 eis kernel:  [kernel_thread_helper+0x6/0x0d]
kernel_thread_helper+0x6/0xd
Feb  8 13:04:40 eis kernel: Mem-Info:
Feb  8 13:04:40 eis kernel: DMA per-cpu:
Feb  8 13:04:40 eis kernel: CPU    0: hi:    0, btch:   1 usd:   0
Feb  8 13:04:40 eis kernel: CPU    1: hi:    0, btch:   1 usd:   0
Feb  8 13:04:40 eis kernel: Normal per-cpu:
Feb  8 13:04:40 eis kernel: CPU    0: hi:  186, btch:  31 usd:   0
Feb  8 13:04:40 eis kernel: CPU    1: hi:  186, btch:  31 usd:   0
Feb  8 13:04:40 eis kernel: HighMem per-cpu:
Feb  8 13:04:41 eis kernel: CPU    0: hi:  186, btch:  31 usd:   0
Feb  8 13:04:41 eis kernel: CPU    1: hi:  186, btch:  31 usd:   0
Feb  8 13:04:41 eis kernel: active_anon:1720 inactive_anon:10923
isolated_anon:0
Feb  8 13:04:41 eis kernel:  active_file:13252 inactive_file:19978
isolated_file:32
Feb  8 13:04:41 eis kernel:  unevictable:0 dirty:5 writeback:5 unstable:0
Feb  8 13:04:41 eis kernel:  free:508208 slab_reclaimable:4235
slab_unreclaimable:101164
Feb  8 13:04:41 eis kernel:  mapped:4222 shmem:94 pagetables:428 bounce:0
Feb  8 13:04:41 eis kernel: DMA free:3532kB min:64kB low:80kB high:96kB
active_anon:0kB inactive_anon:0kB active_file:0kB inactive_fi
le:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15800kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
 slab_reclaimable:20kB slab_unreclaimable:5276kB kernel_stack:7080kB
pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_s
canned:0 all_unreclaimable? yes
Feb  8 13:04:41 eis kernel: lowmem_reserve[]: 0 865 2999 2999
Feb  8 13:04:41 eis kernel: Normal free:11964kB min:3728kB low:4660kB
high:5592kB active_anon:0kB inactive_anon:0kB active_file:280kB
 inactive_file:388kB unevictable:0kB isolated(anon):0kB
isolated(file):128kB present:885944kB mlocked:0kB dirty:0kB
writeback:0kB map
ped:4kB shmem:0kB slab_reclaimable:16920kB slab_unreclaimable:399380kB
kernel_stack:423544kB pagetables:1712kB unstable:0kB bounce:0k
B writeback_tmp:0kB pages_scanned:12760 all_unreclaimable? yes
Feb  8 13:04:41 eis kernel: lowmem_reserve[]: 0 0 17078 17078
Feb  8 13:04:41 eis kernel: HighMem free:2017336kB min:512kB low:2812kB
high:5112kB active_anon:6880kB inactive_anon:43692kB active_f
ile:52728kB inactive_file:79524kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:2185992kB mlocked:0kB dirty:20kB writ
eback:20kB mapped:16884kB shmem:376kB slab_reclaimable:0kB
slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce
:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Feb  8 13:04:41 eis kernel: lowmem_reserve[]: 0 0 0 0
Feb  8 13:04:41 eis kernel: DMA: 5*4kB 1*8kB 1*16kB 1*32kB 0*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3532kB
Feb  8 13:04:41 eis kernel: Normal: 2784*4kB 0*8kB 1*16kB 0*32kB 1*64kB
0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 11984kB
Feb  8 13:04:41 eis kernel: HighMem: 6268*4kB 3785*8kB 2082*16kB
1161*32kB 635*64kB 298*128kB 141*256kB 88*512kB 53*1024kB 23*2048kB
398*4096kB = 2017336kB
Feb  8 13:04:41 eis kernel: 33380 total pagecache pages
Feb  8 13:04:41 eis kernel: 0 pages in swap cache
Feb  8 13:04:41 eis kernel: Swap cache stats: add 0, delete 0, find 0/0
Feb  8 13:04:41 eis kernel: Free swap  = 4192188kB
Feb  8 13:04:41 eis kernel: Total swap = 4192188kB
Feb  8 13:04:41 eis kernel: 778112 pages RAM
Feb  8 13:04:42 eis kernel: 550802 pages HighMem
Feb  8 13:04:42 eis kernel: 7592 pages reserved
Feb  8 13:04:42 eis kernel: 72228 pages shared
Feb  8 13:04:42 eis kernel: 197071 pages non-shared
Feb  8 13:04:42 eis kernel: [ pid ]   uid  tgid total_vm      rss cpu
oom_adj oom_score_adj name
Feb  8 13:04:42 eis kernel: [ 1805]     0  1805      520      147   0
    0             0 syslogd
Feb  8 13:04:42 eis kernel: [ 1818]     0  1818      853      504   0
    0             0 klogd
Feb  8 13:04:42 eis kernel: [ 1862]     0  1862      992      218   0
    0             0 rpcbind
Feb  8 13:04:42 eis kernel: [ 1873]     0  1873      688       93   0
    0             0 rpc.idmapd
Feb  8 13:04:42 eis kernel: [ 1883]     0  1883     1327      482   0
    0             0 rpc.mountd
Feb  8 13:04:42 eis kernel: [ 1892] 65534  1892     1057      332   1
    0             0 rpc.statd
Feb  8 13:04:42 eis kernel: [ 1959]     0  1959      716      221   0
    0             0 xinetd
Feb  8 13:04:43 eis kernel: [ 1967]     0  1967     1460      247   0
  -17         -1000 sshd
Feb  8 13:04:43 eis kernel: [ 1975]     0  1975      632       89   0
    0             0 atd
Feb  8 13:04:43 eis kernel: [ 1983]     0  1983      836      178   0
    0             0 fcron
Feb  8 13:04:43 eis kernel: [ 2097]     0  2097      517      144   0
    0             0 pptpd
Feb  8 13:04:43 eis kernel: [ 2254]     0  2254     1182      696   0
    0             0 brute_force_blo
Feb  8 13:04:43 eis kernel: [ 2726]     0  2726    19738     4569   0
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2758]     0  2758     2373      297   0
    0             0 exim
Feb  8 13:04:43 eis kernel: [ 2761]    30  2761    19780     4148   0
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2762]    30  2762    21027     4586   1
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2763]    30  2763    21084     4680   0
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2764]    30  2764    19745     4052   1
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2765]    30  2765    19980     4336   1
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2871]     0  2871     3717      567   0
    0             0 nmbd
Feb  8 13:04:43 eis kernel: [ 2873]     0  2873     5989     1147   0
    0             0 smbd
Feb  8 13:04:43 eis kernel: [ 2892]     0  2892    14283      590   0
    0             0 smbd
Feb  8 13:04:43 eis kernel: [ 2897]     0  2897      687      214   0
    0             0 mdadm
Feb  8 13:04:43 eis kernel: [ 2919]     0  2919     6500      592   0
    0             0 smbd
Feb  8 13:04:43 eis kernel: [ 3170]     0  3170      884      191   0
    0             0 smartd
Feb  8 13:04:43 eis kernel: [ 3339]     0  3339     1271      195   1
    0             0 mini_httpd
Feb  8 13:04:43 eis kernel: [ 3361]     0  3361     9369      254   0
    0             0 apcupsd
Feb  8 13:03:07 eis kernel: [ 3401]     0  3401     1134      202   1
    0             0 mingetty
Feb  8 13:03:07 eis kernel: [ 3402]     0  3402     1134      202   0
    0             0 mingetty
Feb  8 13:03:07 eis kernel: [ 3403]     0  3403     1134      202   1
    0             0 mingetty
Feb  8 13:03:07 eis kernel: [ 4143]     0  4143     3696      929   1
    0             0 login
Feb  8 13:03:07 eis kernel: [ 4357]     0  4357     1742      443   0
    0             0 bash
Feb  8 13:03:07 eis kernel: [ 4808]     0  4808     8660     1716   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7287]     0  7287     8570     1629   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7719]     0  7719    10514     1539   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [16027]    30 16027    19745     4051   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [16233]    30 16233    21021     4579   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [18232]    30 18232    19738     3686   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [18233]    30 18233    19738     3686   1
    0             0 httpd
Feb  8 13:03:07 eis kernel: [18234]    30 18234    19738     3686   0
    0             0 httpd
Feb  8 13:03:07 eis kernel: [ 2611]     0  2611     8440     1469   1
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 2613]     0  2613      573      188   0
    0             0 pptpctrl
Feb  8 13:03:07 eis kernel: [ 2614]     0  2614      692      314   0
    0             0 pppd
Feb  8 13:03:07 eis kernel: [ 5358]  2003  5358     6051     1218   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 6364]  2003  6364     6051     1218   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7619]  2003  7619     6051     1219   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 8820]  2003  8820     6051     1216   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [10016]  2003 10016     6051     1218   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [10814]     0 10814     6048     1247   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [20906]     0 20906      573      188   0
    0             0 pptpctrl
Feb  8 13:03:07 eis kernel: [20907]     0 20907      692      312   0
    0             0 pppd
Feb  8 13:03:07 eis kernel: [24124]     0 24124   258494    89233   0
    0             0 java
Feb  8 13:03:07 eis kernel: [  493]     0   493     6115     1280   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 4614]     0  4614     6088     1317   0
    0             0 smbd
Feb  8 13:03:07 eis kernel: [ 7623]     0  7623      573      186   0
    0             0 pptpctrl
Feb  8 13:03:08 eis kernel: [ 7624]     0  7624      692      312   0
    0             0 pppd
Feb  8 13:03:08 eis kernel: [10502]  2003 10502     6716     1507   0
    0             0 smbd
Feb  8 13:03:08 eis kernel: [11898]     0 11898     4595     1337   0
    0             0 sshd
Feb  8 13:03:08 eis kernel: [12109]     0 12109     1742      442   0
    0             0 bash
Feb  8 13:03:08 eis kernel: [12142]     0 12142     1697      360   0
    0             0 top
Feb  8 13:03:08 eis kernel: [13141]  2003 13141     6146     1263   0
    0             0 smbd
Feb  8 13:03:08 eis kernel: [15742]     0 15742     6631     1361   0
    0             0 smbd
Feb  8 13:03:08 eis kernel: [21199]     0 21199      573      187   0
    0             0 pptpctrl
Feb  8 13:03:08 eis kernel: [21200]     0 21200      692      314   0
    0             0 pppd
Feb  8 13:03:08 eis kernel: [22454]     0 22454      573      186   0
    0             0 pptpctrl
Feb  8 13:03:08 eis kernel: [22455]     0 22455      692      312   0
    0             0 pppd
Feb  8 13:03:08 eis kernel: [25451]     0 25451      827      271   0
    0             0 grep
Feb  8 13:03:08 eis kernel: [25452]     0 25452      827      270   0
    0             0 grep
Feb  8 13:03:08 eis kernel: [25453]     0 25453      528      134   0
    0             0 sed
Feb  8 13:03:08 eis kernel: [25454]     0 25454      827      270   0
    0             0 grep
Feb  8 13:03:08 eis kernel: [25455]     0 25455      528      133   0
    0             0 sed
Feb  8 13:03:08 eis kernel: [25456]     0 25456      528      134   0
    0             0 sed
Feb  8 13:03:08 eis kernel: [25457]     0 25457      655      207   0
    0             0 in.grep
Feb  8 13:03:08 eis kernel: Out of memory: Kill process 24124 (java)
score 48 or sacrifice child
Feb  8 13:03:08 eis kernel: Killed process 24124 (java)
total-vm:1033976kB, anon-rss:345804kB, file-rss:11128kB
Feb  8 13:03:13 eis kernel: INFO: rcu_sched detected stall on CPU 1
(t=690450 jiffies)
Feb  8 13:03:13 eis kernel: Pid: 2611, comm: smbd Not tainted
3.2.75-eisfair-1-SMP #1
Feb  8 13:03:13 eis kernel: Call Trace:
Feb  8 13:03:13 eis kernel:  [__rcu_pending+0x64/0x28f]
__rcu_pending+0x64/0x28f
Feb  8 13:03:13 eis kernel:  [rcu_check_callbacks+0x6d/0x98]
rcu_check_callbacks+0x6d/0x98
Feb  8 13:03:13 eis kernel:  [update_process_times+0x2d/0x58]
update_process_times+0x2d/0x58
Feb  8 13:03:13 eis kernel:  [tick_sched_timer+0x13f/0x166]
tick_sched_timer+0x13f/0x166
Feb  8 13:03:13 eis kernel:  [__run_hrtimer.isra.27+0x3d/0x91]
__run_hrtimer.isra.27+0x3d/0x91
Feb  8 13:03:14 eis kernel:  [hrtimer_interrupt+0xe2/0x1cb]
hrtimer_interrupt+0xe2/0x1cb
Feb  8 13:03:14 eis kernel:  [smp_apic_timer_interrupt+0x67/0x7a]
smp_apic_timer_interrupt+0x67/0x7a
Feb  8 13:03:14 eis kernel:  [apic_timer_interrupt+0x2a/0x30]
apic_timer_interrupt+0x2a/0x30
Feb  8 13:03:14 eis kernel:  [ipv6:_raw_spin_lock+0x14/0x80] ?
_raw_spin_lock+0x14/0x1c
Feb  8 13:03:14 eis kernel:  [unix_state_double_lock+0x3d/0x41]
unix_state_double_lock+0x3d/0x41
Feb  8 13:03:14 eis kernel:  [unix_dgram_connect+0x83/0x153]
unix_dgram_connect+0x83/0x153
Feb  8 13:03:14 eis kernel:  [sys_connect+0x63/0x88] sys_connect+0x63/0x88
Feb  8 13:03:14 eis kernel:  [sys_socketcall+0x76/0x192]
sys_socketcall+0x76/0x192
Feb  8 13:03:14 eis kernel:  [syscall_after_call+0x0/0x04]
syscall_call+0x7/0x7
Feb  8 13:04:34 eis kernel: kworker/u:6 invoked oom-killer:
gfp_mask=0xd0, order=1, oom_adj=0, oom_score_adj=0
Feb  8 13:04:35 eis kernel: Pid: 1245, comm: kworker/u:6 Not tainted
3.2.75-eisfair-1-SMP #1
Feb  8 13:04:35 eis kernel: Call Trace:
Feb  8 13:04:36 eis kernel:  [dump_header.isra.8+0x55/0x156]
dump_header.isra.8+0x55/0x156
Feb  8 13:04:36 eis kernel:  [___ratelimit+0x93/0xac] ?
___ratelimit+0x93/0xac
Feb  8 13:04:36 eis kernel:  [oom_kill_process.constprop.13+0x26/0x1ef]
oom_kill_process.constprop.13+0x26/0x1ef
Feb  8 13:04:36 eis kernel:  [has_capability_noaudit+0x19/0x25] ?
has_capability_noaudit+0x19/0x25
Feb  8 13:04:36 eis kernel:  [out_of_memory+0x1f1/0x259]
out_of_memory+0x1f1/0x259
Feb  8 13:04:36 eis kernel:  [ipv6:__alloc_pages_nodemask+0x458/0x2f11]
__alloc_pages_nodemask+0x458/0x536
Feb  8 13:04:36 eis kernel:  [copy_process.part.44+0x56/0xd05]
copy_process.part.44+0x56/0xd05
Feb  8 13:04:36 eis kernel:  [do_fork+0x10e/0x287] do_fork+0x10e/0x287
Feb  8 13:04:39 eis kernel:  [wait_for_helper+0x0/0x85] ?
umh_complete+0x1c/0x1c
Feb  8 13:04:39 eis kernel:  [kernel_thread+0x6e/0x76]
kernel_thread+0x6e/0x76
Feb  8 13:04:39 eis kernel:  [wait_for_helper+0x0/0x85] ?
umh_complete+0x1c/0x1c
Feb  8 13:04:39 eis kernel:  [kernel_thread_helper+0x0/0x0d] ?
common_interrupt+0x30/0x30
Feb  8 13:04:39 eis kernel:  [__call_usermodehelper+0x28/0x66]
__call_usermodehelper+0x28/0x66
Feb  8 13:04:39 eis kernel:  [process_one_work+0x165/0x26b]
process_one_work+0x165/0x26b
Feb  8 13:04:39 eis kernel:  [worker_thread+0x12d/0x1ee]
worker_thread+0x12d/0x1ee
Feb  8 13:04:39 eis kernel:  [worker_thread+0x0/0x1ee] ?
process_scheduled_works+0x21/0x21
Feb  8 13:04:39 eis kernel:  [kthread+0x63/0x68] kthread+0x63/0x68
Feb  8 13:04:39 eis kernel:  [kthread+0x0/0x68] ?
kthread_worker_fn+0x107/0x107
Feb  8 13:04:39 eis kernel:  [kernel_thread_helper+0x6/0x0d]
kernel_thread_helper+0x6/0xd
Feb  8 13:04:40 eis kernel: Mem-Info:
Feb  8 13:04:40 eis kernel: DMA per-cpu:
Feb  8 13:04:40 eis kernel: CPU    0: hi:    0, btch:   1 usd:   0
Feb  8 13:04:40 eis kernel: CPU    1: hi:    0, btch:   1 usd:   0
Feb  8 13:04:40 eis kernel: Normal per-cpu:
Feb  8 13:04:40 eis kernel: CPU    0: hi:  186, btch:  31 usd:   0
Feb  8 13:04:40 eis kernel: CPU    1: hi:  186, btch:  31 usd:   0
Feb  8 13:04:40 eis kernel: HighMem per-cpu:
Feb  8 13:04:41 eis kernel: CPU    0: hi:  186, btch:  31 usd:   0
Feb  8 13:04:41 eis kernel: CPU    1: hi:  186, btch:  31 usd:   0
Feb  8 13:04:41 eis kernel: active_anon:1720 inactive_anon:10923
isolated_anon:0
Feb  8 13:04:41 eis kernel:  active_file:13252 inactive_file:19978
isolated_file:32
Feb  8 13:04:41 eis kernel:  unevictable:0 dirty:5 writeback:5 unstable:0
Feb  8 13:04:41 eis kernel:  free:508208 slab_reclaimable:4235
slab_unreclaimable:101164
Feb  8 13:04:41 eis kernel:  mapped:4222 shmem:94 pagetables:428 bounce:0
Feb  8 13:04:41 eis kernel: DMA free:3532kB min:64kB low:80kB high:96kB
active_anon:0kB inactive_anon:0kB active_file:0kB inactive_fi
le:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15800kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
 slab_reclaimable:20kB slab_unreclaimable:5276kB kernel_stack:7080kB
pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_s
canned:0 all_unreclaimable? yes
Feb  8 13:04:41 eis kernel: lowmem_reserve[]: 0 865 2999 2999
Feb  8 13:04:41 eis kernel: Normal free:11964kB min:3728kB low:4660kB
high:5592kB active_anon:0kB inactive_anon:0kB active_file:280kB
 inactive_file:388kB unevictable:0kB isolated(anon):0kB
isolated(file):128kB present:885944kB mlocked:0kB dirty:0kB
writeback:0kB map
ped:4kB shmem:0kB slab_reclaimable:16920kB slab_unreclaimable:399380kB
kernel_stack:423544kB pagetables:1712kB unstable:0kB bounce:0k
B writeback_tmp:0kB pages_scanned:12760 all_unreclaimable? yes
Feb  8 13:04:41 eis kernel: lowmem_reserve[]: 0 0 17078 17078
Feb  8 13:04:41 eis kernel: HighMem free:2017336kB min:512kB low:2812kB
high:5112kB active_anon:6880kB inactive_anon:43692kB active_f
ile:52728kB inactive_file:79524kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:2185992kB mlocked:0kB dirty:20kB writ
eback:20kB mapped:16884kB shmem:376kB slab_reclaimable:0kB
slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce
:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Feb  8 13:04:41 eis kernel: lowmem_reserve[]: 0 0 0 0
Feb  8 13:04:41 eis kernel: DMA: 5*4kB 1*8kB 1*16kB 1*32kB 0*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3532kB
Feb  8 13:04:41 eis kernel: Normal: 2784*4kB 0*8kB 1*16kB 0*32kB 1*64kB
0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 11984kB
Feb  8 13:04:41 eis kernel: HighMem: 6268*4kB 3785*8kB 2082*16kB
1161*32kB 635*64kB 298*128kB 141*256kB 88*512kB 53*1024kB 23*2048kB
398*4096kB = 2017336kB
Feb  8 13:04:41 eis kernel: 33380 total pagecache pages
Feb  8 13:04:41 eis kernel: 0 pages in swap cache
Feb  8 13:04:41 eis kernel: Swap cache stats: add 0, delete 0, find 0/0
Feb  8 13:04:41 eis kernel: Free swap  = 4192188kB
Feb  8 13:04:41 eis kernel: Total swap = 4192188kB
Feb  8 13:04:41 eis kernel: 778112 pages RAM
Feb  8 13:04:42 eis kernel: 550802 pages HighMem
Feb  8 13:04:42 eis kernel: 7592 pages reserved
Feb  8 13:04:42 eis kernel: 72228 pages shared
Feb  8 13:04:42 eis kernel: 197071 pages non-shared
Feb  8 13:04:42 eis kernel: [ pid ]   uid  tgid total_vm      rss cpu
oom_adj oom_score_adj name
Feb  8 13:04:42 eis kernel: [ 1805]     0  1805      520      147   0
    0             0 syslogd
Feb  8 13:04:42 eis kernel: [ 1818]     0  1818      853      504   0
    0             0 klogd
Feb  8 13:04:42 eis kernel: [ 1862]     0  1862      992      218   0
    0             0 rpcbind
Feb  8 13:04:42 eis kernel: [ 1873]     0  1873      688       93   0
    0             0 rpc.idmapd
Feb  8 13:04:42 eis kernel: [ 1883]     0  1883     1327      482   0
    0             0 rpc.mountd
Feb  8 13:04:42 eis kernel: [ 1892] 65534  1892     1057      332   1
    0             0 rpc.statd
Feb  8 13:04:42 eis kernel: [ 1959]     0  1959      716      221   0
    0             0 xinetd
Feb  8 13:04:43 eis kernel: [ 1967]     0  1967     1460      247   0
  -17         -1000 sshd
Feb  8 13:04:43 eis kernel: [ 1975]     0  1975      632       89   0
    0             0 atd
Feb  8 13:04:43 eis kernel: [ 1983]     0  1983      836      178   0
    0             0 fcron
Feb  8 13:04:43 eis kernel: [ 2097]     0  2097      517      144   0
    0             0 pptpd
Feb  8 13:04:43 eis kernel: [ 2254]     0  2254     1182      696   0
    0             0 brute_force_blo
Feb  8 13:04:43 eis kernel: [ 2726]     0  2726    19738     4569   0
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2758]     0  2758     2373      297   0
    0             0 exim
Feb  8 13:04:43 eis kernel: [ 2761]    30  2761    19780     4148   0
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2762]    30  2762    21027     4586   1
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2763]    30  2763    21084     4680   0
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2764]    30  2764    19745     4052   1
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2765]    30  2765    19980     4336   1
    0             0 httpd
Feb  8 13:04:43 eis kernel: [ 2871]     0  2871     3717      567   0
    0             0 nmbd
Feb  8 13:04:43 eis kernel: [ 2873]     0  2873     5989     1147   0
    0             0 smbd
Feb  8 13:04:43 eis kernel: [ 2892]     0  2892    14283      590   0
    0             0 smbd
Feb  8 13:04:43 eis kernel: [ 2897]     0  2897      687      214   0
    0             0 mdadm
Feb  8 13:04:43 eis kernel: [ 2919]     0  2919     6500      592   0
    0             0 smbd
Feb  8 13:04:43 eis kernel: [ 3170]     0  3170      884      191   0
    0             0 smartd
Feb  8 13:04:43 eis kernel: [ 3339]     0  3339     1271      195   1
    0             0 mini_httpd
Feb  8 13:04:43 eis kernel: [ 3361]     0  3361     9369      254   0
    0             0 apcupsd
Feb  8 13:04:43 eis kernel: [ 3401]     0  3401     1134      202   1
    0             0 mingetty
Feb  8 13:04:43 eis kernel: [ 3402]     0  3402     1134      202   0
    0             0 mingetty
Feb  8 13:04:43 eis kernel: [ 3403]     0  3403     1134      202   1
    0             0 mingetty
Feb  8 13:04:43 eis kernel: [ 4143]     0  4143     3696      929   1
    0             0 login
Feb  8 13:04:43 eis kernel: [ 4357]     0  4357     1742      443   0
    0             0 bash
Feb  8 13:04:43 eis kernel: [ 4808]     0  4808     8660     1716   0
    0             0 smbd
Feb  8 13:04:43 eis kernel: [ 7287]     0  7287     8570     1629   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [ 7719]     0  7719    10514     1539   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [16027]    30 16027    19745     4051   1
    0             0 httpd
Feb  8 13:04:44 eis kernel: [16233]    30 16233    21021     4579   1
    0             0 httpd
Feb  8 13:04:44 eis kernel: [18232]    30 18232    19738     3686   1
    0             0 httpd
Feb  8 13:04:44 eis kernel: [18233]    30 18233    19738     3686   1
    0             0 httpd
Feb  8 13:04:44 eis kernel: [18234]    30 18234    19738     3686   0
    0             0 httpd
Feb  8 13:04:44 eis kernel: [ 2611]     0  2611     8440     1469   1
    0             0 smbd
Feb  8 13:04:44 eis kernel: [ 2613]     0  2613      573      188   0
    0             0 pptpctrl
Feb  8 13:04:44 eis kernel: [ 2614]     0  2614      692      314   0
    0             0 pppd
Feb  8 13:04:44 eis kernel: [ 5358]  2003  5358     6051     1218   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [ 6364]  2003  6364     6051     1218   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [ 7619]  2003  7619     6051     1219   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [ 8820]  2003  8820     6051     1216   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [10016]  2003 10016     6051     1218   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [10814]     0 10814     6048     1247   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [20906]     0 20906      573      188   0
    0             0 pptpctrl
Feb  8 13:04:44 eis kernel: [20907]     0 20907      692      312   0
    0             0 pppd
Feb  8 13:04:44 eis kernel: [  493]     0   493     6115     1280   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [ 4614]     0  4614     6088     1317   0
    0             0 smbd
Feb  8 13:04:44 eis kernel: [ 7623]     0  7623      573      186   0
    0             0 pptpctrl
Feb  8 13:04:45 eis kernel: [ 7624]     0  7624      692      312   0
    0             0 pppd
Feb  8 13:04:45 eis kernel: [10502]  2003 10502     6716     1507   0
    0             0 smbd
Feb  8 13:04:45 eis kernel: [11898]     0 11898     4595     1337   0
    0             0 sshd
Feb  8 13:04:45 eis kernel: [12109]     0 12109     1742      474   0
    0             0 bash
Feb  8 13:04:45 eis kernel: [13141]  2003 13141     6146     1263   0
    0             0 smbd
Feb  8 13:04:45 eis kernel: [15742]     0 15742     6631     1361   0
    0             0 smbd
Feb  8 13:04:45 eis kernel: [21199]     0 21199      573      187   0
    0             0 pptpctrl
Feb  8 13:04:45 eis kernel: [21200]     0 21200      692      314   0
    0             0 pppd
Feb  8 13:04:45 eis kernel: [22454]     0 22454      573      186   0
    0             0 pptpctrl
Feb  8 13:04:45 eis kernel: [22455]     0 22455      692      312   0
    0             0 pppd
Feb  8 13:04:45 eis kernel: Out of memory: Kill process 2726 (httpd)
score 2 or sacrifice child
Feb  8 13:04:45 eis kernel: Killed process 2761 (httpd)
total-vm:79120kB, anon-rss:12368kB, file-rss:4224kB
Feb  8 13:05:47 eis kernel: smbd invoked oom-killer: gfp_mask=0xd0,
order=1, oom_adj=0, oom_score_adj=0
Feb  8 13:05:47 eis kernel: Pid: 2873, comm: smbd Not tainted
3.2.75-eisfair-1-SMP #1
Feb  8 13:05:47 eis kernel: Call Trace:
Feb  8 13:05:47 eis kernel:  [dump_header.isra.8+0x55/0x156]
dump_header.isra.8+0x55/0x156
Feb  8 13:05:47 eis kernel:  [___ratelimit+0x93/0xac] ?
___ratelimit+0x93/0xac
Feb  8 13:05:47 eis kernel:  [oom_kill_process.constprop.13+0x26/0x1ef]
oom_kill_process.constprop.13+0x26/0x1ef
Feb  8 13:05:47 eis kernel:  [has_capability_noaudit+0x19/0x25] ?
has_capability_noaudit+0x19/0x25
Feb  8 13:05:47 eis kernel:  [out_of_memory+0x1f1/0x259]
out_of_memory+0x1f1/0x259
Feb  8 13:05:47 eis kernel:  [ipv6:__alloc_pages_nodemask+0x458/0x2f11]
__alloc_pages_nodemask+0x458/0x536
Feb  8 13:05:47 eis kernel:  [copy_process.part.44+0x56/0xd05]
copy_process.part.44+0x56/0xd05
Feb  8 13:05:47 eis kernel:  [do_page_fault+0x2ea/0x355] ?
do_page_fault+0x2ea/0x355
Feb  8 13:05:47 eis kernel:  [do_fork+0x10e/0x287] do_fork+0x10e/0x287
Feb  8 13:05:47 eis kernel:  [sys_clone+0x1b/0x20] sys_clone+0x1b/0x20
Feb  8 13:05:48 eis kernel:  [ptregs_clone+0x15/0x40] ptregs_clone+0x15/0x40
Feb  8 13:05:48 eis kernel:  [syscall_after_call+0x0/0x04] ?
syscall_call+0x7/0x7
Feb  8 13:05:48 eis kernel: Mem-Info:
Feb  8 13:05:48 eis kernel: DMA per-cpu:
Feb  8 13:05:49 eis kernel: CPU    0: hi:    0, btch:   1 usd:   0
Feb  8 13:05:50 eis kernel: CPU    1: hi:    0, btch:   1 usd:   0
Feb  8 13:05:50 eis kernel: Normal per-cpu:
Feb  8 13:05:50 eis kernel: CPU    0: hi:  186, btch:  31 usd:   0
Feb  8 13:05:50 eis kernel: CPU    1: hi:  186, btch:  31 usd:   0
Feb  8 13:05:50 eis kernel: HighMem per-cpu:
Feb  8 13:05:50 eis kernel: CPU    0: hi:  186, btch:  31 usd:   0
Feb  8 13:05:50 eis kernel: CPU    1: hi:  186, btch:  31 usd:   0
Feb  8 13:05:50 eis kernel: active_anon:1719 inactive_anon:10829
isolated_anon:0
Feb  8 13:05:50 eis kernel:  active_file:13406 inactive_file:19852
isolated_file:8
Feb  8 13:05:50 eis kernel:  unevictable:0 dirty:5 writeback:30 unstable:0
Feb  8 13:05:50 eis kernel:  free:508265 slab_reclaimable:4236
slab_unreclaimable:101185
Feb  8 13:05:51 eis kernel:  mapped:4220 shmem:94 pagetables:414 bounce:0
Feb  8 13:05:51 eis kernel: DMA free:3532kB min:64kB low:80kB high:96kB
active_anon:0kB inactive_anon:0kB active_file:0kB inactive_fi
le:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15800kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
 slab_reclaimable:20kB slab_unreclaimable:5276kB kernel_stack:7080kB
pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_s
canned:0 all_unreclaimable? yes
Feb  8 13:05:51 eis kernel: lowmem_reserve[]: 0 865 2999 2999
Feb  8 13:05:51 eis kernel: Normal free:11824kB min:3728kB low:4660kB
high:5592kB active_anon:0kB inactive_anon:0kB active_file:332kB
 inactive_file:436kB unevictable:0kB isolated(anon):0kB
isolated(file):32kB present:885944kB mlocked:0kB dirty:0kB
writeback:40kB map
ped:4kB shmem:0kB slab_reclaimable:16924kB slab_unreclaimable:399464kB
kernel_stack:423544kB pagetables:1656kB unstable:0kB bounce:0k
B writeback_tmp:0kB pages_scanned:6425 all_unreclaimable? yes
Feb  8 13:05:51 eis kernel: lowmem_reserve[]: 0 0 17078 17078
Feb  8 13:05:51 eis kernel: HighMem free:2017704kB min:512kB low:2812kB
high:5112kB active_anon:6876kB inactive_anon:43316kB active_f
ile:53292kB inactive_file:78972kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:2185992kB mlocked:0kB dirty:20kB writ
eback:80kB mapped:16876kB shmem:376kB slab_reclaimable:0kB
slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce
:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Feb  8 13:05:51 eis kernel: lowmem_reserve[]: 0 0 0 0
Feb  8 13:05:51 eis kernel: DMA: 5*4kB 1*8kB 1*16kB 1*32kB 0*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3532kB
Feb  8 13:05:51 eis kernel: Normal: 2753*4kB 0*8kB 0*16kB 0*32kB 1*64kB
0*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 11844kB
Feb  8 13:05:51 eis kernel: HighMem: 6256*4kB 3791*8kB 2087*16kB
1166*32kB 637*64kB 298*128kB 141*256kB 88*512kB 53*1024kB 23*2048kB
398*4096kB = 2017704kB
Feb  8 13:05:51 eis kernel: 33384 total pagecache pages
Feb  8 13:05:51 eis kernel: 0 pages in swap cache
Feb  8 13:05:51 eis kernel: Swap cache stats: add 0, delete 0, find 0/0
Feb  8 13:05:51 eis kernel: Free swap  = 4192188kB
Feb  8 13:05:51 eis kernel: Total swap = 4192188kB
Feb  8 13:05:51 eis kernel: 778112 pages RAM
Feb  8 13:05:51 eis kernel: 550802 pages HighMem
Feb  8 13:05:51 eis kernel: 7592 pages reserved
Feb  8 13:05:51 eis kernel: 68164 pages shared
Feb  8 13:05:52 eis kernel: 197012 pages non-shared
Feb  8 13:05:53 eis kernel: [ pid ]   uid  tgid total_vm      rss cpu
oom_adj oom_score_adj name
Feb  8 13:05:54 eis kernel: [ 1805]     0  1805      520      147   0
    0             0 syslogd
Feb  8 13:05:56 eis kernel: [ 1818]     0  1818      853      504   0
    0             0 klogd
Feb  8 13:05:57 eis kernel: [ 1862]     0  1862      992      218   0
    0             0 rpcbind
Feb  8 13:05:57 eis kernel: [ 1873]     0  1873      688       93   0
    0             0 rpc.idmapd
Feb  8 13:05:59 eis kernel: [ 1883]     0  1883     1327      482   0
    0             0 rpc.mountd
Feb  8 13:05:59 eis kernel: [ 1892] 65534  1892     1057      332   1
    0             0 rpc.statd

Wer ist schuld am einfrieren des Servers? Bzw. was kann ich tun damit
dies nicht mehr passiert?

Danke und Gruß
Jürgen


Mehr Informationen über die Mailingliste Eisfair