rendered paste body[ 5091.846677] No mptable found.
[ 5091.847635] PERCPU: Allocating 22368 bytes of per cpu data
[ 5091.847668] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 131300
[ 5091.847672] Kernel command line: root=/dev/sda1 ro xencons=tty console=tty1 clocksource=jiffies
[ 5091.848365] Initializing CPU#0
[ 5091.848527] PID hash table entries: 4096 (order: 12, 32768 bytes)
[ 5091.848562] Xen reported: 1994.998 MHz processor.
[ 0.048070] console [tty1] enabled
[ 0.048107] Console: colour dummy device 80x25
[ 0.048111] console [tty1] enabled
[ 0.048494] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.048870] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.048984] Software IO TLB disabled
[ 0.052357] Memory: 431084k/532480k available (2533k kernel code, 92648k reserved, 1331k data, 220k init)
[ 0.120097] Calibrating delay using timer specific routine.. 3993.72 BogoMIPS (lpj=7987454)
[ 0.120149] Security Framework initialized
[ 0.120158] SELinux: Disabled at boot.
[ 0.120167] AppArmor: AppArmor initialized
[ 0.120172] Failure registering capabilities with primary security module.
[ 0.120193] Mount-cache hash table entries: 256
[ 0.120325] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.120333] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.120339] CPU: Physical Processor ID: 1
[ 0.120342] CPU: Processor Core ID: 2
[ 0.120359] SMP alternatives: switching to UP code
[ 0.120961] Early unpacking initramfs... done
[ 0.197806] Brought up 1 CPUs
[ 0.198583] net_namespace: 120 bytes
[ 0.198592] failed to set up cpufreq notifier
[ 0.214715] Time: 165:165:165 Date: 165/165/65
[ 0.214800] NET: Registered protocol family 16
[ 0.227436] SMP alternatives: switching to SMP code
[ 0.000021] Initializing CPU#1
[ 0.000075] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.000079] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.000083] CPU: Physical Processor ID: 1
[ 0.000085] CPU: Processor Core ID: 2
[ 0.000013] Initializing CPU#2
[ 0.000056] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.000062] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.000069] CPU: Physical Processor ID: 1
[ 0.000072] CPU: Processor Core ID: 2
[ 0.000023] Initializing CPU#3
[ 0.249932] 04 08 01 02
[ 0.000079] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.000086] CPU: Physical Processor ID: 1
[ 0.000089] CPU: Processor Core ID: 2
[ 0.250004] Brought up 4 CPUs
[ 0.250361] PCI: Fatal: No config space access function found
[ 0.250369] PCI: setting up Xen PCI frontend stub
[ 0.251302] ACPI: Interpreter disabled.
[ 0.251311] Linux Plug and Play Support v0.97 (c) Adam Belay
[ 0.251347] pnp: PnP ACPI: disabled
[ 0.251657] xen_mem: Initialising balloon driver.
[ 0.256466] Setting mem allocation to 524288 kiB
[ 0.256665] PCI: System does not support PCI
[ 0.256672] PCI: System does not support PCI
[ 0.261162] NET: Registered protocol family 8
[ 0.261176] NET: Registered protocol family 20
[ 0.261360] AppArmor: AppArmor Filesystem Enabled
[ 0.261820] NET: Registered protocol family 2
[ 0.296216] IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.296595] TCP established hash table entries: 131072 (order: 9, 2097152 bytes)
[ 0.297630] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.298170] TCP: Hash tables configured (established 131072 bind 65536)
[ 0.298178] TCP reno registered
[ 0.307700] checking if image is initramfs... it is
[ 0.399192] Freeing initrd memory: 76412k freed
[ 0.194885] audit: initializing netlink socket (disabled)
[ 0.194914] audit(1257234829.667:1): initialized
[ 0.195661] VFS: Disk quotas dquot_6.5.1
[ 0.195727] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.195865] io scheduler noop registered
[ 0.195872] io scheduler anticipatory registered
[ 0.195876] io scheduler deadline registered
[ 0.195914] io scheduler cfq registered (default)
[ 0.198645] Xen virtual console successfully installed as tty1
[ 0.198971] Event-channel device installed.
[ 0.205131] Successfully initialized TPM backend driver.
[ 0.226776] netfront: Initialising virtual ethernet driver.
[ 0.471382] xen-vbd: registered block device major 8
[ 0.471440] blkfront: sda1: barriers enabled
[ 0.286044] rtc: IRQ 8 is not free.
[ 0.286168] Linux agpgart interface v0.102
[ 0.287091] RAMDISK driver initialized: 16 RAM disks of 65536K size 1024 blocksize
[ 0.287230] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[ 0.287449] PNP: No PS/2 controller found. Probing ports directly.
[ 0.288278] i8042.c: No controller found.
[ 0.534179] blkfront: sda2: barriers enabled
[ 0.303727] mice: PS/2 mouse device common for all mice
[ 0.303807] cpuidle: using governor ladder
[ 0.303959] NET: Registered protocol family 1
[ 0.304049] registered taskstats version 1
[ 0.304072] XENBUS: Device with no driver: device/console/0
[ 0.304089] Magic number: 1:252:3141
[ 0.304266] /build/buildd/linux-2.6.24/debian/build/custom-source-xen/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 0.304292] Freeing unused kernel memory: 220k freed
Loading, please wait...
G[ 1.136525] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Couldnt get a file descriptor referring to the console
Couldnt get a file descriptor referring to the console
Couldnt get a file descriptor referring to the console
Couldnt get a file descriptor referring to the console
Couldnt get a file descriptor referring to the console
Couldnt get a file descriptor referring to the console
Begin: Loading essential drivers... ...
[ 1.579760] loop: module loaded
[ 1.445205] fuse init (API version 7.9)
[ 1.531863] thermal: Unknown symbol acpi_processor_set_thermal_limit
[ 1.742535] device-mapper: uevent: version 1.0.3
[ 1.742609] device-mapper: ioctl: 4.12.0-ioctl (2007-10-02) initialised: dm-devel@redhat.com
[ 1.591222] md: linear personality registered for level -1
[ 1.604185] md: multipath personality registered for level -4
[ 1.616860] md: raid0 personality registered for level 0
[ 1.630052] md: raid1 personality registered for level 1
[ 1.642288] xor: automatically using best checksumming function: generic_sse
[ 1.658609] generic_sse: 5670.000 MB/sec
[ 1.658624] xor: using function: generic_sse (5670.000 MB/sec)
[ 1.659432] async_tx: api initialized (async)
[ 1.726465] raid6: int64x1 2113 MB/s
[ 1.793039] raid6: int64x2 2544 MB/s
[ 1.859507] raid6: int64x4 2564 MB/s
[ 1.924688] raid6: int64x8 1925 MB/s
[ 1.989703] raid6: sse2x1 2685 MB/s
[ 2.055659] raid6: sse2x2 4238 MB/s
[ 2.119936] raid6: sse2x4 4020 MB/s
[ 2.119971] raid6: using algorithm sse2x2 (4238 MB/s)
[ 2.119997] md: raid6 personality registered for level 6
[ 2.120001] md: raid5 personality registered for level 5
[ 2.120005] md: raid4 personality registered for level 4
[ 2.196033] md: raid10 personality registered for level 10
Done.
Begin: Running /scripts/init-premount ...
Done.
Begin: Mounting root file system... ...
Begin: Running /scripts/local-top ...
Done.
Begin: Running /scripts/local-premount ...
Done.
[ 13.021211] EXT3-fs: INFO: recovery required on readonly filesystem.
[ 13.021227] EXT3-fs: write access will be enabled during recovery.
[ 76.065040] kjournald starting. Commit interval 5 seconds
[ 76.065087] EXT3-fs: sda1: orphan cleanup on readonly fs
[ 91.943629] EXT3-fs: sda1: 174 orphan inodes deleted
[ 91.943647] EXT3-fs: recovery complete.
[ 94.939542] EXT3-fs: mounted filesystem with ordered data mode.
Begin: Running /scripts/local-bottom ...
Done.
Done.
Begin: Running /scripts/init-bottom ...
Done.
INIT: version 2.86 booting
[ 107.814668] usbcore: registered new interface driver usbfs
[ 107.814737] usbcore: registered new interface driver hub
[ 107.814769] usbcore: registered new device driver usb
Welcome to CentOS release 5.3 (Final)
Press 'I' to enter interactive startup.
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
Setting clock (utc): Tue Nov 3 07:55:49 UTC 2009 Ä OK Ü
Starting udev: Ä OK Ü
Loading default keymap (us): /etc/rc.d/rc.sysinit: line 396: /dev/tty0: No such device or address
ÄFAILEDÜ
Setting hostname vandam.meenstreek.com: Ä OK Ü
raidautorun: RAID_AUTORUN failed: No such device
No devices found
Checking filesystems
Checking all file systems.
Ä/sbin/fsck.ext3 (1) -- /Ü fsck.ext3 -a /dev/sda1
/dev/sda1: clean, 242981/2490368 files, 2340998/4980736 blocks
Ä OK Ü
Remounting root filesystem in read-write mode: Ä OK Ü
Mounting local filesystems: Ä OK Ü
Enabling local filesystem quotas: Ä OK Ü
Enabling /etc/fstab swaps: Ä OK Ü
INIT: Entering runlevel: 3
Entering non-interactive startup
Starting sysstat: Calling the system activity data collector (sadc):
Ä OK Ü
Starting background readahead: Ä OK Ü
Checking for hardware changes Ä OK Ü
Starting securetmp: Securing /tmp & /var/tmp
Setting up /tmp... Done
Setting up /var/tmp... Done
Checking fstab for entries ...Done
Logrotate TMPDIR already configured
Process Complete
Ä OK Ü
Applying ip6tables firewall rules: Ä OK Ü
Bringing up loopback interface: Ä OK Ü
Bringing up interface eth0: Ä OK Ü
Bringing up interface eth1: Ä OK Ü
Starting auditd: Ä OK Ü
Increasing file system limits Ä OK Ü
Bringing up eth0:1 Ä OK Ü
Routing 67.23.7.44 Ä OK Ü
Bringing up eth0:2 Ä OK Ü
This computer system is for authorized users only. Individuals using this
system without authority or in excess of their authority are subject to
having all their activities on this system monitored and recorded or
examined by any authorized person, including law enforcement, as system
personnel deem appropriate. In the course of monitoring individuals
improperly using the system or in the course of system maintenance, the
activities of authorized users may also be monitored and recorded. Any
material so recorded may be disclosed as appropriate. Anyone using this
system consents to these terms.
vandam login: Starting bandmin: [ OK ]
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
[30755426.580012] named invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[30755426.580040] Pid: 18442, comm: named Not tainted 2.6.24-23-xen #1
[30755426.580045]
[30755426.580046] Call Trace:
[30755426.580071] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30755426.580078] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30755426.580086] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30755426.580096] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[30755426.580105] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[30755426.580113] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[30755426.580121] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[30755426.580132] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30755426.580142] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30755426.580149] [<ffffffff80472447>] error_exit+0x0/0x79
[30755426.580157]
[30755426.580161] DMA per-cpu:
[30755426.580166] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30755426.580172] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30755426.580178] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30755426.580183] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30755426.580188] DMA32 per-cpu:
[30755426.580192] CPU 0: Hot: hi: 186, btch: 31 usd: 162 Cold: hi: 62, btch: 15 usd: 37
[30755426.580197] CPU 1: Hot: hi: 186, btch: 31 usd: 51 Cold: hi: 62, btch: 15 usd: 59
[30755426.580203] CPU 2: Hot: hi: 186, btch: 31 usd: 91 Cold: hi: 62, btch: 15 usd: 51
[30755426.580209] CPU 3: Hot: hi: 186, btch: 31 usd: 70 Cold: hi: 62, btch: 15 usd: 57
[30755426.580216] Active:2101 inactive:76365 dirty:0 writeback:0 unstable:0
[30755426.580217] free:1210 slab:17331 mapped:47 pagetables:23096 bounce:0
[30755426.580225] DMA free:2072kB min:88kB low:108kB high:132kB active:7380kB inactive:296kB present:16160kB pages_scanned:16340 all_unreclaimable? yes
[30755426.580231] lowmem_reserve[]: 0 497 497 497
[30755426.580240] DMA32 free:2768kB min:2804kB low:3504kB high:4204kB active:1024kB inactive:305164kB present:509040kB pages_scanned:553332 all_unreclaimable? yes
[30755426.580248] lowmem_reserve[]: 0 0 0 0
[30755426.580253] DMA: 8*4kB 3*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
[30755426.580269] DMA32: 76*4kB 8*8kB 38*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2768kB
[30755426.580287] Swap cache: add 6121354, delete 6121344, find 304340634/304991196, race 2+1154
[30755426.580292] Free swap = 0kB
[30755426.580295] Total swap = 1048568kB
[30755426.584611] Out of memory: kill process 1041 (httpd) score 170290 or a child
[30755426.584686] Killed process 1041 (httpd)
[30760314.100120] repair invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[30760314.100152] Pid: 1404, comm: repair Not tainted 2.6.24-23-xen #1
[30760314.100157]
[30760314.100157] Call Trace:
[30760314.100184] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30760314.100191] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30760314.100199] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30760314.100209] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[30760314.100217] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[30760314.100226] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[30760314.100233] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[30760314.100242] [<ffffffff80229f83>] set_next_entity+0x23/0x50
[30760314.100251] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30760314.100257] [<ffffffff80470039>] thread_return+0x3a/0x481
[30760314.100266] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30760314.100273] [<ffffffff80472447>] error_exit+0x0/0x79
[30760314.100285]
[30760314.100291] DMA per-cpu:
[30760314.100295] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760314.100301] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760314.100307] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760314.100312] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760314.100317] DMA32 per-cpu:
[30760314.100321] CPU 0: Hot: hi: 186, btch: 31 usd: 114 Cold: hi: 62, btch: 15 usd: 16
[30760314.100327] CPU 1: Hot: hi: 186, btch: 31 usd: 65 Cold: hi: 62, btch: 15 usd: 61
[30760314.100335] CPU 2: Hot: hi: 186, btch: 31 usd: 73 Cold: hi: 62, btch: 15 usd: 52
[30760314.100341] CPU 3: Hot: hi: 186, btch: 31 usd: 66 Cold: hi: 62, btch: 15 usd: 59
[30760314.100349] Active:58539 inactive:20080 dirty:0 writeback:0 unstable:0
[30760314.100350] free:1175 slab:17332 mapped:62 pagetables:22833 bounce:0
[30760314.100357] DMA free:2072kB min:88kB low:108kB high:132kB active:3504kB inactive:3356kB present:16160kB pages_scanned:17931 all_unreclaimable? yes
[30760314.100364] lowmem_reserve[]: 0 497 497 497
[30760314.100375] DMA32 free:2628kB min:2804kB low:3504kB high:4204kB active:230652kB inactive:76964kB present:509040kB pages_scanned:1508074 all_unreclaimable? yes
[30760314.100383] lowmem_reserve[]: 0 0 0 0
[30760314.100389] DMA: 6*4kB 4*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
[30760314.100408] DMA32: 51*4kB 3*8kB 38*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2628kB
[30760314.100424] Swap cache: add 6207627, delete 6207619, find 304343681/305004404, race 2+1183
[30760314.100429] Free swap = 0kB
[30760314.100433] Total swap = 1048568kB
[30760314.103888] Out of memory: kill process 1045 (httpd) score 170271 or a child
[30760314.103946] Killed process 1045 (httpd)
[30761047.316015] httpd invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[30761047.316047] Pid: 1153, comm: httpd Not tainted 2.6.24-23-xen #1
[30761047.316052]
[30761047.316052] Call Trace:
[30761047.316078] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30761047.316085] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30761047.316093] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30761047.316102] [<ffffffff8029169e>] get_swap_bio+0x5e/0xd0
[30761047.316109] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[30761047.316117] [<ffffffff80282eed>] swapin_readahead+0x6d/0x90
[30761047.316124] [<ffffffff80287f27>] handle_mm_fault+0x9d7/0xd60
[30761047.316136] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30761047.316142] [<ffffffff80470039>] thread_return+0x3a/0x481
[30761047.316147] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[30761047.316158] [<ffffffff80472447>] error_exit+0x0/0x79
[30761047.316166]
[30761047.316171] DMA per-cpu:
[30761047.316176] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30761047.316187] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30761047.316193] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30761047.316199] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30761047.316204] DMA32 per-cpu:
[30761047.316207] CPU 0: Hot: hi: 186, btch: 31 usd: 139 Cold: hi: 62, btch: 15 usd: 13
[30761047.316213] CPU 1: Hot: hi: 186, btch: 31 usd: 50 Cold: hi: 62, btch: 15 usd: 56
[30761047.316219] CPU 2: Hot: hi: 186, btch: 31 usd: 63 Cold: hi: 62, btch: 15 usd: 51
[30761047.316225] CPU 3: Hot: hi: 186, btch: 31 usd: 75 Cold: hi: 62, btch: 15 usd: 51
[30761047.316234] Active:44456 inactive:33725 dirty:0 writeback:0 unstable:0
[30761047.316235] free:1216 slab:17353 mapped:37 pagetables:22693 bounce:0
[30761047.316242] DMA free:2076kB min:88kB low:108kB high:132kB active:7148kB inactive:224kB present:16160kB pages_scanned:19762 all_unreclaimable? yes
[30761047.316249] lowmem_reserve[]: 0 497 497 497
[30761047.316258] DMA32 free:2788kB min:2804kB low:3504kB high:4204kB active:170676kB inactive:134676kB present:509040kB pages_scanned:589775 all_unreclaimable? yes
[30761047.316268] lowmem_reserve[]: 0 0 0 0
[30761047.316274] DMA: 5*4kB 5*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2076kB
[30761047.316289] DMA32: 89*4kB 4*8kB 38*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2788kB
[30761047.316306] Swap cache: add 6299339, delete 6299335, find 304345998/305017438, race 2+1206
[30761047.316311] Free swap = 0kB
[30761047.316314] Total swap = 1048568kB
[30761047.320539] Out of memory: kill process 1134 (httpd) score 169665 or a child
[30761047.320607] Killed process 1134 (httpd)
[30757084.472654] tailwatchd invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[30757084.472685] Pid: 1456, comm: tailwatchd Not tainted 2.6.24-23-xen #1
[30757084.472690]
[30757084.472690] Call Trace:
[30757084.472710] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30757084.472717] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30757084.472725] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30757084.472734] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[30757084.472742] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[30757084.472750] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[30757084.472758] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[30757084.472768] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30757084.472777] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30757084.472785] [<ffffffff80472447>] error_exit+0x0/0x79
[30757084.472792]
[30757084.472797] DMA per-cpu:
[30757084.472801] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30757084.472807] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30757084.472813] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30757084.472820] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30757084.472827] DMA32 per-cpu:
[30757084.472832] CPU 0: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 55
[30757084.472839] CPU 1: Hot: hi: 186, btch: 31 usd: 143 Cold: hi: 62, btch: 15 usd: 57
[30757084.472848] CPU 2: Hot: hi: 186, btch: 31 usd: 122 Cold: hi: 62, btch: 15 usd: 27
[30757084.472855] CPU 3: Hot: hi: 186, btch: 31 usd: 133 Cold: hi: 62, btch: 15 usd: 26
[30757084.472865] Active:77415 inactive:1098 dirty:0 writeback:0 unstable:0
[30757084.472866] free:1226 slab:17432 mapped:58 pagetables:22494 bounce:0
[30757084.472876] DMA free:2068kB min:88kB low:108kB high:132kB active:4376kB inactive:3636kB present:16160kB pages_scanned:14304 all_unreclaimable? yes
[30757084.472885] lowmem_reserve[]: 0 497 497 497
[30757084.472907] DMA32 free:2836kB min:2804kB low:3504kB high:4204kB active:305284kB inactive:756kB present:509040kB pages_scanned:517207 all_unreclaimable? yes
[30757084.472917] lowmem_reserve[]: 0 0 0 0
[30757084.472934] DMA: 7*4kB 3*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2068kB
[30757084.472973] DMA32: 103*4kB 3*8kB 38*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2836kB
[30757084.473013] Swap cache: add 6353001, delete 6352997, find 304347483/305025121, race 2+1218
[30757084.473020] Free swap = 0kB
[30757084.473024] Total swap = 1048568kB
[30757084.476640] Out of memory: kill process 1157 (httpd) score 85085 or a child
[30757084.476712] Killed process 1157 (httpd)
[30758094.259843] crond invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[30758094.259878] Pid: 1497, comm: crond Not tainted 2.6.24-23-xen #1
[30758094.259883]
[30758094.259884] Call Trace:
[30758094.259910] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30758094.259917] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30758094.259925] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30758094.259935] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[30758094.259943] [<ffffffff80282eed>] swapin_readahead+0x6d/0x90
[30758094.259950] [<ffffffff80287f27>] handle_mm_fault+0x9d7/0xd60
[30758094.259961] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30758094.259970] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30758094.259978] [<ffffffff80472447>] error_exit+0x0/0x79
[30758094.259986]
[30758094.259991] DMA per-cpu:
[30758094.259995] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30758094.260002] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30758094.260008] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30758094.260013] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30758094.260024] DMA32 per-cpu:
[30758094.260028] CPU 0: Hot: hi: 186, btch: 31 usd: 183 Cold: hi: 62, btch: 15 usd: 52
[30758094.260034] CPU 1: Hot: hi: 186, btch: 31 usd: 135 Cold: hi: 62, btch: 15 usd: 24
[30758094.260039] CPU 2: Hot: hi: 186, btch: 31 usd: 119 Cold: hi: 62, btch: 15 usd: 53
[30758094.260045] CPU 3: Hot: hi: 186, btch: 31 usd: 79 Cold: hi: 62, btch: 15 usd: 52
[30758094.260052] Active:61572 inactive:16051 dirty:0 writeback:0 unstable:0
[30758094.260053] free:1151 slab:17434 mapped:21 pagetables:22463 bounce:0
[30758094.260066] DMA free:2068kB min:88kB low:108kB high:132kB active:4012kB inactive:3944kB present:16160kB pages_scanned:14451 all_unreclaimable? yes
[30758094.260073] lowmem_reserve[]: 0 497 497 497
[30758094.260082] DMA32 free:2536kB min:2804kB low:3504kB high:4204kB active:242276kB inactive:60260kB present:509040kB pages_scanned:2929401 all_unreclaimable? yes
[30758094.260094] lowmem_reserve[]: 0 0 0 0
[30758094.260100] DMA: 5*4kB 4*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2068kB
[30758094.260146] DMA32: 74*4kB 2*8kB 27*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2536kB
[30758094.260167] Swap cache: add 6406037, delete 6406033, find 304348817/305032581, race 2+1252
[30758094.260173] Free swap = 0kB
[30758094.260176] Total swap = 1048568kB
[30758094.264253] Out of memory: kill process 1069 (httpd) score 85071 or a child
[30758094.264330] Killed process 1069 (httpd)
[30760622.948878] named invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[30760622.948912] Pid: 18446, comm: named Not tainted 2.6.24-23-xen #1
[30760622.948917]
[30760622.948918] Call Trace:
[30760622.948944] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30760622.948951] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30760622.948959] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30760622.948969] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[30760622.948978] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[30760622.948987] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[30760622.948994] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[30760622.949003] [<ffffffff80229f83>] set_next_entity+0x23/0x50
[30760622.949012] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30760622.949017] [<ffffffff80470039>] thread_return+0x3a/0x481
[30760622.949027] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30760622.949034] [<ffffffff80472447>] error_exit+0x0/0x79
[30760622.949042]
[30760622.949047] DMA per-cpu:
[30760622.949052] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760622.949058] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760622.949064] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760622.949069] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30760622.949074] DMA32 per-cpu:
[30760622.949078] CPU 0: Hot: hi: 186, btch: 31 usd: 169 Cold: hi: 62, btch: 15 usd: 43
[30760622.949083] CPU 1: Hot: hi: 186, btch: 31 usd: 111 Cold: hi: 62, btch: 15 usd: 20
[30760622.949089] CPU 2: Hot: hi: 186, btch: 31 usd: 104 Cold: hi: 62, btch: 15 usd: 48
[30760622.949096] CPU 3: Hot: hi: 186, btch: 31 usd: 89 Cold: hi: 62, btch: 15 usd: 49
[30760622.949109] Active:76606 inactive:1344 dirty:0 writeback:0 unstable:0
[30760622.949110] free:1193 slab:17460 mapped:18 pagetables:22284 bounce:0
[30760622.949118] DMA free:2072kB min:88kB low:108kB high:132kB active:4044kB inactive:3720kB present:16160kB pages_scanned:27269 all_unreclaimable? yes
[30760622.949124] lowmem_reserve[]: 0 497 497 497
[30760622.949133] DMA32 free:2700kB min:2804kB low:3504kB high:4204kB active:302380kB inactive:1656kB present:509040kB pages_scanned:886600 all_unreclaimable? yes
[30760622.949141] lowmem_reserve[]: 0 0 0 0
[30760622.949153] DMA: 6*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
[30760622.949168] DMA32: 121*4kB 1*8kB 26*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2700kB
[30760622.949191] Swap cache: add 6520414, delete 6520413, find 304351811/305048735, race 2+1306
[30760622.949197] Free swap = 0kB
[30760622.949204] Total swap = 1048568kB
[30760622.952972] Out of memory: kill process 1083 (httpd) score 84832 or a child
[30760622.953036] Killed process 1083 (httpd)
[30759519.344230] httpd invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[30759519.344256] Pid: 1154, comm: httpd Not tainted 2.6.24-23-xen #1
[30759519.344261]
[30759519.344262] Call Trace:
[30759519.344284] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30759519.344290] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30759519.344298] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30759519.344306] [<ffffffff804707b8>] io_schedule+0x28/0x40
[30759519.344313] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[30759519.344321] [<ffffffff80282eed>] swapin_readahead+0x6d/0x90
[30759519.344328] [<ffffffff80287f27>] handle_mm_fault+0x9d7/0xd60
[30759519.344337] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30759519.344341] [<ffffffff80470039>] thread_return+0x3a/0x481
[30759519.344346] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[30759519.344357] [<ffffffff80472447>] error_exit+0x0/0x79
[30759519.344364]
[30759519.344369] DMA per-cpu:
[30759519.344373] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30759519.344379] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30759519.344385] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30759519.344390] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30759519.344395] DMA32 per-cpu:
[30759519.344398] CPU 0: Hot: hi: 186, btch: 31 usd: 170 Cold: hi: 62, btch: 15 usd: 16
[30759519.344404] CPU 1: Hot: hi: 186, btch: 31 usd: 81 Cold: hi: 62, btch: 15 usd: 58
[30759519.344410] CPU 2: Hot: hi: 186, btch: 31 usd: 82 Cold: hi: 62, btch: 15 usd: 59
[30759519.344415] CPU 3: Hot: hi: 186, btch: 31 usd: 92 Cold: hi: 62, btch: 15 usd: 50
[30759519.344422] Active:8147 inactive:69755 dirty:0 writeback:0 unstable:0
[30759519.344423] free:1196 slab:17463 mapped:38 pagetables:22024 bounce:0
[30759519.344430] DMA free:2072kB min:88kB low:108kB high:132kB active:4260kB inactive:3624kB present:16160kB pages_scanned:12129 all_unreclaimable? yes
[30759519.344437] lowmem_reserve[]: 0 497 497 497
[30759519.344445] DMA32 free:2712kB min:2804kB low:3504kB high:4204kB active:28328kB inactive:275396kB present:509040kB pages_scanned:1683527 all_unreclaimable? yes
[30759519.344457] lowmem_reserve[]: 0 0 0 0
[30759519.344463] DMA: 6*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
[30759519.344478] DMA32: 130*4kB 0*8kB 25*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2712kB
[30759519.344500] Swap cache: add 6603939, delete 6603939, find 304353568/305060130, race 2+1326
[30759519.344505] Free swap = 0kB
[30759519.344507] Total swap = 1048568kB
[30759519.348004] Out of memory: kill process 1361 (mysqld) score 67328 or a child
[30759519.348063] Killed process 1361 (mysqld)
[30762953.562036] authProg invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[30762953.562063] Pid: 16863, comm: authProg Not tainted 2.6.24-23-xen #1
[30762953.562068]
[30762953.562069] Call Trace:
[30762953.562095] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30762953.562102] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30762953.562111] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30762953.562121] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[30762953.562128] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[30762953.562137] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[30762953.562145] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[30762953.562156] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30762953.562161] [<ffffffff80470039>] thread_return+0x3a/0x481
[30762953.562171] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30762953.562178] [<ffffffff80472447>] error_exit+0x0/0x79
[30762953.562186]
[30762953.562191] DMA per-cpu:
[30762953.562196] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762953.562202] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762953.562207] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762953.562213] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762953.562217] DMA32 per-cpu:
[30762953.562221] CPU 0: Hot: hi: 186, btch: 31 usd: 154 Cold: hi: 62, btch: 15 usd: 52
[30762953.562227] CPU 1: Hot: hi: 186, btch: 31 usd: 101 Cold: hi: 62, btch: 15 usd: 57
[30762953.562232] CPU 2: Hot: hi: 186, btch: 31 usd: 122 Cold: hi: 62, btch: 15 usd: 49
[30762953.562238] CPU 3: Hot: hi: 186, btch: 31 usd: 93 Cold: hi: 62, btch: 15 usd: 46
[30762953.562245] Active:57135 inactive:21435 dirty:0 writeback:0 unstable:0
[30762953.562246] free:1200 slab:17129 mapped:34 pagetables:21950 bounce:0
[30762953.562254] DMA free:2052kB min:88kB low:108kB high:132kB active:4020kB inactive:3644kB present:16160kB pages_scanned:11621 all_unreclaimable? yes
[30762953.562261] lowmem_reserve[]: 0 497 497 497
[30762953.562271] DMA32 free:2748kB min:2804kB low:3504kB high:4204kB active:224520kB inactive:82096kB present:509040kB pages_scanned:1242257 all_unreclaimable? yes
[30762953.562278] lowmem_reserve[]: 0 0 0 0
[30762953.562285] DMA: 1*4kB 4*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2052kB
[30762953.562324] DMA32: 49*4kB 27*8kB 34*16kB 4*32kB 0*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2748kB
[30762953.562344] Swap cache: add 7608409, delete 7608408, find 304366803/305185723, race 3+1473
[30762953.562349] Free swap = 0kB
[30762953.562352] Total swap = 1048568kB
[30762953.566272] Out of memory: kill process 1044 (httpd) score 56555 or a child
[30762953.566352] Killed process 1044 (httpd)
[30766218.451310] init invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[30766218.451336] Pid: 1, comm: init Not tainted 2.6.24-23-xen #1
[30766218.451341]
[30766218.451342] Call Trace:
[30766218.451373] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30766218.451380] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30766218.451389] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30766218.451399] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[30766218.451407] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[30766218.451415] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[30766218.451423] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[30766218.451434] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30766218.451446] [<ffffffff80472447>] error_exit+0x0/0x79
[30766218.451454]
[30766218.451459] DMA per-cpu:
[30766218.451463] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30766218.451469] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30766218.451475] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30766218.451481] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30766218.451486] DMA32 per-cpu:
[30766218.451489] CPU 0: Hot: hi: 186, btch: 31 usd: 154 Cold: hi: 62, btch: 15 usd: 61
[30766218.451495] CPU 1: Hot: hi: 186, btch: 31 usd: 94 Cold: hi: 62, btch: 15 usd: 51
[30766218.451500] CPU 2: Hot: hi: 186, btch: 31 usd: 55 Cold: hi: 62, btch: 15 usd: 31
[30766218.451506] CPU 3: Hot: hi: 186, btch: 31 usd: 66 Cold: hi: 62, btch: 15 usd: 50
[30766218.451513] Active:25565 inactive:54410 dirty:0 writeback:0 unstable:0
[30766218.451514] free:1257 slab:17091 mapped:48 pagetables:21205 bounce:0
[30766218.451521] DMA free:2068kB min:88kB low:108kB high:132kB active:4268kB inactive:3628kB present:16160kB pages_scanned:11398 all_unreclaimable? yes
[30766218.451527] lowmem_reserve[]: 0 497 497 497
[30766218.451536] DMA32 free:2960kB min:2804kB low:3504kB high:4204kB active:97992kB inactive:214012kB present:509040kB pages_scanned:672881 all_unreclaimable? yes
[30766218.451544] lowmem_reserve[]: 0 0 0 0
[30766218.451558] DMA: 5*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2068kB
[30766218.451574] DMA32: 98*4kB 21*8kB 36*16kB 3*32kB 1*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2960kB
[30766218.451590] Swap cache: add 8046493, delete 8046493, find 304375642/305244023, race 4+1592
[30766218.451594] Free swap = 0kB
[30766218.451597] Total swap = 1048568kB
[30766218.455537] Out of memory: kill process 1096 (httpd) score 56555 or a child
[30766218.455613] Killed process 1096 (httpd)
[30762391.141334] irqbalance invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[30762391.141362] Pid: 4220, comm: irqbalance Not tainted 2.6.24-23-xen #1
[30762391.141367]
[30762391.141368] Call Trace:
[30762391.141395] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30762391.141402] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30762391.141410] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30762391.141421] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[30762391.141429] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[30762391.141438] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[30762391.141446] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[30762391.141457] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30762391.141464] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[30762391.141474] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30762391.141482] [<ffffffff80472447>] error_exit+0x0/0x79
[30762391.141490]
[30762391.141495] DMA per-cpu:
[30762391.141499] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762391.141506] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762391.141512] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762391.141517] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762391.141522] DMA32 per-cpu:
[30762391.141526] CPU 0: Hot: hi: 186, btch: 31 usd: 76 Cold: hi: 62, btch: 15 usd: 37
[30762391.141532] CPU 1: Hot: hi: 186, btch: 31 usd: 92 Cold: hi: 62, btch: 15 usd: 61
[30762391.141538] CPU 2: Hot: hi: 186, btch: 31 usd: 54 Cold: hi: 62, btch: 15 usd: 61
[30762391.141543] CPU 3: Hot: hi: 186, btch: 31 usd: 95 Cold: hi: 62, btch: 15 usd: 60
[30762391.141550] Active:53830 inactive:25670 dirty:0 writeback:0 unstable:0
[30762391.141551] free:1212 slab:17084 mapped:51 pagetables:21257 bounce:0
[30762391.141559] DMA free:2076kB min:88kB low:108kB high:132kB active:4404kB inactive:3528kB present:16160kB pages_scanned:13274 all_unreclaimable? yes
[30762391.141565] lowmem_reserve[]: 0 497 497 497
[30762391.141574] DMA32 free:2772kB min:2804kB low:3504kB high:4204kB active:210916kB inactive:99152kB present:509040kB pages_scanned:1109653 all_unreclaimable? yes
[30762391.141582] lowmem_reserve[]: 0 0 0 0
[30762391.141608] DMA: 7*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2076kB
[30762391.141624] DMA32: 81*4kB 6*8kB 36*16kB 3*32kB 1*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2772kB
[30762391.141640] Swap cache: add 8092376, delete 8092376, find 304376421/305249886, race 5+1598
[30762391.141645] Free swap = 0kB
[30762391.141648] Total swap = 1048568kB
[30762391.145235] Out of memory: kill process 1070 (httpd) score 42416 or a child
[30762391.145293] Killed process 1070 (httpd)
[30767116.801963] tailwatchd invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[30767116.801985] Pid: 1915, comm: tailwatchd Not tainted 2.6.24-23-xen #1
[30767116.801989]
[30767116.801990] Call Trace:
[30767116.802010] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30767116.802016] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30767116.802024] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30767116.802032] [<ffffffff8029169e>] get_swap_bio+0x5e/0xd0
[30767116.802038] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[30767116.802046] [<ffffffff80282eed>] swapin_readahead+0x6d/0x90
[30767116.802052] [<ffffffff80287f27>] handle_mm_fault+0x9d7/0xd60
[30767116.802062] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30767116.802072] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[30767116.802079] [<ffffffff80472447>] error_exit+0x0/0x79
[30767116.802086]
[30767116.802091] DMA per-cpu:
[30767116.802095] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30767116.802101] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30767116.802107] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30767116.802112] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30767116.802117] DMA32 per-cpu:
[30767116.802120] CPU 0: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 38
[30767116.802126] CPU 1: Hot: hi: 186, btch: 31 usd: 103 Cold: hi: 62, btch: 15 usd: 55
[30767116.802136] CPU 2: Hot: hi: 186, btch: 31 usd: 61 Cold: hi: 62, btch: 15 usd: 51
[30767116.802142] CPU 3: Hot: hi: 186, btch: 31 usd: 77 Cold: hi: 62, btch: 15 usd: 58
[30767116.802148] Active:49647 inactive:29951 dirty:0 writeback:0 unstable:0
[30767116.802149] free:1204 slab:17080 mapped:45 pagetables:21033 bounce:0
[30767116.802157] DMA free:2056kB min:88kB low:108kB high:132kB active:4332kB inactive:3556kB present:16160kB pages_scanned:14227 all_unreclaimable? yes
[30767116.802163] lowmem_reserve[]: 0 497 497 497
[30767116.802171] DMA32 free:2760kB min:2804kB low:3504kB high:4204kB active:194256kB inactive:116248kB present:509040kB pages_scanned:1764127 all_unreclaimable? yes
[30767116.802181] lowmem_reserve[]: 0 0 0 0
[30767116.802187] DMA: 0*4kB 3*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2056kB
[30767116.802202] DMA32: 90*4kB 0*8kB 36*16kB 3*32kB 1*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2760kB
[30767116.802219] Swap cache: add 8124690, delete 8124690, find 304376859/305253852, race 5+1603
[30767116.802224] Free swap = 0kB
[30767116.802226] Total swap = 1048568kB
[30767116.806156] Out of memory: kill process 1078 (httpd) score 42416 or a child
[30767116.806212] Killed process 1078 (httpd)
[30762981.668973] httpd invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[30762981.668996] Pid: 1143, comm: httpd Not tainted 2.6.24-23-xen #1
[30762981.669001]
[30762981.669001] Call Trace:
[30762981.669021] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30762981.669028] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30762981.669036] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30762981.669044] [<ffffffff8029169e>] get_swap_bio+0x5e/0xd0
[30762981.669050] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[30762981.669058] [<ffffffff80282eed>] swapin_readahead+0x6d/0x90
[30762981.669064] [<ffffffff80287f27>] handle_mm_fault+0x9d7/0xd60
[30762981.669074] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30762981.669079] [<ffffffff80470039>] thread_return+0x3a/0x481
[30762981.669084] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[30762981.669094] [<ffffffff80472447>] error_exit+0x0/0x79
[30762981.669102]
[30762981.669106] DMA per-cpu:
[30762981.669110] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762981.669116] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762981.669122] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762981.669127] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30762981.669132] DMA32 per-cpu:
[30762981.669135] CPU 0: Hot: hi: 186, btch: 31 usd: 155 Cold: hi: 62, btch: 15 usd: 53
[30762981.669141] CPU 1: Hot: hi: 186, btch: 31 usd: 101 Cold: hi: 62, btch: 15 usd: 53
[30762981.669147] CPU 2: Hot: hi: 186, btch: 31 usd: 141 Cold: hi: 62, btch: 15 usd: 59
[30762981.669152] CPU 3: Hot: hi: 186, btch: 31 usd: 116 Cold: hi: 62, btch: 15 usd: 58
[30762981.669159] Active:23428 inactive:56187 dirty:0 writeback:0 unstable:0
[30762981.669160] free:1215 slab:17134 mapped:46 pagetables:20810 bounce:0
[30762981.669168] DMA free:2060kB min:88kB low:108kB high:132kB active:4180kB inactive:3528kB present:16160kB pages_scanned:26840 all_unreclaimable? yes
[30762981.669174] lowmem_reserve[]: 0 497 497 497
[30762981.669182] DMA32 free:2800kB min:2804kB low:3504kB high:4204kB active:89532kB inactive:221220kB present:509040kB pages_scanned:842512 all_unreclaimable? yes
[30762981.669190] lowmem_reserve[]: 0 0 0 0
[30762981.669196] DMA: 3*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2060kB
[30762981.669211] DMA32: 110*4kB 3*8kB 32*16kB 3*32kB 1*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2800kB
[30762981.669226] Swap cache: add 8186303, delete 8186303, find 304377328/305261211, race 6+1613
[30762981.669231] Free swap = 0kB
[30762981.669234] Total swap = 1048568kB
[30762981.672945] Out of memory: kill process 1079 (httpd) score 42416 or a child
[30762981.673029] Killed process 1079 (httpd)
[30763325.322855] httpd invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[30763325.322877] Pid: 1135, comm: httpd Not tainted 2.6.24-23-xen #1
[30763325.322881]
[30763325.322882] Call Trace:
[30763325.322902] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30763325.322909] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30763325.322917] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30763325.322924] [<ffffffff804707b8>] io_schedule+0x28/0x40
[30763325.322932] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[30763325.322940] [<ffffffff80282eed>] swapin_readahead+0x6d/0x90
[30763325.322947] [<ffffffff80287f27>] handle_mm_fault+0x9d7/0xd60
[30763325.322955] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30763325.322960] [<ffffffff80470039>] thread_return+0x3a/0x481
[30763325.322968] [<ffffffff802b6587>] mntput_no_expire+0x27/0xb0
[30763325.322976] [<ffffffff80472447>] error_exit+0x0/0x79
[30763325.322984]
[30763325.322988] DMA per-cpu:
[30763325.322992] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763325.322999] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763325.323004] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763325.323010] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763325.323015] DMA32 per-cpu:
[30763325.323018] CPU 0: Hot: hi: 186, btch: 31 usd: 114 Cold: hi: 62, btch: 15 usd: 54
[30763325.323024] CPU 1: Hot: hi: 186, btch: 31 usd: 90 Cold: hi: 62, btch: 15 usd: 23
[30763325.323029] CPU 2: Hot: hi: 186, btch: 31 usd: 71 Cold: hi: 62, btch: 15 usd: 56
[30763325.323035] CPU 3: Hot: hi: 186, btch: 31 usd: 39 Cold: hi: 62, btch: 15 usd: 49
[30763325.323041] Active:78399 inactive:1156 dirty:0 writeback:0 unstable:0
[30763325.323042] free:1197 slab:17138 mapped:52 pagetables:20734 bounce:0
[30763325.323050] DMA free:2064kB min:88kB low:108kB high:132kB active:4244kB inactive:3568kB present:16160kB pages_scanned:11793 all_unreclaimable? yes
[30763325.323057] lowmem_reserve[]: 0 497 497 497
[30763325.323065] DMA32 free:2724kB min:2804kB low:3504kB high:4204kB active:309352kB inactive:1056kB present:509040kB pages_scanned:717231 all_unreclaimable? yes
[30763325.323072] lowmem_reserve[]: 0 0 0 0
[30763325.323078] DMA: 4*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2064kB
[30763325.323093] DMA32: 101*4kB 0*8kB 31*16kB 3*32kB 1*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2724kB
[30763325.323109] Swap cache: add 8261879, delete 8261878, find 304378043/305270398, race 6+1620
[30763325.323114] Free swap = 0kB
[30763325.323116] Total swap = 1048568kB
[30763325.326558] Out of memory: kill process 1081 (httpd) score 42416 or a child
[30763325.326616] Killed process 1081 (httpd)
[30763856.894243] httpd invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[30763856.894265] Pid: 1151, comm: httpd Not tainted 2.6.24-23-xen #1
[30763856.894270]
[30763856.894271] Call Trace:
[30763856.894292] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[30763856.894299] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[30763856.894307] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[30763856.894314] [<ffffffff8029169e>] get_swap_bio+0x5e/0xd0
[30763856.894321] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[30763856.894329] [<ffffffff80282eed>] swapin_readahead+0x6d/0x90
[30763856.894335] [<ffffffff80287f27>] handle_mm_fault+0x9d7/0xd60
[30763856.894345] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[30763856.894350] [<ffffffff80470039>] thread_return+0x3a/0x481
[30763856.894354] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[30763856.894365] [<ffffffff80472447>] error_exit+0x0/0x79
[30763856.894373]
[30763856.894377] DMA per-cpu:
[30763856.894381] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763856.894387] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763856.894393] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763856.894398] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[30763856.894403] DMA32 per-cpu:
[30763856.894407] CPU 0: Hot: hi: 186, btch: 31 usd: 147 Cold: hi: 62, btch: 15 usd: 30
[30763856.894412] CPU 1: Hot: hi: 186, btch: 31 usd: 73 Cold: hi: 62, btch: 15 usd: 55
[30763856.894418] CPU 2: Hot: hi: 186, btch: 31 usd: 74 Cold: hi: 62, btch: 15 usd: 61
[30763856.894424] CPU 3: Hot: hi: 186, btch: 31 usd: 93 Cold: hi: 62, btch: 15 usd: 50
[30763856.894431] Active:68323 inactive:11170 dirty:0 writeback:0 unstable:0
[30763856.894432] free:1208 slab:17150 mapped:39 pagetables:20465 bounce:0
[30763856.894440] DMA free:2072kB min:88kB low:108kB high:132kB active:4088kB inactive:3488kB present:16160kB pages_scanned:33413 all_unreclaimable? yes
[30763856.894446] lowmem_reserve[]: 0 497 497 497
[30763856.894455] DMA32 free:2760kB min:2804kB low:3504kB high:4204kB active:269204kB inactive:41192kB present:509040kB pages_scanned:696912 all_unreclaimable? yes
[30763856.894462] lowmem_reserve[]: 0 0 0 0
[30763856.894471] DMA: 8*4kB 3*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
[30763856.894486] DMA32: 106*4kB 2*8kB 31*16kB 3*32kB 1*64kB 3*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2760kB
[30763856.894503] Swap cache: add 8370884, delete 8370884, find 304379717/305284480, race 6+1648
[30763856.894508] Free swap = 0kB
[30763856.894510] Total swap = 1048568kB
[30763856.898034] Out of memory: kill process 1085 (httpd) score 42416 or a child
[30763856.898084] Killed process 1085 (httpd)
[31932031.739394] swapper: page allocation failure. order:0, mode:0x20
[31932031.739419] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.739424]
[31932031.739425] Call Trace:
[31932031.739431] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.739466] [<ffffffff8041f362>] ip_queue_xmit+0x2f2/0x470
[31932031.739475] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.739482] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.739490] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.739497] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.739503] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.739512] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.739520] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.739527] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.739534] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.739542] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.739555] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.739561] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.739569] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.739576] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.739585] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.739595] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.739604] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.739612] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.739619] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.739625] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.739630] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.739637] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.739646] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.739650] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.739666] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.739671] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.739688] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.739694] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.739700]
[31932031.739704] DMA per-cpu:
[31932031.739708] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.739715] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.739721] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.739727] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.739732] DMA32 per-cpu:
[31932031.739735] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.739742] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.739748] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.739753] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.739760] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.739761] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.739770] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.739777] lowmem_reserve[]: 0 497 497 497
[31932031.739785] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.739792] lowmem_reserve[]: 0 0 0 0
[31932031.739798] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.739813] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.739829] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.739834] Free swap = 900120kB
[31932031.739837] Total swap = 1048568kB
[31932031.743800] swapper: page allocation failure. order:0, mode:0x20
[31932031.743814] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.743818]
[31932031.743819] Call Trace:
[31932031.743823] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.743851] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.743858] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.743867] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.743875] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.743881] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.743890] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.743898] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.743905] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.743913] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.743920] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.743929] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.743935] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.743943] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.743950] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.743959] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.743970] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.743979] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.743987] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.743995] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.744000] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.744006] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.744012] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.744021] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.744026] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.744040] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.744045] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.744056] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.744063] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.744068]
[31932031.744072] DMA per-cpu:
[31932031.744076] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.744082] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.744087] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.744093] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.744098] DMA32 per-cpu:
[31932031.744101] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.744107] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.744113] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.744118] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.744125] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.744126] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.744135] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.744141] lowmem_reserve[]: 0 497 497 497
[31932031.744148] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.744155] lowmem_reserve[]: 0 0 0 0
[31932031.744161] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.744175] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.744191] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.744196] Free swap = 900120kB
[31932031.744199] Total swap = 1048568kB
[31932031.748219] swapper: page allocation failure. order:0, mode:0x20
[31932031.748233] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.748237]
[31932031.748238] Call Trace:
[31932031.748242] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.748270] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.748278] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.748286] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.748294] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.748300] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.748308] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.748316] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.748323] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.748330] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.748338] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.748347] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.748353] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.748364] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.748371] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.748380] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.748391] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.748400] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.748408] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.748416] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.748422] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.748427] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.748433] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.748442] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.748446] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.748459] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.748464] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.748472] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.748479] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.748484]
[31932031.748488] DMA per-cpu:
[31932031.748491] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.748497] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.748502] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.748508] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.748513] DMA32 per-cpu:
[31932031.748516] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.748522] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.748528] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.748534] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.748541] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.748542] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.748550] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.748556] lowmem_reserve[]: 0 497 497 497
[31932031.748564] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.748570] lowmem_reserve[]: 0 0 0 0
[31932031.748576] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.748594] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.748609] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.748614] Free swap = 900120kB
[31932031.748617] Total swap = 1048568kB
[31932031.752508] swapper: page allocation failure. order:0, mode:0x20
[31932031.752520] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.752524]
[31932031.752524] Call Trace:
[31932031.752528] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.752556] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.752563] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.752572] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.752579] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.752585] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.752593] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.752601] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.752607] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.752614] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.752622] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.752631] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.752637] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.752644] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.752651] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.752660] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.752670] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.752679] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.752687] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.752694] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.752700] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.752705] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.752711] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.752720] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.752724] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.752737] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.752742] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.752750] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.752757] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.752762]
[31932031.752765] DMA per-cpu:
[31932031.752769] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.752774] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.752779] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.752784] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.752789] DMA32 per-cpu:
[31932031.752792] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.752797] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.752803] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.752808] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.752814] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.752815] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.752822] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.752828] lowmem_reserve[]: 0 497 497 497
[31932031.752835] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.752841] lowmem_reserve[]: 0 0 0 0
[31932031.752846] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.752859] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.752873] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.752878] Free swap = 900120kB
[31932031.752880] Total swap = 1048568kB
[31932031.756768] swapper: page allocation failure. order:0, mode:0x20
[31932031.756779] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.756783]
[31932031.756783] Call Trace:
[31932031.756787] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.756813] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.756820] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.756828] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.756836] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.756842] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.756849] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.756856] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.756862] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.756870] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.756877] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.756885] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.756891] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.756899] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.756905] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.756914] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.756925] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.756933] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.756941] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.756948] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.756953] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.756958] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.756964] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.756973] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.756976] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.756989] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.756993] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.757002] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.757008] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.945911]
[31932031.945925] DMA per-cpu:
[31932031.945929] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.945943] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.945948] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.945953] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.945958] DMA32 per-cpu:
[31932031.945961] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.945967] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.945972] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.945980] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.945987] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.945988] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.945996] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.946003] lowmem_reserve[]: 0 497 497 497
[31932031.946011] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.946018] lowmem_reserve[]: 0 0 0 0
[31932031.946024] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.946041] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.946060] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.946066] Free swap = 900120kB
[31932031.946069] Total swap = 1048568kB
[31932031.949646] swapper: page allocation failure. order:0, mode:0x20
[31932031.949660] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.949665]
[31932031.949665] Call Trace:
[31932031.949670] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.949695] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.949702] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.949711] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.949718] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.949724] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.949732] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.949740] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.949747] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.949754] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.949762] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.949770] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.949776] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.949783] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.949790] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.949798] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.949809] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.949817] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.949825] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.949832] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.949838] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.949842] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.949848] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.949857] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.949861] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.949875] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.949879] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.949887] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.949893] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.949898]
[31932031.949902] DMA per-cpu:
[31932031.949906] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.949912] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.949917] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.949923] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.949928] DMA32 per-cpu:
[31932031.949931] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.949937] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.949942] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.949948] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.949955] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.949956] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.949964] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.949970] lowmem_reserve[]: 0 497 497 497
[31932031.949977] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.949984] lowmem_reserve[]: 0 0 0 0
[31932031.949990] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.950006] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.950022] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.950027] Free swap = 900120kB
[31932031.950029] Total swap = 1048568kB
[31932031.953578] swapper: page allocation failure. order:0, mode:0x20
[31932031.953595] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.953599]
[31932031.953600] Call Trace:
[31932031.953605] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.953630] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.953638] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.953646] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.953653] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.953659] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.953668] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.953675] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.953682] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.953689] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.953697] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.953705] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.953711] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.953718] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.953725] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.953733] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.953744] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.953752] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.953760] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.953767] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.953772] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.953777] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.953784] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.953792] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.953797] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.953810] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.953815] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.953822] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.953828] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.953834]
[31932031.953838] DMA per-cpu:
[31932031.953842] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.953848] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.953854] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.953859] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.953864] DMA32 per-cpu:
[31932031.953868] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.953873] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.953879] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.953884] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.953891] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.953892] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.953900] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.953906] lowmem_reserve[]: 0 497 497 497
[31932031.953914] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.953921] lowmem_reserve[]: 0 0 0 0
[31932031.953927] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.953941] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.953957] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.953962] Free swap = 900120kB
[31932031.953964] Total swap = 1048568kB
[31932031.957656] swapper: page allocation failure. order:0, mode:0x20
[31932031.957671] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.957675]
[31932031.957676] Call Trace:
[31932031.957681] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.957706] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.957713] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.957721] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.957728] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.957734] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.957743] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932031.957750] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932031.957757] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932031.957764] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932031.957771] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932031.957779] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932031.957785] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932031.957791] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932031.957798] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932031.957806] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932031.957816] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932031.957824] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932031.957831] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932031.957838] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932031.957844] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932031.957848] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932031.957854] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932031.957862] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932031.957866] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932031.957879] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932031.957883] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932031.957890] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932031.957896] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932031.957901]
[31932031.957905] DMA per-cpu:
[31932031.957908] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.957914] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.957920] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.957925] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932031.957929] DMA32 per-cpu:
[31932031.957932] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932031.957938] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932031.957943] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932031.957948] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932031.957954] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932031.957955] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932031.957963] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932031.957968] lowmem_reserve[]: 0 497 497 497
[31932031.957976] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932031.957982] lowmem_reserve[]: 0 0 0 0
[31932031.957987] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932031.958000] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932031.958014] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932031.958019] Free swap = 900120kB
[31932031.958022] Total swap = 1048568kB
[31932031.961502] swapper: page allocation failure. order:0, mode:0x20
[31932031.961516] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932031.961520]
[31932031.961521] Call Trace:
[31932031.961525] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932031.961550] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932031.961557] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932031.961565] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932031.961572] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932031.961577] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932031.961585] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932032.136602] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932032.136627] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932032.136635] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932032.136643] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932032.136653] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932032.136659] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932032.136667] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932032.136675] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932032.136685] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932032.136696] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932032.136705] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932032.136713] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932032.136721] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932032.136727] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932032.136732] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932032.136738] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932032.136747] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932032.136752] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932032.136766] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932032.136771] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932032.136780] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932032.136786] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932032.136792]
[31932032.136797] DMA per-cpu:
[31932032.136802] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.136809] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.136815] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.136820] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.136826] DMA32 per-cpu:
[31932032.136829] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932032.136835] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932032.136841] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932032.136847] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932032.136854] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932032.136855] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932032.136864] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932032.136870] lowmem_reserve[]: 0 497 497 497
[31932032.136878] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932032.136885] lowmem_reserve[]: 0 0 0 0
[31932032.136891] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932032.136906] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932032.136923] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932032.136928] Free swap = 900120kB
[31932032.136931] Total swap = 1048568kB
[31932032.140759] swapper: page allocation failure. order:0, mode:0x20
[31932032.140776] Pid: 0, comm: swapper Not tainted 2.6.24-23-xen #1
[31932032.140781]
[31932032.140781] Call Trace:
[31932032.140786] <IRQ> [<ffffffff80278ced>] __alloc_pages+0x2dd/0x3c0
[31932032.140812] [<ffffffff8029a0ce>] cache_alloc_refill+0x2ee/0x5f0
[31932032.140820] [<ffffffff8029a528>] __kmalloc+0x158/0x160
[31932032.140828] [<ffffffff803ed648>] __alloc_skb+0x68/0x150
[31932032.140835] [<ffffffff80431866>] tcp_send_ack+0x26/0x110
[31932032.140841] [<ffffffff8042ff30>] tcp_rcv_established+0x350/0x9f0
[31932032.140849] [<ffffffff881c2e20>] :ip_tables:ipt_do_table+0x240/0x520
[31932032.140857] [<ffffffff8043738b>] tcp_v4_do_rcv+0x36b/0x700
[31932032.140864] [<ffffffff80278520>] get_page_from_freelist+0xc0/0x520
[31932032.140871] [<ffffffff80416be8>] ip_route_input+0x38/0xe50
[31932032.140879] [<ffffffff8043a275>] tcp_v4_rcv+0x895/0xaf0
[31932032.140887] [<ffffffff80419c93>] ip_local_deliver_finish+0xc3/0x250
[31932032.140893] [<ffffffff80419934>] ip_rcv_finish+0x114/0x3b0
[31932032.140900] [<ffffffff80252083>] getnstimeofday+0x33/0xa0
[31932032.140907] [<ffffffff803f322c>] netif_receive_skb+0x3cc/0x4c0
[31932032.140916] [<ffffffff8039c391>] netif_poll+0x2c1/0xd80
[31932032.140926] [<ffffffff8022ce81>] run_rebalance_domains+0x1d1/0x5a0
[31932032.140934] [<ffffffff803f5ada>] net_rx_action+0x19a/0x2b0
[31932032.140942] [<ffffffff8023b938>] __do_softirq+0x98/0x130
[31932032.140950] [<ffffffff8020d33c>] call_softirq+0x1c/0x30
[31932032.140955] [<ffffffff8020e985>] do_softirq+0x95/0xf0
[31932032.140960] [<ffffffff8020ec02>] do_IRQ+0x62/0xc0
[31932032.140966] [<ffffffff80382af5>] evtchn_do_upcall+0x135/0x260
[31932032.140975] [<ffffffff8020cdae>] do_hypervisor_callback+0x1e/0x30
[31932032.140980] <EOI> [<ffffffff802101cf>] xen_safe_halt+0x8f/0xe0
[31932032.140992] [<ffffffff8020b6d8>] xen_idle+0x48/0x90
[31932032.140997] [<ffffffff8020ae53>] cpu_idle+0x73/0xe0
[31932032.141005] [<ffffffff805e7c65>] start_kernel+0x2e5/0x390
[31932032.141012] [<ffffffff805e714e>] _sinittext+0x14e/0x160
[31932032.141017]
[31932032.141021] DMA per-cpu:
[31932032.141025] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.141031] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.141037] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.141043] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[31932032.141048] DMA32 per-cpu:
[31932032.141051] CPU 0: Hot: hi: 186, btch: 31 usd: 178 Cold: hi: 62, btch: 15 usd: 58
[31932032.141057] CPU 1: Hot: hi: 186, btch: 31 usd: 43 Cold: hi: 62, btch: 15 usd: 1
[31932032.141063] CPU 2: Hot: hi: 186, btch: 31 usd: 160 Cold: hi: 62, btch: 15 usd: 48
[31932032.141069] CPU 3: Hot: hi: 186, btch: 31 usd: 107 Cold: hi: 62, btch: 15 usd: 4
[31932032.141075] Active:90342 inactive:9635 dirty:1990 writeback:0 unstable:0
[31932032.141077] free:754 slab:19305 mapped:10517 pagetables:3300 bounce:0
[31932032.141084] DMA free:2000kB min:88kB low:108kB high:132kB active:7616kB inactive:288kB present:16160kB pages_scanned:32 all_unreclaimable? no
[31932032.141092] lowmem_reserve[]: 0 497 497 497
[31932032.141100] DMA32 free:1016kB min:2804kB low:3504kB high:4204kB active:353752kB inactive:38252kB present:509040kB pages_scanned:109 all_unreclaimable? no
[31932032.141107] lowmem_reserve[]: 0 0 0 0
[31932032.141112] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2000kB
[31932032.141127] DMA32: 1*4kB 1*8kB 1*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 988kB
[31932032.141143] Swap cache: add 8973720, delete 8966279, find 321212920/322216558, race 22+1724
[31932032.141148] Free swap = 900120kB
[31932032.141151] Total swap = 1048568kB
[38811021.680436] printk: 7 messages suppressed.
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
INIT: version 2.86 reloading
[44976223.539909] httpd invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44976223.539935] Pid: 29624, comm: httpd Not tainted 2.6.24-23-xen #1
[44976223.539940]
[44976223.539941] Call Trace:
[44976223.539967] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44976223.539974] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44976223.539983] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44976223.539993] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44976223.540001] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44976223.540009] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44976223.540017] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44976223.540029] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44976223.540035] [<ffffffff80470039>] thread_return+0x3a/0x481
[44976223.540042] [<ffffffff8024ce89>] remove_wait_queue+0x19/0x60
[44976223.540051] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44976223.540059] [<ffffffff80472447>] error_exit+0x0/0x79
[44976223.540067]
[44976223.540071] DMA per-cpu:
[44976223.540076] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44976223.540082] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44976223.540087] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44976223.540093] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44976223.540099] DMA32 per-cpu:
[44976223.540102] CPU 0: Hot: hi: 186, btch: 31 usd: 53 Cold: hi: 62, btch: 15 usd: 61
[44976223.540108] CPU 1: Hot: hi: 186, btch: 31 usd: 72 Cold: hi: 62, btch: 15 usd: 56
[44976223.540114] CPU 2: Hot: hi: 186, btch: 31 usd: 79 Cold: hi: 62, btch: 15 usd: 59
[44976223.540119] CPU 3: Hot: hi: 186, btch: 31 usd: 16 Cold: hi: 62, btch: 15 usd: 53
[44976223.540126] Active:69633 inactive:4460 dirty:0 writeback:0 unstable:0
[44976223.540127] free:1205 slab:21803 mapped:50 pagetables:22814 bounce:0
[44976223.540135] DMA free:2056kB min:88kB low:108kB high:132kB active:4396kB inactive:3356kB present:16160kB pages_scanned:31073 all_unreclaimable? yes
[44976223.540141] lowmem_reserve[]: 0 497 497 497
[44976223.540149] DMA32 free:2764kB min:2804kB low:3504kB high:4204kB active:274136kB inactive:14484kB present:509040kB pages_scanned:718995 all_unreclaimable? yes
[44976223.540156] lowmem_reserve[]: 0 0 0 0
[44976223.540162] DMA: 4*4kB 3*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2056kB
[44976223.540175] DMA32: 131*4kB 10*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2764kB
[44976223.540190] Swap cache: add 18535229, delete 18535228, find 441156800/443365419, race 27+3659
[44976223.540196] Free swap = 0kB
[44976223.540198] Total swap = 1048568kB
[44976223.544242] Out of memory: kill process 11943 (httpd) score 181908 or a child
[44976223.544301] Killed process 11943 (httpd)
[44973131.592196] httpd invoked oom-killer: gfp_mask=0x1200d2, order=0, oomkilladj=0
[44973131.592221] Pid: 12011, comm: httpd Not tainted 2.6.24-23-xen #1
[44973131.592226]
[44973131.592227] Call Trace:
[44973131.592253] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44973131.592260] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44973131.592268] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44973131.592278] [<ffffffff80291b36>] read_swap_cache_async+0xc6/0x110
[44973131.592285] [<ffffffff80287f39>] handle_mm_fault+0x9e9/0xd60
[44973131.592296] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44973131.592302] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[44973131.592311] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44973131.592319] [<ffffffff80472447>] error_exit+0x0/0x79
[44973131.592327]
[44973131.592332] DMA per-cpu:
[44973131.592337] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973131.592344] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973131.592350] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973131.592355] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973131.592360] DMA32 per-cpu:
[44973131.592364] CPU 0: Hot: hi: 186, btch: 31 usd: 121 Cold: hi: 62, btch: 15 usd: 34
[44973131.592370] CPU 1: Hot: hi: 186, btch: 31 usd: 49 Cold: hi: 62, btch: 15 usd: 22
[44973131.592376] CPU 2: Hot: hi: 186, btch: 31 usd: 117 Cold: hi: 62, btch: 15 usd: 60
[44973131.592381] CPU 3: Hot: hi: 186, btch: 31 usd: 87 Cold: hi: 62, btch: 15 usd: 59
[44973131.592389] Active:36425 inactive:37815 dirty:0 writeback:0 unstable:0
[44973131.592390] free:1201 slab:21794 mapped:32 pagetables:22414 bounce:0
[44973131.592398] DMA free:2056kB min:88kB low:108kB high:132kB active:4352kB inactive:3676kB present:16160kB pages_scanned:23235 all_unreclaimable? yes
[44973131.592404] lowmem_reserve[]: 0 497 497 497
[44973131.592413] DMA32 free:2748kB min:2804kB low:3504kB high:4204kB active:141348kB inactive:147584kB present:509040kB pages_scanned:622861 all_unreclaimable? yes
[44973131.592421] lowmem_reserve[]: 0 0 0 0
[44973131.592427] DMA: 0*4kB 3*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2056kB
[44973131.592443] DMA32: 105*4kB 21*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2748kB
[44973131.592460] Swap cache: add 18678939, delete 18678940, find 441160491/443385638, race 27+3717
[44973131.592465] Free swap = 0kB
[44973131.592468] Total swap = 1048568kB
[44973131.596416] Out of memory: kill process 11942 (httpd) score 168470 or a child
[44973131.596487] Killed process 11942 (httpd)
[44977016.621436] httpd invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44977016.621456] Pid: 12009, comm: httpd Not tainted 2.6.24-23-xen #1
[44977016.621461]
[44977016.621462] Call Trace:
[44977016.621483] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44977016.621489] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44977016.621498] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44977016.621507] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44977016.621538] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44977016.621547] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44977016.621554] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44977016.621567] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44977016.621572] [<ffffffff80470039>] thread_return+0x3a/0x481
[44977016.621578] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[44977016.621587] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44977016.621596] [<ffffffff80472447>] error_exit+0x0/0x79
[44977016.621604]
[44977016.621609] DMA per-cpu:
[44977016.621613] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44977016.621619] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44977016.621627] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44977016.621633] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44977016.621638] DMA32 per-cpu:
[44977016.621642] CPU 0: Hot: hi: 186, btch: 31 usd: 207 Cold: hi: 62, btch: 15 usd: 11
[44977016.621647] CPU 1: Hot: hi: 186, btch: 31 usd: 50 Cold: hi: 62, btch: 15 usd: 55
[44977016.621653] CPU 2: Hot: hi: 186, btch: 31 usd: 92 Cold: hi: 62, btch: 15 usd: 5
[44977016.621661] CPU 3: Hot: hi: 186, btch: 31 usd: 82 Cold: hi: 62, btch: 15 usd: 10
[44977016.621667] Active:49482 inactive:25639 dirty:0 writeback:140 unstable:0
[44977016.621669] free:1438 slab:21792 mapped:32 pagetables:22414 bounce:0
[44977016.621677] DMA free:2112kB min:88kB low:108kB high:132kB active:3020kB inactive:4244kB present:16160kB pages_scanned:32 all_unreclaimable? no
[44977016.621683] lowmem_reserve[]: 0 497 497 497
[44977016.621694] DMA32 free:3640kB min:2804kB low:3504kB high:4204kB active:194908kB inactive:98312kB present:509040kB pages_scanned:352 all_unreclaimable? no
[44977016.621701] lowmem_reserve[]: 0 0 0 0
[44977016.621707] DMA: 22*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2136kB
[44977016.621724] DMA32: 313*4kB 20*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 3572kB
[44977016.621739] Swap cache: add 18679130, delete 18678958, find 441160491/443385639, race 27+3717
[44977016.621746] Free swap = 392kB
[44977016.621748] Total swap = 1048568kB
[44977016.625142] Out of memory: kill process 12033 (httpd) score 168470 or a child
[44977016.625192] Killed process 12033 (httpd)
[44973579.723189] ps invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44973579.723214] Pid: 12107, comm: ps Not tainted 2.6.24-23-xen #1
[44973579.723219]
[44973579.723220] Call Trace:
[44973579.723240] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44973579.723246] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44973579.723254] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44973579.723264] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44973579.723272] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44973579.723280] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44973579.723287] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44973579.723296] [<ffffffff802324f9>] mmput+0x9/0xb0
[44973579.723300] [<ffffffff802889f2>] access_process_vm+0x172/0x190
[44973579.723309] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44973579.723318] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44973579.723326] [<ffffffff80472447>] error_exit+0x0/0x79
[44973579.723333]
[44973579.723338] DMA per-cpu:
[44973579.723342] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973579.723349] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973579.723355] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973579.723360] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973579.723365] DMA32 per-cpu:
[44973579.723368] CPU 0: Hot: hi: 186, btch: 31 usd: 116 Cold: hi: 62, btch: 15 usd: 58
[44973579.723374] CPU 1: Hot: hi: 186, btch: 31 usd: 148 Cold: hi: 62, btch: 15 usd: 27
[44973579.723380] CPU 2: Hot: hi: 186, btch: 31 usd: 72 Cold: hi: 62, btch: 15 usd: 53
[44973579.723386] CPU 3: Hot: hi: 186, btch: 31 usd: 97 Cold: hi: 62, btch: 15 usd: 59
[44973579.723393] Active:1974 inactive:73147 dirty:0 writeback:0 unstable:0
[44973579.723394] free:1208 slab:21811 mapped:56 pagetables:21842 bounce:0
[44973579.723402] DMA free:2088kB min:88kB low:108kB high:132kB active:4920kB inactive:1756kB present:16160kB pages_scanned:12161 all_unreclaimable? yes
[44973579.723408] lowmem_reserve[]: 0 497 497 497
[44973579.723417] DMA32 free:2744kB min:2804kB low:3504kB high:4204kB active:2976kB inactive:290832kB present:509040kB pages_scanned:556443 all_unreclaimable? yes
[44973579.723425] lowmem_reserve[]: 0 0 0 0
[44973579.723431] DMA: 10*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2088kB
[44973579.723446] DMA32: 110*4kB 18*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2744kB
[44973579.723463] Swap cache: add 18809185, delete 18809180, find 441164285/443404295, race 27+3780
[44973579.723468] Free swap = 0kB
[44973579.723470] Total swap = 1048568kB
[44973579.726897] Out of memory: kill process 12030 (httpd) score 84225 or a child
[44973579.726950] Killed process 12030 (httpd)
[44973835.495862] cpsrvd invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44973835.495884] Pid: 12115, comm: cpsrvd Not tainted 2.6.24-23-xen #1
[44973835.495889]
[44973835.495890] Call Trace:
[44973835.495910] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44973835.495916] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44973835.495925] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44973835.495934] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44973835.495942] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44973835.495951] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44973835.495958] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44973835.495968] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44973835.495977] [<ffffffff80286ace>] free_pgtables+0x3e/0xf0
[44973835.495986] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44973835.495993] [<ffffffff80472447>] error_exit+0x0/0x79
[44973835.496001]
[44973835.496006] DMA per-cpu:
[44973835.496010] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973835.496016] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973835.496021] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973835.496027] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44973835.496032] DMA32 per-cpu:
[44973835.496035] CPU 0: Hot: hi: 186, btch: 31 usd: 87 Cold: hi: 62, btch: 15 usd: 27
[44973835.496041] CPU 1: Hot: hi: 186, btch: 31 usd: 57 Cold: hi: 62, btch: 15 usd: 14
[44973835.496047] CPU 2: Hot: hi: 186, btch: 31 usd: 81 Cold: hi: 62, btch: 15 usd: 51
[44973835.496052] CPU 3: Hot: hi: 186, btch: 31 usd: 99 Cold: hi: 62, btch: 15 usd: 51
[44973835.496059] Active:1497 inactive:73848 dirty:0 writeback:0 unstable:0
[44973835.496060] free:1200 slab:21800 mapped:34 pagetables:21653 bounce:0
[44973835.496069] DMA free:2064kB min:88kB low:108kB high:132kB active:4228kB inactive:3804kB present:16160kB pages_scanned:14106 all_unreclaimable? yes
[44973835.496075] lowmem_reserve[]: 0 497 497 497
[44973835.496084] DMA32 free:2736kB min:2804kB low:3504kB high:4204kB active:1760kB inactive:291588kB present:509040kB pages_scanned:703241 all_unreclaimable? yes
[44973835.496091] lowmem_reserve[]: 0 0 0 0
[44973835.496097] DMA: 8*4kB 0*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2064kB
[44973835.496113] DMA32: 111*4kB 15*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2724kB
[44973835.496129] Swap cache: add 18851592, delete 18851575, find 441165512/443410401, race 27+3801
[44973835.496134] Free swap = 0kB
[44973835.496137] Total swap = 1048568kB
[44973835.499526] Out of memory: kill process 11977 (httpd) score 84172 or a child
[44973835.499567] Killed process 11977 (httpd)
[44974124.261765] sh invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44974124.261808] Pid: 12135, comm: sh Not tainted 2.6.24-23-xen #1
[44974124.261823]
[44974124.261824] Call Trace:
[44974124.261845] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44974124.261851] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44974124.261859] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44974124.261869] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44974124.261877] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44974124.261885] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44974124.261893] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44974124.261903] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44974124.261909] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[44974124.261919] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44974124.261927] [<ffffffff80472447>] error_exit+0x0/0x79
[44974124.261934]
[44974124.261939] DMA per-cpu:
[44974124.261943] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44974124.261950] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44974124.261956] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44974124.261962] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44974124.261967] DMA32 per-cpu:
[44974124.261970] CPU 0: Hot: hi: 186, btch: 31 usd: 118 Cold: hi: 62, btch: 15 usd: 41
[44974124.261976] CPU 1: Hot: hi: 186, btch: 31 usd: 83 Cold: hi: 62, btch: 15 usd: 57
[44974124.261982] CPU 2: Hot: hi: 186, btch: 31 usd: 90 Cold: hi: 62, btch: 15 usd: 57
[44974124.261988] CPU 3: Hot: hi: 186, btch: 31 usd: 75 Cold: hi: 62, btch: 15 usd: 60
[44974124.261995] Active:34889 inactive:40470 dirty:0 writeback:0 unstable:0
[44974124.261996] free:1218 slab:21816 mapped:71 pagetables:21425 bounce:0
[44974124.262004] DMA free:2072kB min:88kB low:108kB high:132kB active:3912kB inactive:4032kB present:16160kB pages_scanned:12325 all_unreclaimable? yes
[44974124.262010] lowmem_reserve[]: 0 497 497 497
[44974124.262020] DMA32 free:2800kB min:2804kB low:3504kB high:4204kB active:135516kB inactive:157976kB present:509040kB pages_scanned:719298 all_unreclaimable? yes
[44974124.262027] lowmem_reserve[]: 0 0 0 0
[44974124.262033] DMA: 10*4kB 0*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
[44974124.262050] DMA32: 126*4kB 17*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2800kB
[44974124.262066] Swap cache: add 18897243, delete 18897230, find 441167021/443417129, race 27+3815
[44974124.262071] Free swap = 0kB
[44974124.262073] Total swap = 1048568kB
[44974124.265875] Out of memory: kill process 11971 (httpd) score 83934 or a child
[44974124.265951] Killed process 11971 (httpd)
[44978445.919911] httpd invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44978445.919931] Pid: 11986, comm: httpd Not tainted 2.6.24-23-xen #1
[44978445.919936]
[44978445.919937] Call Trace:
[44978445.919957] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44978445.919963] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44978445.919972] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44978445.919981] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44978445.919990] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44978445.919998] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44978445.920005] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44978445.920016] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44978445.920022] [<ffffffff80291c0d>] free_pages_and_swap_cache+0x8d/0xb0
[44978445.920032] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44978445.920039] [<ffffffff80472447>] error_exit+0x0/0x79
[44978445.920047]
[44978445.920052] DMA per-cpu:
[44978445.920060] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44978445.920067] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44978445.920073] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44978445.920078] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44978445.920083] DMA32 per-cpu:
[44978445.920086] CPU 0: Hot: hi: 186, btch: 31 usd: 93 Cold: hi: 62, btch: 15 usd: 34
[44978445.920092] CPU 1: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 40
[44978445.920098] CPU 2: Hot: hi: 186, btch: 31 usd: 141 Cold: hi: 62, btch: 15 usd: 55
[44978445.920104] CPU 3: Hot: hi: 186, btch: 31 usd: 112 Cold: hi: 62, btch: 15 usd: 29
[44978445.920111] Active:3316 inactive:71903 dirty:0 writeback:0 unstable:0
[44978445.920112] free:1210 slab:21818 mapped:31 pagetables:21145 bounce:0
[44978445.920120] DMA free:2068kB min:88kB low:108kB high:132kB active:7540kB inactive:360kB present:16160kB pages_scanned:13125 all_unreclaimable? yes
[44978445.920126] lowmem_reserve[]: 0 497 497 497
[44978445.920135] DMA32 free:2772kB min:2804kB low:3504kB high:4204kB active:5724kB inactive:287252kB present:509040kB pages_scanned:502130 all_unreclaimable? yes
[44978445.920142] lowmem_reserve[]: 0 0 0 0
[44978445.920148] DMA: 5*4kB 2*8kB 3*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2068kB
[44978445.920163] DMA32: 115*4kB 19*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2772kB
[44978445.920179] Swap cache: add 18935523, delete 18935516, find 441168422/443422940, race 28+3838
[44978445.920184] Free swap = 0kB
[44978445.920187] Total swap = 1048568kB
[44978445.923553] Out of memory: kill process 11974 (httpd) score 83934 or a child
[44978445.923597] Killed process 11974 (httpd)
[44979121.457136] cpsrvd invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44979121.457160] Pid: 967, comm: cpsrvd Not tainted 2.6.24-23-xen #1
[44979121.457165]
[44979121.457165] Call Trace:
[44979121.457193] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44979121.457203] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44979121.457215] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44979121.457225] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44979121.457233] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44979121.457242] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44979121.457249] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44979121.457260] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44979121.457266] [<ffffffff8024ce89>] remove_wait_queue+0x19/0x60
[44979121.457275] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44979121.457286] [<ffffffff80472447>] error_exit+0x0/0x79
[44979121.457294]
[44979121.457298] DMA per-cpu:
[44979121.457302] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44979121.457309] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44979121.457314] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44979121.457320] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44979121.457327] DMA32 per-cpu:
[44979121.457331] CPU 0: Hot: hi: 186, btch: 31 usd: 161 Cold: hi: 62, btch: 15 usd: 54
[44979121.457336] CPU 1: Hot: hi: 186, btch: 31 usd: 103 Cold: hi: 62, btch: 15 usd: 60
[44979121.457342] CPU 2: Hot: hi: 186, btch: 31 usd: 62 Cold: hi: 62, btch: 15 usd: 60
[44979121.457348] CPU 3: Hot: hi: 186, btch: 31 usd: 102 Cold: hi: 62, btch: 15 usd: 57
[44979121.457354] Active:73947 inactive:1839 dirty:0 writeback:0 unstable:0
[44979121.457355] free:1213 slab:21846 mapped:31 pagetables:20749 bounce:0
[44979121.457366] DMA free:2072kB min:88kB low:108kB high:132kB active:4336kB inactive:2504kB present:16160kB pages_scanned:16970 all_unreclaimable? yes
[44979121.457372] lowmem_reserve[]: 0 497 497 497
[44979121.457381] DMA32 free:2780kB min:2804kB low:3504kB high:4204kB active:291452kB inactive:4852kB present:509040kB pages_scanned:760450 all_unreclaimable? yes
[44979121.457391] lowmem_reserve[]: 0 0 0 0
[44979121.457397] DMA: 6*4kB 4*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2072kB
[44979121.457412] DMA32: 141*4kB 7*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2780kB
[44979121.457429] Swap cache: add 19279778, delete 19279779, find 441179719/443473155, race 28+4008
[44979121.457434] Free swap = 0kB
[44979121.457437] Total swap = 1048568kB
[44979121.460897] Out of memory: kill process 11976 (httpd) score 83934 or a child
[44979121.460953] Killed process 11976 (httpd)
[44975841.122477] named invoked oom-killer: gfp_mask=0x1201d2, order=0, oomkilladj=0
[44975841.122505] Pid: 24212, comm: named Not tainted 2.6.24-23-xen #1
[44975841.122511]
[44975841.122511] Call Trace:
[44975841.122538] [<ffffffff80275fe6>] oom_kill_process+0xf6/0x110
[44975841.122545] [<ffffffff8027646e>] out_of_memory+0x19e/0x1e0
[44975841.122554] [<ffffffff80278d99>] __alloc_pages+0x389/0x3c0
[44975841.122564] [<ffffffff8027b104>] __do_page_cache_readahead+0x104/0x260
[44975841.122572] [<ffffffff802753ce>] filemap_fault+0x2de/0x3e0
[44975841.122581] [<ffffffff802820ea>] __do_fault+0x6a/0x5d0
[44975841.122589] [<ffffffff80287721>] handle_mm_fault+0x1d1/0xd60
[44975841.122600] [<ffffffff80473da3>] do_page_fault+0x1f3/0x11e0
[44975841.122605] [<ffffffff80470039>] thread_return+0x3a/0x481
[44975841.122615] [<ffffffff80269111>] audit_syscall_exit+0x351/0x3b0
[44975841.122623] [<ffffffff80472447>] error_exit+0x0/0x79
[44975841.122630]
[44975841.122635] DMA per-cpu:
[44975841.122640] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44975841.122647] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44975841.122653] CPU 2: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44975841.122659] CPU 3: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[44975841.122665] DMA32 per-cpu:
[44975841.122668] CPU 0: Hot: hi: 186, btch: 31 usd: 154 Cold: hi: 62, btch: 15 usd: 51
[44975841.122674] CPU 1: Hot: hi: 186, btch: 31 usd: 76 Cold: hi: 62, btch: 15 usd: 50
[44975841.122680] CPU 2: Hot: hi: 186, btch: 31 usd: 68 Cold: hi: 62, btch: 15 usd: 50
[44975841.122685] CPU 3: Hot: hi: 186, btch: 31 usd: 84 Cold: hi: 62, btch: 15 usd: 16
[44975841.122694] Active:44129 inactive:31526 dirty:0 writeback:0 unstable:0
[44975841.122695] free:1207 slab:21846 mapped:23 pagetables:20716 bounce:0
[44975841.122706] DMA free:2076kB min:88kB low:108kB high:132kB active:3272kB inactive:3240kB present:16160kB pages_scanned:16992 all_unreclaimable? yes
[44975841.122712] lowmem_reserve[]: 0 497 497 497
[44975841.122721] DMA32 free:2752kB min:2804kB low:3504kB high:4204kB active:173244kB inactive:122864kB present:509040kB pages_scanned:924615 all_unreclaimable? yes
[44975841.122729] lowmem_reserve[]: 0 0 0 0
[44975841.122735] DMA: 11*4kB 2*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2076kB
[44975841.122751] DMA32: 148*4kB 0*8kB 3*16kB 4*32kB 9*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 2752kB
[44975841.122768] Swap cache: add 19682500, delete 19682501, find 441185252/443524333, race 28+4076
[44975841.122773] Free swap = 0kB
[44975841.122776] Total swap = 1048568kB
[44975841.126543] Out of memory: kill process 12063 (mysqld) score 67138 or a child
[44975841.126647] Killed process 12063 (mysqld)