Can anyone look at this and see what might be the problem?

My MySQL keeps crashing.

I notice that the serverload goes up to 30-40 all very, very quickly, then mysql stops accepting connections.

is anyone able to tell from this what might be happening?

############# Logwatch 7.3.6+cvs20080702-debian (07/02/08)

Processing Initiated: Sun Jul 11 09:29:51 2010

Date Range Processed: today

( 2010-Jul-11 )

Period is day.

Detail Level of Output: 5

Type of Output/Format: mail / text

Logfiles for Host: wiggins

#

–------------------- courier mail services Begin ------------------------

Connections: 10 Times

Protocol POP3 - 10 Times

Host 66.183.188.57 - 10 Times

Logins: 10 Times

Protocol POP3 - 10 Times, 0 Bytes

User info@synthgear.com - 5 Times, 0 Bytes

Host 66.183.188.57 - 5 Times, 0 Bytes

User info@tunereel.com - 5 Times, 0 Bytes

Host 66.183.188.57 - 5 Times, 0 Bytes

---------------------- courier mail services End -------------------------

--------------------- Cron Begin ------------------------

Commands Run:

User root:

cd / && run-parts --report /etc/cron.hourly: 3 Time(s)

[ -x /usr/lib/php5/maxlifetime ] && [ -d /var/lib/php5 ] && find /var/lib/php5/ -type f -cmin +$(/usr/lib/php5/maxlifetime) -print0 | xargs -n 200 -r -0 rm: 6 Time(s)

php /root/check_mysql.php: 36 Time(s)

test -x /usr/sbin/anacron || ( cd / && run-parts –report /etc/cron.weekly ): 1 Time(s)

---------------------- Cron End -------------------------

--------------------- httpd Begin ------------------------

0.00 MB transferred in 1816 responses (1xx 0, 2xx 1813, 3xx 0, 4xx 3, 5xx 0)

1 Images (0.00 MB),

1 Content pages (0.00 MB),

1814 Other (0.00 MB)

Requests with error response codes

400 Bad Request

/wp-content/themes/arthemia-premium/images/left_stripe.gif: 1 Time(s)

/wp-content/themes/arthemia-premium/script … h=80&zc=1&q=100: 1 Time(s)

HTTP/1.1: 1 Time(s)

---------------------- httpd End -------------------------

--------------------- Kernel Begin ------------------------

WARNING: Kernel Errors Present

[] ? error_code+0x66/0x6c …: 18 Time(s)

19 Time(s): 0 pages HighMem

1 Time(s): 10127 total pagecache pages

1 Time(s): 10141 pages shared

1 Time(s): 10221 pages shared

1 Time(s): 10661 pages shared

1 Time(s): 119790 pages non-shared

1 Time(s): 12322 pages shared

1 Time(s): 123765 pages non-shared

1 Time(s): 124358 pages non-shared

1 Time(s): 124459 pages non-shared

1 Time(s): 124475 pages non-shared

1 Time(s): 124498 pages non-shared

1 Time(s): 124532 pages non-shared

1 Time(s): 124537 pages non-shared

1 Time(s): 124539 pages non-shared

1 Time(s): 124558 pages non-shared

1 Time(s): 124580 pages non-shared

1 Time(s): 124587 pages non-shared

1 Time(s): 124613 pages non-shared

1 Time(s): 124655 pages non-shared

1 Time(s): 124762 pages non-shared

1 Time(s): 124781 pages non-shared

1 Time(s): 124854 pages non-shared

1 Time(s): 125003 pages non-shared

1 Time(s): 125120 pages non-shared

1 Time(s): 12552 pages shared

1 Time(s): 12591 pages shared

19 Time(s): 131072 pages RAM

1 Time(s): 13468 pages shared

1 Time(s): 13638 pages shared

1 Time(s): 14059 pages shared

1 Time(s): 14108 pages shared

1 Time(s): 14606 pages shared

1 Time(s): 15861 pages shared

1 Time(s): 16534 pages shared

1 Time(s): 18945 pages shared

1 Time(s): 21265 pages shared

1 Time(s): 22072 pages shared

19 Time(s): 3409 pages reserved

1 Time(s): 4202 pages in swap cache

1 Time(s): 4575 total pagecache pages

1 Time(s): 4909 pages in swap cache

1 Time(s): 4918 pages in swap cache

1 Time(s): 5164 pages in swap cache

1 Time(s): 5242 total pagecache pages

1 Time(s): 5267 pages in swap cache

1 Time(s): 5270 total pagecache pages

1 Time(s): 5373 pages in swap cache

1 Time(s): 5381 pages in swap cache

1 Time(s): 5697 total pagecache pages

1 Time(s): 5782 total pagecache pages

1 Time(s): 5849 total pagecache pages

1 Time(s): 5869 pages in swap cache

1 Time(s): 5905 total pagecache pages

1 Time(s): 6183 pages in swap cache

1 Time(s): 6526 pages in swap cache

1 Time(s): 6562 total pagecache pages

1 Time(s): 6572 pages in swap cache

1 Time(s): 6577 pages in swap cache

1 Time(s): 6582 pages in swap cache

1 Time(s): 6916 total pagecache pages

1 Time(s): 6979 total pagecache pages

1 Time(s): 7033 pages in swap cache

1 Time(s): 7037 pages in swap cache

1 Time(s): 7417 total pagecache pages

1 Time(s): 7477 total pagecache pages

1 Time(s): 7635 total pagecache pages

1 Time(s): 7691 total pagecache pages

1 Time(s): 8035 total pagecache pages

2 Time(s): 8736 pages shared

2 Time(s): 8784 pages in swap cache

2 Time(s): 8815 total pagecache pages

1 Time(s): 9099 pages in swap cache

1 Time(s): 9181 pages shared

1 Time(s): 9598 total pagecache pages

1 Time(s): 9743 pages in swap cache

19 Time(s): CPU 0: hi: 0, btch: 1 usd: 0

2 Time(s): CPU 0: hi: 186, btch: 31 usd: 26

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 30

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 31

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 43

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 64

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 70

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 86

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 107

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 113

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 128

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 131

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 133

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 137

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 146

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 151

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 155

2 Time(s): CPU 0: hi: 186, btch: 31 usd: 163

19 Time(s): CPU 1: hi: 0, btch: 1 usd: 0

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 13

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 18

2 Time(s): CPU 1: hi: 186, btch: 31 usd: 27

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 102

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 117

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 135

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 146

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 147

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 154

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 156

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 157

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 163

2 Time(s): CPU 1: hi: 186, btch: 31 usd: 171

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 177

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 180

2 Time(s): CPU 1: hi: 186, btch: 31 usd: 181

19 Time(s): CPU 2: hi: 0, btch: 1 usd: 0

2 Time(s): CPU 2: hi: 186, btch: 31 usd: 30

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 37

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 46

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 72

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 81

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 111

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 117

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 119

2 Time(s): CPU 2: hi: 186, btch: 31 usd: 130

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 135

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 145

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 151

2 Time(s): CPU 2: hi: 186, btch: 31 usd: 170

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 172

2 Time(s): CPU 2: hi: 186, btch: 31 usd: 179

19 Time(s): CPU 3: hi: 0, btch: 1 usd: 0

2 Time(s): CPU 3: hi: 186, btch: 31 usd: 22

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 30

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 52

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 81

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 95

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 100

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 107

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 120

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 139

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 142

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 146

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 158

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 162

2 Time(s): CPU 3: hi: 186, btch: 31 usd: 167

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 171

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 179

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 184

19 Time(s): Call Trace:

1 Time(s): DMA free:2028kB min:84kB low:104kB high:124kB activeanon:2444kB inactiveanon:2584kB activefile:0kB inactivefile:12kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:12kB shmem:0kB slabreclaimable:60kB slabunreclaimable:192kB kernelstack:48kB pagetables:16kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

1 Time(s): DMA free:2028kB min:84kB low:104kB high:124kB activeanon:2444kB inactiveanon:2584kB activefile:0kB inactivefile:16kB unevictable:0kB isolated(anon):0kB isolated(file):40kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:52kB shmem:0kB slabreclaimable:60kB slabunreclaimable:192kB kernelstack:48kB pagetables:16kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:13 allunreclaimable? no

1 Time(s): DMA free:2028kB min:84kB low:104kB high:124kB activeanon:2524kB inactiveanon:2404kB activefile:0kB inactivefile:28kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:20kB mapped:44kB shmem:0kB slabreclaimable:60kB slabunreclaimable:184kB kernelstack:48kB pagetables:52kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:42 allunreclaimable? no

1 Time(s): DMA free:2032kB min:84kB low:104kB high:124kB activeanon:2328kB inactiveanon:2500kB activefile:8kB inactivefile:28kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:48kB shmem:0kB slabreclaimable:60kB slabunreclaimable:192kB kernelstack:48kB pagetables:16kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:11 allunreclaimable? no

1 Time(s): DMA free:2036kB min:84kB low:104kB high:124kB activeanon:2248kB inactiveanon:2468kB activefile:12kB inactivefile:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:32kB shmem:0kB slabreclaimable:60kB slabunreclaimable:340kB kernelstack:88kB pagetables:52kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:32 allunreclaimable? yes

2 Time(s): DMA free:2040kB min:84kB low:104kB high:124kB activeanon:2376kB inactiveanon:2532kB activefile:12kB inactivefile:28kB unevictable:0kB isolated(anon):0kB isolated(file):100kB present:15872kB mlocked:0kB dirty:0kB writeback:32kB mapped:88kB shmem:0kB slabreclaimable:60kB slabunreclaimable:196kB kernelstack:48kB pagetables:20kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:25 allunreclaimable? no

1 Time(s): DMA free:2040kB min:84kB low:104kB high:124kB activeanon:2384kB inactiveanon:2536kB activefile:28kB inactivefile:96kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:16kB mapped:68kB shmem:0kB slabreclaimable:60kB slabunreclaimable:184kB kernelstack:48kB pagetables:52kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? yes

1 Time(s): DMA free:2040kB min:84kB low:104kB high:124kB activeanon:2404kB inactiveanon:2496kB activefile:12kB inactivefile:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:64kB shmem:0kB slabreclaimable:60kB slabunreclaimable:216kB kernelstack:32kB pagetables:16kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

2 Time(s): DMA free:2044kB min:84kB low:104kB high:124kB activeanon:2444kB inactiveanon:2468kB activefile:8kB inactivefile:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slabreclaimable:64kB slabunreclaimable:216kB kernelstack:32kB pagetables:16kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:68 allunreclaimable? yes

2 Time(s): DMA free:2048kB min:84kB low:104kB high:124kB activeanon:2208kB inactiveanon:2664kB activefile:0kB inactivefile:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:28kB shmem:0kB slabreclaimable:60kB slabunreclaimable:248kB kernelstack:48kB pagetables:52kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:13 allunreclaimable? no

1 Time(s): DMA free:2048kB min:84kB low:104kB high:124kB activeanon:2468kB inactiveanon:2608kB activefile:8kB inactivefile:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slabreclaimable:60kB slabunreclaimable:192kB kernelstack:48kB pagetables:16kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:32 allunreclaimable? yes

1 Time(s): DMA free:2052kB min:84kB low:104kB high:124kB activeanon:2132kB inactiveanon:2352kB activefile:20kB inactivefile:56kB unevictable:0kB isolated(anon):264kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:36kB shmem:0kB slabreclaimable:60kB slabunreclaimable:340kB kernelstack:72kB pagetables:52kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:73 allunreclaimable? no

1 Time(s): DMA free:2052kB min:84kB low:104kB high:124kB activeanon:2260kB inactiveanon:2352kB activefile:20kB inactivefile:16kB unevictable:0kB isolated(anon):136kB isolated(file):28kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:36kB shmem:0kB slabreclaimable:60kB slabunreclaimable:340kB kernelstack:72kB pagetables:52kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:14 allunreclaimable? no

1 Time(s): DMA free:2052kB min:84kB low:104kB high:124kB activeanon:2388kB inactiveanon:2568kB activefile:0kB inactivefile:44kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:60kB shmem:0kB slabreclaimable:64kB slabunreclaimable:216kB kernelstack:32kB pagetables:16kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:80 allunreclaimable? yes

1 Time(s): DMA free:2064kB min:84kB low:104kB high:124kB activeanon:2344kB inactiveanon:2504kB activefile:28kB inactivefile:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:16kB mapped:64kB shmem:0kB slabreclaimable:60kB slabunreclaimable:196kB kernelstack:48kB pagetables:20kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:95 allunreclaimable? no

1 Time(s): DMA free:2064kB min:84kB low:104kB high:124kB activeanon:2372kB inactiveanon:2548kB activefile:24kB inactivefile:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:76kB mapped:60kB shmem:0kB slabreclaimable:60kB slabunreclaimable:200kB kernelstack:48kB pagetables:52kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

19 Time(s): DMA per-cpu:

1 Time(s): DMA: 114kB 128kB 316kB 132kB 164kB 0128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2076kB

1 Time(s): DMA: 114kB 88kB 016kB 032kB 164kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2092kB

1 Time(s): DMA: 124kB 18kB 016kB 032kB 164kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2040kB

2 Time(s): DMA: 144kB 98kB 116kB 132kB 164kB 0128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2032kB

1 Time(s): DMA: 174kB 08kB 016kB 032kB 164kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2052kB

1 Time(s): DMA: 204kB 98kB 316kB 132kB 164kB 0128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2088kB

1 Time(s): DMA: 344kB 98kB 016kB 032kB 164kB 0128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2064kB

1 Time(s): DMA: 354kB 108kB 116kB 132kB 064kB 0128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2060kB

1 Time(s): DMA: 394kB 108kB 116kB 132kB 064kB 0128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2076kB

2 Time(s): DMA: 44kB 128kB 316kB 132kB 164kB 0128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2048kB

2 Time(s): DMA: 44kB 78kB 016kB 032kB 164kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2056kB

1 Time(s): DMA: 54kB 28kB 216kB 032kB 164kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2052kB

1 Time(s): DMA: 84kB 48kB 016kB 032kB 164kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2048kB

1 Time(s): DMA: 94kB 18kB 316kB 132kB 064kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2044kB

2 Time(s): DMA: 94kB 28kB 216kB 032kB 164kB 1128kB 1256kB 1512kB 11024kB 02048kB 0*4096kB = 2068kB

10 Time(s): Free swap = 0kB

2 Time(s): Free swap = 16kB

2 Time(s): Free swap = 20kB

1 Time(s): Free swap = 380kB

1 Time(s): Free swap = 40kB

1 Time(s): Free swap = 4284kB

2 Time(s): Free swap = 4kB

1 Time(s): Killed process 20435 (mysqld)

1 Time(s): Killed process 31863 (apache2)

1 Time(s): Killed process 31878 (apache2)

1 Time(s): Killed process 31885 (apache2)

1 Time(s): Killed process 32089 (apache2)

1 Time(s): Killed process 32093 (apache2)

1 Time(s): Killed process 32094 (apache2)

1 Time(s): Killed process 32098 (apache2)

1 Time(s): Killed process 32109 (apache2)

1 Time(s): Killed process 32111 (apache2)

1 Time(s): Killed process 32117 (apache2)

1 Time(s): Killed process 32129 (apache2)

1 Time(s): Killed process 32134 (apache2)

1 Time(s): Killed process 32149 (mysqld)

1 Time(s): Killed process 32158 (apache2)

1 Time(s): Killed process 32187 (apache2)

1 Time(s): Killed process 32239 (mysqld)

1 Time(s): Killed process 32283 (mysqld)

19 Time(s): Mem-Info:

1 Time(s): Normal free:2692kB min:2792kB low:3488kB high:4188kB activeanon:232576kB inactiveanon:232768kB activefile:484kB inactivefile:1608kB unevictable:0kB isolated(anon):1004kB isolated(file):296kB present:503936kB mlocked:0kB dirty:0kB writeback:0kB mapped:512kB shmem:28kB slabreclaimable:3116kB slabunreclaimable:9772kB kernelstack:2080kB pagetables:7472kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:2996 allunreclaimable? no

1 Time(s): Normal free:2708kB min:2792kB low:3488kB high:4188kB activeanon:233372kB inactiveanon:233416kB activefile:536kB inactivefile:628kB unevictable:0kB isolated(anon):0kB isolated(file):768kB present:503936kB mlocked:0kB dirty:0kB writeback:352kB mapped:1440kB shmem:24kB slabreclaimable:3336kB slabunreclaimable:9580kB kernelstack:1944kB pagetables:6852kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:2018 allunreclaimable? yes

1 Time(s): Normal free:2712kB min:2792kB low:3488kB high:4188kB activeanon:234320kB inactiveanon:234228kB activefile:0kB inactivefile:108kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:568kB mapped:84kB shmem:28kB slabreclaimable:2972kB slabunreclaimable:9556kB kernelstack:2072kB pagetables:6780kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:27 allunreclaimable? no

1 Time(s): Normal free:2712kB min:2792kB low:3488kB high:4188kB activeanon:234320kB inactiveanon:234228kB activefile:0kB inactivefile:108kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:568kB mapped:84kB shmem:28kB slabreclaimable:2972kB slabunreclaimable:9556kB kernelstack:2072kB pagetables:6780kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:292 allunreclaimable? no

1 Time(s): Normal free:2728kB min:2792kB low:3488kB high:4188kB activeanon:232732kB inactiveanon:233020kB activefile:260kB inactivefile:1056kB unevictable:0kB isolated(anon):1240kB isolated(file):328kB present:503936kB mlocked:0kB dirty:0kB writeback:36kB mapped:176kB shmem:28kB slabreclaimable:3116kB slabunreclaimable:9772kB kernelstack:2080kB pagetables:7472kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:1330 allunreclaimable? yes

1 Time(s): Normal free:2752kB min:2792kB low:3488kB high:4188kB activeanon:233260kB inactiveanon:233212kB activefile:580kB inactivefile:2044kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:576kB mapped:532kB shmem:24kB slabreclaimable:3476kB slabunreclaimable:9564kB kernelstack:2016kB pagetables:7076kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:6918 allunreclaimable? yes

1 Time(s): Normal free:2752kB min:2792kB low:3488kB high:4188kB activeanon:233668kB inactiveanon:233688kB activefile:476kB inactivefile:376kB unevictable:0kB isolated(anon):0kB isolated(file):384kB present:503936kB mlocked:0kB dirty:0kB writeback:428kB mapped:1272kB shmem:24kB slabreclaimable:3116kB slabunreclaimable:9340kB kernelstack:1968kB pagetables:7084kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:1421 allunreclaimable? yes

1 Time(s): Normal free:2752kB min:2792kB low:3488kB high:4188kB activeanon:234040kB inactiveanon:234084kB activefile:144kB inactivefile:1428kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:568kB mapped:72kB shmem:24kB slabreclaimable:3088kB slabunreclaimable:9336kB kernelstack:1968kB pagetables:7112kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:960 allunreclaimable? yes

1 Time(s): Normal free:2764kB min:2792kB low:3488kB high:4188kB activeanon:232884kB inactiveanon:233084kB activefile:380kB inactivefile:516kB unevictable:0kB isolated(anon):192kB isolated(file):260kB present:503936kB mlocked:0kB dirty:28kB writeback:628kB mapped:1124kB shmem:24kB slabreclaimable:3428kB slabunreclaimable:9916kB kernelstack:2032kB pagetables:7192kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:3385 allunreclaimable? yes

1 Time(s): Normal free:2764kB min:2792kB low:3488kB high:4188kB activeanon:232884kB inactiveanon:233084kB activefile:568kB inactivefile:336kB unevictable:0kB isolated(anon):192kB isolated(file):500kB present:503936kB mlocked:0kB dirty:28kB writeback:628kB mapped:1236kB shmem:24kB slabreclaimable:3428kB slabunreclaimable:9916kB kernelstack:2032kB pagetables:7192kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:3283 allunreclaimable? yes

1 Time(s): Normal free:2768kB min:2792kB low:3488kB high:4188kB activeanon:232848kB inactiveanon:232896kB activefile:320kB inactivefile:380kB unevictable:0kB isolated(anon):256kB isolated(file):384kB present:503936kB mlocked:0kB dirty:0kB writeback:72kB mapped:740kB shmem:24kB slabreclaimable:3696kB slabunreclaimable:10092kB kernelstack:2264kB pagetables:7140kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:2493 allunreclaimable? yes

1 Time(s): Normal free:2768kB min:2792kB low:3488kB high:4188kB activeanon:233768kB inactiveanon:233956kB activefile:692kB inactivefile:3312kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:0kB mapped:800kB shmem:32kB slabreclaimable:3112kB slabunreclaimable:9344kB kernelstack:1824kB pagetables:6512kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:3392 allunreclaimable? yes

1 Time(s): Normal free:2768kB min:2792kB low:3488kB high:4188kB activeanon:233768kB inactiveanon:233956kB activefile:692kB inactivefile:3424kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:0kB mapped:912kB shmem:32kB slabreclaimable:3112kB slabunreclaimable:9344kB kernelstack:1824kB pagetables:6512kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:3392 allunreclaimable? yes

1 Time(s): Normal free:2788kB min:2792kB low:3488kB high:4188kB activeanon:232652kB inactiveanon:232716kB activefile:248kB inactivefile:268kB unevictable:0kB isolated(anon):1368kB isolated(file):592kB present:503936kB mlocked:0kB dirty:12kB writeback:168kB mapped:672kB shmem:28kB slabreclaimable:3116kB slabunreclaimable:9768kB kernelstack:2272kB pagetables:7436kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:1217 allunreclaimable? yes

1 Time(s): Normal free:2800kB min:2792kB low:3488kB high:4188kB activeanon:233588kB inactiveanon:233548kB activefile:708kB inactivefile:564kB unevictable:0kB isolated(anon):384kB isolated(file):640kB present:503936kB mlocked:0kB dirty:0kB writeback:340kB mapped:956kB shmem:32kB slabreclaimable:3128kB slabunreclaimable:9420kB kernelstack:1896kB pagetables:6704kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:32 allunreclaimable? no

1 Time(s): Normal free:3080kB min:2792kB low:3488kB high:4188kB activeanon:233372kB inactiveanon:233416kB activefile:416kB inactivefile:620kB unevictable:0kB isolated(anon):0kB isolated(file):640kB present:503936kB mlocked:0kB dirty:0kB writeback:352kB mapped:1104kB shmem:24kB slabreclaimable:3336kB slabunreclaimable:9580kB kernelstack:1944kB pagetables:6852kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

1 Time(s): Normal free:3136kB min:2792kB low:3488kB high:4188kB activeanon:233652kB inactiveanon:233488kB activefile:868kB inactivefile:1044kB unevictable:0kB isolated(anon):256kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:316kB mapped:796kB shmem:24kB slabreclaimable:3156kB slabunreclaimable:9460kB kernelstack:2000kB pagetables:7200kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:992 allunreclaimable? no

1 Time(s): Normal free:3692kB min:2792kB low:3488kB high:4188kB activeanon:233060kB inactiveanon:232932kB activefile:512kB inactivefile:1168kB unevictable:0kB isolated(anon):512kB isolated(file):128kB present:503936kB mlocked:0kB dirty:0kB writeback:124kB mapped:704kB shmem:24kB slabreclaimable:3312kB slabunreclaimable:9592kB kernelstack:1952kB pagetables:6864kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:2531 allunreclaimable? no

1 Time(s): Normal free:4004kB min:2792kB low:3488kB high:4188kB activeanon:233496kB inactiveanon:233652kB activefile:216kB inactivefile:688kB unevictable:0kB isolated(anon):384kB isolated(file):384kB present:503936kB mlocked:0kB dirty:0kB writeback:256kB mapped:372kB shmem:32kB slabreclaimable:3144kB slabunreclaimable:9364kB kernelstack:1856kB pagetables:6600kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:896 allunreclaimable? no

19 Time(s): Normal per-cpu:

1 Time(s): Normal: 26764kB 9218kB 14616kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 20408kB

1 Time(s): Normal: 2704kB 1068kB 4216kB 532kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2760kB

1 Time(s): Normal: 2944kB 698kB 5716kB 432kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2768kB

1 Time(s): Normal: 3004kB 1008kB 5216kB 132kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2864kB

1 Time(s): Normal: 3004kB 938kB 4616kB 132kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2712kB

2 Time(s): Normal: 3024kB 1278kB 3416kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2768kB

1 Time(s): Normal: 3024kB 778kB 5616kB 132kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2752kB

1 Time(s): Normal: 3044kB 748kB 5716kB 132kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2752kB

2 Time(s): Normal: 3054kB 1038kB 3516kB 532kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2764kB

1 Time(s): Normal: 3094kB 1728kB 616kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2708kB

1 Time(s): Normal: 3244kB 1648kB 1216kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2800kB

1 Time(s): Normal: 3304kB 1368kB 2016kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2728kB

1 Time(s): Normal: 3374kB 1488kB 1616kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 2788kB

1 Time(s): Normal: 3804kB 728kB 6516kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 3136kB

1 Time(s): Normal: 3884kB 1798kB 616kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 3080kB

1 Time(s): Normal: 5214kB 1538kB 1816kB 332kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 3692kB

1 Time(s): Normal: 5654kB 1748kB 2216kB 032kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 4004kB

1 Time(s): Out of memory: kill process 20171 (mysqld_safe) score 15877 or a child

1 Time(s): Out of memory: kill process 31863 (apache2) score 13677 or a child

1 Time(s): Out of memory: kill process 31878 (apache2) score 13325 or a child

1 Time(s): Out of memory: kill process 31885 (apache2) score 13663 or a child

1 Time(s): Out of memory: kill process 32089 (apache2) score 13491 or a child

1 Time(s): Out of memory: kill process 32093 (apache2) score 13484 or a child

1 Time(s): Out of memory: kill process 32094 (apache2) score 13470 or a child

1 Time(s): Out of memory: kill process 32098 (apache2) score 13504 or a child

1 Time(s): Out of memory: kill process 32109 (apache2) score 13589 or a child

1 Time(s): Out of memory: kill process 32111 (apache2) score 13449 or a child

1 Time(s): Out of memory: kill process 32117 (apache2) score 13451 or a child

1 Time(s): Out of memory: kill process 32129 (apache2) score 13262 or a child

1 Time(s): Out of memory: kill process 32134 (apache2) score 13460 or a child

1 Time(s): Out of memory: kill process 32149 (mysqld) score 34419 or a child

1 Time(s): Out of memory: kill process 32158 (apache2) score 13551 or a child

1 Time(s): Out of memory: kill process 32187 (apache2) score 13420 or a child

1 Time(s): Out of memory: kill process 32239 (mysqld) score 32241 or a child

1 Time(s): Out of memory: kill process 32283 (mysqld) score 14617 or a child

1 Time(s): Pid: 31878, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32006, comm: smtp Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32039, comm: smtp Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32090, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32092, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32097, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32098, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32105, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32109, comm: apache2 Not tainted 2.6.32.12-linode25 #1

3 Time(s): Pid: 32111, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32112, comm: apache2 Not tainted 2.6.32.12-linode25 #1

2 Time(s): Pid: 32113, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32206, comm: smtpd Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32235, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32260, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Pid: 32285, comm: apache2 Not tainted 2.6.32.12-linode25 #1

1 Time(s): Swap cache stats: add 6977820, delete 6973619, find 7256579/7779513

1 Time(s): Swap cache stats: add 6986707, delete 6981789, find 7257730/7780872

1 Time(s): Swap cache stats: add 6986707, delete 6981798, find 7257730/7780872

1 Time(s): Swap cache stats: add 7002601, delete 6996732, find 7259236/7783070

1 Time(s): Swap cache stats: add 7009714, delete 7004341, find 7260821/7785371

1 Time(s): Swap cache stats: add 7009722, delete 7004341, find 7260821/7785371

1 Time(s): Swap cache stats: add 7010750, delete 7005586, find 7261106/7785766

1 Time(s): Swap cache stats: add 7054055, delete 7047473, find 7272274/7801059

1 Time(s): Swap cache stats: add 7054179, delete 7047653, find 7272290/7801083

1 Time(s): Swap cache stats: add 7054284, delete 7048101, find 7272292/7801091

1 Time(s): Swap cache stats: add 7095558, delete 7090291, find 7278968/7811068

1 Time(s): Swap cache stats: add 7104941, delete 7097908, find 7280682/7813461

1 Time(s): Swap cache stats: add 7104988, delete 7097951, find 7280760/7813546

2 Time(s): Swap cache stats: add 7122151, delete 7113367, find 7284760/7819110

1 Time(s): Swap cache stats: add 7135372, delete 7126273, find 7287403/7823015

1 Time(s): Swap cache stats: add 7141602, delete 7131859, find 7288439/7824595

1 Time(s): Swap cache stats: add 7146452, delete 7139875, find 7289110/7825750

1 Time(s): Swap cache stats: add 7146452, delete 7139880, find 7289113/7825754

19 Time(s): Total swap = 262136kB

7 Time(s): [] ? xensetpte_at+0x80/0xf0

6 Time(s): [] ? xenforceevtchn_callback+0x17/0x30

3 Time(s): [] ? xenrestorefldirectend+0x0/0x1

15 Time(s): [] ? check_events+0x8/0xc

1 Time(s): [] ? syscall_call+0x7/0xb

3 Time(s): [] ? xendoupcall+0x7/0xc

36 Time(s): [] ? dopagefault+0x0/0x330

19 Time(s): [] ? dopagefault+0x134/0x330

4 Time(s): [] ? finishtaskswitch+0x47/0xa0

2 Time(s): [] ? do_softirq+0x31/0x40

2 Time(s): [] ? irq_exit+0x31/0x70

1 Time(s): [] ? localbhenable_ip+0x16/0x90

2 Time(s): [] ? _wakeup_bit+0x2e/0x40

3 Time(s): [] ? autoremovewakefunction+0x0/0x50

1 Time(s): [] ? _rcuprocess_callbacks+0x44/0x2e0

10 Time(s): [] ? filemap_fault+0x397/0x3a0

1 Time(s): [] ? genericfileaio_read+0x3fa/0x6b0

18 Time(s): [] ? oomkillprocess+0x9a/0x280

18 Time(s): [] ? _outof_memory+0xfc/0x160

18 Time(s): [] ? outofmemory+0x54/0xb0

1 Time(s): [] ? _allocpages_nodemask+0x49c/0x580

18 Time(s): [] ? _allocpages_nodemask+0x561/0x580

11 Time(s): [] ? _dopagecachereadahead+0xdd/0x1f0

11 Time(s): [] ? ra_submit+0x27/0x40

1 Time(s): [] ? pagecachesync_readahead+0x43/0x70

10 Time(s): [] ? _dofault+0x5a/0x490

10 Time(s): [] ? handlemmfault+0x167/0x990

4 Time(s): [] ? handlemmfault+0x6d9/0x990

4 Time(s): [] ? handlemmfault+0x8bf/0x990

2 Time(s): [] ? _vmenough_memory+0x2c/0x170

2 Time(s): [] ? vma_merge+0xf1/0x280

2 Time(s): [] ? mmap_region+0x1d9/0x480

4 Time(s): [] ? readswapcache_async+0xc7/0x110

4 Time(s): [] ? swapin_readahead+0x68/0x90

1 Time(s): [] ? kmemcachefree+0x41/0x60

3 Time(s): [] ? filp_close+0x47/0x80

1 Time(s): [] ? dosyncread+0x0/0x120

1 Time(s): [] ? dosyncread+0xd5/0x120

1 Time(s): [] ? rwverifyarea+0x5a/0xd0

1 Time(s): [] ? vfs_read+0x9d/0x180

1 Time(s): [] ? sys_read+0x41/0x80

2 Time(s): [] ? __fput+0x145/0x1d0

1 Time(s): [] ? dput+0x84/0x130

2 Time(s): [] ? dput+0xe0/0x130

1 Time(s): [] ? flocklockfile_wait+0x216/0x320

1 Time(s): [] ? securityfilepermission+0xc/0x10

1 Time(s): [] ? sock_setsockopt+0x96/0x6f0

3 Time(s): [] ? schedule+0x407/0xa20

1 Time(s): [] ? spinlock_irq+0x10/0x20

2 Time(s): [] ? spinlock+0x5/0x10

1 Time(s): [] ? unlock_kernel+0x25/0x2c

1 Time(s): activeanon:58725 inactiveanon:58796 isolated_anon:342

1 Time(s): activeanon:58733 inactiveanon:58808 isolated_anon:317

1 Time(s): activeanon:58748 inactiveanon:58843 isolated_anon:344

1 Time(s): activeanon:58794 inactiveanon:58849 isolated_anon:64

1 Time(s): activeanon:58823 inactiveanon:58859 isolated_anon:128

2 Time(s): activeanon:58832 inactiveanon:58917 isolated_anon:48

1 Time(s): activeanon:58932 inactiveanon:58955 isolated_anon:0

2 Time(s): activeanon:58937 inactiveanon:58987 isolated_anon:0

1 Time(s): activeanon:58971 inactiveanon:59055 isolated_anon:96

1 Time(s): activeanon:58998 inactiveanon:59011 isolated_anon:96

1 Time(s): activeanon:59006 inactiveanon:59009 isolated_anon:64

1 Time(s): activeanon:59048 inactiveanon:59023 isolated_anon:0

2 Time(s): activeanon:59053 inactiveanon:59106 isolated_anon:0

1 Time(s): activeanon:59106 inactiveanon:59155 isolated_anon:0

2 Time(s): activeanon:59132 inactiveanon:59223 isolated_anon:32

2 Time(s): activefile:0 inactivefile:26 isolated_file:0

1 Time(s): activefile:107 inactivefile:141 isolated_file:217

1 Time(s): activefile:118 inactivefile:101 isolated_file:96

1 Time(s): activefile:126 inactivefile:416 isolated_file:74

1 Time(s): activefile:135 inactivefile:315 isolated_file:32

1 Time(s): activefile:137 inactivefile:164 isolated_file:217

1 Time(s): activefile:138 inactivefile:88 isolated_file:135

1 Time(s): activefile:147 inactivefile:515 isolated_file:0

1 Time(s): activefile:175 inactivefile:855 isolated_file:0

1 Time(s): activefile:175 inactivefile:883 isolated_file:0

1 Time(s): activefile:180 inactivefile:145 isolated_file:160

1 Time(s): activefile:223 inactivefile:261 isolated_file:0

1 Time(s): activefile:43 inactivefile:381 isolated_file:0

1 Time(s): activefile:54 inactivefile:162 isolated_file:96

1 Time(s): activefile:65 inactivefile:67 isolated_file:148

1 Time(s): activefile:70 inactivefile:268 isolated_file:89

1 Time(s): activefile:82 inactivefile:102 isolated_file:64

1 Time(s): activefile:91 inactivefile:132 isolated_file:65

2 Time(s): apache2 invoked oom-killer: gfpmask=0x200da, order=0, oomadj=0

9 Time(s): apache2 invoked oom-killer: gfpmask=0x201da, order=0, oomadj=0

4 Time(s): apache2 invoked oom-killer: gfpmask=0x280da, order=0, oomadj=0

1 Time(s): apache2: page allocation failure. order:0, mode:0x200da

1 Time(s): free:1186 slabreclaimable:794 slabunreclaimable:2528

1 Time(s): free:1187 slabreclaimable:849 slabunreclaimable:2444

2 Time(s): free:1190 slabreclaimable:758 slabunreclaimable:2451

1 Time(s): free:1195 slabreclaimable:794 slabunreclaimable:2381

1 Time(s): free:1195 slabreclaimable:794 slabunreclaimable:2528

1 Time(s): free:1198 slabreclaimable:787 slabunreclaimable:2380

2 Time(s): free:1198 slabreclaimable:872 slabunreclaimable:2527

1 Time(s): free:1200 slabreclaimable:884 slabunreclaimable:2439

1 Time(s): free:1200 slabreclaimable:939 slabunreclaimable:2571

2 Time(s): free:1203 slabreclaimable:794 slabunreclaimable:2390

1 Time(s): free:1206 slabreclaimable:794 slabunreclaimable:2527

1 Time(s): free:1210 slabreclaimable:797 slabunreclaimable:2409

1 Time(s): free:1280 slabreclaimable:849 slabunreclaimable:2444

1 Time(s): free:1300 slabreclaimable:804 slabunreclaimable:2415

1 Time(s): free:1439 slabreclaimable:843 slabunreclaimable:2447

1 Time(s): free:1514 slabreclaimable:802 slabunreclaimable:2395

1 Time(s): imklog 3.18.6, log source = /proc/kmsg started.

19 Time(s): lowmem_reserve[]: 0 0 0 0

19 Time(s): lowmem_reserve[]: 0 492 492 492

1 Time(s): mapped:108 shmem:8 pagetables:1654 bounce:0

1 Time(s): mapped:133 shmem:6 pagetables:1773 bounce:0

1 Time(s): mapped:137 shmem:7 pagetables:1881 bounce:0

1 Time(s): mapped:176 shmem:7 pagetables:1872 bounce:0

1 Time(s): mapped:192 shmem:6 pagetables:1721 bounce:0

1 Time(s): mapped:197 shmem:6 pagetables:1789 bounce:0

1 Time(s): mapped:205 shmem:8 pagetables:1632 bounce:0

1 Time(s): mapped:214 shmem:6 pagetables:1813 bounce:0

1 Time(s): mapped:233 shmem:8 pagetables:1632 bounce:0

1 Time(s): mapped:255 shmem:8 pagetables:1680 bounce:0

2 Time(s): mapped:28 shmem:7 pagetables:1708 bounce:0

1 Time(s): mapped:284 shmem:6 pagetables:1802 bounce:0

1 Time(s): mapped:298 shmem:6 pagetables:1718 bounce:0

1 Time(s): mapped:322 shmem:6 pagetables:1802 bounce:0

1 Time(s): mapped:329 shmem:6 pagetables:1784 bounce:0

1 Time(s): mapped:35 shmem:6 pagetables:1791 bounce:0

1 Time(s): mapped:382 shmem:6 pagetables:1718 bounce:0

1 Time(s): mapped:53 shmem:7 pagetables:1881 bounce:0

1 Time(s): smtp invoked oom-killer: gfpmask=0x200da, order=0, oomadj=0

1 Time(s): smtp invoked oom-killer: gfpmask=0x201da, order=0, oomadj=0

1 Time(s): smtpd invoked oom-killer: gfpmask=0x201da, order=0, oomadj=0

3 Time(s): unevictable:0 dirty:0 writeback:0 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:112 unstable:0

2 Time(s): unevictable:0 dirty:0 writeback:142 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:144 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:146 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:35 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:64 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:8 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:85 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:9 unstable:0

2 Time(s): unevictable:0 dirty:0 writeback:96 unstable:0

1 Time(s): unevictable:0 dirty:0 writeback:98 unstable:0

1 Time(s): unevictable:0 dirty:3 writeback:42 unstable:0

2 Time(s): unevictable:0 dirty:7 writeback:157 unstable:0

–-------------------- Kernel End -------------------------

--------------------- pam_unix Begin ------------------------

cron:

Sessions Opened:

root: 46 Time(s)

sshd:

Authentication Failures:

root (125.77.107.212): 19 Time(s)

unknown (125.77.107.212): 1 Time(s)

Invalid Users:

Unknown Account: 1 Time(s)

Sessions Opened:

root: 3 Time(s)

---------------------- pam_unix End -------------------------

--------------------- POP-3 Begin ------------------------

[POP3] Connections:

=========================

Host | Connections

–----------------------------------------------------------- | -----------

::ffff:66.183.188.57 | 10


10

[POP3] Logout stats (in MB):

============================

User | Logouts | Downloaded | Mbox Size

–------------------------------------- | ------- | ---------- | ----------

info@synthgear.com | 5 | 0 | 0

info@tunereel.com | 5 | 0 | 0


10 | 0.00 | 0.00

---------------------- POP-3 End -------------------------

--------------------- Postfix Begin ------------------------

Summary ***

5 *Fatal: General fatal

3 *Warning: Startup error

1 *Warning: Map lookup problem

5 Process exited

7 Postfix communications error

18 Miscellaneous warnings

225.448K Bytes accepted 230,859

2.691M Bytes sent via SMTP 2,821,500

======== ================================================

54 Accepted 45.00%

66 Rejected 55.00%


120 Total 100.00%

======== ================================================

66 5xx Reject unknown user 100.00%


66 Total 5xx Rejects 100.00%

======== ================================================

96 Connections made

15 Connections lost (inbound)

7 Connections lost (outbound)

96 Disconnections

56 Removed from queue

1469 Sent via SMTP

1 Resent

67 Deferred

736 Deferrals

142 Bounced (local)

334 Bounced (remote)

1 Bounce failure

24 Notifications sent

894 Connection failure (outbound)

8 Timeout (inbound)

12 MX errors

13 Numeric hostname

6 Hostname verification errors

4 Hostname validation errors

5 PIX workaround enabled

Detail ****

5 *Fatal: General fatal -------------------------------------------------------------------

5 Proxy:mysql:/etc/postfix/mysql-virtualdomains.cf(0,lock|foldfix): table lookup pr…

3 *Warning: Startup error -----------------------------------------------------------------

3 Bad command startup -- throttling

1 *Warning: Map lookup problem ------------------------------------------------------------

1 virtualaliasmaps

5 Process exited --------------------------------------------------------------------------

5 Exit status 1

7 Postfix communications error ------------------------------------------------------------

6 Problem talking to service rewrite

1 Problem talking to service private/scache

18 Miscellaneous warnings ------------------------------------------------------------------

13 do not list domain synthgear.com in BOTH mydestination and virtualmailboxdomains

4 connect to mysql server 127.0.0.1: Can't connect to MySQL server on '127.0.0.1' (111)

1 mysql query failed: Lost connection to MySQL server during query

66 5xx Reject unknown user -----------------------------------------------------------------

66 Virtual mailbox table

15 Connections lost (inbound) --------------------------------------------------------------

11 After RCPT

2 After DATA

1 After CONNECT

1 After MAIL

7 Connections lost (outbound) -------------------------------------------------------------

4 While sending DATA command

3 While sending RCPT TO

1469 Sent via SMTP ---------------------------------------------------------------------------

536 gmail.com

191 yahoo.com

181 hotmail.com

70 mail.ru

58 yahoo.co.uk

52 pwagorn.msoutlookonline.net

12 yandex.ru

10 bk.ru

10 mac.com

9 freemeilaadressforall.net

9 googlemail.com

9 testbird.info

8 comcast.net

8 mailinator.com

8 msn.com

8 sbcglobal.net

7 hotmail.co.uk

6 goodemailadressforfree.net

5 gooogletartsert.net

5 greatvox.com

4 live.com

4 rocketmail.com

4 yahoo.ca

3 att.net

3 cox.net

3 juno.com

2 aol.com

2 asdf.com

2 astroboymail.com

2 bellsouth.net

2 btinternet.com

2 charter.net

2 earthlink.net

2 free.fr

2 list.ru

2 pookmail.com

2 shaw.ca

2 sogetthis.com

2 ttu.edu

2 uoregon.edu

2 visir.is

2 web.de

2 yahoo.es

2 ymail.com

1 800hightech.com

1 aanet.com.au

1 abc.net.au

1 abella.net

1 adsf.com

1 alko.com.br

1 amandaledsham.plus.com

1 americanapparel.net

1 annomedia.com

1 asd.pt

1 audiothru.com

1 austin.rr.com

1 basslinejack.com

1 berkeley.edu

1 bertg.be

1 blackbaud.com

1 blueorchidarts.com

1 bluethumbproductions.com

1 blueyonder.co.uk

1 bscdi.org

1 btopenworld.com

1 califaudio.com

1 captain-obvious.de

1 carolina.rr.com

1 cd6.so-net.ne.jp

1 celticblues.com

1 centrum.cz

1 cfl.rr.com

1 charlestaylor.co.uk

1 christian-mail.zzn.com

1 chvnx.com

1 cinci.rr.com

1 cmu.edu

1 cn.edu

1 columbia.edu

1 comments.com

1 cosh.nl

1 cranky.ca

1 crestlinesoaring.org

1 cruzerrf.com

1 cruzio.com

1 cs.dal.ca

1 csusb.edu

1 d00m.com

1 damnhandy.com

1 defsf.com

1 diegostocco.com

1 djpsmusicmix.com

1 djshoxy.com

1 eircom.net

1 email.it

1 eskimo.com

1 excite.com

1 farmland.de

1 fiu.edu

1 fl.net.au

1 flamefireshows.com

1 flamestitch.com

1 fortasse.org

1 freetube.uni.cc

1 fsmail.net

1 fsu.edu

1 gipsymedia.com

1 girlzdealz.com

1 gmx.at

1 gmx.com

1 gmx.net

1 goetzit.com

1 gozo.com

1 groc.org

1 grudaemmim.com.br

1 gym-muttenz.educanet2.ch

1 hampshire.edu

1 hiltonius.com

1 hot.ee

1 hotmail.fr

1 ikmultimedia.com

1 inaudible-visions.net

1 inbox.com

1 indiana.edu

1 instantdogma.net

1 intouch.adam2.org

1 ispaul.com

1 itofkc.com

1 jakuza.de

1 jhu.edu

1 jimandrada.com

1 jns18.com

1 jon.com

1 jowersinc.com

1 karlsruhe.hu

1 kefcorp.net

1 kidsloveguns.com

1 kingston.net

1 l-rs.org

1 lelab.tv

1 lgnshow.com

1 libero.it

1 live.nl

1 logicsmith.com

1 lpbroadband.net

1 lycos.com

1 mailin8r.com

1 manx.net

1 maui.net

1 me.com

1 mediaroach.com

1 melbpc.org.au

1 memolinkcorp.com

1 meuspartum.com

1 michaelboland.ca

1 mmi-agency.com

1 mtu.edu

1 my.sanjuancollege.edu

1 myway.com

1 narod.ru

1 nerif.com

1 neuf.fr

1 no.com

1 nocc.net

1 noise.io

1 noiseaddicts.com

1 noisenik.com

1 noisetrade.com

1 noos.fr

1 nucleus.com

1 nuim.ie

1 o2.pl

1 oddstrument.com

1 optonline.net

1 orange.fr

1 pandora.be

1 pcsites.com

1 pdogrecords.com

1 pinnacleitdev.com

1 pobox.com

1 pomona.edu

1 protype.com

1 ptolserv.com

1 pyccmaui.org

1 re-mix.de

1 reckon.ws

1 recursor.net

1 rediffmail.com

1 reforma.si

1 rice.edu

1 rolfguild.org

1 sdmaus.com

1 sennfelder.de

1 shunra.co.za

1 silcom.com

1 smashbase.com

1 sound.net

1 spectorbass.com

1 student.gla.ac.uk

1 student.wpunj.edu

1 studioguitar.com

1 suddenlink.net

1 supercable.net.ve

1 swoop.otherinbox.com

1 sympatico.ca

1 tcsi.pt

1 tedtedted.com

1 telenet.be

1 terryjackson.us

1 thecellstudio.com

1 thetafreq.com

1 theyachtforsale.com

1 timeinc.com

1 timothyandrew.net

1 tiscali.co.uk

1 tom.com

1 tommunch.com

1 topmail.co.za

1 tpg.com.au

1 transmit.net

1 unstoppablex.com

1 upf.edu

1 upyourego.com

1 ussnomad.org

1 utk.edu

1 vcu.edu

1 vegasbuzznews.com

1 vektor57.com

1 verizon.net

1 videotron.ca

1 virgin.net

1 vision-webs.com

1 wanadoo.fr

1 wanadoo.nl

1 waterfuel.ws

1 well.com

1 wenzler.us

1 westcoastplasma.ca

1 westofeastmusic.com

1 whitelabel-music.co.uk

1 willphalen.com

1 wonko.info

1 worldbid.com

1 xennexinc.com

1 xmission.com

1 xpressblinds.net

1 yahoo.co.id

1 yahoo.co.in

1 yahoo.com.cn

1 yahoo.com.hk

1 yahoo.fr

1 yahoo.gr

1 yes.com

1 zenme.info

736 Deferrals -------------------------------------------------------------------------------

586 4.4.1: Transient failure: Network & routing status: No answer from host

74 4.2.1: Transient failure: Mailbox status: Mailbox disabled, not accepting messages

36 4.4.2: Transient failure: Network & routing status: Bad connection

27 4.4.3: Transient failure: Network & routing status: Routing server failure

8 4.0.0: Transient failure: Other/Undefined status: Other undefined status

3 4.1.8: Transient failure: Addressing status: Bad sender's system address

1 4.3.5: Transient failure: Mail system status

1 4.7.0: Transient failure: Security/policy status: Temporary authentication failure

142 Bounced (local) -------------------------------------------------------------------------

117 5.4.4: Permanent failure: Network & routing status: Unable to route

25 5.1.1: Permanent failure: Addressing status: Bad destination mailbox address

334 Bounced (remote) ------------------------------------------------------------------------

239 5.1.1: Permanent failure: Addressing status: Bad destination mailbox address

69 5.0.0: Permanent failure: Other/Undefined status: Other undefined status

15 5.2.1: Permanent failure: Mailbox status: Mailbox disabled, not accepting messages

9 5.7.1: Permanent failure: Security/policy status: Delivery not authorized, message …

1 5.3.0: Permanent failure: Mail system status: Other/Undefined mail system status

1 5.4.1: Permanent failure: Network & routing status: No answer from host

24 Notifications sent ----------------------------------------------------------------------

24 Non-delivery

894 Connection failure (outbound) -----------------------------------------------------------

544 Connection refused

338 Connection timed out

11 Refused to talk to me

1 No route to host

8 Timeout (inbound) -----------------------------------------------------------------------

8 While receiving the initial server greeting

12 MX errors -------------------------------------------------------------------------------

8 No MX host has a valid address record

4 Malformed domain name in resource data of MX record

13 Numeric hostname ------------------------------------------------------------------------

13 Resource data of MX record

6 Hostname verification errors ------------------------------------------------------------

4 Name or service not known

2 Address not listed for hostname

4 Hostname validation errors --------------------------------------------------------------

4 empty hostname

5 PIX workaround enabled ------------------------------------------------------------------

5 disableesmtp delaydotcrlf

======================================================================================================================

Delays Percentiles 0% 25% 50% 75% 90% 95% 98% 100%


1: Pre qmgr 0.000 0.890 1.900 3.000 49198.000 57410.000 61309.000 81353.000

2: In qmgr 0.000 0.280 3.400 16.000 37.000 42.000 48.000 235.000

3: Connection setup 0.000 0.040 0.140 0.620 21.000 21.000 33.200 604.000

4: Xmit time 0.000 0.000 0.540 6.100 16.000 194.000 206.000 268.000

======================================================================================================================

---------------------- Postfix End -------------------------

--------------------- SSHD Begin ------------------------

Failed logins from:

125.77.107.212: 19 times

root/password: 19 times

Illegal users from:

125.77.107.212: 1 time

shit: 1 time

Users logging in through sshd:

root:

66.183.188.57: 3 times

SFTP subsystem requests: 1 Time(s)

Unmatched Entries

pam_env(sshd:setcred): Unable to open env file: /etc/default/locale: No such file or directory : 6 time(s)

---------------------- SSHD End -------------------------

--------------------- Disk Space Begin ------------------------

Filesystem Size Used Avail Use% Mounted on

/dev/xvda 16G 880M 15G 6% /

---------------------- Disk Space End -------------------------

################ Logwatch End #########################

4 Replies

You are running out of memory and the kernel is killing processes as a result. Tune Apache and MySQL to use less memory – see numerous threads on this forum.

perfect,that's exactly what I was looking for, appreciate it & I'll go digging through the threads…!

The most basic Linode comes with 512MB of RAM, which is enough to handle massive loads if properly configured. So, before you go upgrading your Linode, make sure you've configured MySQL and Apache to not go overboard on RAM usage.

One easy way to keep RAM usage under control is to replace Apache with Lighttpd/nginx/cherokee/litespeed/etc, since they all come configured decently out of the box, but they're not for everyone.

I know it mind sound basic, but remember to close your connections when you're done querying databases in MySQL. Usually, in overload situations like these, the code is to blame.

Reply

Please enter an answer
Tips:

You can mention users to notify them: @username

You can use Markdown to format your question. For more examples see the Markdown Cheatsheet.

> I’m a blockquote.

I’m a blockquote.

[I'm a link] (https://www.google.com)

I'm a link

**I am bold** I am bold

*I am italicized* I am italicized

Community Code of Conduct