Memory Woes

Here's an update:

I installed and ran tuning-primer.sh which made some interesting suggestion to make in my.cnf. I changed a couple of these to see how things were affected and restarted mysql. MySQL dropped from 16.5% to 12.1 ... I'm sure there is more I can do there.

I also see that you can tune httpd ... looking into that now.

I'm actually running in the green... but time will tell! :)
 
Oh I thought you meant you had recompiled Apache, not sure how much tuning is going to help if you're running an excessive amount of modules but it is of course worth a try :)
 
Hey Dan,

I wouldn't know where to start with recompiling Apache or even which modules are unnecessary ... feel like really deep water here, and I'm stuck in the shallows, LOL.

What modules would you NOT want to use?

Tweaking mysql and http has been some help. But after looking again at TOP (gee, you have to pull the window all the way down to get the whole list!) I see that MySql is still in the 12% range and spamd is running more than once with instances at 9 and 11% (or what ever they may be at some moment).
 
Hello chaddro,

I'm a bit stumped as it's impossible for me to tell you which modules you need and do not need as it is based on the code you have on your site(s). For the basics you'd want the newest version of Apache and PHP5 (assuming your code is not written for PHP4 that is). There are numerous tutorials online you can look at and perhaps you would want to talk to support about it too. You may have difficulty compiling it as it does require available ram.
 
Dan,

Well, Knownhost support didn't think there was anything in Apache that could be further optimized.

I'm sure I could continue to work with my.cnf for mysql and httpd.conf to get things to work better, but it seems that it's the bots that are gobbling up system resources during a crawl that get me to 100%.

Is there a way to clear httpd threads without restarting Apache? That was the first thing support did ...

So, after all this I did a 128mb memory upgrade. Now a when yahoo, google, and msn gang up on me I'm hitting only 85%.

Still open to suggestions.
 
It is usually Yahoo spider which consumes most of the bandwidth and resources, you can slow it down up adding the following entry in your robots.txt file.

User-agent: Slurp
Crawl-delay: 60

Alternatively also check for bad bots which suck up all the resources, in particular the following ip range which I have seen wreaking a havoc on my forum.

87.118.96.
87.118.97.
87.118.98.
87.118.99.
87.118.100.
87.118.102.
87.118.101
87.118.102.
87.118.103.
87.118.104.
87.118.105.
87.118.106.
87.118.107.
87.118.108.
87.118.109.
87.118.111.
87.118.110.
87.118.112.
87.118.113.
87.118.114.
87.118.115.
87.118.116.
87.118.117.
87.118.118.
87.118.119.
87.118.120.
87.118.121.
87.118.122.
87.118.123.
87.118.124.
87.118.125.
87.118.126.
87.118.127.
84.122.149.
88.254.200.
85.106.154.
88.254.204.
88.224.30.
 
You must log in or register to reply here.
Top