Munin CGI Graphs Stopped Working
I've been using Munin for about 4-5 months with no issues. I finally got it all set up and monitoring exactly what I need it to monitor. Munin has been configured to use munin-cgi-graph as to make on-demand graphs.
Recently (within the past week), my Munin page stopped showing graphs. I can pull up the page, the HTML loads fine, and Firefox makes requests for the images, they just never show up. I went ahead and did some permission checks, even went as far as deleting the existing graph .pngs.
munin-cgi-graph appears to generate a graph then store it in the htdocs folder. If I delete all the existing graph .pngs and refresh the page that makes the cgi-bin calls, some of the .pngs are regenerated and viewable if i link directly to them using my browser. Some, but not all are regenerated. They DO NOT show up on the page automatically. This makes me think that something is hung between when the graph is generated and when the cgi script sends data back to the browser.
/var/log/apache2/error.log shows errors such as the following:
[Mon Feb 08 22:34:08 2010] [warn] [client 134.X.X.X] Timeout waiting for output from CGI script /content/munin/cgi-bin/munin-cgi-graph, referer: [censored] [Mon Feb 08 22:34:08 2010] [error] [client 134.X.X.X] Premature end of script headers: munin-cgi-graph, referer: [censored]
I'm out of ideas and am looking for more input. As far as I can remember, I made no changes to the server around the time munin "broke". Any tips or suggestions would be greatly appreciated!