rsyslog drops messages before site outage -- coincidence?

This is the place for you, if you got rsyslog up and running but wonder how to make it do what you want.

Moderator: rgerhards

rsyslog drops messages before site outage -- coincidence?

Postby donhamish » Wed Mar 25, 2009 10:38 pm

Hello there. First off, I apologize -- I posted this message to the rsyslog mailing list. I'm seeing more activity here, so I figured why not break a fundamental rule of the Internet and post here too...

I have rsyslog configured to forward logging messages from several application servers to a central log server. It's a Ruby on Rails app and I'm using the SyslogLogger gem to talk to rsyslog. From time to time under moderate volume my application, or more accurately one or more of my application containers, begins to freeze. I haven't been able to pin down the cause, but I did notice a couple of interesting things related to rsyslog. Very soon before the application begins to experience problems the central log file (to which all app servers forward) stops updating. This has happened every time the application has had problems. On a lark I decided to disable rsyslog and instead use the native rails logging framework. Each time this change has completely cleared up all the problems on the site. Obviously this is a grossly unscientific observation but I just can't ignore the coincidence.

I'm thinking that I have borked the config of my installation to, somehow, cause this failure. Is it possible that I have configured rsyslog to somehow wait for a successful write to the log file instead of firing and forgetting? Am I required to create a local spool per http://www.rsyslog.com/doc-rsyslog_reli ... rding.html? Many thanks in advance.

This is the configuration for the host:

Code: Select all
$ModLoad imtcp
$InputTCPServerRun 200
*.info;mail.none;authpriv.none;cron.none;my_app.none                /var/log/messages
authpriv.*                                              /var/log/secure
mail.*                                                  -/var/log/maillog
cron.*                                                  /var/log/cron
*.emerg                                                 *
uucp,news.crit                                          /var/log/spooler
local7.*                                                /var/log/boot.log
$outchannel my_app_rotate,/vol/logs/my_app.log,5242880,/usr/bin/loganalysis /vol/logs/my_app.log
!my_app
*.* $my_app_rotate


Each host then has this in rsyslog.conf

Code: Select all
!my_app
*.*      @@log_host:200


And I start rsyslogd on the central log host with SYSLOGD_OPTIONS="-t200 -m 0"
donhamish
New
 
Posts: 1
Joined: Wed Mar 25, 2009 10:33 pm

Professional Services Information

  • Custom written rsyslog.conf?
  • Maintenance Contract?
  • Installation support?

Google Ads


Return to Configuration

Who is online

Users browsing this forum: No registered users and 0 guests

cron