rsyslog 2.0.6 on RHEL5: stuck at ~1000 FDs

General discussions here

Moderator: rgerhards

rsyslog 2.0.6 on RHEL5: stuck at ~1000 FDs

Postby nixar » Mon Feb 23, 2009 5:18 pm

I keep hitting a bug in 2.0.6 on RHEL5 whereby

I upped the limits by specifying it sysconfig/rsyslog:

Code: Select all
SYSLOGD_OPTIONS="-m 0 -r514 -t514,4000 -x"
KLOGD_OPTIONS="-x"
ulimit -Hn 5000
ulimit -Sn 4200


I verifiered that the limits have taken hold:

Code: Select all
# cat /proc/$(pgrep rsyslogd)/limits
Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            10485760             unlimited            bytes     
Max core file size        0                    unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             139264               139264               processes
Max open files            4200                 5000                 files     
Max locked memory         32768                32768                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       139264               139264               signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                   
Max realtime priority     0                    0


Yet for some reason, after a while the number of open fd hits 1038 and never goes above, and new connections are are stalled for a minute or 2 (until a connection frees up I guess).

Am I missing something here?
nixar
Avarage
 
Posts: 12
Joined: Mon Feb 23, 2009 5:07 pm

Professional Services Information

  • Custom written rsyslog.conf?
  • Maintenance Contract?
  • Installation support?

Re: rsyslog 2.0.6 on RHEL5: stuck at ~1000 FDs

Postby rgerhards » Tue Feb 24, 2009 11:02 am

This may be a select() limit. I have to admit I so far did not test with that number of connections...
User avatar
rgerhards
Site Admin
 
Posts: 2647
Joined: Thu Feb 13, 2003 11:57 am

Re: rsyslog 2.0.6 on RHEL5: stuck at ~1000 FDs

Postby nixar » Tue Feb 24, 2009 11:18 am

Oh it uses select, not poll or epoll?

Was this changed in 3.x?
nixar
Avarage
 
Posts: 12
Joined: Mon Feb 23, 2009 5:07 pm

Re: rsyslog 2.0.6 on RHEL5: stuck at ~1000 FDs

Postby rgerhards » Tue Feb 24, 2009 11:20 am

no, its unfortunately still at select. Reason is platform compatibilty and no time (yet) to change to epoll for those platforms that support it :(
User avatar
rgerhards
Site Admin
 
Posts: 2647
Joined: Thu Feb 13, 2003 11:57 am

Re: rsyslog 2.0.6 on RHEL5: stuck at ~1000 FDs

Postby nixar » Tue Feb 24, 2009 11:32 am

Oh crap. This means I'll have to switch to UDP, or maybe launch several instances bound to different ports, I guess.
nixar
Avarage
 
Posts: 12
Joined: Mon Feb 23, 2009 5:07 pm

Re: rsyslog 2.0.6 on RHEL5: stuck at ~1000 FDs

Postby rgerhards » Tue Feb 24, 2009 11:36 am

I fear so...
User avatar
rgerhards
Site Admin
 
Posts: 2647
Joined: Thu Feb 13, 2003 11:57 am

Google Ads



Return to General

Who is online

Users browsing this forum: No registered users and 1 guest

cron