MonitorWare Knowledge Base

Hi again.

Setting a queue other than Direct (LinkedList, FixedArray, or Disk) causes a core dump on my machine. FreeBSD 7.0, rsyslog 3.17.4, compiled with the --enable-debug option. Here's what my working rsyslog.conf file looks like:

Code: Select all

$ActionQueueType Direct
*.*                             /var/log/debug.log


Changing Direct to any of the others crashes rsyslog almost immediately upon starting. Here's the output of an interactive, debugging run when LinkedList was configured:

Code: Select all

qa-freebsd# /usr/local/sbin/rsyslogd -c3 -dn -f /usr/local/etc/rsyslog.conf

7647.094113627:main thread: Writing pidfile /var/run/rsyslogd.pid.
7647.096137068:main thread: rsyslog 3.17.4 - called init()
7647.096139024:main thread: Unloading non-static modules.
7647.096140980:main thread: module lmnet NOT unloaded because it still has a refcount of 3
7647.096580980:main thread: module lmtcpclt NOT unloaded because it still has a refcount of 1
7647.096582935:main thread: modules still loaded after module.UnloadAndDestructAll:
7647.096584891:main thread: printing users of loadable module lmnet, refcount 3, ptr 0x28213080, type 2
7647.096587126:main thread:     module lmnet is currently in use by file omfwd.c
7647.096589081:main thread:     module lmnet is currently in use by file syslogd.c
7647.096591037:main thread:     module lmnet is currently in use by file conf.c
7647.096592992:main thread: printing users of loadable module builtin-file, refcount 0, ptr 0x282130e0, type 1
7647.096594948:main thread: printing users of loadable module lmtcpclt, refcount 1, ptr 0x282131a0, type 2
7647.096596903:main thread:     module lmtcpclt is currently in use by file omfwd.c
7647.096598859:main thread: printing users of loadable module builtin-fwd, refcount 0, ptr 0x28213140, type 1
7647.096601094:main thread: printing users of loadable module builtin-shell, refcount 0, ptr 0x28213200, type 1
7647.096605005:main thread: printing users of loadable module builtin-discard, refcount 0, ptr 0x28213260, type 1
7647.096606960:main thread: printing users of loadable module builtin-usrmsg, refcount 0, ptr 0x282132c0, type 1
7647.096608916:main thread: Clearing templates.
7647.098056027:main thread: cfline: '$ActionQueueType LinkedList'
7647.098089830:main thread: action queue type set to LINKEDLIST
7647.098091786:main thread: cfline: '*.*                                /var/log/debug.log'
7647.098163304:main thread:  - traditional PRI filter
7647.098165259:main thread: symbolic name: * ==> 255
7647.098692421:main thread: tried selector action for builtin-file: 0
7647.098694377:main thread: Module builtin-file processed this config line.
7647.099180472:main thread: template: 'RSYSLOG_FileFormat' assigned

7647.099557615:main thread: action 1 queue: save on shutdown 1, max disk space allowed 0
7647.099615723:main thread: action 1 queue: is NOT disk-assisted
7647.099617678:main thread: action 1 queue: type 1, enq-only 0, disk assisted 0, maxFileSz 1048576, qsize 0, child 0 starting
7647.099696459:main thread: action 1 queue:Reg: finalizing construction of worker thread pool
7647.099698415:main thread: action 1 queue:Reg/w0: finalizing construction of worker instance data
7647.099700370:main thread: action 1 queue: queue starts up without (loading) any DA disk state (this is normal for the DA queue itself!)
7647.099702326:main thread: action 1 queue:Reg: high activity - starting 1 additional worker thread(s).
7647.099704561:main thread: action 1 queue:Reg/w0: receiving command 2
7647.100652447:main thread: action 1 queue:Reg: started with state 0, num workers now 1
7647.102434796:main thread: Action 0x2821f0b0: queue 0x28224260 created
7647.102602415:main thread: selector line successfully processed
7647.102674212:main thread: main queue: is NOT disk-assisted
7647.102676168:main thread: main queue: type 0, enq-only 0, disk assisted 0, maxFileSz 1048576, qsize 0, child 0 starting
7647.103064485:main thread: main queue:Reg: finalizing construction of worker thread pool
7647.103066441:main thread: main queue:Reg/w0: finalizing construction of worker instance data
7647.103068396:main thread: main queue: queue starts up without (loading) any DA disk state (this is normal for the DA queue itself!)
7647.103070352:main thread: main queue:Reg: high activity - starting 1 additional worker thread(s).
7647.103072307:main thread: main queue:Reg/w0: receiving command 2
7647.103651711:main thread: main queue:Reg: started with state 0, num workers now 1
7647.103705628:28201200: action 1 queue:Reg/w0: receiving command 4
7647.105066136:main thread: Main processing queue is initialized and running
7647.105068371:main thread:
Active selectors:
7647.105139609:main thread: Selector 1:
7647.105141565:main thread: FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF
Actions:
7647.106559343:main thread: builtin-file: /var/log/debug.log
        Instance data: 0x28224140
7647.106632536:main thread:     RepeatedMsgReduction: 0
7647.106634492:main thread:     Resume Interval: 30
7647.106636448:main thread:     Suspended: 0
7647.107060244:main thread:     Disabled: 0
7647.107062479:main thread:     Exec only when previous is suspended: 0
7647.107064435:main thread:
7647.107066390:main thread:
7647.107068346:main thread:
7647.107070301:main thread:
7647.107074213:main thread: Template: Name='RSYSLOG_SyslogProtocol23Format'
7647.107609756:main thread:     Entry(28205680): type 1, (CONSTANT), value: '<'
7647.107664790:main thread:     Entry(282056c0): type 2, (FIELD), value: 'pri'
7647.107720105:main thread:     Entry(28205700): type 1, (CONSTANT), value: '>1 '
7647.108103394:main thread:     Entry(28205740): type 2, (FIELD), value: 'timestamp' [Format as RFC3339-Date]
7647.108172676:main thread:     Entry(28205780): type 1, (CONSTANT), value: ' '
7647.108558200:main thread:     Entry(282057c0): type 2, (FIELD), value: 'hostname'
7647.108617705:main thread:     Entry(28205800): type 1, (CONSTANT), value: ' '
7647.108673019:main thread:     Entry(28205840): type 2, (FIELD), value: 'app-name'
7647.109060778:main thread:     Entry(28205880): type 1, (CONSTANT), value: ' '
7647.109116092:main thread:     Entry(282058c0): type 2, (FIELD), value: 'procid'
7647.109170848:main thread:     Entry(28205900): type 1, (CONSTANT), value: ' '
7647.109557489:main thread:     Entry(28205940): type 2, (FIELD), value: 'msgid'
7647.109614200:main thread:     Entry(28205980): type 1, (CONSTANT), value: ' '
7647.109668956:main thread:     Entry(282059c0): type 2, (FIELD), value: 'structured-data'
7647.110057273:main thread:     Entry(28205a00): type 1, (CONSTANT), value: ' '
7647.110564600:main thread:     Entry(28205a40): type 2, (FIELD), value: 'msg'
7647.110648689:main thread:     Entry(28205a80): type 1, (CONSTANT), value: '
'
7647.110716016:main thread: Template: Name='RSYSLOG_FileFormat'
7647.111086454:main thread:     Entry(28205ac0): type 2, (FIELD), value: 'timestamp' [Format as RFC3339-Date]
7647.111155458:main thread:     Entry(28205b00): type 1, (CONSTANT), value: ' '
7647.111210213:main thread:     Entry(28205b40): type 2, (FIELD), value: 'hostname'
7647.111625350:main thread:     Entry(28205b80): type 1, (CONSTANT), value: ' '
7647.111680943:main thread:     Entry(28205bc0): type 2, (FIELD), value: 'syslogtag'
7647.112068423:main thread:     Entry(28205c00): type 2, (FIELD), value: 'msg' [drop last LF in msg]
7647.112137985:main thread:     Entry(28205c40): type 1, (CONSTANT), value: '
'
7647.112204474:main thread: Template: Name='RSYSLOG_TraditionalFileFormat'
7647.112208385:main thread:     Entry(28205c80): type 2, (FIELD), value: 'timestamp'
7647.112640004:main thread:     Entry(28205cc0): type 1, (CONSTANT), value: ' '
7647.112695039:main thread:     Entry(28205d00): type 2, (FIELD), value: 'hostname'
7647.113086429:main thread:     Entry(28205d40): type 1, (CONSTANT), value: ' '
7647.113141743:main thread:     Entry(28205d80): type 2, (FIELD), value: 'syslogtag'
7647.113196499:main thread:     Entry(28205dc0): type 2, (FIELD), value: 'msg' [drop last LF in msg]
7647.113597109:main thread:     Entry(28205e00): type 1, (CONSTANT), value: '
'
7647.113663597:main thread: Template: Name=' WallFmt'
7647.113704106:main thread:     Entry(28205e40): type 1, (CONSTANT), value: '
Message from syslogd@'
7647.114110302:main thread:     Entry(28205e80): type 2, (FIELD), value: 'hostname'
7647.114165617:main thread:     Entry(28205ec0): type 1, (CONSTANT), value: ' at '
7647.114555610:main thread:     Entry(28205f00): type 2, (FIELD), value: 'timegenerated'
7647.114612322:main thread:     Entry(28205f40): type 1, (CONSTANT), value: ' ...
'
7647.114679649:main thread:     Entry(28205f80): type 2, (FIELD), value: 'syslogtag'
7647.115219661:main thread:     Entry(28205fc0): type 2, (FIELD), value: 'msg'
7647.115633680:main thread:     Entry(2821d040): type 1, (CONSTANT), value: '
'
7647.115709947:main thread: Template: Name='RSYSLOG_ForwardFormat'
7647.116156372:main thread:     Entry(2821d080): type 1, (CONSTANT), value: '<'
7647.116211687:main thread:     Entry(2821d0c0): type 2, (FIELD), value: 'pri'
7647.116561172:main thread:     Entry(2821d100): type 1, (CONSTANT), value: '>'
7647.116618163:main thread:     Entry(2821d140): type 2, (FIELD), value: 'timestamp' [Format as RFC3339-Date]
7647.116689960:main thread:     Entry(2821d180): type 1, (CONSTANT), value: ' '
7647.117077160:main thread:     Entry(2821d1c0): type 2, (FIELD), value: 'hostname'
7647.117132195:main thread:     Entry(2821d200): type 1, (CONSTANT), value: ' '
7647.117186950:main thread:     Entry(2821d240): type 2, (FIELD), value: 'syslogtag' [substring, from character 1 to 32]
7647.117559344:main thread:     Entry(2821d280): type 2, (FIELD), value: 'msg'
7647.117643712:main thread: Template: Name='RSYSLOG_TraditionalForwardFormat'
7647.117684500:main thread:     Entry(2821d2c0): type 1, (CONSTANT), value: '<'
7647.118071700:main thread:     Entry(2821d300): type 2, (FIELD), value: 'pri'
7647.118129249:main thread:     Entry(2821d340): type 1, (CONSTANT), value: '>'
7647.118184563:main thread:     Entry(2821d380): type 2, (FIELD), value: 'timestamp'
7647.118559750:main thread:     Entry(2821d3c0): type 1, (CONSTANT), value: ' '
7647.118638811:main thread:     Entry(2821d400): type 2, (FIELD), value: 'hostname'
7647.118694405:main thread:     Entry(2821d440): type 1, (CONSTANT), value: ' '
7647.119082163:main thread:     Entry(2821d480): type 2, (FIELD), value: 'syslogtag' [substring, from character 1 to 32]
7647.119152005:main thread:     Entry(2821d4c0): type 2, (FIELD), value: 'msg'
7647.119207039:main thread: Template: Name=' StdUsrMsgFmt'
7647.119210951:main thread:     Entry(2821d500): type 1, (CONSTANT), value: ' '
7647.119642849:main thread:     Entry(2821d540): type 2, (FIELD), value: 'syslogtag'
7647.120720360:main thread:     Entry(2821d580): type 2, (FIELD), value: 'msg'
7647.121070684:main thread:     Entry(2821d5c0): type 1, (CONSTANT), value: '
'
7647.121139408:main thread: Template: Name=' StdDBFmt' [SQL-Format (MySQL)]
7647.121203103:main thread:     Entry(2821d600): type 1, (CONSTANT), value: 'insert into SystemEvents (Message, Facility, FromHost, Priority, DeviceReportedTime, ReceivedAt, InfoUnitID, SysLogTag) values (''
7647.121207014:main thread:     Entry(2821d640): type 2, (FIELD), value: 'msg'
7647.121653161:main thread:     Entry(2821d680): type 1, (CONSTANT), value: '', '
7647.121708195:main thread:     Entry(2821d6c0): type 2, (FIELD), value: 'syslogfacility'
7647.122089529:main thread:     Entry(2821d700): type 1, (CONSTANT), value: ', ''
7647.122144564:main thread:     Entry(2821d740): type 2, (FIELD), value: 'hostname'
7647.122199040:main thread:     Entry(2821d780): type 1, (CONSTANT), value: '', '
7647.122202951:main thread:     Entry(2821d7c0): type 2, (FIELD), value: 'syslogpriority'
7647.122644627:main thread:     Entry(2821d800): type 1, (CONSTANT), value: ', ''
7647.122699383:main thread:     Entry(2821d840): type 2, (FIELD), value: 'timereported' [Format as MySQL-Date]
7647.123101389:main thread:     Entry(2821d880): type 1, (CONSTANT), value: '', ''
7647.123156424:main thread:     Entry(2821d8c0): type 2, (FIELD), value: 'timegenerated' [Format as MySQL-Date]
7647.123557592:main thread:     Entry(2821d900): type 1, (CONSTANT), value: '', '
7647.123614304:main thread:     Entry(2821d940): type 2, (FIELD), value: 'iut'
7647.123672132:main thread:     Entry(2821d980): type 1, (CONSTANT), value: ', ''
7647.124060729:main thread:     Entry(2821d9c0): type 2, (FIELD), value: 'syslogtag'
7647.124115764:main thread:     Entry(2821da00): type 1, (CONSTANT), value: '')'
7647.124180856:main thread: Template: Name=' StdPgSQLFmt' [SQL-Format (standard SQL)]
7647.124554367:main thread:     Entry(2821da40): type 1, (CONSTANT), value: 'insert into SystemEvents (Message, Facility, FromHost, Priority, DeviceReportedTime, ReceivedAt, InfoUnitID, SysLogTag) values (''
7647.125595282:main thread:     Entry(2821da80): type 2, (FIELD), value: 'msg'
7647.125655345:main thread:     Entry(2821dac0): type 1, (CONSTANT), value: '', '
7647.125710939:main thread:     Entry(2821db00): type 2, (FIELD), value: 'syslogfacility'
7647.126097860:main thread:     Entry(2821db40): type 1, (CONSTANT), value: ', ''
7647.126153174:main thread:     Entry(2821db80): type 2, (FIELD), value: 'hostname'
7647.126208209:main thread:     Entry(2821dbc0): type 1, (CONSTANT), value: '', '
7647.126599599:main thread:     Entry(2821dc00): type 2, (FIELD), value: 'syslogpriority'
7647.126654634:main thread:     Entry(2821dc40): type 1, (CONSTANT), value: ', ''
7647.126709390:main thread:     Entry(2821dc80): type 2, (FIELD), value: 'timereported' [Format as PgSQL-Date]
7647.127125364:main thread:     Entry(2821dcc0): type 1, (CONSTANT), value: '', ''
7647.127564806:main thread:     Entry(2821dd00): type 2, (FIELD), value: 'timegenerated' [Format as PgSQL-Date]
7647.127652806:main thread:     Entry(2821dd40): type 1, (CONSTANT), value: '', '
7647.127707841:main thread:     Entry(2821dd80): type 2, (FIELD), value: 'iut'
7647.128147841:main thread:     Entry(2821ddc0): type 1, (CONSTANT), value: ', ''
7647.128562139:main thread:     Entry(2821de00): type 2, (FIELD), value: 'syslogtag'
7647.128622761:main thread:     Entry(2821de40): type 1, (CONSTANT), value: '')'
7647.128678914:main thread: Loaded Module: Name='lmnet', IFVersion=4, type=library module.
7647.129079803:main thread: Entry points:
7647.129081758:main thread:     queryEtryPt:        0x281d7500
7647.129083714:main thread:     doAction:           0x0
7647.129085669:main thread:     parseSelectorAct:   0x0
7647.129087625:main thread:     dbgPrintInstInfo:   0x0
7647.129089860:main thread:     freeInstance:       0x0
7647.129093771:main thread:
7647.129095727:main thread: Loaded Module: Name='builtin-file', IFVersion=4, type=output module.
7647.129669263:main thread: Entry points:
7647.129671219:main thread:     queryEtryPt:        0x806fad0
7647.129673174:main thread:     doAction:           0x8070900
7647.131129225:main thread:     parseSelectorAct:   0x8070030
7647.131131181:main thread:     dbgPrintInstInfo:   0x8070710
7647.131133136:main thread:     freeInstance:       0x806ffb0
7647.131135092:main thread:
7647.131139003:main thread: Loaded Module: Name='lmtcpclt', IFVersion=4, type=library module.
7647.131645213:main thread: Entry points:
7647.131647168:main thread:     queryEtryPt:        0x281dbd60
7647.131649403:main thread:     doAction:           0x0
7647.131651359:main thread:     parseSelectorAct:   0x0
7647.131653314:main thread:     dbgPrintInstInfo:   0x0
7647.131655270:main thread:     freeInstance:       0x0
7647.131657225:main thread:
7647.131659181:main thread: Loaded Module: Name='builtin-fwd', IFVersion=4, type=output module.
7647.132557060:main thread: Entry points:
7647.132559016:main thread:     queryEtryPt:        0x806e7a0
7647.132560971:main thread:     doAction:           0x806ecf0
7647.132562927:main thread:     parseSelectorAct:   0x806f0b0
7647.132564882:main thread:     dbgPrintInstInfo:   0x806ecd0
7647.132566838:main thread:     freeInstance:       0x806ec30
7647.132569073:main thread:
7647.132571029:main thread: Loaded Module: Name='builtin-shell', IFVersion=4, type=output module.
7647.133174457:main thread: Entry points:
7647.133176413:main thread:     queryEtryPt:        0x806d720
7647.133180324:main thread:     doAction:           0x806da80
7647.133182279:main thread:     parseSelectorAct:   0x806d8b0
7647.133184235:main thread:     dbgPrintInstInfo:   0x806da60
7647.133186470:main thread:     freeInstance:       0x806d890
7647.133188426:main thread:
7647.133190381:main thread: Loaded Module: Name='builtin-discard', IFVersion=4, type=output module.
7647.134101111:main thread: Entry points:
7647.134103067:main thread:     queryEtryPt:        0x8070fa0
7647.134105022:main thread:     doAction:           0x8071110
7647.134106978:main thread:     parseSelectorAct:   0x8071150
7647.134109213:main thread:     dbgPrintInstInfo:   0x8070e70
7647.134113124:main thread:     freeInstance:       0x8071130
7647.134115080:main thread:
7647.135635385:main thread: Loaded Module: Name='builtin-usrmsg', IFVersion=4, type=output module.
7647.135707181:main thread: Entry points:
7647.135709416:main thread:     queryEtryPt:        0x806dc40
7647.135711372:main thread:     doAction:           0x806e4b0
7647.135713327:main thread:     parseSelectorAct:   0x806de20
7647.135715283:main thread:     dbgPrintInstInfo:   0x806ddb0
7647.135717238:main thread:     freeInstance:       0x806de00
7647.135719194:main thread:
7647.135723385:main thread: Sytem Line Configuration Commands:
7647.135725340:main thread:     Command 'dynafilecachesize':
7647.135727296:main thread:             type : 6
7647.135729251:main thread:             pData: 0x0
7647.135731207:main thread:             Hdlr : 0x806fc40
7647.135733442:main thread:             Owner: 0x806fe80
7647.135735397:main thread:
7647.135737353:main thread:     Command 'dirowner':
7647.135739308:main thread:             type : 2
7647.135741264:main thread:             pData: 0x8084d90
7647.135743219:main thread:             Hdlr : 0x0
7647.135745454:main thread:             Owner: 0x806fe80
7647.135749365:main thread:
7647.135751321:main thread:     Command 'dirgroup':
7647.135753276:main thread:             type : 3
7647.135755232:main thread:             pData: 0x8084d94
7647.135757188:main thread:             Hdlr : 0x0
7647.135759423:main thread:             Owner: 0x806fe80
7647.135761378:main thread:
7647.135763334:main thread:     Command 'fileowner':
7647.135765289:main thread:             type : 2
7647.135767245:main thread:             pData: 0x8084d88
7647.135769200:main thread:             Hdlr : 0x0
7647.135771435:main thread:             Owner: 0x806fe80
7647.135775347:main thread:
7647.135777302:main thread:     Command 'filegroup':
7647.135779258:main thread:             type : 3
7647.135781213:main thread:             pData: 0x8084d8c
7647.135783448:main thread:             Hdlr : 0x0
7647.135785404:main thread:             Owner: 0x806fe80
7647.135787359:main thread:
7647.135789315:main thread:     Command 'dircreatemode':
7647.135791270:main thread:             type : 5
7647.135793226:main thread:             pData: 0x8082a50
7647.135795181:main thread:             Hdlr : 0x0
7647.135797416:main thread:             Owner: 0x806fe80
7647.140563385:main thread:
7647.140565341:main thread:     Command 'filecreatemode':
7647.140567296:main thread:             type : 5
7647.140569252:main thread:             pData: 0x8082a54
7647.140571207:main thread:             Hdlr : 0x0
7647.140573442:main thread:             Owner: 0x806fe80
7647.140575398:main thread:
7647.140577353:main thread:     Command 'createdirs':
7647.140579309:main thread:             type : 4
7647.140581265:main thread:             pData: 0x8084d98
7647.140583220:main thread:             Hdlr : 0x0
7647.140585455:main thread:             Owner: 0x806fe80
7647.140589366:main thread:
7647.140591322:main thread:     Command 'failonchownfailure':
7647.140593277:main thread:             type : 4
7647.140595233:main thread:             pData: 0x8084d84
7647.140597188:main thread:             Hdlr : 0x0
7647.140599423:main thread:             Owner: 0x806fe80
7647.140601379:main thread:
7647.140603334:main thread:     Command 'actionfileenablesync':
7647.140605290:main thread:             type : 4
7647.140607245:main thread:             pData: 0x8084d78
7647.140609201:main thread:             Hdlr : 0x0
7647.140611436:main thread:             Owner: 0x806fe80
7647.140615347:main thread:
7647.140617303:main thread:     Command 'actionfiledefaulttemplate':
7647.140619258:main thread:             type : 11
7647.140621214:main thread:             pData: 0x8084d7c
7647.140623449:main thread:             Hdlr : 0x0
7647.140625404:main thread:             Owner: 0x0
7647.140627360:main thread:
7647.140629315:main thread:     Command 'resetconfigvariables':
7647.140631271:main thread:             type : 1
7647.140633226:main thread:             pData: 0x0
7647.140635461:main thread:             Hdlr : 0x806fea0
7647.140637417:main thread:             Owner: 0x806fe80
7647.140641328:main thread:
7647.140643283:main thread:             type : 1
7647.140645239:main thread:             pData: 0x0
7647.140647195:main thread:             Hdlr : 0x806eb60
7647.140649429:main thread:             Owner: 0x806eb90
7647.140651385:main thread:
7647.140653341:main thread:             type : 1
7647.140655296:main thread:             pData: 0x0
7647.140657252:main thread:             Hdlr : 0x804f8c0
7647.140659207:main thread:             Owner: 0x0
7647.140661442:main thread:
7647.145187157:main thread:     Command 'actionforwarddefaulttemplate':
7647.145189113:main thread:             type : 11
7647.145191068:main thread:             pData: 0x8084d70
7647.145195259:main thread:             Hdlr : 0x0
7647.145197214:main thread:             Owner: 0x0
7647.145199170:main thread:
7647.145201125:main thread:     Command 'workdirectory':
7647.145203081:main thread:             type : 11
7647.145205316:main thread:             pData: 0x8083c98
7647.145207271:main thread:             Hdlr : 0x0
7647.145209227:main thread:             Owner: 0x0
7647.145211183:main thread:
7647.145213138:main thread:     Command 'actionresumeretrycount':
7647.145215094:main thread:             type : 6
7647.145217049:main thread:             pData: 0x8084dd0
7647.145221240:main thread:             Hdlr : 0x0
7647.145223195:main thread:             Owner: 0x0
7647.145225151:main thread:
7647.145227106:main thread:     Command 'mainmsgqueuefilename':
7647.145229062:main thread:             type : 11
7647.145231297:main thread:             pData: 0x8083cc4
7647.145233252:main thread:             Hdlr : 0x0
7647.145235208:main thread:             Owner: 0x0
7647.145237163:main thread:
7647.145239119:main thread:     Command 'mainmsgqueuesize':
7647.145241075:main thread:             type : 6
7647.145243309:main thread:             pData: 0x8081300
7647.145247221:main thread:             Hdlr : 0x0
7647.145249176:main thread:             Owner: 0x0
7647.145251132:main thread:
7647.147708986:main thread:     Command 'mainmsgqueuehighwatermark':
7647.147711221:main thread:             type : 6
7647.147713176:main thread:             pData: 0x8081304
7647.147715132:main thread:             Hdlr : 0x0
7647.147717087:main thread:             Owner: 0x0
7647.147719043:main thread:
7647.147720999:main thread:     Command 'mainmsgqueuelowwatermark':
7647.147725189:main thread:             type : 6
7647.147727145:main thread:             pData: 0x8081308
7647.147729100:main thread:             Hdlr : 0x0
7647.147731056:main thread:             Owner: 0x0
7647.147733011:main thread:
7647.147735246:main thread:     Command 'mainmsgqueuediscardmark':
7647.147737202:main thread:             type : 6
7647.147739158:main thread:             pData: 0x808130c
7647.147741113:main thread:             Hdlr : 0x0
7647.110130467:action 1 queue:Reg/w0: action 1 queue: entering rate limiter
7647.152669114:28201300: main queue:Reg/w0: receiving command 4
7647.153090955:main thread:             Owner: 0x0
7647.153092911:main thread:
7647.153094866:main thread:     Command 'mainmsgqueuediscardseverity':
7647.153096822:main thread:             type : 10
7647.153098777:main thread:             pData: 0x8081310
7647.153102968:main thread:             Hdlr : 0x0
7647.153104923:main thread:             Owner: 0x0
7647.153106879:main thread:
7647.153108834:main thread:     Command 'mainmsgqueuecheckpointinterval':
7647.153110790:main thread:             type : 6
7647.153112745:main thread:             pData: 0x8083cc8
7647.153114980:main thread:             Hdlr : 0x0
7647.153116936:main thread:             Owner: 0x0
7647.153118891:main thread:
7647.153120847:main thread:     Command 'mainmsgqueuetype':
7647.153122803:main thread:             type : 11
7647.153124758:main thread:             pData: 0x0
7647.153126993:main thread:             Hdlr : 0x804ff50
7647.153130904:main thread:             Owner: 0x0
7647.153132860:main thread:
7647.153134815:main thread:     Command 'mainmsgqueueworkerthreads':
7647.153136771:main thread:             type : 6
7647.153138726:main thread:             pData: 0x8081314
7647.153140961:main thread:             Hdlr : 0x0
7647.153142917:main thread:             Owner: 0x0
7647.153144872:main thread:
7647.153146828:main thread:     Command 'mainmsgqueuetimeoutshutdown':
7647.153148784:main thread:             type : 6
7647.153150739:main thread:             pData: 0x8083ccc
7647.153154930:main thread:             Hdlr : 0x0
7647.153156885:main thread:             Owner: 0x0
7647.153158841:main thread:
7647.153160796:main thread:     Command 'mainmsgqueuetimeoutactioncompletion':
7647.153162752:main thread:             type : 6
7647.153164987:main thread:             pData: 0x8081318
7647.153166942:main thread:             Hdlr : 0x0
7647.153168898:main thread:             Owner: 0x0
7647.153170853:main thread:
7647.153172809:main thread:     Command 'mainmsgqueuetimeoutenqueue':
7647.153174764:main thread:             type : 6
7647.153176999:main thread:             pData: 0x808131c
7647.153180910:main thread:             Hdlr : 0x0
7647.153182866:main thread:             Owner: 0x0
7647.153184822:main thread:
7647.153186777:main thread:     Command 'mainmsgqueueworketimeoutrthreadshutdown':
7647.157070511:main thread:             type : 6
7647.157072467:main thread:             pData: 0x8081320
7647.157074422:main thread:             Hdlr : 0x0
7647.157076378:main thread:             Owner: 0x0
7647.157078333:main thread:
7647.157080289:main thread:     Command 'mainmsgqueuedequeueslowdown':
7647.157084479:main thread:             type : 6
7647.157086435:main thread:             pData: 0x8083cd0
7647.157088390:main thread:             Hdlr : 0x0
7647.157090346:main thread:             Owner: 0x0
7647.157092302:main thread:
7647.157094536:main thread:     Command 'mainmsgqueueworkerthreadminimummessages':
7647.157096492:main thread:             type : 6
7647.157098448:main thread:             pData: 0x8081324
7647.157100403:main thread:             Hdlr : 0x0
7647.157102359:main thread:             Owner: 0x0
7647.157104314:main thread:
7647.157106270:main thread:     Command 'mainmsgqueuemaxfilesize':
7647.157110460:main thread:             type : 7
7647.157112416:main thread:             pData: 0x8081328
7647.157114371:main thread:             Hdlr : 0x0
7647.157116327:main thread:             Owner: 0x0
7647.157118282:main thread:
7647.157120517:main thread:     Command 'mainmsgqueuemaxdiskspace':
7647.157122473:main thread:             type : 7
7647.157124429:main thread:             pData: 0x8083cd8
7647.157126384:main thread:             Hdlr : 0x0
7647.157128340:main thread:             Owner: 0x0
7647.157130295:main thread:
7647.157132530:main thread:     Command 'mainmsgqueuesaveonshutdown':
7647.157136441:main thread:             type : 4
7647.157138397:main thread:             pData: 0x8081330
7647.157140352:main thread:             Hdlr : 0x0
7647.157142308:main thread:             Owner: 0x0
7647.157144543:main thread:
7647.157146498:main thread:     Command 'mainmsgqueuedequeuetimebegin':
7647.157148454:main thread:             type : 6
7647.157150409:main thread:             pData: 0x8083ce0
7647.157152365:main thread:             Hdlr : 0x0
7647.157154320:main thread:             Owner: 0x0
7647.157156276:main thread:
7647.157158511:main thread:     Command 'mainmsgqueuedequeuetimeend':
7647.157160467:main thread:             type : 6
7647.157164378:main thread:             pData: 0x8081334
7647.157166333:main thread:             Hdlr : 0x0
7647.160648899:main queue:Reg/w0: main queue: entering rate limiter
7647.163663528:action 1 queue:Reg/w0: action 1 queue:Reg/w0: worker IDLE, waiting for work.
7647.163712417:main thread:             Owner: 0x0
7647.163714651:main thread:
7647.163716607:main thread:     Command 'repeatedmsgreduction':
7647.163718563:main thread:             type : 4
7647.163720518:main thread:             pData: 0x8084dfc
7647.163724429:main thread:             Hdlr : 0x0
7647.163726385:main thread:             Owner: 0x0
7647.163728620:main thread:
7647.163730575:main thread:     Command 'actionexeconlywhenpreviousissuspended':
7647.163732531:main thread:             type : 4
7647.163734487:main thread:             pData: 0x8084e00
7647.163736442:main thread:             Hdlr : 0x0
7647.163738398:main thread:             Owner: 0x0
7647.163740633:main thread:
7647.165187744:main thread:     Command 'actionexeconlyonceeveryinterval':
7647.165189699:main thread:             type : 6
7647.165593941:main thread:             pData: 0x8083c94
7647.165595896:main thread:             Hdlr : 0x0
7647.165597852:main thread:             Owner: 0x0
7647.165599807:main thread:
7647.165602042:main thread:     Command 'actionresumeinterval':
7647.165603998:main thread:             type : 6
7647.165605953:main thread:             pData: 0x0
7647.165607909:main thread:             Hdlr : 0x804ff40
7647.165609864:main thread:             Owner: 0x0
7647.165611820:main thread:
7647.165614055:main thread:     Command 'controlcharacterescapeprefix':
7647.165617966:main thread:             type : 8
7647.165619922:main thread:             pData: 0x8081338
7647.165621877:main thread:             Hdlr : 0x0
7647.165623833:main thread:             Owner: 0x0
7647.165625788:main thread:
7647.165628023:main thread:     Command 'escapecontrolcharactersonreceive':
7647.165629979:main thread:             type : 4
7647.165631934:main thread:             pData: 0x808133c
7647.165633890:main thread:             Hdlr : 0x0
7647.165635845:main thread:             Owner: 0x0
7647.165637801:main thread:
7647.165640036:main thread:     Command 'dropmsgswithmaliciousdnsptrrecords':
7647.165643947:main thread:             type : 4
7647.165645902:main thread:             pData: 0x8083c90
7647.165647858:main thread:             Hdlr : 0x0
7647.165649814:main thread:             Owner: 0x0
7647.165652049:main thread:
7647.168092024:main thread:     Command 'droptrailinglfonreception':
7647.168093979:main thread:             type : 4
7647.168095935:main thread:             pData: 0x8081340
7647.168097890:main thread:             Hdlr : 0x0
7647.168100125:main thread:             Owner: 0x0
7647.168104036:main thread:
7647.168105992:main thread:     Command 'template':
7647.168107947:main thread:             type : 1
7647.168109903:main thread:             pData: 0x0
7647.168112138:main thread:             Hdlr : 0x806d1c0
7647.168114093:main thread:             Owner: 0x0
7647.168116049:main thread:
7647.168118004:main thread:     Command 'outchannel':
7647.168119960:main thread:             type : 1
7647.168121916:main thread:             pData: 0x1
7647.168123871:main thread:             Hdlr : 0x806d1c0
7647.168126106:main thread:             Owner: 0x0
7647.168130017:main thread:
7647.168131973:main thread:     Command 'allowedsender':
7647.168133928:main thread:             type : 1
7647.168135884:main thread:             pData: 0x2
7647.168138119:main thread:             Hdlr : 0x806d1c0
7647.168140074:main thread:             Owner: 0x0
7647.168142030:main thread:
7647.168143986:main thread:     Command 'modload':
7647.168145941:main thread:             type : 1
7647.168147897:main thread:             pData: 0x0
7647.168150132:main thread:             Hdlr : 0x806d2a0
7647.168152087:main thread:             Owner: 0x0
7647.168155998:main thread:
7647.168157954:main thread:     Command 'includeconfig':
7647.168159909:main thread:             type : 1
7647.168162144:main thread:             pData: 0x0
7647.168164100:main thread:             Hdlr : 0x806d350
7647.168166055:main thread:             Owner: 0x0
7647.168168011:main thread:
7647.168169966:main thread:     Command 'umask':
7647.168171922:main thread:             type : 5
7647.168173877:main thread:             pData: 0x0
7647.168176112:main thread:             Hdlr : 0x804ff10
7647.168178068:main thread:             Owner: 0x0
7647.168180024:main thread:
7647.168183935:main thread:     Command 'debugprinttemplatelist':
7647.168185890:main thread:             type : 4
7647.168188125:main thread:             pData: 0x8081344
7647.168190081:main thread:             Hdlr : 0x0
7647.168192036:main thread:             Owner: 0x0
7647.168193992:main thread:
7647.174191961:main queue:Reg/w0: main queue:Reg/w0: worker IDLE, waiting for work.
7647.174200062:main thread:     Command 'debugprintmodulelist':
7647.174202018:main thread:             type : 4
7647.174203973:main thread:             pData: 0x8081348
7647.174205929:main thread:             Hdlr : 0x0
7647.174207885:main thread:             Owner: 0x0
7647.174209840:main thread:
7647.174212075:main thread:     Command 'debugprintcfsyslinehandlerlist':
7647.174214031:main thread:             type : 4
7647.174215986:main thread:             pData: 0x808134c
7647.174217942:main thread:             Hdlr : 0x0
7647.174219897:main thread:             Owner: 0x0
7647.175595212:main thread:
7647.175597167:main thread:     Command 'moddir':
7647.175599123:main thread:             type : 11
7647.175601078:main thread:             pData: 0x8084da0
7647.175603313:main thread:             Hdlr : 0x0
7647.175605269:main thread:             Owner: 0x0
7647.175607224:main thread:
7647.175609180:main thread:     Command 'actionqueuefilename':
7647.175611136:main thread:             type : 11
7647.175613091:main thread:             pData: 0x8084dd4
7647.175615326:main thread:             Hdlr : 0x0
7647.175619237:main thread:             Owner: 0x0
7647.175621193:main thread:
7647.175623148:main thread:     Command 'actionqueuesize':
7647.175625104:main thread:             type : 6
7647.175627339:main thread:             pData: 0x8082c60
7647.175629294:main thread:             Hdlr : 0x0
7647.175631250:main thread:             Owner: 0x0
7647.175633206:main thread:
7647.175635161:main thread:     Command 'actionqueuemaxdiskspace':
7647.175637117:main thread:             type : 7
7647.175639072:main thread:             pData: 0x8084dd8
7647.175641307:main thread:             Hdlr : 0x0
7647.175643263:main thread:             Owner: 0x0
7647.175647174:main thread:
7647.175649129:main thread:     Command 'actionqueuehighwatermark':
7647.175651085:main thread:             type : 6
7647.175653320:main thread:             pData: 0x8082c64
7647.175655275:main thread:             Hdlr : 0x0
7647.175657231:main thread:             Owner: 0x0
7647.175659186:main thread:
7647.175661142:main thread:     Command 'actionqueuelowwatermark':
7647.175663097:main thread:             type : 6
7647.175665332:main thread:             pData: 0x8082c68
7647.178391936:main thread:             Hdlr : 0x0
7647.178393892:main thread:             Owner: 0x0
7647.178396126:main thread:
7647.178398082:main thread:     Command 'actionqueuediscardmark':
7647.178400038:main thread:             type : 6
7647.178401993:main thread:             pData: 0x8082c6c
7647.178403949:main thread:             Hdlr : 0x0
7647.178405904:main thread:             Owner: 0x0
7647.178408139:main thread:
7647.178410095:main thread:     Command 'actionqueuediscardseverity':
7647.178412050:main thread:             type : 6
7647.178414006:main thread:             pData: 0x8082c70
7647.178417917:main thread:             Hdlr : 0x0
7647.178420152:main thread:             Owner: 0x0
7647.178422107:main thread:
7647.178424063:main thread:     Command 'actionqueuecheckpointinterval':
7647.178426018:main thread:             type : 6
7647.178427974:main thread:             pData: 0x8084de0
7647.178429930:main thread:             Hdlr : 0x0
7647.178432164:main thread:             Owner: 0x0
7647.178434120:main thread:
7647.178436076:main thread:     Command 'actionqueuetype':
7647.178438031:main thread:             type : 11
7647.178439987:main thread:             pData: 0x0
7647.178441942:main thread:             Hdlr : 0x8074b50
7647.178443898:main thread:             Owner: 0x0
7647.178446133:main thread:
7647.178448088:main thread:     Command 'actionqueueworkerthreads':
7647.178450044:main thread:             type : 6
7647.178452000:main thread:             pData: 0x8082c74
7647.178453955:main thread:             Hdlr : 0x0
7647.178455911:main thread:             Owner: 0x0
7647.178458146:main thread:
7647.178460101:main thread:     Command 'actionqueuetimeoutshutdown':
7647.178462057:main thread:             type : 6
7647.178464012:main thread:             pData: 0x8084de4
7647.178465968:main thread:             Hdlr : 0x0
7647.178467923:main thread:             Owner: 0x0
7647.178470158:main thread:
7647.178472114:main thread:     Command 'actionqueuetimeoutactioncompletion':
7647.178474069:main thread:             type : 6
7647.178476025:main thread:             pData: 0x8082c78
7647.178477980:main thread:             Hdlr : 0x0
7647.178479936:main thread:             Owner: 0x0
7647.178481891:main thread:
7647.178484126:main thread:     Command 'actionqueuetimeoutenqueue':
7647.179954704:main thread:             type : 6
7647.179956939:main thread:             pData: 0x8082c7c
7647.179958895:main thread:             Hdlr : 0x0
7647.179960850:main thread:             Owner: 0x0
7647.179962806:main thread:
7647.179964761:main thread:     Command 'actionqueueworkertimeoutthreadshutdown':
7647.179966717:main thread:             type : 6
7647.179968952:main thread:             pData: 0x8082c80
7647.179970907:main thread:             Hdlr : 0x0
7647.179972863:main thread:             Owner: 0x0
7647.179974819:main thread:
7647.179976774:main thread:     Command 'actionqueueworkerthreadminimummessages':
7647.179978730:main thread:             type : 6
7647.179982920:main thread:             pData: 0x8082c84
7647.179984876:main thread:             Hdlr : 0x0
7647.179986831:main thread:             Owner: 0x0
7647.179988787:main thread:
7647.179990743:main thread:     Command 'actionqueuemaxfilesize':
7647.179992698:main thread:             type : 7
7647.179994933:main thread:             pData: 0x8082c88
7647.179996889:main thread:             Hdlr : 0x0
7647.179998844:main thread:             Owner: 0x0
7647.180000800:main thread:
7647.180002755:main thread:     Command 'actionqueuesaveonshutdown':
7647.180004711:main thread:             type : 4
7647.180008901:main thread:             pData: 0x8082c90
7647.180010857:main thread:             Hdlr : 0x0
7647.180012812:main thread:             Owner: 0x0
7647.180014768:main thread:
7647.180016723:main thread:     Command 'actionqueuedequeueslowdown':
7647.180018958:main thread:             type : 6
7647.180020914:main thread:             pData: 0x8084de8
7647.180022869:main thread:             Hdlr : 0x0
7647.180024825:main thread:             Owner: 0x0
7647.180028736:main thread:
7647.180030971:main thread:     Command 'actionqueuedequeuetimebegin':
7647.180032927:main thread:             type : 6
7647.180034882:main thread:             pData: 0x8084dec
7647.180036838:main thread:             Hdlr : 0x0
7647.180038793:main thread:             Owner: 0x0
7647.180040749:main thread:
7647.180042704:main thread:     Command 'actionqueuedequeuetimeend':
7647.180044939:main thread:             type : 6
7647.180048850:main thread:             pData: 0x8082c94
7647.180050806:main thread:             Hdlr : 0x0
7647.180052762:main thread:             Owner: 0x0
7647.185069600:main thread:
7647.185071835:main thread:
7647.185073791:main thread: Messages with malicious PTR DNS Records are not dropped.
7647.185075746:main thread: Control characters are replaced upon reception.
7647.185077702:main thread: Control character escape sequence prefix is '#'.
7647.185079657:main thread: Main queue size 10000 messages.
7647.185083848:main thread: Main queue worker threads: 1, Perists every 0 updates.
7647.185085803:main thread: Main queue timeouts: shutdown: 0, action completion shutdown: 1000, enq: 2000
7647.185087759:main thread: Main queue watermarks: high: 8000, low: 2000, discard: 9800, discard-severity: 4
7647.185089715:main thread: Main queue save on shutdown 1, max disk space allowed 0
7647.185091670:main thread: Work Directory: '(null)'.
7647.186613651:main thread: logmsg: flags 5, from 'qa-freebsd', msg  [origin software="rsyslogd" swVersion="3.17.4" x-pid="17462" x-info="http://www.rsyslog.com"] restart
7647.186615607:main thread: Message has legacy syslog format.
7647.187085220:main thread:



Signal 11 (SIGSEGV) occured, execution must be terminated.



7647.187193054:main thread:
7647.187196966:main thread: Recorded Call Order for Thread 'main thread (28201100)':
7647.187198921:main thread: maximum number of nested calls for this thread: 0.
7647.187200877:main thread: NOTE: not all calls may have been recorded, code does not currently guarantee that!
7647.187202832:main thread:
7647.187205067:main thread: Recorded Call Order for Thread 'action 1 queue:Reg/w0 (28201200)':
7647.187207023:main thread: maximum number of nested calls for this thread: 0.
7647.187208978:main thread: NOTE: not all calls may have been recorded, code does not currently guarantee that!
7647.187210934:main thread:
7647.187212890:main thread: Recorded Call Order for Thread 'main queue:Reg/w0 (28201300)':
7647.187214845:main thread: maximum number of nested calls for this thread: 0.
7647.187217080:main thread: NOTE: not all calls may have been recorded, code does not currently guarantee that!
7647.189175709:main thread: Mutex log for all known mutex operations:
7647.189177664:main thread: If the call trace is empty, you may want to ./configure --enable-rtinst
7647.189179620:main thread:

To submit bug reports, visit http://www.rsyslog.com/bugs

7647.189602858:main thread:

To submit bug reports, visit http://www.rsyslog.com/bugs

Abort (core dumped)


Please let me know if I can provide further information.
-HKS

• Custom written rsyslog.conf?
• Maintenance Contract?
• Installation support?

Hi,

I tried to reproduce, but I can not Also, the debug log does not contain sufficient information. Would it be possible that you get me a gdb backtrace of a crashed instance? That would be most helpful. As an alternative, please add --enable-rtinst to the configure command. That provides at least a bit more information on the rsyslog crashdump itself.

Thanks,
Rainer

Here's the gdb backtrace. I'm not super-familiar with the tool, so let me know if you need further details, the full core file, etc.

Code: Select all

qa-freebsd# gdb /usr/local/sbin/rsyslogd rsyslogd.core
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-marcel-freebsd"...
Core was generated by `rsyslogd'.
Program terminated with signal 6, Aborted.
Reading symbols from /lib/libz.so.4...done.
Loaded symbols for /lib/libz.so.4
Reading symbols from /lib/libthr.so.3...done.
Loaded symbols for /lib/libthr.so.3
Reading symbols from /lib/libc.so.7...done.
Loaded symbols for /lib/libc.so.7
Reading symbols from /usr/local/lib/rsyslog/lmnet.so...done.
Loaded symbols for /usr/local/lib/rsyslog/lmnet.so
Reading symbols from /usr/local/lib/rsyslog/lmtcpclt.so...done.
Loaded symbols for /usr/local/lib/rsyslog/lmtcpclt.so
Reading symbols from /libexec/ld-elf.so.1...done.
Loaded symbols for /libexec/ld-elf.so.1
#0  0x2811e5cb in thr_kill () from /lib/libc.so.7
[New Thread 0x28201300 (LWP 100091)]
[New Thread 0x28201200 (LWP 100090)]
[New Thread 0x28201100 (LWP 100082)]
(gdb) bt
#0  0x2811e5cb in thr_kill () from /lib/libc.so.7
#1  0x280d2386 in pthread_kill () from /lib/libthr.so.3
#2  0x280d0123 in raise () from /lib/libthr.so.3
#3  0x281abb8a in abort () from /lib/libc.so.7
#4  0x080581ec in sigsegvHdlr (signum=6) at debug.c:741
#5  <signal handler called>
#6  0x280d156b in pthread_mutex_getprioceiling () from /lib/libthr.so.3
#7  0x0806a295 in MsgPrepareEnqueueLockingCase (pThis=0x0) at msg.c:167
#8  0x08050d25 in logmsg (pMsg=0x282244a0, flags=1) at syslogd.c:1629
#9  0x0805140f in logmsgInternal (pri=Variable "pri" is not available.
) at syslogd.c:915
#10 0x08051c57 in init () at syslogd.c:2370
#11 0x08053b16 in realMain (argc=5, argv=0xbfbfeccc) at syslogd.c:2808
#12 0x0805424f in main (argc=Cannot access memory at address 0x0
) at syslogd.c:3483
(gdb) quit
qa-freebsd#


Thanks for the help.
-HKS

hmmm... could you run configure with --enable-debug and --enable-rtinst and let me know the output of the run. I think it still aborts. The gdb backtrace did not point me as good as I hoped. We may need to look into the other threads, but the --enable-rtinst can probably aid in seeing what's going on.

Rainer

The -dn output with --enable-debug and --enable-rtinst:

Code: Select all


0403.071359216:28201100: Writing pidfile /var/run/rsyslogd.pid.
0403.073852829:28201100: rsyslog 3.17.4 - called init()
0403.073854785:28201100: Unloading non-static modules.
0403.073856740:28201100: module lmnet NOT unloaded because it still has a refcount of 3
0403.073858696:28201100: module lmtcpclt NOT unloaded because it still has a refcount of 1
0403.073860651:28201100: modules still loaded after module.UnloadAndDestructAll:
0403.073862607:28201100: printing users of loadable module lmnet, refcount 3, ptr 0x28216080, type 2
0403.073866797:28201100:        module lmnet is currently in use by file omfwd.c
0403.073868753:28201100:        module lmnet is currently in use by file syslogd.c
0403.073870708:28201100:        module lmnet is currently in use by file conf.c
0403.073872664:28201100: printing users of loadable module builtin-file, refcount 0, ptr 0x282160e0, type 1
0403.073874620:28201100: printing users of loadable module lmtcpclt, refcount 1, ptr 0x282161a0, type 2
0403.073876854:28201100:        module lmtcpclt is currently in use by file omfwd.c
0403.073878810:28201100: printing users of loadable module builtin-fwd, refcount 0, ptr 0x28216140, type 1
0403.073880766:28201100: printing users of loadable module builtin-shell, refcount 0, ptr 0x28216200, type 1
0403.073882721:28201100: printing users of loadable module builtin-discard, refcount 0, ptr 0x28216260, type 1
0403.073884677:28201100: printing users of loadable module builtin-usrmsg, refcount 0, ptr 0x282162c0, type 1
0403.073886632:28201100: Clearing templates.
0403.075387382:28201100: cfline: '$ActionQueueType LinkedList'
0403.075427331:28201100: action queue type set to LINKEDLIST
0403.075429287:28201100: cfline: '*.*                             /var/log/debug.log'
0403.075855598:28201100:  - traditional PRI filter
0403.075857553:28201100: symbolic name: * ==> 255
0403.076348677:28201100: tried selector action for builtin-file: 0
0403.076350633:28201100: Module builtin-file processed this config line.
0403.076352588:28201100: template: 'RSYSLOG_FileFormat' assigned

0403.076870810:28201100: action 1 queue: save on shutdown 1, max disk space allowed 0
0403.076930315:28201100: action 1 queue: is NOT disk-assisted
0403.076934226:28201100: action 1 queue: type 1, enq-only 0, disk assisted 0, maxFileSz 1048576, qsize 0, child 0 starting
0403.077326455:28201100: action 1 queue:Reg: finalizing construction of worker thread pool
0403.077328410:28201100: action 1 queue:Reg/w0: finalizing construction of worker instance data
0403.077330645:28201100: action 1 queue: queue starts up without (loading) any DA disk state (this is normal for the DA queue itself!)
0403.077416411:28201100: action 1 queue:Reg: high activity - starting 1 additional worker thread(s).
0403.077796627:28201100: action 1 queue:Reg/w0: receiving command 2
0403.078289706:28201100: action 1 queue:Reg: started with state 0, num workers now 1
0403.080407014:28201100: Action 0x282240b0: queue 0x28229260 created
0403.080884449:28201100: selector line successfully processed
0403.080948144:28201100: main queue: is NOT disk-assisted
0403.080952335:28201100: main queue: type 0, enq-only 0, disk assisted 0, maxFileSz 1048576, qsize 0, child 0 starting
0403.081337859:28201100: main queue:Reg: finalizing construction of worker thread pool
0403.081339814:28201100: main queue:Reg/w0: finalizing construction of worker instance data
0403.081341770:28201100: main queue: queue starts up without (loading) any DA disk state (this is normal for the DA queue itself!)
0403.081343725:28201100: main queue:Reg: high activity - starting 1 additional worker thread(s).
0403.081345681:28201100: main queue:Reg/w0: receiving command 2
0403.081896868:28201100: main queue:Reg: started with state 0, num workers now 1
0403.081947433:28201200: action 1 queue:Reg/w0: receiving command 4
0403.083365770:28201100: Main processing queue is initialized and running
0403.083398735:28201100:
Active selectors:
0403.083437008:28201100: Selector 1:
0403.083438964:28201100: FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF
Actions:
0403.084835510:28201100: builtin-file: /var/log/debug.log
        Instance data: 0x28229140
0403.084891104:28201100:        RepeatedMsgReduction: 0
0403.084893059:28201100:        Resume Interval: 30
0403.084895294:28201100:        Suspended: 0
0403.085335573:28201100:        Disabled: 0
0403.085337529:28201100:        Exec only when previous is suspended: 0
0403.085339484:28201100:
0403.085341719:28201100:
0403.085343675:28201100:
0403.085345630:28201100:
0403.085347586:28201100: Template: Name='RSYSLOG_SyslogProtocol23Format'
0403.085866367:28201100:        Entry(28205700): type 1, (CONSTANT), value: '<'
0403.085919726:28201100:        Entry(28205740): type 2, (FIELD), value: 'pri'
0403.085923637:28201100:        Entry(28205780): type 1, (CONSTANT), value: '>1 '
0403.086374812:28201100:        Entry(282057c0): type 2, (FIELD), value: 'timestamp' [Format as RFC3339-Date]
0403.086442139:28201100:        Entry(28205800): type 1, (CONSTANT), value: ' '
0403.086824031:28201100:        Entry(28205840): type 2, (FIELD), value: 'hostname'
0403.086877390:28201100:        Entry(28205880): type 1, (CONSTANT), value: ' '
0403.086931028:28201100:        Entry(282058c0): type 2, (FIELD), value: 'app-name'
0403.086934939:28201100:        Entry(28205900): type 1, (CONSTANT), value: ' '
0403.087374101:28201100:        Entry(28205940): type 2, (FIELD), value: 'procid'
0403.087428018:28201100:        Entry(28205980): type 1, (CONSTANT), value: ' '
0403.087809910:28201100:        Entry(282059c0): type 2, (FIELD), value: 'msgid'
0403.087863269:28201100:        Entry(28205a00): type 1, (CONSTANT), value: ' '
0403.087916348:28201100:        Entry(28205a40): type 2, (FIELD), value: 'structured-data'
0403.088290977:28201100:        Entry(28205a80): type 1, (CONSTANT), value: ' '
0403.088359422:28201100:        Entry(28205ac0): type 2, (FIELD), value: 'msg'
0403.088412780:28201100:        Entry(28205b00): type 1, (CONSTANT), value: '
'
0403.089289987:28201100: Template: Name='RSYSLOG_FileFormat'
0403.089345860:28201100:        Entry(28205b40): type 2, (FIELD), value: 'timestamp' [Format as RFC3339-Date]
0403.089412628:28201100:        Entry(28205b80): type 1, (CONSTANT), value: ' '
0403.089796196:28201100:        Entry(28205bc0): type 2, (FIELD), value: 'hostname'
0403.089849834:28201100:        Entry(28205c00): type 1, (CONSTANT), value: ' '
0403.089903193:28201100:        Entry(28205c40): type 2, (FIELD), value: 'syslogtag'
0403.090290393:28201100:        Entry(28205c80): type 2, (FIELD), value: 'msg' [drop last LF in msg]
0403.090359396:28201100:        Entry(28205cc0): type 1, (CONSTANT), value: '
'
0403.090424209:28201100: Template: Name='RSYSLOG_TraditionalFileFormat'
0403.090793809:28201100:        Entry(28205d00): type 2, (FIELD), value: 'timestamp'
0403.090847168:28201100:        Entry(28205d40): type 1, (CONSTANT), value: ' '
0403.090900527:28201100:        Entry(28205d80): type 2, (FIELD), value: 'hostname'
0403.091290241:28201100:        Entry(28205dc0): type 1, (CONSTANT), value: ' '
0403.091345555:28201100:        Entry(28205e00): type 2, (FIELD), value: 'syslogtag'
0403.091398914:28201100:        Entry(28205e40): type 2, (FIELD), value: 'msg' [drop last LF in msg]
0403.091795333:28201100:        Entry(28205e80): type 1, (CONSTANT), value: '
'
0403.091870203:28201100: Template: Name=' WallFmt'
0403.091909593:28201100:        Entry(28205ec0): type 1, (CONSTANT), value: '
Message from syslogd@'
0403.092331993:28201100:        Entry(28205f00): type 2, (FIELD), value: 'hostname'
0403.092385911:28201100:        Entry(28205f40): type 1, (CONSTANT), value: ' at '
0403.092438990:28201100:        Entry(28205f80): type 2, (FIELD), value: 'timegenerated'
0403.092826190:28201100:        Entry(28205fc0): type 1, (CONSTANT), value: ' ...
'
0403.092890724:28201100:        Entry(28222040): type 2, (FIELD), value: 'syslogtag'
0403.092944082:28201100:        Entry(28222080): type 2, (FIELD), value: 'msg'
0403.093332120:28201100:        Entry(282220c0): type 1, (CONSTANT), value: '
'
0403.093884146:28201100: Template: Name='RSYSLOG_ForwardFormat'
0403.093925492:28201100:        Entry(28222100): type 1, (CONSTANT), value: '<'
0403.094288946:28201100:        Entry(28222140): type 2, (FIELD), value: 'pri'
0403.094344540:28201100:        Entry(28222180): type 1, (CONSTANT), value: '>'
0403.094398178:28201100:        Entry(282221c0): type 2, (FIELD), value: 'timestamp' [Format as RFC3339-Date]
0403.094817226:28201100:        Entry(28222200): type 1, (CONSTANT), value: ' '
0403.094870863:28201100:        Entry(28222240): type 2, (FIELD), value: 'hostname'
0403.094924222:28201100:        Entry(28222280): type 1, (CONSTANT), value: ' '
0403.095329302:28201100:        Entry(282222c0): type 2, (FIELD), value: 'syslogtag' [substring, from character 1 to 32]
0403.095396908:28201100:        Entry(28222300): type 2, (FIELD), value: 'msg'
0403.095781035:28201100: Template: Name='RSYSLOG_TraditionalForwardFormat'
0403.095821264:28201100:        Entry(28222340): type 1, (CONSTANT), value: '<'
0403.095874622:28201100:        Entry(28222380): type 2, (FIELD), value: 'pri'
0403.095927981:28201100:        Entry(282223c0): type 1, (CONSTANT), value: '>'
0403.096340883:28201100:        Entry(28222400): type 2, (FIELD), value: 'timestamp'
0403.096394521:28201100:        Entry(28222440): type 1, (CONSTANT), value: ' '
0403.096447880:28201100:        Entry(28222480): type 2, (FIELD), value: 'hostname'
0403.096830889:28201100:        Entry(282224c0): type 1, (CONSTANT), value: ' '
0403.096884248:28201100:        Entry(28222500): type 2, (FIELD), value: 'syslogtag' [substring, from character 1 to 32]
0403.097287651:28201100:        Entry(28222540): type 2, (FIELD), value: 'msg'
0403.097343245:28201100: Template: Name=' StdUsrMsgFmt'
0403.097382635:28201100:        Entry(28222580): type 1, (CONSTANT), value: ' '
0403.097780731:28201100:        Entry(282225c0): type 2, (FIELD), value: 'syslogtag'
0403.097834927:28201100:        Entry(28222600): type 2, (FIELD), value: 'msg'
0403.097888007:28201100:        Entry(28222640): type 1, (CONSTANT), value: '
'
0403.098289455:28201100: Template: Name=' StdDBFmt' [SQL-Format (MySQL)]
0403.099401328:28201100:        Entry(28222680): type 1, (CONSTANT), value: 'insert into SystemEvents (Message, Facility, FromHost, Priority, DeviceReportedTime, ReceivedAt, InfoUnitID, SysLogTag) values (''
0403.099458877:28201100:        Entry(282226c0): type 2, (FIELD), value: 'msg'
0403.099829874:28201100:        Entry(28222700): type 1, (CONSTANT), value: '', '
0403.099883232:28201100:        Entry(28222740): type 2, (FIELD), value: 'syslogfacility'
0403.099936312:28201100:        Entry(28222780): type 1, (CONSTANT), value: ', ''
0403.099940502:28201100:        Entry(282227c0): type 2, (FIELD), value: 'hostname'
0403.100404528:28201100:        Entry(28222800): type 1, (CONSTANT), value: '', '
0403.100784464:28201100:        Entry(28222840): type 2, (FIELD), value: 'syslogpriority'
0403.100837823:28201100:        Entry(28222880): type 1, (CONSTANT), value: ', ''
0403.100890903:28201100:        Entry(282228c0): type 2, (FIELD), value: 'timereported' [Format as MySQL-Date]
0403.101291233:28201100:        Entry(28222900): type 1, (CONSTANT), value: '', ''
0403.101383703:28201100:        Entry(28222940): type 2, (FIELD), value: 'timegenerated' [Format as MySQL-Date]
0403.101450750:28201100:        Entry(28222980): type 1, (CONSTANT), value: '', '
0403.101833201:28201100:        Entry(282229c0): type 2, (FIELD), value: 'iut'
0403.101886280:28201100:        Entry(28222a00): type 1, (CONSTANT), value: ', ''
0403.101939360:28201100:        Entry(28222a40): type 2, (FIELD), value: 'syslogtag'
0403.102329633:28201100:        Entry(28222a80): type 1, (CONSTANT), value: '')'
0403.102382991:28201100: Template: Name=' StdPgSQLFmt' [SQL-Format (standard SQL)]
0403.102435233:28201100:        Entry(28222ac0): type 1, (CONSTANT), value: 'insert into SystemEvents (Message, Facility, FromHost, Priority, DeviceReportedTime, ReceivedAt, InfoUnitID, SysLogTag) values (''
0403.102821315:28201100:        Entry(28222b00): type 2, (FIELD), value: 'msg'
0403.102874674:28201100:        Entry(28222b40): type 1, (CONSTANT), value: '', '
0403.102927753:28201100:        Entry(28222b80): type 2, (FIELD), value: 'syslogfacility'
0403.103332553:28201100:        Entry(28222bc0): type 1, (CONSTANT), value: ', ''
0403.104386039:28201100:        Entry(28222c00): type 2, (FIELD), value: 'hostname'
0403.104440516:28201100:        Entry(28222c40): type 1, (CONSTANT), value: '', '
0403.104825201:28201100:        Entry(28222c80): type 2, (FIELD), value: 'syslogpriority'
0403.104878281:28201100:        Entry(28222cc0): type 1, (CONSTANT), value: ', ''
0403.104931360:28201100:        Entry(28222d00): type 2, (FIELD), value: 'timereported' [Format as PgSQL-Date]
0403.105346776:28201100:        Entry(28222d40): type 1, (CONSTANT), value: '', ''
0403.105400135:28201100:        Entry(28222d80): type 2, (FIELD), value: 'timegenerated' [Format as PgSQL-Date]
0403.106086255:28201100:        Entry(28222dc0): type 1, (CONSTANT), value: '', '
0403.106142687:28201100:        Entry(28222e00): type 2, (FIELD), value: 'iut'
0403.106196605:28201100:        Entry(28222e40): type 1, (CONSTANT), value: ', ''
0403.106249684:28201100:        Entry(28222e80): type 2, (FIELD), value: 'syslogtag'
0403.106253874:28201100:        Entry(28222ec0): type 1, (CONSTANT), value: '')'
0403.106633532:28201100: Loaded Module: Name='lmnet', IFVersion=4, type=library module.
0403.106818751:28201100: Entry points:
0403.106820706:28201100:        queryEtryPt:        0x281ee6b0
0403.106822662:28201100:        doAction:           0x0
0403.106824618:28201100:        parseSelectorAct:   0x0
0403.106826573:28201100:        dbgPrintInstInfo:   0x0
0403.106828808:28201100:        freeInstance:       0x0
0403.106832719:28201100:
0403.106834675:28201100: Loaded Module: Name='builtin-file', IFVersion=4, type=output module.
0403.107399551:28201100: Entry points:
0403.107401506:28201100:        queryEtryPt:        0x8081fd0
0403.107403462:28201100:        doAction:           0x8083280
0403.107405418:28201100:        parseSelectorAct:   0x8082780
0403.107407373:28201100:        dbgPrintInstInfo:   0x8083020
0403.107409608:28201100:        freeInstance:       0x8082630
0403.107411564:28201100:
0403.107413519:28201100: Loaded Module: Name='lmtcpclt', IFVersion=4, type=library module.
0403.108334865:28201100: Entry points:
0403.108336821:28201100:        queryEtryPt:        0x281f3290
0403.109469926:28201100:        doAction:           0x0
0403.109471881:28201100:        parseSelectorAct:   0x0
0403.109473837:28201100:        dbgPrintInstInfo:   0x0
0403.109475792:28201100:        freeInstance:       0x0
0403.109478027:28201100:
0403.109479983:28201100: Loaded Module: Name='builtin-fwd', IFVersion=4, type=output module.
0403.109947361:28201100: Entry points:
0403.109951551:28201100:        queryEtryPt:        0x8080840
0403.109953507:28201100:        doAction:           0x8080fc0
0403.109955462:28201100:        parseSelectorAct:   0x8081400
0403.109957418:28201100:        dbgPrintInstInfo:   0x8080f50
0403.109959373:28201100:        freeInstance:       0x8080e70
0403.109961329:28201100:
0403.109963564:28201100: Loaded Module: Name='builtin-shell', IFVersion=4, type=output module.
0403.110875412:28201100: Entry points:
0403.110877367:28201100:        queryEtryPt:        0x807f1e0
0403.110879323:28201100:        doAction:           0x807f6d0
0403.110883513:28201100:        parseSelectorAct:   0x807f410
0403.110885469:28201100:        dbgPrintInstInfo:   0x807f660
0403.110887424:28201100:        freeInstance:       0x807f3a0
0403.110889380:28201100:
0403.110891335:28201100: Loaded Module: Name='builtin-discard', IFVersion=4, type=output module.
0403.111793685:28201100: Entry points:
0403.111795640:28201100:        queryEtryPt:        0x8083bc0
0403.111797875:28201100:        doAction:           0x8083d80
0403.111799831:28201100:        parseSelectorAct:   0x8083e50
0403.111801786:28201100:        dbgPrintInstInfo:   0x8083b70
0403.111803742:28201100:        freeInstance:       0x8083de0
0403.111807653:28201100:
0403.111809888:28201100: Loaded Module: Name='builtin-usrmsg', IFVersion=4, type=output module.
0403.112396555:28201100: Entry points:
0403.112398790:28201100:        queryEtryPt:        0x807fa20
0403.112400745:28201100:        doAction:           0x8080410
0403.112402701:28201100:        parseSelectorAct:   0x807fce0
0403.112404656:28201100:        dbgPrintInstInfo:   0x807fbe0
0403.112406612:28201100:        freeInstance:       0x807fc70
0403.112408567:28201100:
0403.113890320:28201100: Sytem Line Configuration Commands:
0403.113892276:28201100:        Command 'dynafilecachesize':
0403.113894231:28201100:                type : 6
0403.113898142:28201100:                pData: 0x0
0403.113900377:28201100:                Hdlr : 0x8082190
0403.113902333:28201100:                Owner: 0x8082420
0403.113904288:28201100:
0403.113906244:28201100:        Command 'dirowner':
0403.113908199:28201100:                type : 2
0403.113910155:28201100:                pData: 0x809c588
0403.113912390:28201100:                Hdlr : 0x0
0403.113914345:28201100:                Owner: 0x8082420
0403.113916301:28201100:
0403.113918256:28201100:        Command 'dirgroup':
0403.113920212:28201100:                type : 3
0403.113922168:28201100:                pData: 0x809c58c
0403.115312009:28201100:                Hdlr : 0x0
0403.115313965:28201100:                Owner: 0x8082420
0403.115315920:28201100:
0403.115317876:28201100:        Command 'fileowner':
0403.115795311:28201100:                type : 2
0403.115797266:28201100:                pData: 0x809c580
0403.115799501:28201100:                Hdlr : 0x0
0403.115801457:28201100:                Owner: 0x8082420
0403.115803412:28201100:
0403.115805368:28201100:        Command 'filegroup':
0403.115809279:28201100:                type : 3
0403.115811235:28201100:                pData: 0x809c584
0403.115813469:28201100:                Hdlr : 0x0
0403.115815425:28201100:                Owner: 0x8082420
0403.115817381:28201100:
0403.115819336:28201100:        Command 'dircreatemode':
0403.115821292:28201100:                type : 5
0403.115823247:28201100:                pData: 0x8099bd0
0403.115825482:28201100:                Hdlr : 0x0
0403.115827438:28201100:                Owner: 0x8082420
0403.115829393:28201100:
0403.115831349:28201100:        Command 'filecreatemode':
0403.115835260:28201100:                type : 5
0403.115837495:28201100:                pData: 0x8099bd4
0403.115839450:28201100:                Hdlr : 0x0
0403.115841406:28201100:                Owner: 0x8082420
0403.115843361:28201100:
0403.115845317:28201100:        Command 'createdirs':
0403.115847273:28201100:                type : 4
0403.115849228:28201100:                pData: 0x809c590
0403.115851463:28201100:                Hdlr : 0x0
0403.115853419:28201100:                Owner: 0x8082420
0403.115857330:28201100:
0403.115859285:28201100:        Command 'failonchownfailure':
0403.119809229:28201100:                type : 4
0403.119811184:28201100:                pData: 0x809c57c
0403.119813140:28201100:                Hdlr : 0x0
0403.119815095:28201100:                Owner: 0x8082420
0403.119817051:28201100:
0403.119821241:28201100:        Command 'actionfileenablesync':
0403.119823197:28201100:                type : 4
0403.119825152:28201100:                pData: 0x809c534
0403.119827108:28201100:                Hdlr : 0x0
0403.119829064:28201100:                Owner: 0x8082420
0403.119831019:28201100:
0403.119833254:28201100:        Command 'actionfiledefaulttemplate':
0403.119835210:28201100:                type : 11
0403.119837165:28201100:                pData: 0x809c538
0403.119839121:28201100:                Hdlr : 0x0
0403.119841076:28201100:                Owner: 0x0
0403.119844987:28201100:
0403.119847222:28201100:        Command 'resetconfigvariables':
0403.119849178:28201100:                type : 1
0403.119851133:28201100:                pData: 0x0
0403.119853089:28201100:                Hdlr : 0x8082480
0403.119855045:28201100:                Owner: 0x8082420
0403.119857000:28201100:
0403.119859235:28201100:                type : 1
0403.119861191:28201100:                pData: 0x0
0403.119863146:28201100:                Hdlr : 0x8080d60
0403.119867057:28201100:                Owner: 0x8080d90
0403.119869013:28201100:
0403.119871248:28201100:                type : 1
0403.119873203:28201100:                pData: 0x0
0403.119875159:28201100:                Hdlr : 0x804faa0
0403.119877114:28201100:                Owner: 0x0
0403.119879070:28201100:
0403.119881025:28201100:        Command 'actionforwarddefaulttemplate':
0403.119882981:28201100:                type : 11
0403.119885216:28201100:                pData: 0x809c4f0
0403.119889127:28201100:                Hdlr : 0x0
0403.119891083:28201100:                Owner: 0x0
0403.119893038:28201100:
0403.119894994:28201100:        Command 'workdirectory':
0403.119897229:28201100:                type : 11
0403.119899184:28201100:                pData: 0x809ae28
0403.119901140:28201100:                Hdlr : 0x0
0403.119903095:28201100:                Owner: 0x0
0403.119905051:28201100:
0403.119907006:28201100:        Command 'actionresumeretrycount':
0403.119909241:28201100:                type : 6
0403.119913152:28201100:                pData: 0x809c6d0
0403.119915108:28201100:                Hdlr : 0x0
0403.119917063:28201100:                Owner: 0x0
0403.119919019:28201100:
0403.125829826:28201100:        Command 'mainmsgqueuefilename':
0403.125831782:28201100:                type : 11
0403.125834017:28201100:                pData: 0x809ae60
0403.125835972:28201100:                Hdlr : 0x0
0403.125837928:28201100:                Owner: 0x0
0403.125841839:28201100:
0403.125843795:28201100:        Command 'mainmsgqueuesize':
0403.125846029:28201100:                type : 6
0403.125847985:28201100:                pData: 0x8098480
0403.125849941:28201100:                Hdlr : 0x0
0403.125851896:28201100:                Owner: 0x0
0403.125853852:28201100:
0403.125855807:28201100:        Command 'mainmsgqueuehighwatermark':
0403.125858042:28201100:                type : 6
0403.125859998:28201100:                pData: 0x8098484
0403.125861953:28201100:                Hdlr : 0x0
0403.125863909:28201100:                Owner: 0x0
0403.125867820:28201100:
0403.125869775:28201100:        Command 'mainmsgqueuelowwatermark':
0403.125872010:28201100:                type : 6
0403.125873966:28201100:                pData: 0x8098488
0403.125875921:28201100:                Hdlr : 0x0
0403.125877877:28201100:                Owner: 0x0
0403.125879833:28201100:
0403.125881788:28201100:        Command 'mainmsgqueuediscardmark':
0403.125884023:28201100:                type : 6
0403.125885979:28201100:                pData: 0x809848c
0403.125887934:28201100:                Hdlr : 0x0
0403.125889890:28201100:                Owner: 0x0
0403.125893801:28201100:
0403.125896036:28201100:        Command 'mainmsgqueuediscardseverity':
0403.125897991:28201100:                type : 10
0403.125899947:28201100:                pData: 0x8098490
0403.125901903:28201100:                Hdlr : 0x0
0403.125903858:28201100:                Owner: 0x0
0403.125905814:28201100:
0403.125907769:28201100:        Command 'mainmsgqueuecheckpointinterval':
0403.125910004:28201100:                type : 6
0403.125911960:28201100:                pData: 0x809ae64
0403.125913915:28201100:                Hdlr : 0x0
0403.125915871:28201100:                Owner: 0x0
0403.125917826:28201100:
0403.125922017:28201100:        Command 'mainmsgqueuetype':
0403.125923972:28201100:                type : 11
0403.125925928:28201100:                pData: 0x0
0403.125927883:28201100:                Hdlr : 0x8050170
0403.125929839:28201100:                Owner: 0x0
0403.125931794:28201100:
0403.125934029:28201100:        Command 'mainmsgqueueworkerthreads':
0403.088450774:action 1 queue:Reg/w0: action 1 queue: entering rate limiter
0403.133393078:28201300: main queue:Reg/w0: receiving command 4
0403.133458449:28201100:                type : 6
0403.133460684:28201100:                pData: 0x8098494
0403.133462640:28201100:                Hdlr : 0x0
0403.133464596:28201100:                Owner: 0x0
0403.133466551:28201100:
0403.133468507:28201100:        Command 'mainmsgqueuetimeoutshutdown':
0403.133470462:28201100:                type : 6
0403.133474653:28201100:                pData: 0x809ae68
0403.133476608:28201100:                Hdlr : 0x0
0403.133478564:28201100:                Owner: 0x0
0403.133480519:28201100:
0403.133482475:28201100:        Command 'mainmsgqueuetimeoutactioncompletion':
0403.133484430:28201100:                type : 6
0403.133486665:28201100:                pData: 0x8098498
0403.133488621:28201100:                Hdlr : 0x0
0403.133490576:28201100:                Owner: 0x0
0403.133492532:28201100:
0403.133494487:28201100:        Command 'mainmsgqueuetimeoutenqueue':
0403.133496443:28201100:                type : 6
0403.133498678:28201100:                pData: 0x809849c
0403.135313434:28201100:                Hdlr : 0x0
0403.135315669:28201100:                Owner: 0x0
0403.135317624:28201100:
0403.135319580:28201100:        Command 'mainmsgqueueworketimeoutrthreadshutdown':
0403.135321535:28201100:                type : 6
0403.135323491:28201100:                pData: 0x80984a0
0403.135325446:28201100:                Hdlr : 0x0
0403.135327402:28201100:                Owner: 0x0
0403.135329637:28201100:
0403.135331592:28201100:        Command 'mainmsgqueuedequeueslowdown':
0403.135333548:28201100:                type : 6
0403.136445142:28201100:                pData: 0x809ae6c
0403.136447097:28201100:                Hdlr : 0x0
0403.136449053:28201100:                Owner: 0x0
0403.136451008:28201100:
0403.136453243:28201100:        Command 'mainmsgqueueworkerthreadminimummessages':
0403.136455199:28201100:                type : 6
0403.136457154:28201100:                pData: 0x80984a4
0403.136459110:28201100:                Hdlr : 0x0
0403.136461066:28201100:                Owner: 0x0
0403.136463021:28201100:
0403.136465256:28201100:        Command 'mainmsgqueuemaxfilesize':
0403.136467212:28201100:                type : 7
0403.136469167:28201100:                pData: 0x80984a8
0403.136471123:28201100:                Hdlr : 0x0
0403.136473078:28201100:                Owner: 0x0
0403.136475034:28201100:
0403.136476990:28201100:        Command 'mainmsgqueuemaxdiskspace':
0403.136561358:28201100:                type : 7
0403.136563313:28201100:                pData: 0x809ae70
0403.136565269:28201100:                Hdlr : 0x0
0403.136567224:28201100:                Owner: 0x0
0403.136569180:28201100:
0403.136571415:28201100:        Command 'mainmsgqueuesaveonshutdown':
0403.136573371:28201100:                type : 4
0403.136575326:28201100:                pData: 0x80984b0
0403.136577282:28201100:                Hdlr : 0x0
0403.136579237:28201100:                Owner: 0x0
0403.136581193:28201100:
0403.136585383:28201100:        Command 'mainmsgqueuedequeuetimebegin':
0403.136587339:28201100:                type : 6
0403.136589294:28201100:                pData: 0x809ae78
0403.136591250:28201100:                Hdlr : 0x0
0403.136593205:28201100:                Owner: 0x0
0403.136595440:28201100:
0403.136597396:28201100:        Command 'mainmsgqueuedequeuetimeend':
0403.136599351:28201100:                type : 6
0403.136601307:28201100:                pData: 0x80984b4
0403.136603262:28201100:                Hdlr : 0x0
0403.136605218:28201100:                Owner: 0x0
0403.136607174:28201100:
0403.136611364:28201100:        Command 'repeatedmsgreduction':
0403.136613320:28201100:                type : 4
0403.136615275:28201100:                pData: 0x809c738
0403.136617231:28201100:                Hdlr : 0x0
0403.136619186:28201100:                Owner: 0x0
0403.136621421:28201100:
0403.136623377:28201100:        Command 'actionexeconlywhenpreviousissuspended':
0403.136625332:28201100:                type : 4
0403.136627288:28201100:                pData: 0x809c73c
0403.136629244:28201100:                Hdlr : 0x0
0403.136631199:28201100:                Owner: 0x0
0403.136633434:28201100:
0403.136635390:28201100:        Command 'actionexeconlyonceeveryinterval':
0403.136639301:28201100:                type : 6
0403.136641256:28201100:                pData: 0x809ae24
0403.136643212:28201100:                Hdlr : 0x0
0403.136645447:28201100:                Owner: 0x0
0403.136647402:28201100:
0403.136649358:28201100:        Command 'actionresumeinterval':
0403.136651313:28201100:                type : 6
0403.136653269:28201100:                pData: 0x0
0403.136655224:28201100:                Hdlr : 0x8050160
0403.136657180:28201100:                Owner: 0x0
0403.136659415:28201100:
0403.136661370:28201100:        Command 'controlcharacterescapeprefix':
0403.140315466:main queue:Reg/w0: main queue: entering rate limiter
0403.143407759:action 1 queue:Reg/w0: action 1 queue:Reg/w0: worker IDLE, waiting for work.
0403.143789651:28201100:                type : 8
0403.143791606:28201100:                pData: 0x80984b8
0403.143793841:28201100:                Hdlr : 0x0
0403.143795797:28201100:                Owner: 0x0
0403.143797752:28201100:
0403.143801664:28201100:        Command 'escapecontrolcharactersonreceive':
0403.143803619:28201100:                type : 4
0403.143805854:28201100:                pData: 0x80984bc
0403.143807810:28201100:                Hdlr : 0x0
0403.143809765:28201100:                Owner: 0x0
0403.143811721:28201100:
0403.143813676:28201100:        Command 'dropmsgswithmaliciousdnsptrrecords':
0403.143815632:28201100:                type : 4
0403.143817867:28201100:                pData: 0x809ae20
0403.143819822:28201100:                Hdlr : 0x0
0403.143821778:28201100:                Owner: 0x0
0403.143823733:28201100:
0403.145318895:28201100:        Command 'droptrailinglfonreception':
0403.145320851:28201100:                type : 4
0403.145322806:28201100:                pData: 0x80984c0
0403.145324762:28201100:                Hdlr : 0x0
0403.145326717:28201100:                Owner: 0x0
0403.145328673:28201100:
0403.145330908:28201100:        Command 'template':
0403.145332864:28201100:                type : 1
0403.145334819:28201100:                pData: 0x0
0403.145336775:28201100:                Hdlr : 0x807e8c0
0403.145338730:28201100:                Owner: 0x0
0403.145342921:28201100:
0403.145344876:28201100:        Command 'outchannel':
0403.145346832:28201100:                type : 1
0403.145348788:28201100:                pData: 0x1
0403.145350743:28201100:                Hdlr : 0x807e8c0
0403.145352699:28201100:                Owner: 0x0
0403.145354654:28201100:
0403.145356889:28201100:        Command 'allowedsender':
0403.145358845:28201100:                type : 1
0403.145360800:28201100:                pData: 0x2
0403.145362756:28201100:                Hdlr : 0x807e8c0
0403.145364711:28201100:                Owner: 0x0
0403.145366667:28201100:
0403.145370857:28201100:        Command 'modload':
0403.145372813:28201100:                type : 1
0403.145374768:28201100:                pData: 0x0
0403.145376724:28201100:                Hdlr : 0x807ea50
0403.145378679:28201100:                Owner: 0x0
0403.145380914:28201100:
0403.145382870:28201100:        Command 'includeconfig':
0403.145384825:28201100:                type : 1
0403.147907213:28201100:                pData: 0x0
0403.147909169:28201100:                Hdlr : 0x807eba0
0403.147913080:28201100:                Owner: 0x0
0403.147915035:28201100:
0403.147916991:28201100:        Command 'umask':
0403.147919226:28201100:                type : 5
0403.147921181:28201100:                pData: 0x0
0403.147923137:28201100:                Hdlr : 0x8050130
0403.147925093:28201100:                Owner: 0x0
0403.147927048:28201100:
0403.147929004:28201100:        Command 'debugprinttemplatelist':
0403.147931239:28201100:                type : 4
0403.147933194:28201100:                pData: 0x80984c4
0403.147935150:28201100:                Hdlr : 0x0
0403.147937105:28201100:                Owner: 0x0
0403.147941016:28201100:
0403.147943251:28201100:        Command 'debugprintmodulelist':
0403.147945207:28201100:                type : 4
0403.147947162:28201100:                pData: 0x80984c8
0403.147949118:28201100:                Hdlr : 0x0
0403.147951073:28201100:                Owner: 0