mongodb backend to rsyslogd

This is the place for developers to discuss bugs, new features and everything else about code changes.

Google Ads


mongodb backend to rsyslogd

Postby vpereira » Wed Jan 05, 2011 3:54 pm

Hi,

i did develop a plugin to use mongodb as backend.

https://github.com/vpereira/rsyslogd-mongo

i did commit the whole source code from rsyslog, plus the plugin, in the plugin folder.
to use it, you should read the README
to compile it you must just say:
./configure --enable-ommongodb=yes.

I'm not often a C developer, so i'm sorry if i didn't use all best patterns, so if you are a C wizard, it will be easier to improve it ;-)

note that to have a good performance using mongodb as backend, its better when we create first the collection as capped and that we don't use any index.

any question, feedbacks and etc, feel free to shoot ;-)

regards,

VP
vpereira
New
 
Posts: 5
Joined: Wed Jan 05, 2011 2:44 pm

Urgent Question?

  • Pulling out your Hair?
  • Wasting Time and Money?
  • Deadline Approaching?

Re: mongodb backend to rsyslogd

Postby rgerhards » Mon Jan 31, 2011 5:15 pm

Hi I initially overlooked this posting as I was on vacation ;) This is very good news. I'll see that I can integrate the module ASAP.
rgerhards
Site Admin
 
Posts: 3806
Joined: Thu Feb 13, 2003 11:57 am

Re: mongodb backend to rsyslogd

Postby rgerhards » Mon Jan 31, 2011 5:30 pm

I have merged the code as good as I could, but I do not have any experience with mongodb and have not yet installed it. If you like, you can check rsyslog's git master branch and see if the patch made it good enough. While I cannot yet concentrate on some refactoring, I think the availability of ommongodb is definitely useful. And others will probably also step in and help expand it :)

Thanks!
Rainer
rgerhards
Site Admin
 
Posts: 3806
Joined: Thu Feb 13, 2003 11:57 am

Re: mongodb backend to rsyslogd

Postby zerocool » Fri May 27, 2011 6:46 pm

I am running ubuntu 10.10 and I am having trouble running with the module enabled: both in the current beta ( 6.1.8 ) and the vpereira introduction of it. When I run:
Code: Select all
 rsyslogd -f /etc/rsyslog.conf -N1 -c5

I get:
Code: Select all
rsyslogd: could not load module '/usr/local/lib/rsyslog/ommongodb.so', dlopen: usr/local/lib/rsyslog/ommongodb.so: undefined symbol: bson_check_field_name

What am I doing wrong?
zerocool
New
 
Posts: 1
Joined: Fri May 27, 2011 6:41 pm

Re: mongodb backend to rsyslogd

Postby rgerhards » Mon May 30, 2011 8:28 am

It's an experimental contributed module. Maybe it is a good idea to check with the original contributor, I am not sure if he or she follows this forum.

Sorry I have no better answer.
Rainer
rgerhards
Site Admin
 
Posts: 3806
Joined: Thu Feb 13, 2003 11:57 am

Re: mongodb backend to rsyslogd

Postby vpereira » Tue Mar 27, 2012 1:12 pm

rgerhards wrote:It's an experimental contributed module. Maybe it is a good idea to check with the original contributor, I am not sure if he or she follows this forum.

Sorry I have no better answer.
Rainer


Hi, i'm here, dead with so many things in my day job.

I checked it now http://api.mongodb.org/c/0.4/api/encodi ... ource.html and it still available. Maybe you are not linking against the mongodb C lib?
vpereira
New
 
Posts: 5
Joined: Wed Jan 05, 2011 2:44 pm

Re: mongodb backend to rsyslogd

Postby rgerhards » Tue Mar 27, 2012 1:13 pm

I have good news: I have seriously refactored the module in the mean time and used a much nice client library. I am still developing, but it builds again and is set to become even more capable :-)
rgerhards
Site Admin
 
Posts: 3806
Joined: Thu Feb 13, 2003 11:57 am

Re: mongodb backend to rsyslogd

Postby vpereira » Tue Mar 27, 2012 1:18 pm

rgerhards wrote:I have good news: I have seriously refactored the module in the mean time and used a much nice client library. I am still developing, but it builds again and is set to become even more capable :-)



That's awesome. Which lib you did use?

viele grüße aus Leipzig :-)
vpereira
New
 
Posts: 5
Joined: Wed Jan 05, 2011 2:44 pm

Re: mongodb backend to rsyslogd

Postby rgerhards » Tue Mar 27, 2012 1:25 pm

This one:

https://github.com/algernon/libmongo-client

looks like a *Very* decent piece of code, done by a very respectable developer. Also, see this conversation that lead to its use:

https://plus.google.com/u/0/11240218590 ... hNpkeZwVBi

Rainer
rgerhards
Site Admin
 
Posts: 3806
Joined: Thu Feb 13, 2003 11:57 am

Re: mongodb backend to rsyslogd

Postby vpereira » Tue Mar 27, 2012 2:36 pm

hm looks really good. I cry daily when I have to use the "official" drive
vpereira
New
 
Posts: 5
Joined: Wed Jan 05, 2011 2:44 pm

Google Ads



Return to Developer's Corner

Who is online

Users browsing this forum: No registered users and 0 guests

cron