Bazsi's blog

syslog-ng git repo moved to github

Monday, January 16, 2012 @ 08:01 PM Author: Balázs Scheidler
I've been playing with github the last couple of months for git hosting, and since I like what I see and users seem to have found this out on their own, I figured this should be official. The git repository is being moved from their old git.balabit.hu location to: syslog-ng 3.3 http://github.com/bazsi/syslog-ng-3.3.git syslog-ng 3.4 http://github.com/bazsi/syslog-ng-3.4.git Older releases (like 3.2) ...

syslog-ng flexibility improvements

Sunday, January 15, 2012 @ 06:01 PM Author: Balázs Scheidler
syslog-ng is often referred as a very flexible application when it comes to processing logs. Over the years however, I began to feel that some things are a bit more difficult to achieve in the configuration language than it should be. For instance it is sometimes too rigid when you need a combination of parsers ...

syslog-ng and the journal

Tuesday, December 6, 2011 @ 12:12 PM Author: Balázs Scheidler
There's an ongoing project to create a new logging subsystem for Linux, called the journal, by Lennart Poettering of PulseAudio & systemd fame. It is implemented as a core component of systemd, thus has a good chance to be integrated to all distributions that carry systemd: Fedora, openSUSE, and probably others. The vision and design is ...

syslog-ng Open Source Edition 3.3.1 released

Friday, October 7, 2011 @ 10:10 PM Author: Balázs Scheidler
I'm proud to announce that syslog-ng 3.3.1 has been released. It is an important release in a number of ways:
  • syslog-ng architecture was completely revamped to scale properly in today's multi-core environments. I've seen it process 800000 messages / second in some scenarios.
  • following the licensing change in 3.2, it incorporates contributions (code, testing & feedback) from 54 individuals.
In total, the ...

syslog-ng multithreaded performance

Saturday, July 30, 2011 @ 08:07 PM Author: Balázs Scheidler
It seems that the BalaBit syslog-ng team that produces the Premium Edition of syslog-ng has beaten the community project this time, at least in terms of release date. syslog-ng Premium Edition 4F1 (e.g. the first feature release past 4.0) has been released this week. It is the first release of PE in a long time that ...

On CVE-2011-1951: bug or security issue?

Sunday, July 10, 2011 @ 09:07 AM Author: Balázs Scheidler
There's an ongoing debate on the Linux Kernel Mailing List, whether security issues need separate attention. While I agree that distributing available information on security relevance is a good thing, I can also understand the concerns about the "security circus". Being the finder of a security bug has value in one's reputation, and building ...

Log messages in 3d

Sunday, June 26, 2011 @ 09:06 AM Author: Balázs Scheidler
Algernon has created a nice 3d visualization for log messages, 12 days compressed into one and a half minutes of video. Very nice music too :) The post describing how it works is here.  

Behind the scenes: syslog-ng 3.3

Monday, June 20, 2011 @ 08:06 PM Author: Balázs Scheidler
I just wanted to let you know, that fixes are nicely coming into the 3.3 beta tree, although it might not be very visible from th outside. So if you consider trying out 3.3, I'd suggest to try a git snapshot instead of the 3.3beta1 tarball. I'm trying to release a beta2 or rc1 in the near ...

Repository for syslog-ng 3rd party modules

Saturday, June 4, 2011 @ 01:06 PM Author: Balázs Scheidler
I long wanted to create a repository to hold things that were not yet integrated into the syslog-ng codebase. Things can happen to be in this phase either because of technical reasons, which are not addressed, or because of lack of time. Surely, if I was maintaining the repository the time issue wouldn't have been ...

syslog-ng in Kindle

Friday, May 20, 2011 @ 06:05 AM Author: Balázs Scheidler
CzP has found out that syslog-ng is used in the Amazon Kindle. Seems like our userbase is in the millions. :)  

syslog-ng 3.3 feature freeze, 3.4 branch opened

Sunday, May 1, 2011 @ 10:05 PM Author: Balázs Scheidler
With the recent maintenance policy updates in my last post, I plan quickly release a maintenance version for 3.2 (with version number 3.2.3) and then to concentrate on getting 3.3 into a stable form, starting with a beta release. As a reminder, here are the new features of syslog-ng 3.3:
  • performance improvements:
    • new multi-threaded core that allows syslog-ng ...

Maintenance Policy update for syslog-ng Open Source Editions

Sunday, May 1, 2011 @ 10:05 PM Author: Balázs Scheidler
Dear syslog-ng users, As discussed on the syslog-ng mailing list, the current versioning policies regarding syslog-ng Open Source Edition is confusing, and with the proliferation of syslog-ng versions, their maintenance is an increasing burden on the  syslog-ng project. Currently three major versions are supported (3.0, 3.1 and 3.2) and a fourth one (3.3) is in active ...

The 2nd alpha for syslog-ng 3.3 is released

Thursday, March 10, 2011 @ 08:03 PM Author: Balázs Scheidler
I wanted to let you know that a new alpha version for the upcoming syslog-ng version has been published on our website. It is by all means an important step forward, because the new release brings us:
  • It uses multiple threads to do its work, thus capable of scaling to multiple CPUs. Add 'threaded(yes)' to your ...

Intrusion Prevention with syslog-ng

Wednesday, February 23, 2011 @ 03:02 PM Author: Balázs Scheidler
Valentijn has published (blog post, mailing list archive) a nice hack using syslog-ng to actively react to intrusion attempts with patterndb and iptables. The blocking part is implemented using iptables recent match that is capable of closing an opened port for certain amount of time. This is controlled by syslog-ng: whenever a  login ...

syslog-ng’s development drivers

Sunday, February 6, 2011 @ 01:02 PM Author: Balázs Scheidler
I got some interesting comments in a forum posting, outlining a perception how syslog-ng's development is driven by BalaBit. The original post is here, but the interesting quote I'd like to react is this:
@all Some general points: A main difference between rsyslog and syslog-ng is that syslog-ng is backed by a large commercial organisation ...

Article on message correllation

Tuesday, February 1, 2011 @ 06:02 PM Author: Balázs Scheidler
There's a good writeup on syslog-ng correllation functions on LWN. Since it is currently for subscriber's only, here's a link that you can use to see until it is published. http://lwn.net/SubscriberLink/424459/dc2ec3fee7d80d3b/ LWN is a great publication by the way, so consider subscribing if you can.

syslog-ng releases

Sunday, January 16, 2011 @ 04:01 PM Author: Balázs Scheidler
I've made a round of syslog-ng releases in the last couple of weeks. From these 3.0.10 and 3.1.4 are quite similar, as they carry the almost the same set of bugfixes, which you can find in the respective changelogs. 3.2.2 is however different, it is a slightly ...

mongodb() driver for syslog-ng

Tuesday, January 11, 2011 @ 05:01 PM Author: Balázs Scheidler
Update: The driver has a homepage of its own at http://asylum.madhouse-project.org/projects/syslog-ng/mongodb/ Though I had no chance to look at it yet, Algernon has posted a MongoDB destination driver for syslog-ng. I can't wait to have a closer look at it, hopefully I get a chance in the coming days, but until then be sure to ...

Threading + epoll on 3.3 mainline

Tuesday, December 21, 2010 @ 04:12 PM Author: Balázs Scheidler
I've achieved an important milestone on the current threading stuff and I'm happy to tell you that multi-processing and epoll related performance improvements work is progressing nicely. The current master branch of the syslog-ng-3.3 tree runs the testsuite (make check) and performs much better than earlier releases. The only performance data was measured on my laptop, ...

syslog-ng 3.2 in openSUSE

Wednesday, December 8, 2010 @ 09:12 PM Author: Balázs Scheidler
The adoption rate of syslog-ng 3.2 is marvellous. It was made available for Mandriva on the date of the release, and about a week later openSUSE Factory has a package, thanks to Marius Tomaschewsky. I also received a patch to include support for cygwin into the system() source, courtesy of Corinna Vinschen. FreeBSD ports still ...

Featuring WPMU Bloglist Widget by YD WordPress Developer

Network-wide options by YD - Freelance Wordpress Developer