A long-waited feature for syslog-ng, the Kafka source, is getting ready soon. The development is still in progress, but you can already try it, and it is worth the effort. How? Using the very same tool the syslog-ng testing and release process relies…

Dear syslog-ng users, This is the 89th issue of syslog-ng Insider, a monthly newsletter that brings you syslog-ng-related news. NEWS Consuming logs from a Kafka topic There is no official Kafka source in syslog-ng, but because this question…

Dear syslog-ng users, This is the 88th issue of syslog-ng Insider, a monthly newsletter that brings you syslog-ng-related news. NEWS Finding the real source IP: using the PROXY protocol Until now collecting logs behind proxies or load balancers…

There is no official Kafka source in syslog-ng, but because this question comes up often enough, I created one. It is just a temporary workaround using the program() source, but it works. It involves Java and installing Kafka manually, but it was fast…

The C implementation of the Kafka destination in syslog-ng has been improved in version 3.30. Support for templates in topic names was added as a result of a Google Summer of Code (GSoC) project. The advantage of the new template support feature is that…

Version 8, a new major version of Red Hat Enterprise Linux was released this spring. Now that CentOS 8 is also available, there is a rapidly growing interest in syslog-ng running on these platforms. From this blog, you can learn about the availability…

In our previous post , we discussed the performance of syslog-ng, streaming logs to HDFS destinations. Now we’ll pick up where we left off, and continue our performance evaluation with the Kafka. In our Kafka tests, we used syslog-ng Premium Edition…

Hadoop and Kafka are part of modern high speed data management, and syslog-ng has been supporting these destinations for some time now, as it’s an integral part of a versatile central log management solution. Seamless integration is great, but what about…