syslog-ng

0

Описание

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.

Языки

  • C75,8%
  • Python8,1%
  • C++4,6%
  • CMake3,1%
  • Makefile2,8%
  • Shell1,9%
  • Остальные3,7%
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
месяц назад
README.md

Build Status Nightly Binary packages Compile dbld-images

syslog-ng

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, message queues, databases (SQL and NoSQL alike), and more.

Quickstart

The simplest configuration accepts system logs from /dev/log (from applications or forwarded by systemd) and writes everything to a single file:

This one additionally processes logs from the network (TCP/514 by default):

This config is designed for structured/application logging, using local submission via JSON, and outputting in key=value format:

To submit a structured log using

logger
, you might run:

In which case the resulting message will be:

For a brief introduction to configuring the syslog-ng application, see the quickstart guide.

Features

  • Receive and send RFC3164 and RFC5424 style syslog messages
  • Receive and send JSON formatted messages
  • Work with any kind of unstructured data
  • Classify and structure logs using built-in parsers (csv-parser(), db-parser(), kv-parser(), etc.)
  • Normalize, crunch, and process logs as they flow through the system
  • Hand over logs for further processing using files, message queues (like AMQP), or databases (like PostgreSQL or MongoDB)
  • Forward logs to big data tools (like Elasticsearch, Apache Kafka, or Apache Hadoop)

Performance

  • syslog-ng provides performance levels comparable to a large cluster when running on a single node
  • In the simplest use case, it scales up to 600-800k messages per second
  • But classification, parsing, and filtering still produce several tens of thousands of messages per second

Community

  • syslog-ng is developed by a community of volunteers, the best way to contact us is via our github project page project, our gitter channel or our mailing list.
  • syslog-ng is integrated into almost all Linux distributions and BSDs, it is also incorporated into a number of products, see our powered by syslog-ng page for more details.

Sponsors

  • Balabit is the original commercial sponsor of the syslog-ng project, and was acquired by One Identity in 2018. One Identity offers a commercial edition for syslog-ng, called the syslog-ng Premium Edition.
  • Axoflow is the company of Balazs Scheidler, the original creator and main developer of syslog-ng.

Feedback

We are really interested to see who uses our software, so if you do use it and you like what you see, please tell us about it. A star on github or an email saying thanks means a lot already, but telling us about your use case, your experience, and things to improve would be much appreciated.

Just send an email to feedback (at) syslog-ng.org.

Feedback Powers Open Source.

Installation from source

Releases and precompiled tarballs are available on GitHub.

To compile from source, the easiest is to use

dbld
, a docker based, self-hosted compile/build/release infrastructure within the source tree. See
dbld/README.md
for more information.

For the brave souls who want to compile syslog-ng from scratch, the usual drill applies:

$ ./configure && make && make install

The extra effort in contrast with the dbld based build is the need to fetch and install all build dependencies of syslog-ng (of which there are a few).

If you don't have a configure script (because of cloning from git, for example), run

./autogen.sh

to generate it.

Some of the functionality of syslog-ng is compiled only if the required development libraries are present. The configure script displays a summary of enabled features at the end of its run. For details, see the syslog-ng compiling instructions.

Installation from binaries

Binaries are available in various Linux distributions and contributors maintain packages of the latest and greatest syslog-ng version for various OSes.

Debian/Ubuntu

Simply invoke the following command as root:

The latest versions of syslog-ng are available for a wide range of Debian and Ubuntu releases from our APT repository.

The packages and the APT repository are provided "as is" without warranty of any kind, on a best-effort level.

Supported distributions

syslog-ng packages are released for the following distribution versions:

Distro versionsources.list component nameArchstablenightly
Ubuntu 25.04ubuntu-pluckyx86-64stablenightly
Ubuntu 25.04ubuntu-plucky-arm64arm64stablenightly
Ubuntu 24.04ubuntu-noblex86-64stablenightly
Ubuntu 24.04ubuntu-noble-arm64arm64stablenightly
Ubuntu 22.04ubuntu-jammyx86-64stablenightly
Debian 13debian-trixiex86-64stablenightly
Debian 13debian-trixie-arm64arm64stablenightly
Debian 12debian-bookwormx86-64stablenightly
Debian 12debian-bookworm-arm64arm64stablenightly
Debian 11debian-bullseyex86-64stablenightly
Debian Unstabledebian-sidx86-64stablenightly
Debian Testingdebian-testingx86-64stablenightly

Adding the APT repository

  1. Download and store the release signing key:

    with newer apt (like on Debian 13 - Trixie)

  2. Add the repository containing the latest stable build of syslog-ng to your APT sources. For example if you are running Debian 13 on ARM64, you would use

    debian-trixie-arm64
    (see chart above) NOTE: For X86-64 you do not have to use any postfix, so, for Debian 13 on X86-64, you should simply use
    debian-trixie
    .

    on newer OSes (like on Debian 13 - Trixie)

  3. Update your repositories with

  4. Now install syslog-ng:

Nightly builds

Nightly packages are built and released from the git

develop
branch everyday.

Use

nightly
instead of
stable
in step 2 to use the nightly APT repository. e.g.:

Nightly builds can be used for testing purposes (obtaining new features and bugfixes) at the risk of breakage.

RHEL

Simply invoke the following command as root:

The latest versions of syslog-ng are available for a wide range of RHEL releases from our DNF repository.

The packages and the DNF repository are provided "as is" without warranty of any kind, on a best-effort level.

Supported distributions

syslog-ng packages are released for the following distribution versions:

Distro versionsources.list component nameArchstablenightly
RHEL 8rhel8x86-64stablenightly
RHEL 8rhel8-arm64arm64stablenightly
RHEL 9rhel9x86-64stablenightly
RHEL 9rhel9-arm64arm64stablenightly
RHEL 10rhel10x86-64stablenightly
RHEL 10rhel10-arm64arm64stablenightly

Adding the DNF repository

  1. Download and install the repository definition:

  2. Refresh repsitory metadata:

  3. Now install syslog-ng:

Nightly builds

Nightly packages are built and released from the git

develop
branch everyday.

Use

nightly
instead of
stable
in step 1 to use the nightly DNF repository. E.g.:

Nightly builds can be used for testing purposes (obtaining new features and bugfixes) at the risk of breakage.

Arch Linux

Fedora

syslog-ng is available as a Fedora package that you can install using dnf:

You can download packages for the latest versions from here.

For instructions on how to install syslog-ng on RPM distributions, see the blog post Installing latest syslog-ng on RHEL and other RPM distributions.

If you wish to install the latest RPM package that comes from a recent commit in Git for testing purposes, read the blog post, RPM packages from syslog-ng Git HEAD.

macOS

Others

Binaries for other platforms are listed on the official third party page.

Installation from Docker image

Binaries are also available as a Docker image. You can get:

  • the latest official release with

    docker pull balabit/syslog-ng:latest

  • the latest developer nigthly build with

    docker pull balabit/syslog-ng:nightly

Documentation

For the latest, markdown based version, see the syslog-ng documentation center.
The official documentation of the earlier versions (3.X) of syslog-ng Open Source Edition provided by One Identity is available here.

Contributing

If you would like to contribute to syslog-ng, to fix a bug or create a new module, the syslog-ng developer pages helps you take the first steps to working with the code base.