Log collection tools gather event data from endpoints, servers, network devices, and cloud services, normalize it into a consistent format, and route it to a SIEM, a database, or long-term storage. This article compares five log collection tools: NXLog Platform, Splunk Universal Forwarder, Elastic Agent, Fluent Bit, and Vector. All five move logs reliably. The factors that determine a purchase are operating system coverage, where processing happens, which destinations each tool can feed to, and whether fleet management and storage are included or have to be assembled from separate parts.
What should you look for in a log collection tool?
Coverage comes first. A collector that runs on your current Linux and Windows fleet but not on the AIX box behind your core banking application, or the Windows XP machine driving a production line, leaves exactly the blind spots attackers look for. Check the vendor’s supported platform list against your asset inventory, not against your ideal one.
Where processing happens determines the size of your SIEM bill. Most SIEMs charge by ingest volume, so a collector that filters, deduplicates, and trims events on the endpoint reduces that spend at the source. One that ships everything raw pushes the cost downstream, along with the parsing work.
Destination flexibility decides how hard it is to leave. Some tools write to any backend. Others exist to feed one vendor’s stack. If you expect to switch SIEMs, run two in parallel during a migration, or split data between hot analytics and cheap archive storage, this row of the comparison matters more than any other.
Managing configuration across 10,000 agents requires tooling, and someone has to run the storage and search layer. Some options ship both. Others assume you bring your own.
NXLog Platform
NXLog Platform is an on-premises telemetry pipeline that collects, processes, stores, and routes events, metrics, and traces. It works with any SIEM or observability backend and runs in hybrid, on-premises, and air-gapped environments, a hard requirement in defense, finance, and critical infrastructure work that rules out cloud-managed alternatives.
NXLog Agent handles collection, a single lightweight agent that supports more than 40 operating system and architecture combinations: Windows, Linux, macOS, BSD, AIX, and Solaris across x86, x64, ARM, PowerPC, and SPARC. NXLog Agent fully supports current OS releases, and also works on legacy systems such as Windows XP and Windows 2000 - machines that still run production lines, lab instruments, and medical equipment. Where nothing can be installed at all, the platform falls back to agentless collection over the network.
Windows coverage goes beyond reading the local event log. The Event Log for Windows module collects from any channel locally or from remote machines over MSRPC, with XPath queries that filter events at the subscription, before they are ever collected. The Windows Event Collector module turns an agent into a Windows Event Forwarding collector, and because it also runs on non-Windows platforms such as Linux, the collection tier does not have to be a Windows server. A dedicated legacy module covers Windows XP, 2000, and 2003.
Processing happens in the agent before data touches the network or your SIEM license. This configuration collects six high-value Security channel events, drops noisy machine-account logon failures, and forwards the rest as JSON:
<Extension json>
Module xm_json
</Extension>
<Input security_events>
Module im_msvistalog
<QueryXML>
<QueryList>
<Query Id="0">
<Select Path="Security">
*[System[(EventID=1102 or EventID=4625 or EventID=4648 or
EventID=4719 or EventID=4732 or EventID=4946)]]
</Select>
</Query>
</QueryList>
</QueryXML>
<Exec>
if ($EventID == 4625 and $TargetUserName =~ /\$$/) { (1)
drop();
}
</Exec>
</Input>
<Output siem>
Module om_tcp
Host siem.example.com:1514
Exec to_json();
</Output>
<Route windows_to_siem>
Path security_events => siem
</Route>
| 1 | Drop failed logons from machine accounts to reduce noise |
The same agent works as a relay for sources that cannot run software of their own. This configuration receives syslog from firewalls and switches, parses it into structured fields, and forwards it in RFC 5424 format:
<Extension syslog>
Module xm_syslog
</Extension>
<Input network_devices>
Module im_udp
ListenAddr 0.0.0.0:514
Exec parse_syslog();
</Input>
<Output siem>
Module om_tcp
Host siem.example.com:6514
Exec to_syslog_ietf();
</Output>
<Route relay>
Path network_devices => siem
</Route>
Adjust hosts, ports, and transport security to match your environment. Our Windows Event Log guide walks through hardened variants of both patterns. In production, you rarely edit these files by hand. NXLog Platform pushes configurations fleet-wide from templates and manages up to 100,000 agents per node with auto-enrollment and role-based access control.
Routing is vendor-neutral. More than 120 built-in modules for collection, processing, and routing cover destinations such as Splunk, Microsoft Sentinel, Google Security Operations, Elasticsearch, IBM QRadar, Kafka, and Amazon S3, as well as native OpenTelemetry input and output. The platform also includes its own storage layer, a high-compression, schema-less store with full-text search, SQL-like queries, and dashboards. Smaller teams can retain and investigate logs there without standing up a separate backend, and larger ones can keep a compliance archive next to the SIEM feed. Configurable failover and agent-side buffering keep data flowing when a receiver goes down.
Customers tend to cite the footprint. Yann Chanel of La Banque Postale describes NXLog as "ultimately lightweight in regard to CPU/RAM consumption, while still extremely powerful to process a solid event stream flawlessly." A Free plan covers small environments, and NXLog Agent is free for up to 10 sources, so you can test against your own log volume before committing.
Splunk Universal Forwarder
The universal forwarder is a stripped-down build of Splunk Enterprise containing only the components needed to move data, and it remains the default way to get endpoint logs into a Splunk deployment. A deployment server handles configuration across large fleets, and Splunk’s OS matrix lists the supported operating systems: Windows, Linux, macOS, Solaris, FreeBSD, and AIX.
Splunk itself documents the forwarder’s limits. The https://docs.splunk.com/Splex states that the universal forwarder sends unparsed data except in limited cases such as structured files. Routing event-based data requires a heavy forwarder, a full Splunk Enterprise instance with a much larger footprint. The forwarder also cannot search, index, or alert on data. Splunk indexers and search heads provide storage, search, and analytics are provided by, licensed separately. Inside a committed Splunk shop, none of this is a problem; it becomes one the day you want the same agents to feed anything else.
Elastic Agent
Elastic Agent consolidates what used to be several Beats into one agent for logs, metrics, and endpoint security data, managed centrally through Fleet in Kibana. Its integration catalog is broad, and for teams running Elastic Security, policies, upgrades, and integrations all live in the same console as the detections.
The constraint is the output list. Elastic Agent currently supports three outputs: Elasticsearch (local or remote), Logstash, and Kafka. When data shipped through the latter two continues on to Elasticsearch, Elastic’s Kafka output documentation warns that modifying document structure in transit breaks the ingest pipelines its integrations depend on. Treat Elastic Agent as a component of the Elastic Stack rather than a general-purpose collector, and plan storage and licensing around that stack.
Fluent Bit
Fluent Bit is a lightweight telemetry agent for logs, metrics, and traces on Linux, macOS, Windows, and BSD. Written in C and graduated within the CNCF under the Fluentd umbrella, it is one of the most widely deployed log collectors in Kubernetes clusters, where it deploys as a DaemonSet and ships to a wide catalog of outputs. It ingests and delivers OpenTelemetry natively, favors no particular backend, and runs as an edge agent or a central aggregator.
Windows collection is available via the winevtlog input, which reads event channels via the Windows API and accepts XPath queries for filtering, though the project’s center of gravity remains containerized Linux. Fleet-wide configuration management falls to whatever tooling you already run, such as Ansible, GPO, or a Kubernetes operator, since the open-source project ships no management console. There is no bundled storage or search layer either. The Apache 2.0 license keeps the entry cost at zero.
Vector
Vector is a Rust-based pipeline maintained by Datadog’s open-source engineering team. It deploys as a daemon, sidecar, or central aggregator, routes to a wide sink catalog with no vendor preference, and handles transformation through VRL, a purpose-built remap language that engineers who like configuration-as-code tend to enjoy. It runs on Linux, macOS, and Windows and ships under the MPL 2.0 license.
Scope is worth checking against your roadmap. The project README describes metrics support as beta and traces as planned. Nnative Windows Event Log collection arrived only in v0.55.0, released in 2026, with pull-mode subscriptions and bookmark checkpointing - capable, but young next to collectors that have read Windows events for over a decade. Like Fluent Bit, Vector ships no first-party fleet console or storage layer; you manage configuration and run the backends yourself.
How the five log collection tools compare
Collection-capability rows for NXLog Platform reflect NXLog Agent, the platform’s collection layer. Every cell links to or derives from vendor documentation current as of July 2026.
| Capability | NXLog Platform | Splunk Universal Forwarder | Elastic Agent | Fluent Bit | Vector |
|---|---|---|---|---|---|
Operating systems |
Windows, Linux, macOS, BSD, AIX, Solaris; works on EOL Windows (XP/2000) |
Windows, Linux, macOS, Solaris, FreeBSD, AIX (OS matrix) |
Windows, Linux, macOS |
||
Processing at the source |
Filtering, enrichment, format conversion in the agent |
https://docs.splunk.com/Splex except in limited cases |
Input processors |
Filters and processors |
VRL transforms |
Destinations |
Any SIEM, APM, cloud, or database - 120+ modules |
Splunk receivers (raw pass-through to third parties) |
Wide output catalog |
Wide sink catalog |
|
Windows Event Log |
Local API, remote MSRPC, WEF collection on any supported OS, legacy modules |
Native event log inputs |
Via Windows integrations |
||
Fleet management |
Built in - up to 100,000 agents per node, templates, RBAC |
Deployment server |
Fleet in Kibana |
None first-party |
None first-party |
Storage and analytics |
Built in - compressed schema-less store, search, dashboards |
Splunk indexers, licensed separately |
Elastic Stack, deployed separately |
Bring your own backend |
Bring your own backend |
License and entry point |
Free plan; Premium for scale |
Free forwarder; requires Splunk |
Elastic License 2.0 |
How to choose a log collection tool
Match the tool to the estate you run. If your environment spans current and end-of-life Windows, several Unix flavors, and OT networks, and you want collection, fleet management, and retention from one vendor that runs air-gapped, NXLog Platform covers that scope with a single agent and no dependency on a separate backend. If you are committed to Splunk and expect to stay, the universal forwarder is the path of least resistance. Teams standardized on Elastic Security get the smoothest operations from Elastic Agent and Fleet. Kubernetes-first shops with existing observability backends usually reach for Fluent Bit, and engineering teams that treat their pipeline as code and already have backends in place will feel at home in Vector.
Whichever direction you take, test with your own log volume before rolling out. Every tool here has a free entry point, and a two-week trial against your noisiest Windows domain controller tells you more than any comparison table.
Conclusion
The five tools here overlap on the basics and separate at the edges of an estate: the end-of-life machine nobody can patch, the firewall that only speaks syslog, the day a second SIEM enters the picture.
Key takeaways:
- Platform coverage decides the shortlist
-
Check each vendor’s supported OS list against the assets you actually run, including end-of-life systems, before comparing anything else.
- Where processing happens sets the SIEM bill
-
Most SIEMs charge by ingest volume, so a collector that filters and trims events on the endpoint cuts spend at the source.
- Destination flexibility determines switching costs
-
Vendor-neutral collectors can feed several backends at once during a migration; single-stack agents tie collection to one vendor’s platform.
- Fleet management and storage are part of the total cost
-
Some tools bundle configuration management and a storage layer; others assume you bring your own tooling and backend.
Answer those four questions against your own inventory, and the shortlist usually comes down to one or two names.
FAQ
- What is a log collection tool?
-
A log collection tool is software that gathers event data - operating system logs, application output, network device messages - normalizes it into a consistent format, and forwards it to a destination such as a SIEM, database, or archive. Most run as lightweight agents on the systems they monitor; some also receive data over the network from devices where no agent can be installed.
- What is the difference between a log collector and a SIEM?
-
A log collector moves and prepares data; a SIEM analyzes it. Collectors handle gathering, parsing, filtering, and delivery, while a SIEM correlates events, applies detection rules, and supports investigation. Collection quality determines both how useful the SIEM’s detections are and how much its ingestion costs, since most SIEMs bill by data volume.
- Can one log collector send data to multiple SIEMs?
-
Yes, if the collector is vendor-neutral. NXLog Agent, Fluent Bit, and Vector can each deliver the same stream to several destinations at once, which helps during a SIEM migration or when splitting data between analytics and archive tiers. Splunk Universal Forwarder is built for Splunk receivers, and Elastic Agent supports only Elasticsearch (local or remote), Logstash, and Kafka outputs.
- What is the best way to collect Windows Event Logs at scale?
-
Combine local agents with Windows Event Forwarding. Agents on domain controllers and servers read channels via the Windows Event Log API with XPath filters that drop noise before it leaves the host, while WEF pushes events from machines you cannot install software on to a central collector. NXLog Agent implements WEF collection in a module that also runs on non-Windows platforms such as Linux, so the collection tier is not tied to Windows. Our Windows Event Log guide covers channel selection, filtering, and event trimming in detail.