Write to message queues | Log collection solutions

#1 akumar 10 years ago

Botond,

I would like to write logs out to a message queue such as kafka or redis or rabbitmq etc. Is there a road map for that? Alternately would a workaround such as writing out in JSON format to a om_tcp destination work?

Can I also track the state of a tcp connection and send output to an alternate destination? I could write an external shell that would track the nxlog.log for "connection lost/made" and decision off that but I suspect that would be very expensive.

Thanks

Ash

Permalink

#2 adm Nxlog ✓ 10 years ago

#1 akumar

Botond, I would like to write logs out to a message queue such as kafka or redis or rabbitmq etc. Is there a road map for that? Alternately would a workaround such as writing out in JSON format to a om_tcp destination work? Can I also track the state of a tcp connection and send output to an alternate destination? I could write an external shell that would track the nxlog.log for "connection lost/made" and decision off that but I suspect that would be very expensive. Thanks Ash

Have you seen the kafka module ?

Redis and zeromq are on the roadmap, but can't tell when these will come.

For HA you might want to use a load balancer. Failover mode is also planned but the case is the same as for the above.