Remove Duplicates Help Needed

Hello All,

I am trying to use the pm_norepeat module to remove duplicate log messages that sometimes flood my logs. I am apparently not grasping how this works as the duplicate records are still flooding through the logs when I attempt to use the pm_norepeat function.

Can anyone advise on what I am doing wrong?  Is there a different way to accomplish de-duplification of messages with the im_msvistalog Exec to_syslog_bsd() modules ?????

AskedMarch 28, 2016 - 9:00pm

om_tcp - reconnect(); on a schedule

I have a series of file inputs and tpc outputs. The output targets are geo-balanced across data centers which traffic is directed to based on the originating request. If we have a situation where we need to take one of the two collectors down all the agents would point at one side. Because of this, I want NXLog to reconnect to the output target at a particular interval. How do you properly use the 'reconnect();' procedure? We have a series of inputs using the same outputs.

AskedMarch 28, 2016 - 6:37pm

ERROR maximum number of fields reached, limit is 50

Hello Guys,

         I download and I'm using the version nxlog-ce-2.9.1504.msi and everything working as well, but I have to parse logs from Hadoop and I had the error in the maximum number of fields my fields in Hadoop logs are 80 fields.

Here is my module to parse this:


AskedMarch 28, 2016 - 3:52pm

DateTime format conversion

Hi all

I'm trying to forward logs to my Graylog server using nxlog, and it's working fine, except for one minor problem which I've been unable to fix:

The date/time format in the log is as follows:

2016/03/17    07:06:27 AM     Message

AskedMarch 21, 2016 - 11:40am

Recursive file_remove

Is there any way to recursively delete files with file_remove?

I have applications logging in the following structure:

  • D:\Applogs\App1\Access-3172016.log
  • D:\Applogs\App2\Access-3162016.log

We're able to define an input and collect the logs no problem with the following definition:

<Input Access_Logs>

AskedMarch 17, 2016 - 9:30pm