I am sending data to Elasticsearch via port 9200 and I am also using security for Elasticsearch. Any access to the rest API requiries authentication. Is there a way to configure the om_http output to provide headers to authenticate when sending data to Elasticsearch? Thank you

What this error means that leads some output modules to stop sending logs without crashing?   ASSERTION FAILED at line 21 in writerfuncs.c/nx_module_output_fill_buffer(): "output->buflen == 0" 

HI all, I am trying to transfer Windows eventlog (Securty, Application and System) from a server A to a server B. It is almost working if I send all the events of server A in a flat file on server B. But my goal is a little bit different : I need to have the serverA-Events loggued in the eventviewer of the server B. Do yo know if it is possible to achieve this ? Thanks in advance !

There is a tone of infrastructure and application monitoring tools out there ( uberagent, vmturbo etc., powershell scirpts) to collect proccess details as their main task. Allthough some could be integrated with NXLog ( lets say by using im_exec, or xm_exec) they have limited  filtering and output  capabilities compared to NXLog. If NXLog could implement one day one let's say im_perfmon module to collect performance metrics then it could be easily transformed to a top application to this category.

Has anyone succeed in sending .evt file content to graylog ? Actually, I found that:  - Using im_file module I can parse .evt file and send its content outside, but logs are bad formatted  - Using im_vistalog module I can't parse .evt files only the Windows Event log, but logs are well formatted Any advice someone ? Maybe it is possible to send the ouput of im_file to im_vistalog ? Thanks, -- Mathieu

Every now and then I get reports of logs not reporting. I investigate and 99.9% of the time, it is due to a loss of connectivity to the log server due to an nxlog crash. Typically, it is due to a faulting module, per Windows Event Viewer. OS - Windows Server 2012 R2 Datacenter NXLOG Version - How do I check? Event Viewer :: Faulting application name: nxlog.exe, version: 0.0.0.0, time stamp: 0x54fedd1a Faulting module name: libapr-1-0.dll, version: 0.0.0.0, time stamp: 0x54fedd1a Exception code: 0xc0000005 Fault offset: 0x00015190 Faulting process id: 0x160 Faulting application start time: 0x01d1b804aaa52028 Faulting application path: D:\Program Files (x86)\nxlog\nxlog.exe Faulting module path: D:\Program Files (x86)\nxlog\libapr-1-0.dll Report Id: 79778f7a-2701-11e6-80c2-00155d590419 Faulting package full name:  Faulting package-relative application ID:    Is this a known issue? Are there ways to prevent this from happening? Thank you!

I'm attempting to compile the latest nxlog on FreeBSD and it fails with the following error. Any thoughts as to a fix or workaround would be appreciated. My environment is as follows: FreeBSD 10.1-STABLE OpenSSL 1.0.2h  3 May 2016 [/usr/local/src/nxlog-ce-2.8.1248]#make Making all in src Making all in common make  all-am /bin/sh ../../libtool --tag=CC    --mode=compile cc -DHAVE_CONFIG_H -I. -I/usr/local/include/apr-1   -I/usr/local/include  -pipe -W -Wall -Wshadow -Wno-address -Wcast-qual -Wbad-function-cast -Wsign-compare -Wconversion -funsigned-char -Werror-implicit-function-declaration -Wswitch-default -fstrict-aliasing -Wpointer-arith -Wcast-align -Wwrite-strings -Wmissing-noreturn -Wmissing-format-attribute -Wformat -Wextra -Werror=format-security -rdynamic -ggdb3 -MT ssl.lo -MD -MP -MF .deps/ssl.Tpo -c -o ssl.lo ssl.c libtool: compile:  cc -DHAVE_CONFIG_H -I. -I/usr/local/include/apr-1 -I/usr/local/include -pipe -W -Wall -Wshadow -Wno-address -Wcast-qual -Wbad-function-cast -Wsign-compare -Wconversion -funsigned-char -Werror-implicit-function-declaration -Wswitch-default -fstrict-aliasing -Wpointer-arith -Wcast-align -Wwrite-strings -Wmissing-noreturn -Wmissing-format-attribute -Wformat -Wextra -Werror=format-security -rdynamic -ggdb3 -MT ssl.lo -MD -MP -MF .deps/ssl.Tpo -c ssl.c -o ssl.o cc: warning: argument unused during compilation: '-rdynamic' ssl.c:46:27: warning: cast from function call of type 'apr_os_thread_t'       (aka 'struct pthread *') to non-matching type 'unsigned long'       [-Wbad-function-cast]     ret = (unsigned long) apr_os_thread_current();                           ^~~~~~~~~~~~~~~~~~~~~~~ ssl.c:343:52: warning: cast to 'void *' from smaller integer type 'int'       [-Wint-to-void-pointer-cast]     SSL_set_ex_data(ssl, nx_ssl_verify_result_idx, (void *) verify_result);                                                    ^ ssl.c:372:12: error: implicit declaration of function 'SSLv3_method' is invalid       in C99 [-Werror,-Wimplicit-function-declaration]     meth = SSLv3_method();            ^ ssl.c:372:10: warning: incompatible integer to pointer conversion assigning to       'const SSL_METHOD *' (aka 'const struct ssl_method_st *') from 'int'       [-Wint-conversion]     meth = SSLv3_method();          ^ ~~~~~~~~~~~~~~ 3 warnings and 1 error generated. *** Error code 1 Stop. make[3]: stopped in /usr/local/src/nxlog-ce-2.8.1248/src/common *** Error code 1 Stop. make[2]: stopped in /usr/local/src/nxlog-ce-2.8.1248/src/common *** Error code 1 Stop. make[1]: stopped in /usr/local/src/nxlog-ce-2.8.1248/src *** Error code 1 Stop. make: stopped in /usr/local/src/nxlog-ce-2.8.1248    

Hello Team, I am sending MS SQL Server Error logs from NXLog to our TCP server for processing. I need to select File encoding to Unicode, I tried but it is goving error if I set encoding to Unicode/unicode. If I set encoding to utf-8/utf-16 it is adding dot(.) after every single character in a source log line. Any suggestions/help would be really appriciated. Thanks, Mahesh mahibabar@gmail.com +91-9923622938

NXLog Redis output module  sends data to a Redis server with the RPUSH command allowing only to change the Redis key ( = database). RPUSH inserts all the specified values at the tail of the list stored at key I suggest that the Redis command has to be implemented as a parameter and to support at least the LPUSH. LPUSH inserts all the specified values at the head of the list stored at key There are clients that support only retreiving data from the head. The most usual case is to send data to Redis with LPUSH and then have Logstash poll record from Redis with LPOP.   Thank you.

I have a multiline log sample as follow: 2/22/2016 4:19:30 PM 09F8 EVENT The DNS server has finished the background loading of zones. All zones are now available for DNS updates and zone transfers, as allowed by their individual zone configuration. 2/22/2016 4:19:38 PM 082C EVENT The DNS server has started. 2/22/2016 4:19:38 PM 08E0 PACKET 0000000001564000 UDP Rcv 192.168.2.213 526c Q [0001 D NOERROR] SOA (5)_ldap(4)_tcp(4)snpl(3)com(2)np(0) UDP question info at 0000000001564000 Socket = 324 Remote addr 192.168.2.213, port 57611 Time Query=104249, Queued=0, Expire=0 Buf length = 0x0fa0 (4000) Msg length = 0x0028 (40) Message: XID 0x526c Flags 0x0100 QR 0 (QUESTION) OPCODE 0 (QUERY) AA 0 TC 0 RD 1 RA 0 Z 0 CD 0 AD 0 RCODE 0 (NOERROR) QCOUNT 1 ACOUNT 0 NSCOUNT 0 ARCOUNT 0 QUESTION SECTION: Offset = 0x000c, RR count = 0 Name "(5)_ldap(4)_tcp(4)snpl(3)com(2)np(0)" QTYPE SOA (6) QCLASS 1 ANSWER SECTION: empty AUTHORITY SECTION: empty ADDITIONAL SECTION: empty I wish to add the some string at end of this log say (ENDOFLOG) to the end of logfile. How can i achieve this?

Has anyone seen this with NXlog when you are able to telnet to the host.  When I set this up in a test lab it works fine.  I assume a firewall but I can telnet fine to the host IP and port. 2016-05-20 09:41:31 ERROR om_tcp detected a connection error; An existing connection was forcibly closed by the remote host. 2016-05-20 09:41:32 INFO connecting to seclog.lowes.com:514 Very basic config. #define ROOT C:\Program Files\nxlog define ROOT C:\Program Files (x86)\nxlog Moduledir %ROOT%\modules CacheDir %ROOT%\data Pidfile %ROOT%\data\nxlog.pid SpoolDir %ROOT%\data LogFile %ROOT%\data\nxlog.log <Extension _syslog>     Module      xm_syslog </Extension> <Input in> #Module      im_msvistalog # For windows 2003 and earlier use the following: Module      im_mseventlog Exec if $EventID NOT IN (528, 529, 567, 592, 601, 602, 608, 612, 636, 7034, 7035, 7036, 7040, 4097, 64004, 2, 3005) drop(); </Input> <Output out>     Module      om_tcp     Host        192.168.x.x     Port        514     Exec        to_syslog_snare(); </Output> <Route 1>     Path        in => out </Route>  

Hi All,    I use nxlog-ce-2.9.1504 to read log and parse it,the format of log is like: 20160523 10:58:22 sda              0      0    0    0      14      2    2    9       9     1     1      0    0 20160523 10:58:22 sdb              0      3    2    0      20      4    8    4       2     5     1      7    2 I want get the purpose: if the third field is "sda",nxlog automatically add a string value "disk1" at the tail of  the same row,if "sdb",add "disk2",like 20160523 10:58:22 sda              0      0    0    0      14      2    2    9       9     1     1      0    0  disk1 20160523 10:58:22 sdb              0      3    2    0      20      4    8    4       2     5     1      7    2  disk2   I configure the nxlog.conf as following,but it can not add any fields,I don't know where the mistake,anybody could help me? thanks so so so much~ <Extension kvp>     Module      xm_kvp </Extension> <Input perf>     Module      im_file     File        "/collectl/LKNODE01*.dsk"     SavePos     FALSE     ReadFromLast FALSE     Exec    if $raw_event =~ /^(\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+) (\S+)/\                  {\                         kvp->parse_kvp();\                         if $3 == "sda" $raw_event = $raw_event + " disk1";\                         else if $3 == "sdb" $raw_event = $raw_event + " disk2";\                 } </Input> <Output file>     Module      om_file     file        '/tmp/2.txt' </Output> <Route 1>     Path        perf=> file </Route>

Hi all, I am new with NXLOG and I have a very basic question to ask you : is it possible to simply copy a file from server A (source file name : c:\osit\log\df_mon.log) to server B (target file name : c:\osit\log15\df_mon.log). I spent already hours on NXLOG config file but I was not able to make it worked because the instruction "File" seeems not to be compatible wit the "om_tcp" output modeule and Host/Port settings. Thanks a lot in advance, Sophie

Hi everyboy, I have a log rotation folder on catalina application with a filename based on date like that "catalina.2016-04-15.log". Catalina create a log file with the date of the day, only if he need to write log (not automatically a file per day). Some one has a exemple for configure NX log ?   Thanks in advance !    

I have the usual error "Unexpected data from server ..." using om_http to send Windows event logs through Nginx to Redis. The problem is that when randomly this error happens ( once every 5 days) the service unexpectently stops ! From the source code I can understand that NXLog receives a response which cannot map to a correnponding request. It has a response with an appropriate length but the corresponding request is null! Possibly is a bad logic implementation, or even a network problem that could cause request/response mismatch.I really don't know. But I also really can't understand why NxLog preferres to die instead of  just return from the function in case this happens and not execute the code following the condition that drives the service to crash at the end. Stelios

Would this be the correct placement to add the filter event ID string?  Should anything esle be commented out? #Windows Event Logging of Security,System and Application Logs   Module      im_mseventlog   Exec to_syslog_snare(); Exec if $EventID NOT IN (528, 529, 567, 592, 601, 602, 608, 612, 636, 7034, 7035, 7036, 7040, 4097, 64004, 2, 3005) drop(); </Input>      

When NXLog ships a Windows event, it appears to be changing the Windows original severity level, and replacing it with SeverityValue and Severity with different values.   What is the mapping of these values?  If Windows has severity values, with "Level" being 4 for Information, 3 for Warning, 2 for Error and 1 for Critical, what is the nxlog created SeverityValue?   Also, I couldn't find an explaination of why this value is changing.  

Hi, We are testing NXlog to ship the security logs to our security team.  We are using XP embedded and it working fine.  Security is asking us to only send specific event ID's.  I have looked at the documentation and it appears that we may not be able to do this with XP.  I was going to do the custom view but XP does not support that. We are supported on the embedded version of XP. My question.  Has anyone tried to do this with XP or is it even possible? Thanks, David Martin  

Hi,  I am doing a rule which detects me are making multiple responses of ICMP from the same IP in which there are diferent IPs.   The problem that i have is that don't write in the output with raw_event and file_write. In file_write I put the "otro" file.  Do you know it can be?   Antonio.   File nxlog.conf:   <Extension fileop>     Module      xm_fileop </Extension> <Input in4>     Module    im_file     File    "/home/antonio/Descargas/sn"     SavePos TRUE     Exec    if ($raw_event =~ /^\d\d:\d\d:\d\d.(.+)/) {     \                     $Message = $1;            \                     $raw_event = $Message;       \                 }     exec if $Message =~ /IP (\S{1,}) > \S{1,}:/ $IP=$1; </Input> <Input internal>     Module    im_internal     Exec    $raw_event = $Message; </Input> <Output out4>     Module    om_file     File    "/home/antonio/Descargas/nx" </Output> <Processor evcorr>     Module       pm_evcorr     <Thresholded>                 Condition  $Message =~ /^ICMP echo reply/             Threshold  3            Interval   120     Context $IP     Exec       $raw_event = "3 ECHO REPLY packets from host $IP";     Exec        file_write("/home/antonio/Descargas/otro", "3 ECHO REPLY packets from host $IP");     </Thresholded> </Processor> <Route 4> Path    in4, internal => evcorr => out4 </Route>   File sn:   17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 17:11:33.953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64   File nx:   inode changed for '/home/antonio/Descargas/sn': reopening possibly rotated file 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64 953173 IP mad01s25-in-f3.1e100.net > 192.168.20.153: ICMP echo reply, id 62478, seq 2, length 64   File otro:   Thanks :))

Hi all! Im new and would really appreciate any assistance/feedback on implementation... I'm trying to implement Audit Reduction in my environment which includes (4) Windows 7 boxes , (2) RHEL 7 boxes (SYSLOG) and (1) RHEL 6 box (SYSLOG)... We have all the logs writing to one of the Windows 7 workstations. The logs need to be manually pulled off and put in another location. This environment is replicated 7 times (7 systems with the same configuration with 7 appliances each) They ultimately get to a Dropbox that forwards them off to an ElasticSearch/Kibana instantiation....So 49~ devices/appliances reporting. I would like to know if the Community Edition would work or if I need to purchase Enterprise? Does NXlog need to be installed on each appliance? Thanks!