navdeepsingh83 created
Hi all,
I've set up nxlog (4.1.4016) to monitor a logfile that is been written to constantly. For some reason, when i start nxlog, the programm that creates the loglines no longer adds info to the existing log. A simple commandline 'echo logline >> thelog.txt' does add the line to the logfile (and processed by nxlog), but other logging is not added. As soon as I stop the NXLog service, the log is modified again.
NXLog is running as system, the programm is running as a normal user.
Any suggestions for troubleshooting would be welcome, as I have no clue what is happening.
JanVerhaag created
Hi all,
I am new here, so hello.
I am trying to work out a solution to collect IIS Access Log data from Azure App Services and then forward to a SIEM such as Splunk, Loggly or ElasticSearch for Security analysis, Anomoly identification and alerting.
As far I can see NXLog may provide the link between the Azure Access Logs and my chosen SIEM. Am I right? I would prefer to not get into rewriting of code, hence my interest in NXLog. In addition it appears that NXL:og seems to be widely supported by SIEM tools.
With regards to implementation, would I be correct in thinking that one needs to setup a Linux or WIndows VM on Azure with NXLog running on it. I am trying to avoid onprem installs.
In conclusion, I would welcome your advice on how I could use NXLog as a simple collector and forwarder of Access data. One final word, the Access Logs are currently stored in Azure Storage Blobs, although I could go back to storing them in the File System.
Thanks.
EdB created
hi,
Is somebody has got an experience of im_dbi ?
I tried this example but /tmp/output is filled of blank char ? I checked nxlog log at starting, everything is OK. Driver mysql has been installed correcly
<Input dbi>
Module im_dbi
Driver mysql
Option host 127.0.0.1
Option username mysql
Option password mysql
Option dbname logdb
SQL SELECT id, facility, severity, hostname,
timestamp, application, message
FROM log
</Input>
<Output file> Module om_file File "tmp/output" </Output>
<Route dbi_to_file> Path dbi => file </Route>
iCirco created
DDGH created
Hello! I'm trying to deploy nxlog with GPO on windows, but sims like MSI package from https://nxlog.co/products/nxlog-community-edition/download not working properly. After creating GPO nothing happens, I have tried install as well with scrip (cmd /c Msiexec /I \file server\share\nxlog-ce-2.9.1716.msi /qn) nothing.
When I run the script on local PC getting the error "This installation package could not be opened. Contact the application vendor to verify that this is a valid Windows Installer package."
We using AD 2012 and windows 10/8 machines. Is there any way to deploy nxlog massive on all PC's?
Thx
Maksimsk created
c.scharfenberg created
hi,
I'm working on monitoring a log file using nxlog. I have the File set to "C:\Program Files\test1.log" but it's saying that the "input file does not exist". I tried running a python script to check the file using the os module
import os
test = os.listdir('C:\Program Files\test1.log') print(test)
This will return an error "FileNotFoundError: The system cannot find the path specified"
I noticed that this error has been encountered before but none of the solutions I tried work.
any help is much appreciated.
Thanks, skawt
skawt created
Hello,
is the any way to set custom timeout in om_http? or custom retry mechanism?
Thanks
wisnu.sudarmadi created
Hi. I am having an issue with forwarding event logs from a centralized server to an rsyslog and indexed in splunk. The logs are forwarded but the Event ID (the most important part) is missing. I am also having an issue with control characters on , this however could be blamed on rsyslog, but as I understand it the issue with control characters could be solved in the nxlog config.
Anyone care to give me a nudge in the correct way here?
//Thx
ryssland created
i am getting data from a database, one of these fields containts an xml, is it possible to convert this single field to json?
sample data { "id": 27101, "ResponseStatus": "SUCCESS", "RequestTime": "2018-09-19 14:21:48", "ResponseXml": "<?xml version="1.0" encoding="UTF-8"?>\r\n<Envelope xmlns="http://schemas.xmlsoap.org/soap/envelope/"><Header /><Body><from>Jani</from></Body></Envelope>\r\n", "RequestMode": "DSS", "ErrorCode": null, }
i want the ResponseXml field to be converted to json aswell, i also want to keep the other fields
or any other sollution to parse the xml so i have access to the data inside the xml
thx!
w.schmitt@evidos.nl created
Hi folks,
I am trying to capture analytics and debug logs on windows server 2012 r2. The logs are under applications and services log and the log path is Microsoft-Windows-DNSServer/Analytical
When I enable it, i get the following error
2018-09-19 16:52:23 ERROR failed to subscribe to msvistalog events using bookmark: The caller is trying to subscribe to a direct channel which is not allowed. The events for a direct channel go directly to a logfile and cannot be subscribed to. 2018-09-19 16:52:23 ERROR failed to subscribe to msvistalog events,the Query is invalid: [error code: 50]
I have tried few methods but none of them are working.
any idea how can we capture windows debug and analytics logs using nxlog?
navdeepsingh83 created
Dear all,
I'm trying to get hold of the IIS logs and I get the following issue when I try to restart the service.... we are working on a extra.conf file and I know that it is the one that hinders the service to start.... I just cant see where in the code I mess up.
Here's the code.
Created by NXlog Configuration AT 04-07-2018 08:20:12
NXlog Configuration Version 2018-05-14
Created On HOSTNAMEWEB03
OS INFO 2008 - nxlogserver: 10.233.26.20
dnsloginfo $Undefined DHCPLOGINFO $Undefined###
Start off with Definitions
Rootdir defined from: HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\nxlog,installdir;HKEY_LOCAL_MACHINE\SOFTWARE\nxlog,installdir
define ROOT <C:\Program Files\nxlog>
Generic Settings for ALL installations
define CERTDIR %ROOT%\cert define CONFDIR %ROOT%\conf define LOGDIR %ROOT%\data define LOGFILE %LOGDIR%\nxlog.log
Moduledir %ROOT%\modules CacheDir %ROOT%\data Pidfile %ROOT%\data\nxlog.pid SpoolDir %ROOT%\data LogFile %LOGFILE% LogLevel INFO
<Extension _syslog> Module xm_syslog </Extension>
<Extension _exec> Module xm_exec </Extension>
<Extension _json> Module xm_json </Extension>
Define our inputs
Start ISS created by # 18-09-2018###
<Input IIS> Module im_file File C:\inetpub\logs\LogFiles\W3SVC1\* SavePos True InputType LineBased </Input>
END ISS Inserted by # 18-09-2018###
<Input winlog> Module im_msvistalog ReadFromLast TRUE ResolveSID TRUE <QueryXML> <QueryList> <Query Id='1'> <Select Path='Application'></Select> <Select Path='Security'></Select> <Select Path='System'>*</Select> </Query> </QueryList> </QueryXML> </Input>
Define the output that goes to LP for analysis
<Output syslogout> Module om_tcp Host 10.2XX.26.2X Port 514 Exec to_syslog_bsd(); </Output>
<Output winout> Module om_tcp Host 10.2XX.26.2X Port 514 Exec to_json(); $Message = $raw_event;to_syslog_bsd(); </Output>
Tie together inputs to outputs
<Route 1> Path winlog => winout </Route> include %CONFDIR%\extra.conf
Configuration Completed
The following is taken out of the nxlog.log
2018-09-19 09:28:10 WARNING nxlog received a termination request signal, exiting... nxlog failed to start: Invalid 'include' directive at C:\Program Files\nxlog\conf\extra.conf:86 Failed to open config file <C:\Program Files\nxlog>\conf\extra.conf The filename, directory name, or volume label syntax is incorrect.
2018-09-19 09:41:15 INFO nxlog-4.0.3735 started 2018-09-19 09:41:15 WARNING not starting unused module syslogout 2018-09-19 09:41:15 INFO connecting to 10.233.26.20:514 2018-09-19 09:44:00 WARNING stopping nxlog service 2018-09-19 09:44:00 WARNING nxlog received a termination request signal, exiting... nxlog failed to start: Invalid 'include' directive at C:\Program Files\nxlog\conf\extra.conf:86 Failed to open config file <C:\Program Files\nxlog>\conf\extra.conf The filename, directory name, or volume label syntax is incorrect.
nxlog failed to start: Invalid 'include' directive at C:\Program Files\nxlog\conf\extra.conf:86 Failed to open config file <C:\Program Files\nxlog>\conf\extra.conf The filename, directory name, or volume label syntax is incorrect.
Shahmiri created
w.schmitt@evidos.nl created
Hello!
Are there plans for an update of NXLog Community Edition to integrate TLS 1.3 (or rather OpenSSL 1.1.1)?
Unfortunately I didn't find any information about this. If this question has already been asked, I would be thankful if anyone could show me this thread.
Regards
dk created
Running NXLOG on Windows 2016
Error failed to subscribe to msvistalog events, the channel was not found [error code: 15007], the specific channel could not be found. check channel configuration
NXLOG config file as requested.
Sample of NXLOG configuration file
This is a sample configuration file. See the nxlog reference manual about the
configuration options. It should be installed locally and is also available
online at http://nxlog.org/docs/
Please set the ROOT to the folder your nxlog was installed into,
otherwise it will not start.
#define ROOT C:\Program Files\nxlog define ROOT C:\Program Files (x86)\nxlog
Moduledir %ROOT%\modules CacheDir %ROOT%\data Pidfile %ROOT%\data\nxlog.pid SpoolDir %ROOT%\data LogFile %ROOT%\data\nxlog.log
<Extension _syslog> Module xm_syslog </Extension>
<Input in> Module im_msvistalog
For windows 2003 and earlier use the following:
Module im_mseventlog
Query <QueryList>
<Query Id="0">
<Select Path="Application"></Select>
<Select Path="System"></Select>
<Select Path="Security"></Select>
<Select Path="ForwardedEvents"></Select>
<Select Path="Setup"></Select>
<Select Path="Microsoft-Windows-Sysmon/Operational"></Select>
</Query>
</QueryList>
</Input>
<Output out> Module om_tcp Host x.x.x.x Port 514 Exec to_syslog_snare(); </Output>
<Route 1> Path in => out </Route>
omoanth created
Hi,
According to this documentation https://nxlog.co/documentation/nxlog-user-guide#om_http
I can use 'AddHeader' to put my custom headers to http request.
However, when I put it in config i get: ERROR invalid keyword: AddHeader
I also tried
Exec add_http_header('Application-Id', 'b1f8b7a0-5cc5-11e8-8230-0db3d3bfb10d');
This time error is: procedure 'add_http_header()' does not exist or takes different arguments.
What's the correct way to add a http header"?
piro314 created
Hello,
As the name entices, I am getting multiple errors with XML files.
Here is my conf: <Extension xml> Module xm_xml </Extension>
<Extension json> Module xm_json </Extension>
<Input in> Module im_file File "C:\Users\administrator\Desktop\2016.xml" SavePos FALSE ReadFromLast FALSE Exec parse_xml(); Exec to_json(); </Input>
<Output out> Module om_file File "C:\Users\administrator\Desktop\testxml.txt" </Output>
Here are the errors: 2018-09-10 15:58:04 ERROR procedure 'parse_xml' failed at line 33, character 20 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been ab orted; XML parse error at line 1: no element found 2018-09-10 15:58:04 ERROR procedure 'parse_xml' failed at line 33, character 20 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been ab orted; XML parse error at line 1: not well-formed (invalid token)
Thanks for your time.
Deleted user created
Hi, I'm trying to send messages from NXLog into Logstash with a custom TAG. Logstash would filter those messages and then send them into specific topics in Kafka. For example my current Logstash + Filebeats works like that:
filebeat.yml has:
paths: - /var/log/*.log
tags: ["EXAMPLE_1"]
Logstash.yml has :
output { if "EXAMPLE_1" in [tags]{ kafka { bootstrap_servers => "example_dns:9092" topic_id => "example_1_topic_kafka" } } }
Is it possible to recreate such simple config with NXLog?
NXlog_monitoring created
Hello,
I'm using NXlog CE 2.10.2102 on a Win 2012 R2 x64 server to collect both the four default Windows logs and the Forwarded Events snd send to a Syslog server as Snare formatted. However, some events only contains their System segment, missing their entire EventData. For example, all of events 1000 and 1001 and all 4624 events with Kerberos login. 4624 with Advapi are passed just fine. I've no idea why is that, every idea would be welcomed.
Here's my configuration:
define ROOT C:\Program Files (x86)\nxlog
Moduledir %ROOT%\modules CacheDir %ROOT%\data Pidfile %ROOT%\data\nxlog.pid SpoolDir %ROOT%\data LogFile %ROOT%\data\nxlog.log LogLevel INFO
<Extension _syslog> Module xm_syslog </Extension>
<Input in>
Module im_msvistalog
<QueryXML>
<QueryList>
<Query Id="0">
<Select Path="ForwardedEvents"></Select>
<Select Path="Application"></Select>
<Select Path="System"></Select>
<Select Path="Security"></Select>
</Query>
</QueryList>
</QueryXML>
<Exec>
$Message =~ s/(\t|\R)/ /g; to_syslog_snare();
</Exec>
</Input>
<Output out> Module om_udp Host 1.2.3.4 </Output>
<Route 66> Path in => out </Route>
AmirG created