Ask questions. Get answers. Find technical product solutions from passionate experts in the NXLog community.
Import W3C files generates errors in logs
Austin.Downing created
I am getting thousands of errors in my nxlog.log on my IIS server. Here is my config file that has been sanitized. This is a Server 2012R2 system running IIS 8.
## This is a sample configuration file. See the nxlog reference manual about the
## configuration options. It should be installed locally and is also available
## online at http://nxlog.org/docs/
## Please set the ROOT to the folder your nxlog was installed into,
## otherwise it will not start.
#define ROOT C:\Program Files\nxlog
define ROOT C:\Program Files (x86)\nxlog
Moduledir %ROOT%\modules
CacheDir %ROOT%\data
Pidfile %ROOT%\data\nxlog.pid
SpoolDir %ROOT%\data
LogFile %ROOT%\data\nxlog.log
<Extension gelf>
Module xm_gelf
ShortMessageLength 3000
</Extension>
<Extension w3c>
Module xm_csv
Fields $date, $time, $s-ip, $cs-method, $cs-uri-stem, $cs-uri-query, $s-port, $cs-username, $c-ip, $csUser-Agent, $cs-Referer, $sc-status, $sc-substatus, $sc-win32-status, $time-taken
FieldTypes string, string, string, string, string, string, integer, string, string, string, string, integer, integer, integer, integer
Delimiter ' '
QuoteChar '"'
EscapeControl FALSE
UndefValue -
</Extension>
<Input iis1>
Module im_file
File "F:\\W3SVC1\\u_ex*"
SavePos TRUE
Exec if $raw_event =~ /^#/ drop(); \
else \
{ \
w3c->parse_csv(); \
$EventTime = parsedate($date + " " + $time); \
$SourceName = "IIS"; \
}
</Input>
<Input iis2>
Module im_file
File "F:\\W3SVC2\\u_ex*"
SavePos TRUE
Exec if $raw_event =~ /^#/ drop(); \
else \
{ \
w3c->parse_csv(); \
$EventTime = parsedate($date + " " + $time); \
$SourceName = "IIS"; \
}
</Input>
<Input iis3>
Module im_file
File "F:\\W3SVC3\\u_ex*"
SavePos TRUE
Exec if $raw_event =~ /^#/ drop(); \
else \
{ \
w3c->parse_csv(); \
$EventTime = parsedate($date + " " + $time); \
$SourceName = "IIS"; \
}
</Input>
<Input iis4>
Module im_file
File "F:\\W3SVC4\\u_ex*"
SavePos TRUE
Exec if $raw_event =~ /^#/ drop(); \
else \
{ \
w3c->parse_csv(); \
$EventTime = parsedate($date + " " + $time); \
$SourceName = "IIS"; \
}
</Input>
<Input iis5>
Module im_file
File "F:\\W3SVC5\\u_ex*"
SavePos TRUE
Exec if $raw_event =~ /^#/ drop(); \
else \
{ \
w3c->parse_csv(); \
$EventTime = parsedate($date + " " + $time); \
$SourceName = "IIS"; \
}
</Input>
<Input iis6>
Module im_file
File "F:\\W3SVC6\\u_ex*"
SavePos TRUE
Exec if $raw_event =~ /^#/ drop(); \
else \
{ \
w3c->parse_csv(); \
$EventTime = parsedate($date + " " + $time); \
$SourceName = "IIS"; \
}
</Input>
<Input iis7>
Module im_file
File "F:\\W3SVC7\\u_ex*"
SavePos TRUE
Exec if $raw_event =~ /^#/ drop(); \
else \
{ \
w3c->parse_csv(); \
$EventTime = parsedate($date + " " + $time); \
$SourceName = "IIS"; \
}
</Input>
<Input in>
# Use 'im_mseventlog' for Windows XP, 2000 and 2003
Module im_msvistalog
# Uncomment the following to collect specific event logs only
# Query <QueryList>\
# <Query Id="0">\
# <Select Path="Application">*</Select>\
# <Select Path="System">*</Select>\
# <Select Path="Security">*</Select>\
# </Query>\
# </QueryList>
</Input>
<Output out>
Module om_udp
Host server.corp.com
Port 12201
OutputType GELF
</Output>
<Route r>
Path in => out
</Route>
<Route iis1>
Path iis1 => out
</Route>
<Route iis2>
Path iis2 => out
</Route>
<Route iis3>
Path iis3 => out
</Route>
<Route iis4>
Path iis4 => out
</Route>
<Route iis5>
Path iis5 => out
</Route>
<Route iis6>
Path iis6 => out
</Route>
<Route iis7>
Path iis7 => out
</Route>
Here are the various errors I am getting.
2018-12-06 16:26:08 ERROR if-else failed at line 43, character 430 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; procedure 'parse_csv' failed at line 43, character 239 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; cannot parse integer "https://www.company.com/portal/Processing/Processing.aspx", invalid modifier: 'x'
2018-12-06 16:26:08 ERROR if-else failed at line 57, character 430 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; procedure 'parse_csv' failed at line 57, character 239 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; Too many fields in CSV input, expected 15, got 16 in input '2018-12-06 21:26:06 W3SVC2 10.0.1.122 POST /home/name/services/Publish/Index - 80 - 10.0.0.0 - - 303 0 0 663 915 0'
2018-12-06 16:26:08 ERROR if-else failed at line 43, character 430 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; procedure 'parse_csv' failed at line 43, character 239 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; cannot parse integer "https://www.company.com/home/", invalid modifier: '/'
Austin.Downing created
Nxlog CE agent forwarding all Windows Events despite the query level filter
Olistra created
Hello everybody,
I'm trying to filter Windows events log with severity/level only from warning to critical, so from level 1 to 3.
Unfortunately, I tried several configurations, but the agent is still forwarding all the events. Like if there were no filters.
My specifications are, Nxlog CE Agent (version 2.10.2102) on a Windows 10 64 bits build 1803 with this conf :
Panic Soft
define ROOT C:\Program Files (x86)\nxlog
define CERTDIR %ROOT%\cert
define CONFDIR %ROOT%\conf
define LOGDIR %ROOT%\data
define LOGFILE %LOGDIR%\nxlog.log
LogFile %LOGFILE%
Moduledir %ROOT%\modules
CacheDir %ROOT%\data
Pidfile %ROOT%\data\nxlog.pid
SpoolDir %ROOT%\data
<Extension _syslog>
Module xm_syslog
</Extension>
<Input eventlog>
Module im_msvistalog
<QueryXML>
<QueryList>
<Query Id='0'>
<Select Path='Application'>*[System[(Level=1 or Level=2 or Level=3)]]</Select>
<Select Path='Security'>*[System[(Level=1)]]</Select>
<Select Path='Setup'>*[System[(Level=1 or Level=2 or Level=3)]]</Select>
<Select Path='System'>*[System[(Level=1 or Level=2 or Level=3)]]</Select>
</Query>
</QueryList>
</QueryXML>
</Input>
<Processor buffer>
Module pm_buffer
MaxSize 102400
Type disk
</Processor>
<Output out>
Module om_tcp
Host X.X.X.X
Port 514
Exec to_syslog_snare();
</Output>
<Route 1>
Path eventlog => buffer => out
</Route>
Am I missing something? Did something change recently in the syntax?
Thanks for your help.
Best regards :)
Olistra created
Parsing text for KVP
Pdudas created
Dear All!
We are trying to read the listener log of an Oracle database with Nxlog.
Sample:
<msg time='2018-12-01T23:50:08.409+01:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='server11'
host_addr='10.10.10.10'>
<txt>01-DEC-2018 23:50:08 * (CONNECT_DATA=(SID=oracle)(CID=(PROGRAM=JDBC Thin Client)(HOST=jdbc)(USER=user1$))) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.10.10.10)(PORT=54468)) * establish * db1 * 0
</txt>
</msg>
It is clear that this is a multiline message which can be read by xm-multiline, then with xm_xml it is possible to convert it to XML entries.
After the 'txt' part is available for processing I would like to capture the following info from it:
DATE=01-DEC-2018 23:50:08 (this is simple, just cut the first 20 characters.
Action=establish (this is simple, splitting the text by the '')
Target=db1 (this is simple, splitting the text by the '')
Result=0 (this is simple, splitting the text by the '*')
SID=oracle
PROGRAM=JDBC Thin Client
USER=user1$
HOST=10.10.10.10
PORT=54468
In my opinion the SID/PROGRAM/USER/HOST/PORT cannot be captured by the xm_kvp module as it is not separated by the same symbol.
What would you recommend to collect the proper info from that part of the txt?
I have not found any solution for reading the Oracle listener log - that's why it would be a big help to get your opinions!
Thank you!
Pdudas created
Generate Windows Event log entry at NXLOG start/stop
Pdudas created
Hi,
is it possible to generate event log entries to Windows Event Log at the start/stop of Nxlog?
At the moment start/stop events are in nxlog.log - for safety reasons it would make sense to add entries to Windows Event log if possible.
Thank you!
Pdudas created
Windows Server 2012 R2 - Missing nxlog.exe
gizmo83 created
I'm new to NXlog, and I'm trying to get NXlog working on a Windows Server 2012 R2 server.
I downloaded NXlog Community Edition, and amended the nxlog.conf file as I required. When trying to start the 'nxlog' service I get the following error:
"Windows could not start the nxlog service on Local Computer.
Error 2: The system cannot find the file specified."
After doing some troubleshooting I noticed the file 'C:\Program Files (x86)\nxlog\nxlog.exe' is missing. It doesn't seem to have got installed during installation.
I've had the same behaviour on two of my test servers, any ideas?
gizmo83 created
Send CSV to syslog server
joniro created
Hi. I have a script that fetches S3 logs from Amazon, unpacks them and puts them them to folder. I'm using this NXlog script below.
Problem is that NXlog doesn't start and I get following errors:
status nxlog.service
● nxlog.service - NXLog daemon
Loaded: loaded (/usr/lib/systemd/system/nxlog.service; enabled; vendor preset: disabled)
Active: activating (auto-restart) (Result: exit-code) since Sat 2018-11-24 02:44:31 EET; 2s ago
Process: 10620 ExecStartPre=/opt/nxlog/bin/nxlog -v (code=exited, status=1/FAILURE)
Nov 24 02:44:31 fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG stopping EXTENSION modules
Nov 24 02:44:31 fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG stopping module csv
Nov 24 02:44:31 fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG shutdown_modules: INPUT
Nov 24 02:44:31 -fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG shutdown_modules: PROCESSOR
Nov 24 02:44:31 -fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG shutdown_modules: OUTPUT
Nov 24 02:44:31 fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG shutdown_modules: EXTENSION
Nov 24 02:44:31 fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG no entries found, not writing configcache.dat
Nov 24 02:44:31 fetcher nxlog[10620]: 2018-11-24 02:44:31 DEBUG nxlog_shutdown() leave
Nov 24 02:44:31 fetcher systemd[1]: Unit nxlog.service entered failed state.
Nov 24 02:44:31 fetcher systemd[1]: nxlog.service failed.
2018-11-24 02:48:15 DEBUG Error in Exec block: [to_syslog_bsd();]
2018-11-24 02:48:15 ERROR [modules.c:489/nx_ctx_config_modules()] -;[module.c:1567/nx_module_parse_exec_block()] Couldn't parse Exec block at /opt/nxlog/etc/nxlog.conf:37;[expr-grammar.y:381/parser_do()] couldn't parse statement at line 37, character 21 in /opt/nxlog/etc/nxlog.conf;[expr.c:3359/nx_expr_statement_new_procedure()] procedure 'to_syslog_bsd()' does not exist or takes different arguments
2018-11-24 02:48:15 DEBUG nxlog_shutdown() enter
2018-11-24 02:48:15 DEBUG stopping INPUT modules
2018-11-24 02:48:15 DEBUG stopping module in
2018-11-24 02:48:15 DEBUG stopping PROCESSOR modules
2018-11-24 02:48:15 DEBUG stopping OUTPUT modules
2018-11-24 02:48:15 DEBUG stopping module out
2018-11-24 02:48:15 DEBUG stopping EXTENSION modules
2018-11-24 02:48:15 DEBUG stopping module csv
2018-11-24 02:48:15 DEBUG shutdown_modules: INPUT
2018-11-24 02:48:15 DEBUG shutdown_modules: PROCESSOR
2018-11-24 02:48:15 DEBUG shutdown_modules: OUTPUT
2018-11-24 02:48:15 DEBUG shutdown_modules: EXTENSION
2018-11-24 02:48:15 DEBUG no entries found, not writing configcache.dat
2018-11-24 02:48:15 DEBUG nxlog_shutdown() leave
########################################
# Global directives #
########################################
User nxlog
Group nxlog
LogFile /opt/nxlog/var/log/nxlog/nxlog.log
LogLevel debug
Moduledir /opt/nxlog/libexec/nxlog/modules/
define ROOT /opt/nxlog
CacheDir /opt/nxlog/var/log/nxlog/
Pidfile /opt/nxlog/var/log/nxlog/nxlog.pid
SpoolDir /opt/nxlog/var/log/nxlog/
########################################
# Modules #
########################################
<Extension csv>
Module xm_csv
</Extension>
<Input in>
Module im_file
File "/home/cust/*.csv"
ReadFromLast FALSE
SavePos FALSE
</Input>
<Output out>
Module om_udp
Host 10.10.10.10
Port 514
Exec to_syslog_bsd();
#Exec to_syslog_ietf();
</Output>
########################################
# Routes #
########################################
<Route 1>
Path in => out
</Route>
joniro created
Identifying Facility or local
zamarac created
Hi Team, trying to capture some log files, and get them to the right facility or local, currently I have this
<Input messages>
Module im_file
File "D:\dhcp\logs\*.log"
</Input>
Which does work but I need to get them to facility 21 and local5, any idea how to format my entry so this works?
Thanks,
zamarac created
Missing log issue when log file rotate
Chewb created
Hello,
I'm currently facing an issue with missing log when log file rotate.
Same problem as described here:
https://nxlog.co/question/3495/missing-log-when-log-file-rotate
I'm using NXLog CE 2.10.2102. I tried to upgrade to last version (2.10.2150) but still same problem.
Could you tell me if this issue has been fixed in CE edition please? If not do you have any idea when it will be fixed?
Thank you very much.
Nicolas
Chewb created
Basic Configuration from syslog flat file to IBM QRadar - Connectivity seems to work, can't tell if I'm sending data.
nhart created
We're using NX Log (CE) as a test to see if it will work for our purposes. The overall idea is to use it as a forwarder of syslog flat files to any brand of SIEM.
My config looks like this:
Panic Soft
#NoFreeOnExit TRUE
define ROOT C:\Program Files (x86)\nxlog
define CERTDIR %ROOT%\cert
define CONFDIR %ROOT%\conf
define LOGDIR %ROOT%\data
define LOGFILE %LOGDIR%\nxlog.log
LogFile %LOGFILE%
Moduledir %ROOT%\modules
CacheDir %ROOT%\data
Pidfile %ROOT%\data\nxlog.pid
SpoolDir %ROOT%\data
<Extension syslog>
Module xm_syslog
</Extension>
#<Input Alerts>
Module im_file
File 'E:\DGQradarExports\ForwarderCust\Alerts\*'
ReadFromLast True
Exec parse_syslog();
#</Input>
<Input Events>
Module im_file
File 'E:\DGQradarExports\ForwarderCust\Events\*'
ReadFromLast True
Exec parse_syslog();
</Input>
<Input Process>
Module im_file
File 'E:\DGQradarExports\ForwarderCust\Process\*'
ReadFromLast True
Exec parse_syslog();
</Input>
<Output Customer>
Module om_tcp
Host 192.168.160.141
Port 514
</Output>
<Route customer_siem>
Path Events,Process => Customer
</Route>
<Extension _charconv>
Module xm_charconv
AutodetectCharsets iso8859-2, utf-8, utf-16, utf-32
</Extension>
<Extension _exec>
Module xm_exec
</Extension>
<Extension _fileop>
Module xm_fileop
# Check the size of our log file hourly, rotate if larger than 5MB
<Schedule>
Every 1 hour
Exec if (file_exists('%LOGFILE%') and \
(file_size('%LOGFILE%') >= 5M)) \
file_cycle('%LOGFILE%', 8);
</Schedule>
# Rotate our log file every week on Sunday at midnight
<Schedule>
When @weekly
Exec if file_exists('%LOGFILE%') file_cycle('%LOGFILE%', 8);
</Schedule>
</Extension>
My log just shows this:
2018-11-19 08:50:43 INFO nxlog-ce-2.10.2102 started
2018-11-19 08:50:43 INFO connecting to 192.168.160.141:514
QRadar shows an information source has registered but no data ever flows.
I should see a 'connection was successful' message shouldn't I?
Is there any way to up the logging so I can tell if NX Log is even reading the files and attempting to send them? I really can't tell what it's doing currently.
Multiple files exist in the input directories, I'm trying to have NX Log work through all of them, send them to SIEM and then wait for more files. Config examples seem straightforward, I just can't tell what it's doing.
Any help is appreciated.
nhart created
nxlog to read log4net files for loggly
sinivenugopal created
Hi,
Would like to know whether there is an option to input the files generated by log4net and push it to loggly. The file format from log4net could be with same extension or on rolling numbers. For example, the file name could be like samplelog-10102018.txt, samplelog-10102018.txt.1, samplelog-10102018.txt.2 or
samplelog-10102018.1.txt, samplelog-10102018.2.txt, samplelog-10102018.3.txt. Tried with filename in input block (with in nxlog.conf file) as samplelog*.txt and samplelog*.txt.*, but could not get the details in loggly. How to read multiple files in a location with filenames in rotation based on dateformat.
Thanks in advance!
sinivenugopal created
NXlog Community edition - buffering to disk when using UDP
marcusfox created
Hi,
I am using the nxlog agent version 2.10.2102 to send windows logs to a server.
I know that buffering to disk is an option in the event that connectivity is interrupted.
But, can someone tell me if this is an option when using UDP?
If so how does the UDP protocol know when the connectivity is lost?
Does the NXlog agent poll the server in between bursts of UDP activity to determine when to buffer to disk ??
Or can i only use buffering when configured as sending via TCP ?
thanks guys
marcusfox created
Making changes to the MSI installer - nxlog-ce-2.10.2102.msi
marcusfox created
Hi all, can anyone tell me an easy way to make the following chnages to my MSI file before I push it out via a Group Policy
What tool can i use thats free and easy to use to edit the file to make it do the following things:
I want the service to start automatically after its been installed (currently i have to do a reboot which i want to avoid)
edit the nxlog.conf (within the MSI) file to include it as part of the installation.
Ive tried using ORCA and some others with no sucess.
thanks
marcusfox created
Windows EventData not captured
traz created
Hi,
I'm using the im_msvistalog input to grab events from the Windows security log however the important information is being ignored.
This is one my Windows events:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="AD FS Auditing" />
<EventID Qualifiers="0">411</EventID>
<Level>0</Level>
<Task>3</Task>
<Keywords>0x8090000000000000</Keywords>
<TimeCreated SystemTime="2018-11-06T09:22:29.086191400Z" />
<EventRecordID>85712874</EventRecordID>
<Channel>Security</Channel>
<Computer>server1</Computer>
<Security UserID="S-8-8-88-8888-8888-8888-8888" />
</System>
<EventData>
<Data>00000000-0000-0000-0000-000000000000</Data>
<Data>http://schemas.microsoft.com/ws/2006/05/identitymodel/tokens/UserName</Data>
<Data>user1@domain.com</Data>
<Data>System.IdentityModel.Tokens.SecurityTokenValidationException: user1@domain.com at Microsoft.IdentityServer.Service.Tokens.MSISWindowsUserNameSecurityTokenHandler.ValidateToken(SecurityToken token)</Data>
<Data>8.8.8.8</Data>
</EventData>
<RenderingInfo Culture="en-US">
<Message>Token validation failed. See inner exception for more details. Additional Data Activity ID: 00000000-0000-0000-0000-000000000000 Token Type: http://schemas.microsoft.com/ws/2006/05/identitymodel/tokens/UserName Client IP: 8.8.8.8 Error message: user1@domain.com Exception details: System.IdentityModel.Tokens.SecurityTokenValidationException: user1@domain.com at Microsoft.IdentityServer.Service.Tokens.MSISWindowsUserNameSecurityTokenHandler.ValidateToken(SecurityToken token)</Message>
<Level>Information</Level>
<Task />
<Opcode>Info</Opcode>
<Channel />
<Provider />
<Keywords><Keyword>Audit Failure</Keyword><Keyword>Classic</Keyword>
</Keywords>
</RenderingInfo>
</Event>
As you can see, the relevant information is between EventData and Message tags. But this information does not appear in the output message:
{"EventTime":"2018-11-06 09:22:29"
,"Hostname":"server1"
,"Keywords":-9182839640208441344
,"EventType":"AUDIT_FAILURE"
,"SeverityValue":4
,"Severity":"ERROR"
,"EventID":411
,"SourceName":"AD FS Auditing"
,"Task":3
,"RecordNumber":85712874
,"ProcessID":0
,"ThreadID":0
,"Channel":"Security"
,"Domain":"domain.com"
,"AccountName":"service1"
,"AccountType":"User"
,"EventReceivedTime":"2018-11-06 09:22:31"
,"SourceModuleName":"eventlog"
,"SourceModuleType":"im_msvistalog"
}
This is my nxlog config:
<Input eventlog>
Module im_msvistalog
Channel ForwardedEvents
Exec $Message = to_json();
</Input>
<Output graylog>
Module om_tcp
Host graylog.server.com
Port 1111
OutputType GELF_TCP
</Output>
<Route 1>
Path eventlog => graylog
</Route>
According to the docs, Data between EvenData tags is automatically extracted if it is named, but it isn't in my case. Can data be extracted manually somehow?
I'm running nxlog CE 2.9. Thanks
traz created
NXlog sends the same logs after PC reboot
Alexander created
Hi!
I have an issue with NXlog CE 2.10.2102.
I noticed that nxlog send the same log many times on some PCs. This happends when the PC reboot. I found that the file "configcache.dat" is not always overwritten.
How to avoid this issue?
Here is a part of my conf
<Processor in_win_eventlog_buffer_disk>
Module pm_buffer
MaxSize 61440
Type Disk
WarnLimit 49152
</Processor>
<Input in_win_eventlog>
Module im_msvistalog
SavePos TRUE
Query \
<QueryList> \
<Query Id="0"> \
<Select Path="Security">*</Select> \
<Select Path="Microsoft-Windows-Sysmon/Operational">*</Select> \
<Select Path="Microsoft-Windows-PrintService/Operational">*</Select> \
</Query> \
</QueryList>
<Exec>
if $EventID>=5151 and $EventID<=5159 drop();
if $EventID==4688 or $EventID==4689 drop();
if ($Channel == 'Security') $_ds = 'win-security';
else if ($Channel == 'Microsoft-Windows-Sysmon/Operational') {
$_ds = 'win-sysmon';
delete($UserID);
delete($AccountName);
}
else {
$_ds = 'win-customapps';
delete($UserID);
delete($AccountName);
}
$_fmt = 'json';
$_conv_to_json = TRUE;
</exec>
</Input>
<Route r_win_eventlog>
Path in_win_eventlog => in_win_eventlog_buffer_disk => out_logs_pref
</Route>
Alexander created
why is nxlog getting access denied error code 5 error
mailer935 created
Im not sure why im get this access denied in the nxlog logs
2018-11-01 10:17:45 ERROR failed to subscribe to msvistalog events,access denied [error code: 5]; Access is denied.
Im using nxlog EE v4 on windows 2012 server and it is run as default system user
Any suggestions where to look in the windows configuration or nxlog configuration itself ?
mailer935 created
nxlog in Amazon Linux AMI
andy_cognizant created
Hi Team,
Do anyone know what nxlog file should be installed on Amazon Linux AMI?
I was going through the below forum and it's pretty confusing:
https://forums.aws.amazon.com/thread.jspa?threadID=51647
Any help would be appreciated.
andy_cognizant created
WARNING input file does not exist
tlam.nt created
I was trying to read the DNS log file but was given an error of "WARNING input file does not exist", and it also depends on the directory that the file was in, here were the results. It appears that Windows was restricting the read permissions based on the residing (system?) directories, any idea?
On one server:
C:\Windows\System32\dns\dns.txt - Error
C:\dns.txt - No error
C:\Windows\Temp\dns.txt - No error
On a different server:
It produced error regardless which directory the log file is in.
====
nxlog.conf snip below:
define DNSLOGFILE 'c:\Windows\System32\dns\dns.txt'
<Input dnslog>
Module im_file
File %DNSLOGFILE%
InputType LineBased
SavePos TRUE
ReadFromLast TRUE
...
</Input>
====
Note, I have already turned on Loglevel DEBUG, which shows the file was blacklist'ed for retry, but only after it failed to read the file. I have also already read this thread (https://nxlog.co/question/920/input-file-does-not-exist) which was close but did not resolve my issue.
Thanks in advance.
tlam.nt created
nxlog dropping UDP packets
manoj.muthukumaran created
This is less a question and more of an observation.
I am currently running nxlog 4.1.4016 on Ubuntu 18.04.1 LTS in a vmware environment. Say I boot the VM up and the nxlog service kicks off correctly and works as intended ultimately writing to a network share that I have mounted. If I do a "sudo systemctl restart nxlog.service" or even "./nxlog -r" in order to reload nxlog with a slightly modified config file, UDP packet receive errors and UDP receive buffer errors start climbing from 0 like crazy (netstat -suna). A reboot of the VM from this state does not even fix the issue, the errors immediately appear. In order to fix the issue, I had to purge the nxlog install and do a reinstall in order to prevent any further issues. My config consists of listening for UDP on 2 ports, going through a memory buffer, and writing to the mounted share.
manoj.muthukumaran created
Cache on disk works not good
hatula created
Hi everybody,
To protect the logs from loss, I turned on the recommended settings in client's config:
PersistLogqueue TRUE
SyncLogqueue TRUE
CacheFlushInterval always
CacheSync TRUE
But now I see that parts of log are duplicated much more often than before these setting was enabled.
Why cache in memory works better? In case with cache on disk I hope to see best result.
Thank you so much!
hatula created
Windows server 2003 ERROR im_msvistalog.dll
Shelock created
Hello all,
I am having an issue that I believe is specific to the Windows Server 2003 R2 systems I am trying to install Nxlog CE on. I am getting the following error from the nxlog.log file.
ERROR Failed to load module from C:\Program Files\nxlog\modules\input\im_msvistalog.dll, The specified module could not be found. ; The specified module could not be found
Because its a 32bit OS we installed nxlog in C:\Program Files. I checked and the file im_msvistalog.dll is indeed where it is supposed to be. This error has occurred on most but not all 32bit Windows Server 2003 R2. Any help you can give me would be greatly appreciated.
Thanks
S
Shelock created