Ask questions. Get answers. Find technical product solutions from passionate experts in the NXLog community.
Own module compilation failed at configure
Tuxizm created
Hello
I don't know way to compile my input module for Oracle - need some guidance for it. I guess autogen.sh (using autotools) is designated to generate makefiles etc and configure.
I made Makefile.am based on im_dbi version:
if HAVE_LIBOCI
im_oci_LTLIBRARIES = im_oci.la
im_oci_la_SOURCES = im_oci.c im_oci.h
im_oci_la_CFLAGS = -rdynamic -D_XOPEN_SOURCE -std=c99
im_oci_la_LDFLAGS = -module -no-undefined -avoid-version -ldl
im_oci_la_LIBADD = $(LIBOCI) $(LIBNX)
im_ocidir = $(NX_MODULEDIR)/input
endif
When I call configure or autogen.sh it gives error:
./configure: line 21597: syntax error: unexpected end of file
but last lines are:
21590: #echo ----------------------------------------------------------
21591: #echo Shared: ${BUILD_SHARED_LIBS}
21592: #echo ----------------------------------------------------------
21593: echo
21594: echo "${PACKAGE}-${NXLOG_VERSION_STRING} configured successfully"
21595: echo "type \`${MAKE-make}' and \`${MAKE-make} install'"
21596: echo
21597: echo
21598:
I don't see error here. I just placed my module in modules/input folder Should I generate some files with autotools?
Tuxizm created
Graylog Level Invalid [-1]
gsevestre created
Hi guys,
I need help about NXlog with graylog, on my 2008 server my nxlog send correctly log to my graylog server but i cant see lvl and facility off all logs :-(. like :
facility : Unknown and level Invalid [-1]
plz see my nxlog config :
<Extension gelf>
Module xm_gelf
</Extension>
<Extension syslog>
Module xm_syslog
</Extension>
<Input eventlog>
Module im_msvistalog
# this kinda works for me, put * to get everything
Query <QueryList>\
<Query Id="0">\
<Select Path='Application'>*[Application/Level=2][Application/Level=3][Application/Level=1]</Select>\
<Select Path='System'>*[system/Level=2][system/Level=3][system/Level=1]</Select>\
<Select Path='Security'>*</Select>\
<Select Path='Setup'>*</Select>\
</Query>\
</QueryList>
</Input>
<Output out>
Module om_udp
Host 10.0.0.202
Port 9000
</Output>
<Route 1>
Path eventlog => out
</Route>
btw i tried to use GELF out type but all messages in graylog was ���������������
hope u will help me
Regards,
Gael
gsevestre created
Output buffering
tsigidibam created
I am using om_tcp for forwarding Windows logs to a SIEM system. What will be the expected behavior of nxlog if e.g. a firewall blocks the TCP connections from the nxlog agent to the SIEM? Is there any potential danger in nxlog buffering outgoing logs so that large amounts of memory or disk space would be consumed on the sending host while the connections get blocked?
tsigidibam created
ASSERTION FAILED
vyilmaz created
I got the error below, after a while that i begin to run the nxlog service. I use mysql database, tried postgresql as well and have the same error message. Has anyone idea how I can fix it?
>>ERROR ### ASSERTION FAILED at line 205 in om_dbi.c/om_dbi_get_sql(): "len > j"
vyilmaz created
Typo in syslog.c prevents correct UTF8 BOM processing
vadimevf created
This can be seen in nxlog-ce-2.8.1248 distribution, syslog.c, line 1094
if ( (ptr[0] == 0xEF) && (ptr[0] == 0xBB) && (ptr[0] == 0xBF) )
should be
if ( (ptr[0] == 0xEF) && (ptr[1] == 0xBB) && (ptr[2] == 0xBF) )
Please, fix this.
vadimevf created
nxlog to message queue
akumar created
Is there any roadmap for natively including an output module to a message queue service such as Redis, 0mq etc?
Alternatively how can I write out to a queue using om_http?
Thanks
Ash
akumar created
Losing networking connectivity results in nxlog service failing to connect with loggly.com and never attempting to reconnect
kashdash7651 created
NxLog does not reconnect to the server once a connection is restored after a network disconnect event.
Simple step to repro - Simply unplugging the ethernet cable from the back of the PC while nxlog is attempting to send data to loggly. The error happens almost instantly after the cable is unplugged. Below is the error message
2015-05-11 13:49:56 ERROR couldn't connect to tcp socket on logs-01.loggly.com:443; A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
BTW - I am using NxLog Community Edition. Is this a known issue? I dont expect such a simple feature to not work in a community edition. It should automatically reconnect
kashdash7651 created
NXlog Community Edition on Windows - change installation path ?
emve created
Hi,
Is it possible to change NXlog Community Edition installation path on Windows platform ?
(default installation path is :C:\Program Files\nxlog or C:\Program Files (x86)\nxlog ).
I want to install it to C:\nxlog for example.
Thank you,
emve created
Some log messages got processed twice by nxlog when the log file is rotated
Jerry created
Hi,
I setup nxlog to process log file. Each log file got rotated by application hourly. The original log file will rename to the same file name postfixed by timestamp, and the log messages will continue written to the new log file with the same name.
I found that some of the log messages logged at the last minute or two of an hour are processed more than one time by NXLOG. Does anyone have any idea what went wrong?
regards,
Jerry
Here is my nxlog conf:
<Input in2>
Module im_file
File "/nfs/home/jerryc/domains/smp_demo/nodes/torvm-core14/log/samp-*_svr2*"
SavePos TRUE
ReadFromLast TRUE
Jerry created
Is there a citrix module?
ghostisic created
Is there a citrix module that can import logs from citrix servers?
I'd like to log the following:
Authentication
Apps launched
User Activity
Directories accessed
Thanks
-G
ghostisic created
Need Azure Table Storage output module
igorgatis created
How to use NXLog to store logs in Azure Table Storage? Is there a om_azure_table_storage module out there?
igorgatis created
nxlog bug
aurora created
From time to time on certain Windows servers nslog resends old events. The logs also there is an error "EvtNext failed with error 1717: The interface is unknown"
How to fix that ?
aurora created
can a nxlog.conf reference other nxlog.conf files>>>please assist.
idigwww created
Hi,
Please advise...Thanks!
is it possible to have an nxlog.conf that references other nxlog.conf files. For example, If I have
iis.conf
msevent.conf
log4net.conf
could I have an nxlog.conf that imports them in a componentized or modular format
nxlog.conf would look something like:
import iis.conf
import msevent.conf
import log4net.conf
I am trying to handle many different roles for servers at a big company.. Some servers just have log4net logs we want, other servers we just want iis logs from and others iis logs and msevent logs..
There are lots of combinations.
I am looking for an easy way handle all the server roles....web server, app server, DB server etc. Each server type is going have different
sets of logs processed and sent. Nxlog is awesome...keep up the great work. Thanks!
Best Regards,
Daniel
idigwww created
im_odbc ConnectionString question
ghostcat created
Hello,
I am attempting to use the im_odbc module to gather table data from mssql into nagios log server.
conf snippet
<Input in>
Module im_odbc
ConnectionString DSN=mysql://USERNAME:PASSWORD@IPADDRESS:PORT;database=DATABASENAME;
SQL Select RecordNumber as id, DateOccured as EventTime, data as Message from logtable WHERE RecordNumber > ?
SavePos TRUE
</Input>
<Output out>
Module om_tcp
Host IPADDRESS
Port 1337
OutputType Binary
</Output>
<Route 1>
Path in => out
</Route>
Error
ERROR im_odbc couldn't connect to the database, IM010:1:0:[Microsoft][ODBC Driver Manager] Data source name too long
Please Help!
Thanks
GC.
ghostcat created
IMDBI Setting configuration at load time and at use time
Tuxizm created
Hello
I was wondering if it is possible to have multiple instances of im_dbi at one time. It is important for access to my global variables. If it is possibe, then my question is: does NXLog make nx_im_dbi_conf_t for each module instance? Where I should store variables for module if I want to have per load visibility?
Tuxizm created
UNC Paths in im_file
akumar created
Not sure it can be achieved but wanted to check as to what was the best way to use UNC names in the File path.
I want to stage files locally from a remote location, digest and then delete the files.
I have tried "//FileServer/directory/file as well as "\\FileServer/directory/file" without success.
Is it possible to use a variation of im_exec such as
<Input mapdrive>
Module im_file
command net
arg use
arg z:
arg "\\fileserver\directory" ....etc?
Thanks
Ash
akumar created
Latest CE version for Windows?
LBOmar created
I believe the latest version of the windows ce msi is not available to download.
In the following forum post it was mentioned that version nxlog-ce-2.9.1362 is out:
http://nxlog.org/support-tickets/nxlog-crashing-windows-2012r2
I can't find that version for download via http://nxlog.org/products/nxlog-community-edition/download ? Please advised.
LBOmar created
nxlog v2.9.1357 windows always says keyword else invalid.
yoke88 created
2015-04-29 20:32:46 INFO nxlog-ce-2.9.1347 started
2015-04-29 21:08:14 WARNING stopping nxlog service
2015-04-29 21:08:14 WARNING nxlog-ce received a termination request signal, exiting...
2015-04-29 21:08:15 ERROR invalid keyword: else at C:\Program Files (x86)\nxlog\conf\nxlog.conf:60
2015-04-29 21:08:15 ERROR module 'in' has configuration errors, not adding to route '2' at C:\Program Files (x86)\nxlog\conf\nxlog.conf:89
2015-04-29 21:08:15 WARNING not starting unused module in
2015-04-29 21:08:15 INFO connecting to 172.18.1.11:5142
2015-04-29 21:08:15 INFO nxlog-ce-2.9.1347 started
2015-04-29 21:08:15 ERROR if-else failed at line 77, character 234 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; procedure 'parse_csv' failed at line 77, character 80 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; Not enough fields in CSV input, expected 17, got 1 in input ' #Software: Microsoft Exchange Server'
Here is my conf file
#define ROOT C:\Program Files\nxlog
define ROOT C:\Program Files (x86)\nxlog
define IGNORE_COMMENT if $raw_event =~ /^#/ drop();
define BASEDIR C:\Program Files\Microsoft\Exchange Server\V14\TransportRoles\Logs\MessageTracking
define AgentLog_dir C:\Program Files\Microsoft\Exchange Server\V14\TransportRoles\Logs\AgentLog
Moduledir %ROOT%\modules
CacheDir %ROOT%\data
Pidfile %ROOT%\data\nxlog.pid
SpoolDir %ROOT%\data
LogFile %ROOT%\data\nxlog.log
#LogLevel DEBUG
<Extension _syslog>
Module xm_syslog
</Extension>
<Extension _json>
Module xm_json
</Extension>
<Extension ExAgentLog>
Module xm_csv
Fields $Timestamp,$SessionId,$LocalEndpoint,$RemoteEndpoint,$EnteredOrgFromIP,$MessageId,$P1FromAddress,$P2FromAddresses,$Recipient,$NumRecipients,$Agent,$Event,$Action,$SmtpResponse,$Reason,$ReasonData,$Diagnostics
FieldTypes String,String,String,String,String,String,String,String,String,Integer,String,String,String,String,String,String,String
Delimiter ,
</Extension>
<Extension ExMSGTRK>
Module xm_csv
Fields $date-time,$client-ip,$client-hostname,$server-ip,$server-hostname,$source-context,$connector-id,$source,$event-id,$internal-message-id,$message-id,$recipient-address,$recipient-status,$total-bytes,$recipient-count,$related-recipient-address,$reference,$message-subject,$sender-address,$return-path,$message-info,$directionality,$tenant-id,$original-client-ip,$original-server-ip,$custom-data
FieldTypes String,String,String,String,String,String,String,String,String,String,String,String,String,Integer,Integer,String,String,String,String,String,String,String,String,String,String,String
Delimiter ,
</Extension>
<Extension charconv>
Module xm_charconv
AutodetectCharsets utf-8,UNICODE,utf-16, utf-32, iso8859-2
</Extension>
<Input in>
Module im_file
File '%BASEDIR%\MSGTRK????????*-*.LOG'
ReadFromLast FALSE
Exec if $raw_event =~ /^#/ drop();\
else \
{ \
ExMSGTRK->parse_csv();\
delete($SourceModuleName);\
delete($SourceModuleType);\
delete($EventReceivedTime);\
$SourceName="Message Tracking Log"; \
to_json();\
}
</Input>
<Input in2>
Module im_file
ReadFromLast FALSE
File '%AgentLog_dir%\AgentLog*.LOG'
EXEC if $raw_event =~ /^#/ drop();\
else \
{\
ExAgentLog->parse_csv(); \
delete($SourceModuleName); \
delete($SourceModuleType); \
delete($EventReceivedTime); \
$SourceName="Agent Log"; \
to_json(); \
}
</Input>
<Output out2>
Module om_tcp
Host 172.18.1.11
Port 5142
</Output>
<Route 2>
Path in,in2 => out2
</Route>
yoke88 created
nxlog v2.9.1357 windows read utf-8 file got error '锘?‘ error (UTF-8 BOM)
yoke88 created
2015-04-29 10:12:10 ERROR procedure 'parse_csv' failed at line 50, character 24 in C:\Program Files (x86)\nxlog\conf\nxlog.conf. statement execution has been aborted; Couldn't parse datetime value: '锘?Software: Microsoft Exchange Server'
see http://stackoverflow.com/questions/2223882/whats-different-between-utf-8-and-utf-8-without-bom
yoke88 created
Shipping logs from nxLog to Logstash
kamishiro created
Hi,
I was wondering if it is possible to ship MS Event logs from nxlog to Logstash directly without writing to disk first.
kamishiro created