NXlog GELF Udp is cutting my Doubletake logs
Hello everybody,
I'm trying to collect Doubletake logs from a Centos 6.x server. I have that kind of logs ;
01/31/2016 21:15:26.000000 25786 140456885212928 48 2 0 Ops Skipped: 308390
01/31/2016 21:15:26.000000 25786 140456885212928 49 2 0 Total Mirror Ops: 321057
01/31/2016 21:15:26.000000 25786 140456885212928 50 2 0 Elapsed Time: 2318 seconds
01/31/2016 21:15:26.000000 25786 140456885212928 51 2 0 Paused Time: 0 seconds
01/31/2016 21:15:26.000000 25786 140456885212928 52 2 0 Total number of pauses: 0
01/31/2016 21:44:31.000000 25786 140456771974912 53 2 77 Connection lost with IP address ip://127.0.0.1 : 1501
01/31/2016 21:44:32.000000 25786 140457057756928 54 2 700000 Server Monitor was successfully stopped
01/31/2016 21:44:32.000000 25786 140457057756928 55 2 51503 Source module Stopped
01/31/2016 21:44:32.000000 25786 140457057756928 56 2 52503 Stopping all targets
01/31/2016 21:44:32.000000 25786 140457057756928 57 2 52503 Target module Stopped
00/00/0000 00:00:00.0000 Start of logfile
00/00/0000 00:00:00.0000 Application starting
01/31/2016 21:44:44.000000 9976 139690482448128 1 2 0 Buffer allocator limit is: 67108864 bytes
01/31/2016 21:44:44.000000 9976 139690482448128 2 2 0 QMemoryBufferMax size is: 268435456 bytes
01/31/2016 21:44:45.000000 9976 139690482448128 3 2 0 ActivationCode is valid: "6uvb-kyqa-tgar-wpeu-0t52-ubuv".
01/31/2016 21:44:45.000000 9976 139690482448128 4 2 0 Source Failover is allowed
01/31/2016 21:44:45.000000 9976 139690482448128 5 2 0 Target Failover is allowed
01/31/2016 21:44:45.000000 9976 139690482448128 6 2 0 Source Full Server Failover is allowed
01/31/2016 21:44:45.000000 9976 139690482448128 7 2 0 Target Full Server Failover is allowed
01/31/2016 21:44:45.000000 9976 139690482448128 8 2 0 Source Replication is allowed
01/31/2016 21:44:45.000000 9976 139690482448128 9 2 0 Target Replication is allowed
01/31/2016 21:44:45.000000 9976 139690482448128 10 2 0 Heartbeat Transmission started on port 1500 (interval=3seconds)
01/31/2016 21:44:48.000000 9976 139690482448128 11 2 69 Kernel Started on bl-db01.marsathletic.com ip://10.10.100.75 : 1500 Version: 7.1.1.1255.0
01/31/2016 21:44:48.000000 9976 139690482448128 12 2 504002 Double-Take has successfully found /dev/dtrep0
01/31/2016 21:44:48.000000 9976 139690482448128 13 2 52501 Target module loaded successfully
01/31/2016 21:44:48.000000 9976 139690482448128 14 2 0 Disabling all replication from the driver
01/31/2016 21:44:48.000000 9976 139690482448128 15 2 0 Returning default addr: 10.10.100.75 : 1500
01/31/2016 21:44:48.000000 9976 139690482448128 16 2 71 Originator Attempting ip://10.10.150.10 : 1500
01/31/2016 21:44:48.000000 9976 139689629570816 17 2 73 Connected to IP address ip://10.10.150.10 : 1500
01/31/2016 21:44:48.000000 9976 139690413819648 18 2 75 Connection resumed with IP address ip://10.10.150.10 : 1500
01/31/2016 21:44:48.000000 9976 139690482448128 19 2 80 Auto-reconnecting Lvra_0d341950-6cba-412c-834d-8afa3426cc83 to ip://10.10.150.10 : 1500::/var/lib/mysql/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/var/lib/mysql/;/boot/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/boot/;/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/;
01/31/2016 21:44:48.000000 9976 139690482448128 20 2 800 Transmission manually resumed by client
01/31/2016 21:44:48.000000 9976 139690482448128 21 2 0 Returning default addr: 10.10.100.75 : 1500
01/31/2016 21:44:48.000000 9976 139690482448128 22 2 87 Starting replication of set Lvra_0d341950-6cba-412c-834d-8afa3426cc83 for connection 1
01/31/2016 21:44:48.000000 9976 139690482448128 23 2 0 Activating replication on /
01/31/2016 21:44:48.000000 9976 139690482448128 24 2 0 Activating replication on /boot
01/31/2016 21:44:48.000000 9976 139690482448128 25 2 0 Activating replication on /var/lib/mysql
01/31/2016 21:44:48.000000 9976 139690482448128 26 2 0 Disabling replication on /var/log/DT
01/31/2016 21:44:48.000000 9976 139690482448128 27 2 0 Disabling replication on /var/cache/DT
01/31/2016 21:44:48.000000 9976 139690482448128 28 2 500000 Starting a connection for a Linux Virtual Recovery job.
01/31/2016 21:44:48.000000 9976 139690482448128 29 2 500000 Lvra_0d341950-6cba-412c-834d-8afa3426cc83 is connected to ip://10.10.150.10 : 1500::/var/lib/mysql/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/var/lib/mysql/;/boot/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/boot/;/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/; using compression level 1 (1)
01/31/2016 21:44:48.000000 9976 139690482448128 30 2 500000 Auto-Reconnect success. ConID = 1
01/31/2016 21:44:48.000000 9976 139690482448128 31 2 51501 Source module loaded successfully
01/31/2016 21:44:48.000000 9976 139690482448128 32 2 0 Detected RedHat configuration for failover persistence.
01/31/2016 21:44:53.000000 9976 139690311149312 33 2 72 Connection request from IP address 10.10.150.10
01/31/2016 21:44:53.000000 9976 139690311149312 34 2 99001 Telling peer IP: ip://10.10.150.10 : 1500 that conditions are OK to proceed.
01/31/2016 21:45:01.000000 9976 139690269189888 35 2 800 Local connection accepted, spinning up new local listen thread
01/31/2016 21:45:01.000000 9976 139690269189888 36 2 72 Responding to request from IP address 127.0.0.1 : 1502 using 127.0.0.1 : 1501
01/31/2016 21:45:01.000000 9976 139690269189888 37 2 600002 User :lms: has FULL access (2)
01/31/2016 21:45:04.000000 9976 139689361135360 38 2 0 Repset contains 41751738977 byte(s) to mirror
01/31/2016 21:45:04.000000 9976 139689361135360 39 2 0 Repset requires 324078 ops to mirror
01/31/2016 21:45:04.000000 9976 139689361135360 40 2 94 Delete Orphans Started <1>
01/31/2016 21:45:04.000000 9976 139689361135360 41 2 89 Mirror Started, Differences, Block Checksum <1>
Nxlog is able to send the logs to Graylog via GELF UDP but I cant display the complete line on Graylog.
All I can see is a cutted piece of line like ;
01/31/2016 21:15:26.000000 25786 140456885212928
I cant display more than this.
I will be very happy if somebody can help to solve this.
Thank you.
Mehmet
Here is my nxlog.conf
########################################
# Global directives #
########################################
User root
Group nxlog
LogFile /var/log/nxlog/nxlog.log
LogLevel INFO
########################################
# Modules #
########################################
<Extension gelf>
Module xm_gelf
</Extension>
<Input Doubletake>
Module im_file
File "/tmp/2.log"
SavePos TRUE
</Input>
<Output graylog_out>
Module om_udp
Host 192.168.2.94
Port 12201
OutputType GELF
</Output>
########################################
# Routes #
########################################
<Route 1>
Path Doubletake => graylog_out
</Route>
This could be possibly set with the ShortMessageLength configuration directive.
Otherwise ask the Graylog folks as this is not the proper forum for that.