3
responses

Hello everybody,

I'm trying to collect Doubletake logs from a Centos 6.x server. I have that kind of logs ;

01/31/2016  21:15:26.000000 25786 140456885212928     48  2          0  Ops Skipped:        308390
01/31/2016  21:15:26.000000 25786 140456885212928     49  2          0  Total Mirror Ops:   321057
01/31/2016  21:15:26.000000 25786 140456885212928     50  2          0  Elapsed Time:          2318 seconds
01/31/2016  21:15:26.000000 25786 140456885212928     51  2          0  Paused Time:          0 seconds
01/31/2016  21:15:26.000000 25786 140456885212928     52  2          0  Total number of pauses:          0
01/31/2016  21:44:31.000000 25786 140456771974912     53  2         77  Connection lost with IP address ip://127.0.0.1 : 1501
01/31/2016  21:44:32.000000 25786 140457057756928     54  2     700000  Server Monitor was successfully stopped
01/31/2016  21:44:32.000000 25786 140457057756928     55  2      51503  Source module Stopped
01/31/2016  21:44:32.000000 25786 140457057756928     56  2      52503  Stopping all targets
01/31/2016  21:44:32.000000 25786 140457057756928     57  2      52503  Target module Stopped
00/00/0000  00:00:00.0000 Start of logfile 
00/00/0000  00:00:00.0000 Application starting
01/31/2016  21:44:44.000000  9976 139690482448128      1  2          0  Buffer allocator limit is: 67108864 bytes
01/31/2016  21:44:44.000000  9976 139690482448128      2  2          0  QMemoryBufferMax size is: 268435456 bytes
01/31/2016  21:44:45.000000  9976 139690482448128      3  2          0  ActivationCode is valid: "6uvb-kyqa-tgar-wpeu-0t52-ubuv".
01/31/2016  21:44:45.000000  9976 139690482448128      4  2          0  Source Failover is allowed
01/31/2016  21:44:45.000000  9976 139690482448128      5  2          0  Target Failover is allowed
01/31/2016  21:44:45.000000  9976 139690482448128      6  2          0  Source Full Server Failover is allowed
01/31/2016  21:44:45.000000  9976 139690482448128      7  2          0  Target Full Server Failover is allowed
01/31/2016  21:44:45.000000  9976 139690482448128      8  2          0  Source Replication is allowed
01/31/2016  21:44:45.000000  9976 139690482448128      9  2          0  Target Replication is allowed
01/31/2016  21:44:45.000000  9976 139690482448128     10  2          0  Heartbeat Transmission started on port 1500 (interval=3seconds)
01/31/2016  21:44:48.000000  9976 139690482448128     11  2         69  Kernel Started on bl-db01.marsathletic.com  ip://10.10.100.75 : 1500  Version: 7.1.1.1255.0
01/31/2016  21:44:48.000000  9976 139690482448128     12  2     504002  Double-Take has successfully found /dev/dtrep0
01/31/2016  21:44:48.000000  9976 139690482448128     13  2      52501  Target module loaded successfully
01/31/2016  21:44:48.000000  9976 139690482448128     14  2          0  Disabling all replication from the driver
01/31/2016  21:44:48.000000  9976 139690482448128     15  2          0  Returning default addr: 10.10.100.75 : 1500
01/31/2016  21:44:48.000000  9976 139690482448128     16  2         71  Originator Attempting ip://10.10.150.10 : 1500
01/31/2016  21:44:48.000000  9976 139689629570816     17  2         73  Connected to  IP address ip://10.10.150.10 : 1500
01/31/2016  21:44:48.000000  9976 139690413819648     18  2         75  Connection resumed with IP address ip://10.10.150.10 : 1500
01/31/2016  21:44:48.000000  9976 139690482448128     19  2         80  Auto-reconnecting Lvra_0d341950-6cba-412c-834d-8afa3426cc83 to ip://10.10.150.10 : 1500::/var/lib/mysql/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/var/lib/mysql/;/boot/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/boot/;/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/;
01/31/2016  21:44:48.000000  9976 139690482448128     20  2        800  Transmission manually resumed by client
01/31/2016  21:44:48.000000  9976 139690482448128     21  2          0  Returning default addr: 10.10.100.75 : 1500
01/31/2016  21:44:48.000000  9976 139690482448128     22  2         87  Starting replication of set Lvra_0d341950-6cba-412c-834d-8afa3426cc83 for connection 1
01/31/2016  21:44:48.000000  9976 139690482448128     23  2          0  Activating replication on /
01/31/2016  21:44:48.000000  9976 139690482448128     24  2          0  Activating replication on /boot
01/31/2016  21:44:48.000000  9976 139690482448128     25  2          0  Activating replication on /var/lib/mysql
01/31/2016  21:44:48.000000  9976 139690482448128     26  2          0  Disabling replication on /var/log/DT
01/31/2016  21:44:48.000000  9976 139690482448128     27  2          0  Disabling replication on /var/cache/DT
01/31/2016  21:44:48.000000  9976 139690482448128     28  2     500000  Starting a connection for a Linux Virtual Recovery job.
01/31/2016  21:44:48.000000  9976 139690482448128     29  2     500000  Lvra_0d341950-6cba-412c-834d-8afa3426cc83 is connected to ip://10.10.150.10 : 1500::/var/lib/mysql/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/var/lib/mysql/;/boot/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/boot/;/ -> /opt/dbtk/mnt/.job-0d341950-6cba-412c-834d-8afa3426cc83/; using compression level 1 (1)
01/31/2016  21:44:48.000000  9976 139690482448128     30  2     500000  Auto-Reconnect success. ConID = 1
01/31/2016  21:44:48.000000  9976 139690482448128     31  2      51501  Source module loaded successfully
01/31/2016  21:44:48.000000  9976 139690482448128     32  2          0  Detected RedHat configuration for failover persistence.
01/31/2016  21:44:53.000000  9976 139690311149312     33  2         72  Connection request from IP address 10.10.150.10
01/31/2016  21:44:53.000000  9976 139690311149312     34  2      99001  Telling peer IP: ip://10.10.150.10 : 1500 that conditions are OK to proceed.
01/31/2016  21:45:01.000000  9976 139690269189888     35  2        800  Local connection accepted, spinning up new local listen thread
01/31/2016  21:45:01.000000  9976 139690269189888     36  2         72  Responding to request from IP address 127.0.0.1 : 1502 using 127.0.0.1 : 1501
01/31/2016  21:45:01.000000  9976 139690269189888     37  2     600002  User :lms: has FULL access (2)
01/31/2016  21:45:04.000000  9976 139689361135360     38  2          0  Repset contains 41751738977 byte(s) to mirror
01/31/2016  21:45:04.000000  9976 139689361135360     39  2          0  Repset requires 324078 ops to mirror
01/31/2016  21:45:04.000000  9976 139689361135360     40  2         94  Delete Orphans Started <1>
01/31/2016  21:45:04.000000  9976 139689361135360     41  2         89  Mirror Started, Differences, Block Checksum <1>

Nxlog is able to send the logs to Graylog via GELF UDP but I cant display the complete line on Graylog.

All I can see is a cutted piece of line like ;

01/31/2016  21:15:26.000000 25786 140456885212928

I cant display more than this.

I will be very happy if somebody can help to solve this.

Thank you.

Mehmet

 

Here is my nxlog.conf


########################################
# Global directives                    #
########################################
User root
Group nxlog

LogFile /var/log/nxlog/nxlog.log
LogLevel INFO

########################################
# Modules                              #
########################################

<Extension gelf>
    Module      xm_gelf
</Extension>

<Input Doubletake>
    Module      im_file
    File        "/tmp/2.log"
    SavePos     TRUE
</Input>

<Output graylog_out>
    Module      om_udp
    Host        192.168.2.94
    Port        12201
    OutputType  GELF
</Output>

########################################
# Routes                               #
########################################
<Route 1>
    Path        Doubletake => graylog_out
</Route>


 

AskedJanuary 31, 2016 - 9:08pm

Answer (1)

This could be possibly set with the ShortMessageLength configuration directive.

Otherwise ask the Graylog folks as this is not the proper forum for that.

Comments (2)

  • mbuyukkarakas's picture

    I counted number of chars. It's exactly 64. So it seems so suspectfull. I will try the ShortMessageLenght immeditately and tell you about the result.

    Thank you su much.

    Mehmet