How to fetch logs recursively, when the files may have a number of different file extensions?

Post a different question
5
responses

I traverse /var/log/myAPPLICATION* like shown below to harvest everything below in the folder structure, which has .log as extension. The challenge is now: What if there are occurences of logfiles that have e.g. .txt extension? Is it possible to use some conditional to that File line in the Input directive? Something like

File "/var/log/myAPPLICATION/*.[log|txt]"

<Input appLogs>
        Module                im_file
        File                        "/var/log/myAPPLICATION/*.log"
        Recursive            True
        SavePos               True
        ReadFromLast    True
        Exec                  to_syslog_ietf();
</Input>
AskedOctober 8, 2020 - 12:11pm

Answer (1)

You could create several File lines:

<Input in>
    Module       im_file
    File         '/var/log/*.log'
    File         '/var/log/*.txt'
AnsweredOctober 8, 2020 - 1:03pm

Comments (4)

  • konstantinos's picture
    (NXLog)

    Hi, what if you added two input sections (one for each extension type) and then included both into the route block as source (Path in1, in2 => out )? Thanks

    October 12, 2020 - 11:30pm
  • DS_534595's picture

    Thanks @konstantinos,

    I had this vague idea that since NXlog language has wide support for regex scripting, that it may be possible to achieve this in one line; those dual Inputs was what I aimed to avoid ;) but in the end, that is what I ended up with.

    October 13, 2020 - 10:11am