Current File : //lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyc
�
���^c @@ s= d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l m
Z
d d l m Z d d l
Z d d l Z d d l m Z y d d l Z Wn e k
r� n Xe j e � Z d Z d � Z d � Z d
e j e f d � � YZ d e j j f d
� � YZ d e j e f d � � YZ d S( u�
Logstash Logging Handler
========================
.. versionadded:: 0.17.0
This module provides some `Logstash`_ logging handlers.
UDP Logging Handler
-------------------
For versions of `Logstash`_ before 1.2.0:
In the salt configuration file:
.. code-block:: yaml
logstash_udp_handler:
host: 127.0.0.1
port: 9999
version: 0
msg_type: logstash
In the `Logstash`_ configuration file:
.. code-block:: text
input {
udp {
type => "udp-type"
format => "json_event"
}
}
For version 1.2.0 of `Logstash`_ and newer:
In the salt configuration file:
.. code-block:: yaml
logstash_udp_handler:
host: 127.0.0.1
port: 9999
version: 1
msg_type: logstash
In the `Logstash`_ configuration file:
.. code-block:: text
input {
udp {
port => 9999
codec => json
}
}
Please read the `UDP input`_ configuration page for additional information.
ZeroMQ Logging Handler
----------------------
For versions of `Logstash`_ before 1.2.0:
In the salt configuration file:
.. code-block:: yaml
logstash_zmq_handler:
address: tcp://127.0.0.1:2021
version: 0
In the `Logstash`_ configuration file:
.. code-block:: text
input {
zeromq {
type => "zeromq-type"
mode => "server"
topology => "pubsub"
address => "tcp://0.0.0.0:2021"
charset => "UTF-8"
format => "json_event"
}
}
For version 1.2.0 of `Logstash`_ and newer:
In the salt configuration file:
.. code-block:: yaml
logstash_zmq_handler:
address: tcp://127.0.0.1:2021
version: 1
In the `Logstash`_ configuration file:
.. code-block:: text
input {
zeromq {
topology => "pubsub"
address => "tcp://0.0.0.0:2021"
codec => json
}
}
Please read the `ZeroMQ input`_ configuration page for additional
information.
.. admonition:: Important Logstash Setting
One of the most important settings that you should not forget on your
`Logstash`_ configuration file regarding these logging handlers is
``format``.
Both the `UDP` and `ZeroMQ` inputs need to have ``format`` as
``json_event`` which is what we send over the wire.
Log Level
.........
Both the ``logstash_udp_handler`` and the ``logstash_zmq_handler``
configuration sections accept an additional setting ``log_level``. If not
set, the logging level used will be the one defined for ``log_level`` in
the global configuration file section.
HWM
...
The `high water mark`_ for the ZMQ socket setting. Only applicable for the
``logstash_zmq_handler``.
.. admonition:: Inspiration
This work was inspired in `pylogstash`_, `python-logstash`_, `canary`_
and the `PyZMQ logging handler`_.
.. _`Logstash`: http://logstash.net
.. _`canary`: https://github.com/ryanpetrello/canary
.. _`pylogstash`: https://github.com/turtlebender/pylogstash
.. _`python-logstash`: https://github.com/vklochan/python-logstash
.. _`PyZMQ logging handler`: https://github.com/zeromq/pyzmq/blob/master/zmq/log/handlers.py
.. _`UDP input`: http://logstash.net/docs/latest/inputs/udp
.. _`ZeroMQ input`: http://logstash.net/docs/latest/inputs/zeromq
.. _`high water mark`: http://api.zeromq.org/3-2:zmq-setsockopt
i ( t absolute_importt print_functiont unicode_literalsN( t
LOG_LEVELS( t NewStyleClassMixIn( t sixu logstashc C@ s3 t d t k d t k g � s/ t j d � t St S( Nu logstash_udp_handleru logstash_zmq_handleru� None of the required configuration sections, 'logstash_udp_handler' and 'logstash_zmq_handler', were found in the configuration. Not loading the Logstash logging handlers module.( t anyt __opts__t logt tracet Falset __virtualname__( ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt __virtual__� s c c@ s� d } } } d t k r t d j d d � } t d j d d � } t d j d d � } t d j d d � } | d k r� | d k r� t j d � q t d | d
| � } t | | � } | j | � | j t t d j d t j d d � � � | Vn d
t k r�t d
j d d � } t d
j d d � } t d
j d d � } | d k rjt j d � q�t d
| � } t
| d | �} | j | � | j t t d
j d t j d d � � � | Vn | d k r�| d k r�| d k r�t Vn d S( Nu logstash_udp_handleru hostu portu versioni u msg_typeu logstashu� The required 'logstash_udp_handler' configuration keys, 'host' and/or 'port', are not properly configured. Not configuring the logstash UDP logging handler.t msg_typet versionu log_levelu erroru logstash_zmq_handleru addressu hwmi� u� The required 'logstash_zmq_handler' configuration key, 'address', is not properly configured. Not configuring the logstash ZMQ logging handler.t zmq_hwm( t NoneR t getR t debugt LogstashFormattert DatagramLogstashHandlert setFormattert setLevelR t ZMQLogstashHanderR
( t hostt portt addressR R
t logstash_formattert udp_handlerR t zmq_handler( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt setup_handlers� sP
$R c B@ s8 e Z d d d d � Z d d � Z d � Z d � Z RS( u logstashi c C@ sY | | _ | | _ | | _ t | d j | � � | _ t t | � j d d d d � d S( Nu format_v{0}t fmtt datefmt( t msg_pathR
R t getattrt formatt superR t __init__R ( t selfR
R! R ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyR% s
c C@ s! t j j | j � j � d d S( Ni����u Z( t datetimet utcfromtimestampt createdt isoformat( R& t recordR ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt
formatTime s c C@ s� t j j j � } i | j | � d 6i | j d 6| j d 6| j d 6| j d 6| j d 6| j
d 6| j d 6| j d 6d
6| j
� d 6d j | j | | j � d
6| d 6| j d 6d g d 6| j d 6} | j r� | j | j � | d
d <n x� t j | j � D]� \ } } | d" k r$qn | d k rD| | d
| <qn t | t j t t t t t f � r|| | d
| <qn t | � | d
| <qWt j j j | � S(# Nu
@timestampu levelnameu loggeru linenou pathnameu processu
threadNameu funcNameu processNameu @fieldsu @messageu
{0}://{1}/{2}u @sourceu @source_hostu @source_pathu saltu @tagsu @typeu exc_infou argsu asctimeu createdu exc_textu filenameu idu levelnou moduleu msecsu messageu msgu nameu relativeCreatedu thread( u argsu asctimeu createdu exc_infou exc_textu filenameu funcNameu idu levelnameu levelnou linenou moduleu msecsu msecsu messageu msgu nameu pathnameu processu processNameu relativeCreatedu threadu
threadName(! t saltt utilst networkt get_fqhostnameR, t levelnamet namet linenot pathnamet processt
threadNamet funcNamet processNamet
getMessageR# R
R! t exc_infot formatExceptionR t iteritemst __dict__R t
isinstancet string_typest boolt dictt floatt intt listt reprt jsont dumps( R& R+ R t message_dictt keyt value( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt format_v0 sN
$c C@ sk i d d 6| j | � d 6t j j j � d 6| j d 6| j d 6| j d 6| j d 6| j d 6| j
d
6| j d 6| j d 6| j
� d
6d g d 6| j d 6} | j r� | j | j � | d <n x� t j | j � D]~ \ } } | d k r� q� n | d k r| | | <q� n t | t j t t t t t f � rD| | | <q� n t | � | | <q� Wt j j j | � S( Ni u @versionu
@timestampu hostu levelnameu loggeru linenou pathnameu processu
threadNameu funcNameu processNameu messageu saltu tagsu typeu exc_infou argsu asctimeu createdu exc_textu filenameu idu levelnou moduleu msecsu msgu nameu relativeCreatedu thread( u argsu asctimeu createdu exc_infou exc_textu filenameu funcNameu idu levelnameu levelnou linenou moduleu msecsu msecsu messageu msgu nameu pathnameu processu processNameu relativeCreatedu threadu
threadName( R, R- R. R/ R0 R1 R2 R3 R4 R5 R6 R7 R8 R9 R
R: R; R R< R= R R> R? R@ RA RB RC RD RE RF RG ( R& R+ RH RI RJ ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt format_v1J sB
$
N( t __name__t
__module__R% R R, RK RL ( ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyR s 4R c B@ s e Z d Z d � Z RS( u'
Logstash UDP logging handler.
c C@ s
| j | � S( N( R# ( R& R+ ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt
makePickle| s ( RM RN t __doc__RO ( ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyR w s R c B@ sA e Z d Z e j d d � Z e d � � Z d � Z d � Z RS( u'
Logstash ZMQ logging handler.
i� c C@ sN t t | � j d | � d | _ | _ | | _ | | _ t j � | _
d S( Nt level( R$ R R% R t _contextt
_publishert _addresst _zmq_hwmt ost getpidt _pid( R& R RQ R ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyR% � s
c C@ s� t j � } t | d � s+ | j | k r� | | _ t j � | _ | j j t j � | _ y | j j
t j | j � WnC t
k
r� | j j
t j | j � | j j
t j | j � n X| j j | j � n | j S( Nu
_publisher( RV RW R" RX t zmqt ContextRR t sockett PUBRS t
setsockoptt HWMRU t AttributeErrort SNDHWMt RCVHWMt connectRT ( R& t current_pid( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt publisher� s
c C@ s# | j | � } | j j | � d S( N( R# Rd t send( R& R+ t formatted_object( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt emit� s c C@ s� | j d k r� t | j d � r4 | j j d � q� t | d d � d k rr | j j t j d � | j j � n | j j
t k r� | j j � q� n d S( Nu destroyi i� u
_publisheri� i� (
RR R t hasattrt destroyR" RS R] RY t LINGERt closet closedR
t term( R& ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyRk � s (
RM RN RP t loggingt NOTSETR% t propertyRd Rg Rk ( ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyR � s
(! RP t
__future__R R R RV Rn t logging.handlersR' t salt.log.setupR t salt.log.mixinsR t salt.utils.jsonR- t salt.utils.networkt salt.extR RY t ImportErrort getLoggerRM R R R R t FormatterR t handlerst DatagramHandlerR t HandlerR ( ( ( sB /usr/lib/python2.7/site-packages/salt/log/handlers/logstash_mod.pyt <module>� s*
F l
Mini Shell