Current File : //lib/python2.7/site-packages/salt/transport/tcp.pyc
�
���^c @@ s` d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l
Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z m! Z! d d l" m# Z# d d l$ Z$ d d l% Z$ d d l& Z$ d d l' Z$ d d l( Z$ d d l) Z$ d d l* Z$ e j+ r�d d l, Z, n d d l- j. Z, d d l/ Z/ y d d l0 m1 Z1 e2 Z3 WnO e4 k
rbe5 Z3 y d d l6 m7 Z7 Wn! e4 k
r^d d l8 m7 Z7 n Xn Xe j9 o{e j: j; j< � r�e2 Z= n e5 Z= e= r�d d l Z d d l> Z> d d l? Z$ d d
l m@ Z@ n e jA eB � ZC d � ZD e= rd e@ f d
� � YZE n d e jF jG jH f d � � YZI d e jF jJ jK jL e jF jG jM f d � � YZN d e jF jJ jK jO e jF jP jQ f d � � YZR d e$ jS jT eU f d � � YZV e= r�d eV f d � � YZW n d e$ jX jY f d � � YZZ d e jF j[ f d � � YZ\ d eU f d � � YZ] d eU f d � � YZ^ d e$ jS jT eU f d! � � YZ_ d" e jF jP j` f d# � � YZa d S($ ug
TCP transport classes
Wire protocol: "len(payload) msgpack({'head': SOMEHEADER, 'body': SOMEBODY})"
i ( t absolute_importt print_functiont unicode_literalsN( t six( t queue( t SaltReqTimeoutErrort SaltClientError( t iter_transport_opts( t RSA( t
PKCS1_OAEP( t$ SignalHandlingMultiprocessingProcessc C@ s t t d � r | j d t � r�| j t j t j d � t t d � rBt t d � r� | j d d � } | d k r� | j t j t j t | � � q� n t t d � r� | j d
d � } | d k r� | j t j t j
t | � � q� n t t d � rB| j d d � } | d k r?| j t j t j t | � � q?qBn t t d
� r | j d d � } | j d d � } | d k s�| d k r�| d k r�d } n | d k r�d } n | j t j
d t | d � t | d � f � q�q q | j t j t j d � n d S( u<
Ensure that TCP keepalives are set for the socket.
u SO_KEEPALIVEu
tcp_keepalivei u SOL_TCPu TCP_KEEPIDLEu tcp_keepalive_idlei����i u TCP_KEEPCNTu tcp_keepalive_cntu
TCP_KEEPINTVLu tcp_keepalive_intvlu SIO_KEEPALIVE_VALSi i� N( t hasattrt sockett gett Falset
setsockoptt
SOL_SOCKETt SO_KEEPALIVEt SOL_TCPt TCP_KEEPIDLEt intt TCP_KEEPCNTt
TCP_KEEPINTVLt ioctlt SIO_KEEPALIVE_VALS( t sockt optst tcp_keepalive_idlet tcp_keepalive_cntt tcp_keepalive_intvl( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _set_tcp_keepaliveR sD t LoadBalancerServerc B@ sJ e Z d Z d Z d � Z d � Z d � Z d � Z d � Z d � Z RS( u3
Raw TCP server which runs in its own process and will listen
for incoming connections. Each incoming connection will be
sent via multiprocessing queue to the workers.
Since the queue is shared amongst workers, only one worker will
handle a given connection.
i� c K@ s5 t t | � j | � | | _ | | _ d | _ d S( N( t superR t __init__R t socket_queuet Nonet _socket( t selfR R" t kwargs( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! � s c C@ s9 t | _ | j | d | d d | d d | d �d S( Nu optsu socket_queuet log_queueu log_queuet log_queue_levelu log_queue_level( t Truet _is_childR! ( R% t state( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt __setstate__� s
c C@ s, i | j d 6| j d 6| j d 6| j d 6S( Nu optsu socket_queueu log_queueu log_queue_level( R R" R' R( ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt __getstate__� s
c C@ s? | j d k r; | j j t j � | j j � d | _ n d S( N( R$ R# t shutdownR t SHUT_RDWRt close( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 � s
c C@ s | j � d S( N( R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt __del__� s c C@ s t j t j t j � | _ | j j t j t j d � t | j | j � | j j d � | j j
| j d t | j d � f � | j j | j
� x| t ry5 | j j � \ } } | j j | | f t d � Wq� t j k
r} t j j | � t j k r q� n � q� Xq� Wd S( u1
Start the load balancer
i u interfaceu ret_portN( R t AF_INETt SOCK_STREAMR$ R R t SO_REUSEADDRR R t setblockingt bindR t listent backlogR) t acceptR" t putR# t errort tornadot utilt errno_from_exceptiont errnot ECONNABORTED( R% t
connectiont addresst e( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt run� s * (
t __name__t
__module__t __doc__R8 R! R, R- R0 R1 RD ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR � s
t AsyncTCPReqChannelc B@ s� e Z d Z e j � Z d � Z e d � � Z d � Z d � Z
d � Z d � Z d � Z
e j j d d d d
� � Z e j j d d d � � Z e j j d d d � � Z e j j d d e d
� � Z RS( uX
Encapsulate sending routines to tcp.
Note: this class returns a singleton
c K@ s | j d � p t j j j � } | | j k rF t j � | j | <n | j | } | j | | � } | j | � } | d k r� t
j d | � t j
| � } | j | | � | | _ | | | <d | _ t j � | _ n/ | j � | j d 7_ Wd QXt
j d | � | S( uA
Only create one instance of channel per __key()
u io_loopu* Initializing new AsyncTCPReqChannel for %si Nu" Re-using AsyncTCPReqChannel for %s( R
R< t ioloopt IOLoopt currentt instance_mapt weakreft WeakValueDictionaryt _AsyncTCPReqChannel__keyR# t logt debugt objectt __new__t __singleton_init__t
_instance_keyt _refcountt threadingt RLockt _refcount_lock( t clsR R& t io_loopt loop_instance_mapt keyt obj( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRS � s$ !
c K@ sE d | k r | d | d <n | d | d | d | j d d � f S( Nu
master_uriu pki_diru idu cryptu aes( R
( RZ R R& ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt __key� s c K@ s d S( N( ( R% R R& ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR!
s c K@ s\ t | � | _ t j j | j � | _ | j d d � | _ | j d � pZ t j j
j � | _ | j d k r� t j j
| j d | j �| _ n | j d � } t j | j d � } | j j d d � \ } } | t | � f | _ t | _ t | j d
| j | t | � f d i | j d 6| d 6| j j d � d 6| j j d
� d 6�| _ d S( Nu cryptu aesu io_loopu clearR[ u resolveru
master_uriu :i t argsR& u source_ipu source_ret_portu source_port( t dictR t saltt payloadt Serialt serialR
t cryptR< RI RJ RK R[ t AsyncAutht autht urlparset netloct rsplitR t master_addrR t _closingt SaltMessageClientPoolt message_client( R% R R& t resolvert parset master_hostt master_port( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRT s $$ c C@ s� | j r
d S| j d k rU | j � | j d 8_ Wd QXt j d | j j � d St j d | j j � t | _ | j j � | j
| j j k r� | j j | j
} | j | k r� | | j =n | s� | j j | j
=q� n d S( Ni u2 This is not the last %s instance. Not closing yet.u Closing %s instance(
Rm RV RY RP RQ t __class__RE R) Ro R0 R[ RL RU ( R% R\ ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 ' s$
c C@ s\ | j � d | _ Wd QXy | j � Wn. t j k
rW } | j t j k rX � qX n Xd S( Ni ( RY RV R0 R R; R? t EBADF( R% t exc( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 D s
c C@ s i | j d 6| d 6S( Nu encu load( Rf ( R% t load( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt
_package_loadP s
i i< c c@ s | j j s | j j � Vn | j j | j | j j j | � � d | �V} | j j � } t r | j
| d t j � } n" t
j | � } | j | d � } t j j | j | � } | j | | � }
t j r� t j j j |
� }
n t j j |
� � d S( Nt timeoutu key( Rh t
authenticatedt authenticateRo t sendRx t crypticlet dumpst get_keyst HAS_M2t private_decryptR t pkcs1_oaep_paddingR t newt decryptRb Rf t CrypticleR t loadsR t PY3t transportt framet decode_embedded_strsR< t gent Return( R% Rw t dictkeyt triesRy t retR] t aest ciphert pcryptt data( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt! crypted_transfer_decode_dictentryV s 1 c #@ s� t j j � � � f d � � } � j j s> � j j � Vn y | � V} t j j | � � WnA t j j k
r� � j j � V| � V} t j j | � � n Xd S( u�
In case of authentication errors, try to renegotiate authentication
and retry the method.
Indeed, we can fail too early in case of a master restart during a
minion state execution call
c 3@ s� � j j � j � j j j � � � d � �V} | rp � j j j | � } t j rp t j
j j | � } qp n t
j j | � � d S( NRy ( Ro R| Rx Rh R} R~ R� R R� Rb R� R� R� R< R� R� ( R� ( Rw R% Ry ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _do_transfero s '
N(
R< R� t coroutineRh Rz R{ R� Rb Rf t AuthenticationError( R% Rw R� Ry R� R� ( ( Rw R% Ry s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _crypted_transferg s !
c c@ s8 | j j | j | � d | �V} t j j | � � d S( NRy ( Ro R| Rx R< R� R� ( R% Rw R� Ry R� ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _uncrypted_transfer� s "c c@ s� yN | j d k r1 | j | d | d | �V} n | j | d | d | �V} Wn# t j j k
rs t d � � n Xt j j | � � d S( u^
Send a request, return a future which will complete when we send the message
u clearR� Ry u Connection to master lostN( Rf R� R� R< t iostreamt StreamClosedErrorR R� R� ( R% Rw R� Ry t rawR� ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR| � s N( RE RF RG RM t WeakKeyDictionaryRL RS t classmethodRO R! RT R0 R1 Rx R< R� R� R# R� R� R� R R| ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRH � s" t AsyncTCPPubChannelc B@ s} e Z d � Z d � Z d � Z d � Z e j j d � � Z e j j d � � Z
d � Z e j j d � � Z d � Z
RS( c K@ s� | | _ t j j | j � | _ | j d d � | _ | j d � pT t j j j
� | _ t | _
t | _ t | _ t j j j d d | j d t �| _ d S( Nu cryptu aesu io_loopu minionR R7 ( R Rb Rc Rd Re R
Rf R< RI RJ RK R[ R t connectedRm t _reconnectedt utilst eventt get_event( R% R R& ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! � s $ c C@ s9 | j r
d St | _ t | d � r5 | j j � n d S( Nu message_client( Rm R) R Ro R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 � s
c C@ s | j � d S( N( R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 � s c C@ s i | j d 6| d 6S( Nu encu load( Rf ( R% Rw ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRx � s
c #@ s* i � j d d 6| d 6� t j j � � f d � � } | sL � j j r� d } xm | � j d k s{ � j d d k r� y � j j � VPWqU t k
r� } t j | � | d 7} qU XqU Wn y | � V} t j j
| � � WnA t j j
k
r%� j j � V| � V} t j j
| � � n Xd S( u�
Send the minion id to the master so that the master may better
track the connection state of the minion.
In case of authentication errors, try to renegotiate authentication
and retry the method.
u idu tokc 3@ s` � j � j j j � � � } t j j j | d d �} � j j
| � Vt j j
t � � d S( Nt header( Rx Rh R} R~ Rb R� R� t frame_msgR# Ro t write_to_streamR< R� R� R) ( t msgt package( Rw R% ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s i u tcp_authentication_retriesi N( R R< R� R� Rh Rz R{ R RP RQ R� Rb Rf R� ( R% t tokt
force_authR� t countRv R� ( ( Rw R% s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt send_id� s$ )
c c@ s� | j r
d S| j | j | j � Vt | _ | j j i | j d d 6d � | j r�| j j d � d k r� d j
| j d t j � � } t
j j j | j d d g d � } nD d j
| j d t j � � } t
j j j | j d d g d � } i | j d d 6d
d 6d d 6| j d
6| d 6| d 6} t
j j j t | j f � } zh y | j | d d �WnJ t
j j k
r�t j d � n' t k
r�t j d t j � � n XWd ~ Xn t | _ d S( Nu masteru __master_connectedu __roleu syndicu Syndic {0} started at {1}u idu startu Minion {0} started at {1}u minionu
_minion_eventu cmdu pretagu toku datau tagRy i< uE fire_master failed: master could not be contacted. Request timed out.u fire_master failed: %s( Rm R� R� R� R) R� R� t
fire_eventR R
t formatt timet asctimeRb R� t tagifyR# t asynchronoust SyncWrapperRH R| t
exceptionsR RP t infot Exceptiont tracebackt
format_exc( R% t resultR� t tagRw t req_channel( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt connect_callback� sL
c C@ s; | j r
d St | _ | j j i | j d d 6d � d S( Nu masteru __master_disconnected( Rm R R� R� R� R ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt disconnect_callback s c c@ s\ yt j j | j d | j �| _ | j j d � | _ | j j sV | j j � Vn | j j rt
| j d | j | j d t | j j d � f d i | j d 6| j
d 6| j d 6| j j d
� d
6| j j d � d 6�| _ | j j � Vt | _ n WnS t k
r� n@ t k
rW} d
t j | � k rXt d j | � � � qXn Xd S( NR[ Rb R` u master_ipu publish_portR& u io_loopu connect_callbacku disconnect_callbacku source_ipu source_publish_portu source_portu -|RETRY|-u Unable to sign_in to master: {0}( Rb Rf Rg R R[ Rh t gen_tokenR� Rz R{ Rn R t credsR� R� R
Ro t connectR) R� t KeyboardInterruptR� R t text_typeR R� ( R% Rv ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� " s* ! )
c @ sJ � d k r � j j � � St j j � � f d � � } � j j | � S( u.
Register an on_recv callback
c 3@ s` t | t � sB t j | � } t j rB t j j j | � } qB n � j
| � V} � | � d S( N( t
isinstanceRa t msgpackR� R R� Rb R� R� R� t _decode_payload( t bodyR� ( t callbackR% ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt
wrap_callbackB s N( R# Ro t on_recvR< R� R� ( R% R� R� ( ( R� R% s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� ; s
( RE RF R! R0 R1 Rx R< R� R� R� R� R� R� R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s "6 t TCPReqServerChannelc B@ s_ e Z d Z d � Z e d � � Z d � Z d � Z d � Z d � Z e
j j d � � Z
RS( i c C@ s& t j j j j | | � d | _ d S( N( Rb R� t servert ReqServerChannelR! R# R$ ( R% R ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! S s c C@ s | j S( N( R$ ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR W s c C@ s3 | j d k rs y | j j t j � Wn1 t j k
rY } | j t j k rP qZ | � n X| j j � d | _ n t | j
d � r� y | j
j � Wq/t k
r� } t j
d t | � � q/Xnj t | j
d � r/y | j
j � Wq/t j k
r+} | j d k r� n t j
d t | � � q/Xn d S( Nu shutdownu4 TCPReqServerChannel close generated an exception: %su stopi ( R$ R# R. R R/ R; R? t ENOTCONNR0 R t
req_serverR� RP t exceptiont strt stop( R% Rv ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 [ s*
c C@ s | j � d S( N( R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 u s c C@ s� t j j j j j | | � t rS t j � | _ | j
t d | j | j f �n� t j
j j � s� t j t j t j � | _ | j j t j t j d � t | j | j � | j j d � | j j | j d t | j d � f � n d S( uB
Pre-fork we need to create the zmq router device
R` i i u interfaceu ret_portN( Rb R� t mixinsRh t AESReqServerMixint pre_forkt USE_LOAD_BALANCERt multiprocessingt QueueR" t add_processR R R� t platformt
is_windowsR R2 R3 R$ R R R4 R R5 R6 R ( R% t process_manager( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� x s c
C@ s� | | _ | | _ t j j | j � | _ t j j j | j � �$t
rv t | j | j
d | j j d � �| _ n� t j j j � rt j t j t j � | _ | j j t j t j d � t | j | j � | j j d � | j j | j d t | j d � f � n t | j
d | j j d � d | j �| _ | j j | j � | j j | j � Wd QXt j! j" j# j$ j% | | | � d S( u�
After forking we need to create all of the local sockets to listen to the
router
payload_handler: function to call with your payloads
t ssl_optionsu ssli i u interfaceu ret_portR[ N(& t payload_handlerR[ Rb Rc Rd R Re R� R� t current_ioloopR� t LoadBalancerWorkerR" t handle_messageR
R� R� R� R R2 R3 R$ R R R4 R R5 R6 R t SaltMessageServert
add_socketR7 R8 R� R� Rh R� t post_fork( R% R� R[ ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s( - c
c@ s� yAy | j | � } WnB t k
rZ | j t j j j d d | �� t j j � � n Xt
| t � s� t
| j d � t � r� | j t j j j d d | �� Vt j j � � n yg | d j d d � } t
d � | k r t j d | � | j | j j d � � t j j � � n WnR t k
rtt j d
| � | j | j j d j | � � � t j j � � n X| d d
k r�| j d i � j d � d k r�| j t j j j | j | d � d | �� Vt j j � � n y | j | � V\ } } WnL t k
rP} | j d � t j d d t �| j � t j j � � n X| j d d � } | d k r�| j t j j j | d | �� n� | d k r�| j t j j j | j j | � d | �� no | d k r| j t j j j | j | | d | d � d | �� n' t j d | � | j d � | j � Wnk t j j k
r]� nR t j j k
r�t j d d t �n) t k
r�} t j d | d t �n Xt j j � � d S( uG
Handle incoming messages from underylying tcp streams
u bad loadR� u loadu payload and load must be a dictu idu u u+ Payload contains an id with a null byte: %su! bad load: id contains a null byteu" Payload contains non-string id: %su bad load: id {0} is not a stringu encu clearu cmdu _authu& Some exception handling minion payloadu- Some exception handling a payload from miniont exc_infou funu sendu
send_clearu send_privateu keyu tgtu Unknown req_fun %su& Server-side exception handling payloadu" Connection was unexpectedly closedu! Unexpected exception occurred: %sN( R� R� t writeRb R� R� R� R< R� R� R� Ra R
R� RP R; R| Re R~ t TypeErrorR� t _authR� R) R0 R} t _encrypt_privateR� R� (
R% t streamR� Rc t id_R� t req_optsRC t req_funRv ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � sf
")
"1
% 1
( RE RF R8 R! t propertyR R0 R1 R� R� R< R� R� R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� O s R� c B@ s> e Z d Z d � Z e j j d � � Z d � Z d � Z RS( u{
Raw TCP server which will receive all of the TCP streams and re-assemble
messages that are sent through to us
c O@ se | j d d � p! t j j j � } t t | � j | | � | | _ g | _
| | _ t | _
d S( Nu io_loop( t popR# R< RI RJ RK R R� R! R[ t clientst message_handlerR t _shutting_down( R% R� R` R& R[ ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! � s $ c c@ sB t j d | � | j j | | f � t j � } y� x� t r� | j d d t �V} | j | � xY | D]Q } t j
r� t j j
j | � } n | d } | j j | j | | | d � qh Wq8 WWny t j j k
r� t j d | � | j | | f � n@ t k
r=} t j d | � | j | | f � | j � n Xd S( uP
Handle incoming streams and add messages to the incoming queue
u Req client %s connectedi t partialu headu bodyu req client disconnected %su other master-side exception: %sN( RP t traceR� t appendR� t UnpackerR) t
read_bytest feedR R� Rb R� R� R� R[ t spawn_callbackR� R< R� R� t
remove_clientR� R0 ( R% R� RB t unpackert
wire_bytest
framed_msgR� RC ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt
handle_stream� s(
,c C@ s9 y | j j | � Wn t k
r4 t j d � n Xd S( Nu/ Message server client was not in list to remove( R� t removet
ValueErrorRP R� ( R% t client( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� s
c C@ s� | j r
d St | _ x4 | j D]) } | \ } } | j � | j | � q Wy | j � Wn+ t j k
r� } | j d k r� � q� n Xd S( u+
Shutdown the whole server
Ni ( R� R) R� R0 R� R� R R; R? ( R% t itemR RB Rv ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR. s
(
RE RF RG R! R< R� R� R� R� R. ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s
R� c B@ s) e Z d Z d � Z d � Z d � Z RS( u�
This will receive TCP connections from 'LoadBalancerServer' via
a multiprocessing queue.
Since the queue is shared amongst workers, only one worker will handle
a given connection.
c O@ s] t t | � j | | | � | | _ t j � | _ t j d | j � | _ | j j
� d S( Nt target( R R� R! R" RW t Eventt _stopt Threadt socket_queue_threadt threadt start( R% R" R� R` R& ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! : s
c C@ s | j j � | j j � d S( N( R t setR t join( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� B s
c C@ s� yv xo t rt y | j j t d � \ } } Wn* t j k
rW | j j � r Pq q n X| j j | j | | � q WWn t
t f k
r� n Xd S( Ni ( R) R" R
R t EmptyR t is_setR[ R� t _handle_connectionR� t
SystemExit( R% t
client_socketRB ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR F s ( RE RF RG R! R� R ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� 3 s t TCPClientKeepAlivec B@ s# e Z d Z d d � Z d � Z RS( uN
Override _create_stream() in TCPClient to enable keep alive support.
c C@ s& | | _ t t | � j d | � d S( NRp ( R R R R! ( R% R Rp ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! \ s c K@ so t j t j t j � } t | | j � t j j | d | �} t j d k r\ | j | � S| | j | � f S( u�
Override _create_stream() in TCPClient.
Tornado 4.5 added the kwargs 'source_ip' and 'source_port'.
Due to this, use **kwargs to swallow these and any future
kwargs to maintain compatibility.
t max_buffer_sizei ( i (
R R2 R3 R R R< R� t IOStreamt version_infoR� ( R% R t aft addrR& R R� ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _create_stream` s
N( RE RF RG R# R! R ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR X s Rn c B@ s_ e Z d Z d d d � Z d � Z d � Z e j j d � � Z
d � Z d � Z d � Z
RS( ud
Wrapper class of SaltMessageClient to avoid blocking waiting while writing data to socket.
c C@ s) t t | � j t | d | d | �d S( NR` R& ( R Rn R! t SaltMessageClient( R% R R` R& ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! x s c C@ s | j � d S( N( R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 { s c C@ s+ x | j D] } | j � q
Wg | _ d S( N( t message_clientsR0 ( R% Ro ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 ~ s c c@ sY g } x$ | j D] } | j | j � � q Wx | D] } | Vq4 Wt j j d � � d S( N( R R� R� R< R� R� R# ( R% t futuresRo t future( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s
c O@ s( x! | j D] } | j | | � q
Wd S( N( R R� ( R% R` R& Ro ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s c O@ s, t | j d d � �} | d j | | � S( NR] c S@ s
t | j � S( N( t lent
send_queue( t x( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt <lambda>� s i ( t sortedR R| ( R% R` R& R ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR| � s c O@ s/ t | j d d � �} | d j j | | � S( NR] c S@ s
t | j � S( N( R R ( R ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR � s i ( R R t _streamR� ( R% R` R& R ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s N( RE RF RG R# R! R1 R0 R< R� R� R� R� R| R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRn t s R c B@ s� e Z d Z d d d d d d d � Z d � Z d � Z d � Z d � Z e j
j d � � Z e j
j d � � Z
e j
j d � � Z d � Z d
� Z d � Z d � Z d d e d
� Z RS( u*
Low-level message sending client
c
C@ s | | _ | | _ | | _ | | _ | | _ | | _ | | _ | pT t j j j
� | _ t j
j j | j � � t | d | �| _ Wd QXd | _ t d � | _ g | _ i | _ i | _ d | _ d | _ t | _ | j � | _ t j j � | _! | j j" | j# � d S( NRp i i i I � i���($ R t hostt portt source_ipt source_portR� R� R< RI RJ RK R[ Rb R� R� R� R t _tcp_clientt _midR t
_max_messagesR t send_future_mapt send_timeout_mapR# t _read_until_futuret _on_recvR Rm R� t _connecting_futuret
concurrentt Futuret _stream_return_futureR� t _stream_return(
R% R R" R# R[ Rp R� R� R$ R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! � s* c C@ s# | j d k r | j j � n d S( N( R[ R# R� ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt
_stop_io_loop� s c @ sl � j r
d St � _ t � d � r7� j j � r7z� y� t j j j � } � j j
� � j j � � j d k r� � j j � r� � j j � n � j t j j j d t � k s� � j j � r� � j j � j � f d � � � j j � q� n Wn) t k
r$} t j d t | � � n XWd | j
� Xn � j j � d � _ d � _ d � _ d � _ d S( Nu _streamt instancec @ s
� j � S( N( R2 ( R ( R% ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR � s u/ Exception caught in SaltMessageClient.close: %s( Rm R) R R! t closedR< RI RJ RK R[ t make_currentR0 R+ R# t doneR� R R0 t
add_futureR R� RP R� R� R& R� R� ( R% t orig_loopRC ( ( R% s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 � s4
!
c C@ s | j � d S( N( R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 � s c @ s� t � d � r+ � j j � r+ � j } nY t j j � } | � _ � j j � j � � j d k r� � f d � } | j | � n | S( u@
Ask for this client to reconnect to the origin
u _connecting_futurec @ s& | j � } � j j � j | � d S( N( R� R[ t add_callbackR� ( R t response( R% ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt
handle_future� s N( R R- R6 R< R. R/ R[ R9 t _connectR� R# t add_done_callback( R% R R; ( ( R% s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s c c@ s x
t r | j r Pn y� i } | j s1 | j rm t j d k r] i | j d 6| j d 6} qm t j d � n t j j
j | j � �9 | j
j | j | j d | j j d � | �V| _ Wd QX| j j t � PWq t k
r} t j d | � t j j d
� Vq Xq Wd S( u6
Try to connect for the rest of time!
i i u source_ipu source_portuG If you need a certain source IP/port, consider upgrading Tornado >= 4.5R� u sslNu. TCP Message Client encountered an exception %ri ( i i ( R) Rm R$ R% R< R RP t warningRb R� R� R� R[ R& R� R" R# R R
R! R- t
set_resultR� t warnR� t sleep( R% R& Rv ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR< s(
c c@ s z�x; | j r@ | j j � s5 | j j � t k r@ | j Vq Wt j � } x�| j s�y� | j j d d t �| _ | j V} | j
| � x� | D]� } t j r� t
j j j | � } n | d } | d } | j d � } | | j k r| j j | � j | � | j | � q� | j d k rB| j j | j | | � q� t j d | � q� WWqP t j j k
r
} t j d | j | j! � x' t j" | j � D] } | j# | � q�Wi | _ | j r�d S| j$ r�| j$ � n | j j � r�| j% � | _ n | j VqP t& k
r?d | j' k r6t j( d � q�t) � qP t* k
r�} t j d
d t �x' t j" | j � D] } | j# | � qtWi | _ | j r�d S| j$ r�| j$ � n | j j � r�| j% � | _ n | j VqP XqP WWd | j+ j t � Xd S( Ni R� u headu bodyu midu7 Got response for message_id %s that we are not trackingu* tcp stream to %s:%s closed, unable to recvu detect_modeu[ There was an error trying to use TCP transport; attempting to fallback to another transportu Exception parsing responseR� (, Rm R- R6 R� R) R� R� R! R� R+ R� R R� Rb R� R� R� R
R) R� R? t remove_message_timeoutR, R# R[ R� RP R; R< R� R� RQ R" R# t
itervaluest
set_exceptionR� R� R� R R� R R� R0 ( R% R� R� R� R� R� t
message_idRC R ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 % sj
c c@ s0 x1 | j j � s( | j j � t k r3 | j Vq Wx� t | j � d k r+| j d \ } } y | j j | � V| j d =Wq7 t j j
k
r'} | | j k r� | j j | � j
| � n | j | � | j d =| j r� d S| j r� | j � n | j j � r | j � | _ n | j Vq7 Xq7 Wd S( Ni ( R- R6 R� R) R R R! R� R< R� R� R) R� RD RB Rm R� R� ( R% RE R RC ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _stream_sendg s& (
c C@ sn t } x^ | j | j k rf | j | j k rT | rB t d � � n d | _ t } q | j d 7_ q W| j S( Nu" Unable to find available messageidi ( R R' R) R( R� R) ( R% t wrap( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _message_id� s c @ s4 � d k r � | _ n � f d � } | | _ d S( uU
Register a callback for received messages (that we didn't initiate)
c @ s � | � d S( N( ( R� R� ( R� ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt wrap_recv� s N( R# R, ( R% R� RI ( ( R� s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s c C@ s9 | | j k r d S| j j | � } | j j | � d S( N( R* R� R[ t remove_timeout( R% RE Ry ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRB � s c C@ sQ | | j k r | j | =n | | j k rM | j j | � j t d � � n d S( Nu Message timed out( R* R) R� RD R ( R% RE ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt timeout_message� s
c
@ s � j � } i | d 6} t j j � } � d k rV � � f d � } | j | � n | � j | <� j j d � t k r� d } n | d k r� � j
j | � j | � } | � j
| <n t � j � d k r� � j
j � j � n � j j | t j j j | d | �f � | S( u9
Send given message, and return a future
u midc @ s# | j � } � j j � | � d S( N( R� R[ R9 ( R R: ( R� R% ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR; � s u detect_modei i R� N( RH R< R. R/ R# R= R) R R
R) R[ t
call_laterRK R* R R R� RF R� Rb R� R� R� (
R% R� Ry R� R� RE R� R R; t send_timeout( ( R� R% s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR| � s
+N( RE RF RG R# R! R2 R0 R1 R� R< R� R� R< R1 RF RH R� RB RK R R| ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR � s * B t
Subscriberc B@ s) e Z d Z d � Z d � Z d � Z RS( u=
Client object for use with the TCP publisher server
c C@ s1 | | _ | | _ t | _ d | _ d | _ d S( N( R� RB R Rm R# R+ R� ( R% R� RB ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! � s
c C@ sg | j r
d St | _ | j j � sc | j j � | j d k rc | j j � rc | j j � qc n d S( N( Rm R) R� R4 R0 R+ R# R6 R� ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 � s
c C@ s | j � d S( N( R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 � s ( RE RF RG R! R0 R1 ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRN � s t PubServerc B@ sq e Z d Z d d � Z d � Z d � Z d � Z d � Z e j
j d � � Z d � Z
e j
j d � � Z RS(
u
TCP publisher
c C@ s t t | � j d | j d � � | | _ | | _ t | _ t � | _ t
j j | j � | _
i | _ t | _ | j j d t � r� t } x2 t | j � D]! \ } } | d k r� t } q� q� W| r� t | _ q� n | j r t
j j j d d | j d t �| _ n d S( NR� u sslu presence_eventsu tcpu masterR R7 ( R RO R! R
R[ R R Rm R
R� Rb t mastert AESFuncst aes_funcst presentt presence_eventsR) R R� R� R� ( R% R R[ t tcp_onlyR� t _( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! � s( "
c C@ s | j r
d St | _ d S( N( Rm R) ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR0 s c C@ s | j � d S( N( R0 ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR1 s c C@ s� | j } | | j k r5 | j | } | j | � n� | h | j | <| j r� i | g d 6g d 6} | j j | t j j j d d � � i t | j j
� � d 6} | j j | t j j j d d � � n d S( Nu newu lostu changeu presenceu present( R� RS t addRT R� R� Rb R� R� t listt keys( R% R R� R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _add_client_present s
c C@ s� | j } | d k s$ | | j k r( d S| j | } | | k rE d S| j | � t | � d k r� | j | =| j r� i g d 6| g d 6} | j j | t j j j
d d � � i t | j j � � d 6} | j j | t j j j
d d � � q� n d S( Ni u newu lostu changeu presenceu present(
R� R# RS R� R RT R� R� Rb R� R� RX RY ( R% R R� R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _remove_client_present s&
c c@ s� t j � } x�| j s�y%| j j d d t �| _ | j V} | j | � x� | D]� } t j r{ t
j j j
| � } n | d } | d d k r� qT n t
j j | j t
j j j d d j � } | j | d � } t j r� t
j j j
| � } n | j j | d | d � s qT n | d | _ | j | � qT WWq t j j k
r�} t j d
| j � | j � | j! | � | j" j# | � Pq t$ k
r�} t j% d d t �q q Xq Wd S(
Ni R� u bodyu encu aesu secretu loadu idu toku' tcp stream to %s closed, unable to recvu Exception parsing responseR� (& R� R� Rm R� R� R) R+ R� R R� Rb R� R� R� Rf R� R RP t SMastert secretst valueR� RR t
verify_minionR� RZ R< R� R� RP RQ RB R0 R[ R� t discardR� R; ( R% R R� R� R� R� R} Rw RC ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _stream_read> s<
,
c C@ sI t j d | � t | | � } | j j | � | j j | j | � d S( Nu Subscriber at %s connected( RP R� RN R� RW R[ R� Ra ( R% R� RB R ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� a s c C@ s� t j d | � t j j j | d � } g } d | k r� | d } x| D]� } | | j k r� x{ | j | D]Y } y, | j j | � } | j j
| d � � Wqo t j j
k
r� | j | � qo Xqo WqL t j d | � qL Wng xd | j D]Y } y, | j j | � } | j j
| d � � Wq� t j j
k
rH| j | � q� Xq� WxH | D]@ } t j d | j � | j � | j | � | j j | � qTWt j d � d S( Nu! TCP PubServer sending payload: %su payloadu topic_lstc S@ s t S( N( R) ( t f( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR { s u Publish target %s not connectedc S@ s t S( N( R) ( Rb ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR � s u0 Subscriber at %s has disconnected from publisheru) TCP PubServer finished publishing payload( RP RQ Rb R� R� R� RS R� R� R[ R7 R< R� R� R� R� RB R0 R[ R` R� ( R% R� RV Rc t to_removet topic_lstt topicR Rb ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt publish_payloadh s4
N( RE RF RG R# R! R0 R1 RZ R[ R< R� R� Ra R� Rf ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRO � s # t TCPPubServerChannelc B@ sG e Z d Z d � Z d � Z d � Z d � Z d d � Z d � Z RS( i� c C@ sF | | _ t j j | j � | _ t j j j | � | _ d | _
d S( N( R Rb Rc Rd Re R� t minionst CkMinionst ckminionsR# R[ ( R% R ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR! � s c C@ s( | d t j j _ | j | d � d S( Nu secretsu opts( Rb RP R\ R] R! ( R% R+ ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR, � s c C@ s i | j d 6t j j j d 6S( Nu optsu secrets( R Rb RP R\ R] ( R% ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR- � s
c K@ sP t j j j | j j � | j d � } | d k rJ t j j j
| � n | j d � } | d k r{ t j j j | � n t j j j | � | j
d k r� t j j j � | _
n t | j d | j
�} t j t j t j � } | j t j t j d � t | | j � | j d � | j | j d t | j d � f � | j | j � | j | � | j j d d � d
k r�t | j j d d � � } n t! j" j# | j d
d � } t j$ j% j& | d | j
d | j' �} t j( d | � t j j) j* d � � | j+ � Wd QXy | j
j+ � Wn' t, t- f k
rKt j j j. � n Xd S( uK
Bind to the interface specified in the configuration file
u log_queueu log_queue_levelR[ i i u interfaceu publish_portu ipc_modeu u tcpu tcp_master_publish_pulli� u sock_diru publish_pull.ipcR� u Starting the Salt Puller on %si N(/ Rb R� t processt appendproctitleRt RE R
R# RP t setupt! set_multiprocessing_logging_queuet! set_multiprocessing_logging_levelt setup_multiprocessing_loggingR[ R< RI RJ RK RO R R R2 R3 R R R4 R R5 R6 R R7 R8 R� t ost pathR R� t ipct IPCMessageServerRf R� t filest set_umaskR R� R t shutdown_multiprocessing_logging( R% R& R' R( t
pub_serverR t pull_urit pull_sock( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt _publish_daemon� s@
'
c C@ s | j | j d | �d S( u�
Do anything necessary pre-fork. Since this is on the master side this will
primarily be used to create IPC channels and create our daemon process to
do the actual publishing
R& N( R� R{ ( R% R� R& ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyR� � s c
C@ s� i d d 6} t j j | j t j j j d d j � } | j | � | d <| j d r� t j
j | j d d � } t j
d � t j j | | d � | d <n | j j d
d � d k r� t | j j d
d � � } n t j
j | j d d � } t j j j t j j j | f � } | j � i | j j | � d 6} | d d k r�t | d t j � r�| j j | d d | d �} | d } t j
d | � | | d <q�| d | d <n | j | � d S( u+
Publish "load" to minions
u aesu encu secretu loadu sign_pub_messagesu pki_diru
master.pemu Signing data packetu sigu ipc_modeu u tcpu tcp_master_publish_pulli� u sock_diru publish_pull.ipcu payloadu tgt_typeu listu tgtt tgt_typeu minionsu Publish Side Match: %su topic_lstN( Rb Rf R� R RP R\ R] R^ R~ Rq Rr R RP RQ t sign_messageR
R R� R� R� R� Rs t IPCMessageClientR� Re R� R t string_typesRj t
check_minionsR| (
R% Rw Rc R} t master_pem_pathRy t pub_sockt int_payloadt _rest match_ids( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt publish� s0
,
N(
RE RF R8 R! R, R- R{ R# R� R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyRg � s 4 (b RG t
__future__R R R R? t loggingR Rq RM R� RW R� t
salt.cryptRb t salt.utils.asynchronoust salt.utils.eventt salt.utils.filest salt.utils.platformt salt.utils.processt salt.utils.verifyt salt.payloadt salt.exceptionst salt.transport.framet salt.transport.ipct salt.transport.clientt salt.transport.servert salt.transport.mixins.autht salt.extR t salt.ext.six.movesR R R t salt.transportR R< t tornado.tcpservert tornado.gent tornado.concurrentt tornado.tcpclientt tornado.netutilt tornado.iostreamt PY2Ri t urllib.parseRq R� t M2CryptoR R) R� t ImportErrorR t Cryptodome.CipherR t
Crypto.CipherR� R� R� R� R� R� t tornado.utilR
t getLoggerRE RP R R R� R t
ReqChannelRH R� Rh t AESPubClientMixint AsyncPubChannelR� R� R� R� R� t tcpservert TCPServerRR R� R� t tcpclientt TCPClientR t MessageClientPoolRn R RN RO t PubServerChannelRg ( ( ( s6 /usr/lib/python2.7/site-packages/salt/transport/tcp.pyt <module> s�
7N �.�.� A% (� + �
Mini Shell