Current File : //lib/python2.7/site-packages/salt/master.pyo
�
���^c @� s d Z d d l m Z m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z m Z m Z m Z d d l Z d d l! Z d d l" Z d d l# Z d d l$ Z d d l% Z d d l& Z d d l' Z d d l( Z d d l) Z d d l* Z d d l+ Z d d l, Z d d l- Z d d l. Z d d l/ Z d d l0 Z d d l1 Z d d l2 Z d d l3 Z d d l4 Z d d l5 Z d d l6 Z d d l7 Z d d l8 Z d d l9 Z d d l: Z d d l; Z d d l< Z d d l= Z d d l> Z d d l? Z d d l@ Z d d lA Z d d lB Z d d lC Z d d lD Z d d l Z d d lE mF ZF d d lG mH ZH d d lI mJ ZJ d d
lK mL ZL mM ZM mN ZN d d l6 mO ZO d d lP mQ ZQ y d d lR ZR eS ZT Wn eU k
r�eV ZT n Xy d d lW ZW eS ZX Wn eU k
r�eV ZX n Xd d
lY mZ ZZ d d l[ m\ Z\ e j] e^ � Z_ d e` f d � � YZa d e jb jc jd f d � � YZe d e jb jc jd f d � � YZf d ea f d � � YZg d e jb jc jd f d � � YZh d e jb jc jd f d � � YZi d e jb jc jd f d � � YZj d e` f d � � YZk d ek f d � � YZl d! ek f d" � � YZm d# ej f d$ � � YZn d S(% u�
This module contains all of the routines needed to set up a master server, this
involves preparing the three listeners and the workers needed by the master.
i ( t absolute_importt with_statementt print_functiont unicode_literalsN( t six( t range( t zmqt ZMQDefaultLoopt install_zmqt ZMQ_VERSION_INFO( t DEFAULT_INTERVAL( t DEFAULT_TARGET_DELIM( t iter_transport_opts( t enable_sigusr1_handlert enable_sigusr2_handlert
inspect_stack( t tagify( t OrderedDict( t StackContext( t RequestContextt SMasterc B� s8 e Z d Z i Z d � Z d � Z d � Z d � Z RS( uN
Create a simple salt-master, this will generate the top-level master
c C� s4 | | _ t j j | j � | _ | j � | _ d S( um
Create a salt master server instance
:param dict opts: The salt options dictionary
N( t optst saltt cryptt
MasterKeyst
master_keyt _SMaster__prep_keyt key( t selfR ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __init__k s c C� s8 | d | _ | d | _ | d | _ | d t _ d S( Nu optsu
master_keyu keyu secrets( R R R R t secrets( R t state( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __setstate__z s
c C� s, i | j d 6| j d 6| j d 6t j d 6S( Nu optsu
master_keyu keyu secrets( R R R R R ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __getstate__� s
c C� s t j j j | j � S( u�
A key needs to be placed in the filesystem with permissions 0400 so
clients are required to run as root.
( R t daemonst masterapit access_keysR ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt
__prep_key� s ( t __name__t
__module__t __doc__R R R R! R ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR e s t Maintenancec B� sh e Z d Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z
d � Z d
� Z RS( uP
A generalized maintenance process which performs maintenance routines.
c K� sf t t | � j | � | | _ t | j d � | _ t t j � � | _ t j j
| j � | _ d S( u[
Create a maintenance instance
:param dict opts: The salt options
u
loop_intervalN( t superR) R R t intt
loop_intervalt timet rotateR t payloadt Serialt serial( R R t kwargs( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s
c C� s2 t | _ | j | d d | d d | d �d S( Nu optst log_queueu log_queuet log_queue_levelu log_queue_level( t Truet _is_childR ( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s
c C� s" i | j d 6| j d 6| j d 6S( Nu optsu log_queueu log_queue_level( R R3 R4 ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR! � s
c C� sF t | j � } t | d <t j j | � } t j j | j i � | _ t j j j
| j | j � d | j �| _ t j j j
| j � | _ t j j j | j | j d d t �| _ t j j j | j � | _ t | _ | j j d t � rBt } x2 t | j � D]! \ } } | d k rt } qqW| sBt | _ qBn d S( u<
Some things need to be init'd after the fork has completed
The easiest example is that one of these module types creates a thread
in the parent process, then once the fork happens you'll start getting
errors like "WARNING: Mixing fork() and threads detected; memory leaked."
u quiett returnersu sock_dirt listenu presence_eventsu tcpN( t dictR R5 R t runnert RunnerClientt loaderR7 t utilst schedulet Schedulet functions_dictt minionst CkMinionst ckminionst eventt get_master_eventt FalseR" R# t init_git_pillart
git_pillart presence_eventst getR ( R t roptst
runner_clientt tcp_onlyt transportt _( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt _post_fork_init� s$
+
c C� s t j j j | j j � | j � t t j � � } t � } x� t
rt t j � � } | | | j k r� t j j
j | j � t j j
j | j � t j j
j | j � n | j � | j � | j � | j | � | j | � t j j j | j � | } t j | j � qA Wd S( u�
This is the general passive maintenance process controller for the Salt
master.
This is where any data that needs to be cleanly maintained from the
master is maintained.
N( R R= t processt appendproctitlet __class__R& RP R+ R- t setR5 R, R" R# t clean_old_jobsR t clean_expired_tokenst clean_pub_autht handle_git_pillart handle_schedulet handle_key_cachet handle_presencet handle_key_rotatet verifyt check_max_open_filest sleep( R t lastt old_presentt now( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt run� s$
c C� sp | j d d k rlg } | j d d k r5 d } n d } xx t j t j j | j d | � � D]Q } | j d � ra t j j t j j | j d | | � � ra | j | � qa qa Wt j d
� t
j rt j
j j t j j | j d | d � � � } | j j | | � Wd QXqlt j
j j t j j | j d | d � d
d �� } | j j | | � Wd QXn d S( u`
Evaluate accepted keys and create a msgpack file
which contains a list
u key_cacheu schedu transportu zeromqu tcpu minionsu acceptedu pki_diru .u Writing master key cacheu
.key_cacheNt modeu wb( u zeromqu tcp( R t ost listdirt patht joint
startswitht isfilet appendt logt debugR t PY2R R= t
atomicfilet atomic_openR1 t dump( R t keyst acct fn_t
cache_file( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRZ � s ,;
1 7c C� s� t } t j j | j d d � } y� t j | � } t j j j � r t j
| t j � r t } t j
| t j t j B� n% | j d k r� t } n
t j d � t j | � Wn t j k
r� n X| j j d � r| | j | j d k rt } qn | r�t j d � x� t j t j � D]l \ } } | d j � �( t j j j | d � � | d _ Wd QX| j j i t d
j! | � 6d d �q'W| | _ | j j d
� r�t j" d � t j j# j$ | j � q�n d S( u-
Rotate the AES key rotation
u cachediru .dfni � u6 Found dropfile with incorrect permissions, ignoring...u publish_sessionu Rotating master AES keyu secretu reloadNu rotate_{0}_keyt tagu keyu ping_on_rotateu1 Pinging all connected minions due to key rotation(% RF Re Rg Rh R t statR R= t platformt
is_windowst accesst W_OKR5 t chmodt S_IRUSRt S_IWUSRt st_modeRl t errort removeRJ R. t infoR t iteritemsR R t get_lockt stringutilst to_bytest valueRD t
fire_eventt formatRm t mastert ping_all_connected_minions( R Rb t to_rotatet dfnt statst
secret_keyt
secret_map( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR\ s4 (
)*
c C� sO y" x | j D] } | j � q
WWn& t k
rJ } t j d d t �n Xd S( u#
Update git pillar
u* Exception caught while updating git_pillart exc_infoN( RH t
fetch_remotest ExceptionRl R� R5 ( R t pillart exc( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRX 7 s c C� so y8 | j j � | j j | j k r7 | j j | _ n Wn# t k
r] } t j d | � n X| j j � d S( u(
Evaluate the scheduler
u& Exception %s occurred in scheduled jobN( R> t evalR, R� Rl R� t cleanup_subprocesses( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRY B s
c C� s� | j r� | j j d d � r� | j j � } | j | � } | j | � } | sW | r� i t | � d 6t | � d 6} | j j | t d d � � n i t | � d 6} | j j | t d d � � | j � | j
| � n d S( u1
Fire presence events if enabled
t timeouti u newu lostu changeu presenceu presentN( RI RD t connect_pullRC t
connected_idst
differencet listR� R t cleart update( R Ra t presentt newt lostt data( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR[ P s
(
R& R' R( R R R! RP Rc RZ R\ RX RY R[ ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR) � s # ( t FileserverUpdatec B� sD e Z d Z d � Z d � Z d � Z d � Z d � Z d � Z RS( uH
A process from which to update any dynamic fileserver backends
c K� sZ t t | � j | � | | _ i | _ d d l } | j j | j � | _ | j � d S( Ni ( R* R� R R t update_threadst salt.fileservert
fileservert
Fileservert fill_buckets( R R R2 R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR i s c C� s( t | _ | j | d d | d �d S( Nu optsR3 u log_queue( R5 R6 R ( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR u s
c C� s i | j d 6| j d 6S( Nu optsu log_queue( R R3 ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR! | s
c C� sx | j j � } i | _ xY| j j � D]H} d j | � } y | j j | } Wn$ t k
rw t j d | � q( n X| | k rx� t j
| | � D]b \ } } | s� t } t j d | � n | j j | t
� � } | j | | f g � j | � q� Wq( y d j | � } | j | } Wn* t k
rMt } t j d | | � n Xd | j j | t
� � | | f <q( Wd S( u�
Get the configured backends and the intervals for any backend which
supports them, and set up the update "buckets". There will be one
bucket for each thing being updated at a given interval.
u
{0}.updateu/ No update function for the %s filserver backendu< An update_interval of 0 is not supported, falling back to %su {0}_update_intervaluQ %s key missing from configuration. Falling back to default interval of %d secondsN( R� t update_intervalst bucketst backendsR� t serverst KeyErrorRl Rm R R� R
t
setdefaultR Rk R t warningt None( R R� t backendt fstrt update_funct id_t intervalt i_ptrt interval_key( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s:
&
c � sW � � f d � } t j � } | � x+ t rR | � | j � � Wd QX| � q( Wd S( uV
Threading target which handles all updates for a given wait interval
c � s� t j d � � x� t j � � D]� \ } } | \ } } yI | r` t j d | | � | f } n t j d | � d } | | � Wq t k
r� } t j d | � q Xq Wt j d � � � d S( NuE Performing fileserver updates for items with an update interval of %du: Updating %s fileserver cache for the following targets: %su Updating %s fileserver cacheu5 Uncaught exception while updating %s fileserver cacheuX Completed fileserver updates for items with an update interval of %d, waiting %d seconds( ( Rl Rm R R� R� t exception( R� t update_argst backend_nameR� t argsR� ( R� R� ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt
_do_update� s*
N( t threadingt ConditionR5 t wait( R R� R� R� t condition( ( R� R� s/ /usr/lib/python2.7/site-packages/salt/master.pyt update_fileserver� s c C� s� t j j j | j j � t j j j | j � xQ | j
D]F } t j d | j
d | | j
| f � | j | <| j | j � q9 Wx t r� t j d � q� Wd S( u*
Start the update threads
t targetR� i< N( R R= RQ RR RS R& R" R# t clean_fsbackendR R� R� t ThreadR� R� t startR5 R- R_ ( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRc � s ( R& R' R( R R R! R� R� Rc ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� e s 5 )t Masterc B� s; e Z d Z d � Z d � Z d � Z d � Z d � Z RS( u
The salt master server
c C� s6 t r" t d k r" t j d � n t j | | � d S( u]
Create a salt master server instance
:param dict: The salt options
i i u� You have a version of ZMQ less than ZMQ 3.2! There are known connection keep-alive issues with ZMQ < 3.2 which may result in loss of contact with minions. Please upgrade your ZMQ!N( i i ( R R Rl R� R R ( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s
c C� s t s
d St j t j � \ } } | t j k r: | } n t j d | | � | j d } | | k r� t j d | | | � | } n | | k rt j d | � t j t j | | f � y/ t j t j � \ } } t j d | | � Wqt k
r t j
d | � qXn d S( Nu: Current values for max open files soft/hard setting: %s/%su max_open_filesu� The value for the 'max_open_files' setting, %s, is higher than the highest value the user running salt is allowed to set (%s). Defaulting to %s.u" Raising max open files value to %su5 New values for max open files soft/hard values: %s/%su~ Failed to raise max open files setting to %s. If this value is too low, the salt-master will most likely fail to run properly.( t HAS_RESOURCEt resourcet getrlimitt
RLIMIT_NOFILEt
RLIM_INFINITYRl R� R t setrlimitt
ValueErrort critical( R t mof_st mof_ht mof_c( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __set_max_open_files s4
c
C� sj g } g } y t j d � Wn) t k
rH } | j d j | � � n X| j j d t � r� d d l } | j j
| j � } | j s� | j d j d j | j d � � � q� y | j
� Wq� | j j k
r� } | j d j | � � q� Xn | j d s| j d
� n | j d r�t j j t j j | j d d � � r�yC | j j j d
� �( t j t j j | j d d � � Wd QXWq�t k
r�q�Xn | j j d t � r�yO g | j j d g � D]/ } d | k r�t | d t j � r�| ^ q�} Wn$ t k
r+g } | j d � n X| r�z� t j | j � } d d l } x� | D]� }
|
g | d <yM | j j j | |
d d | j j j! d | j j j" d | j j j# �} WqZ| j j k
r�} | j | j$ � qZXqZWWd ~ Xq�n | s| rfx | D] } t% j& | � q Wx | D] } t% j' | � q)Wt% j' d � t( j) | j* j+ j, � n d S( uv
Run pre flight checks. If anything in this method fails then the master
should not start up.
u /u% Cannot change to root directory ({0})u fileserver_verify_configi NuD Failed to load fileserver backends, the configured backends are: {0}u , u fileserver_backendu {0}u% No fileserver backends are configuredu pillar_cacheu cachediri? u git_pillar_verify_configu
ext_pillaru gitu� Invalid ext_pillar configuration. It is likely that the external pillar type was not specified for one or more external pillars.t per_remote_overridest per_remote_onlyt global_onlyu) Master failed pre flight checks, exiting
(- Re t chdirt OSErrorRk R� R RJ R5 R� R� R� R� Rh t initt
exceptionst FileserverConfigErrorRg t isdirR= t filest set_umaskt mkdirt
isinstanceR t string_typest TypeErrort copyt deepcopyt salt.pillar.git_pillart gitfst GitPillarR� RH t PER_REMOTE_OVERRIDESt PER_REMOTE_ONLYt GLOBAL_ONLYt strerrorRl R� R� t syst exitt defaultst exitcodest
EX_GENERIC(
R t errorst critical_errorst errR R� R� t xt git_pillarst new_optst repoRH R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt _pre_flight3 st
6-
'
c C� s! | j � t j d t j j j � � t � t � | j � t j j
j t j
t j � �Ji t j t j t j j j t j j j � � � d 6t j j j d 6t j d <t j d � t j j
j d d � | _ g } t j d � t j j j � } x_ t | j � D]N \ } } t j j! j" j# | � } | j$ | j d i | d
6�| j% | � qWt j d � | j j& t j j' j( d | j f �| j j) d
� rFt* | j d t+ � rt, } x+ | j d D] } d
| k r�t- } Pq�q�W| sC| j d j% i i d
6� qCqFd
| j d k rFt j d � i | j d d
<qFn t j. j/ | j | j � t j d � | j j& t0 d | j f �| j j) d � r�t j d � | j j& t j j' j1 d | j f �n | j j) d g � } x� | D]� } t j d | � y d j2 | j3 d � d � }
| j3 d � d } t4 |
t5 � t6 � | g d � } | j7 | � } | j j& | d | j f �Wq�t8 k
r�t j9 d | � q�Xq�Wt: r�d | j k r�t j d � | j j& t; d | j d f �n | j d rIt j d � | j j& t j j< j= d | j f �t j> d � t? j@ d � n t j d � i }
t j jA jB � r�| |
d
<t j j jC � |
d <t j |
d <n | j j& tD d | j | jE | jF f d |
d! d" �| j j& tG d | j f �| j d# r�t j jH jI jJ � rp| j j& t j jH jI d$ | j d# d% d& | j d' d( i | j d# j) d) i � d) 6� jK � q�t j9 d* � tL jM jN d k r�t j9 d+ � q�n Wd, QXt jO t j
� t jP k r�t j t j
| jQ � n t jO t j � t jP k rt j t j | jQ � n | j jK � d, S(- u6
Turn on the master server components
u$ salt-master is starting as user '%s'u secretu reloadu aesu Creating master process managert
wait_for_killi u! Creating master publisher processR2 u log_queueu' Creating master event publisher processR� u reactoru enginesu Enabling the reactor engineu# Creating master maintenance processu event_returnu$ Creating master event return processu
ext_processesu" Creating ext_processes process: %su .i����u( Error creating ext_processes process: %su haliteu Creating master halite processu con_cacheu Creating master concache processu- Sleeping for two seconds to let concache resti u& Creating master request server processu log_queue_levelu secretst nameu ReqServeru discoveryt portu portt listen_ipu interfacet answeru mappingu6 Unable to load SSDP: asynchronous IO is not available.uR You are using Python 2, please install "trollius" module to enable SSDP discovery.N(R R� Rl R� R R= t usert get_userR
R t _Master__set_max_open_filesRQ t default_signalst signalt SIGINTt SIGTERMt multiprocessingt Arrayt ctypest c_charR� R� R t Crypticlet generate_key_stringR R t ProcessManagert process_managert setupt! get_multiprocessing_logging_queueR R RN t servert PubServerChannelt factoryt pre_forkRk t add_processRD t EventPublisherRJ R� R� RF R5 t enginest
start_enginesR) t EventReturnRh t splitt
__import__t globalst localst __getattribute__R� R� t
HAS_HALITEt HaliteR� t ConnectedCacheRm R- R_ Rx Ry t! get_multiprocessing_logging_levelt ReqServerR R R� t ssdpt SSDPDiscoveryServert is_availableRc R� t version_infot majort getsignalt SIG_DFLt _handle_signals( R t pub_channelsR3 RO R t chant rinet itemt ext_procst proct modt clst _tmpR2 ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s�
% !
(
!
#
%
*
c C� sH | j j � | j j | � | j j � t j d � t j d � d S( Ni i ( R t stop_restartingt send_signal_to_processest
kill_childrenR- R_ R� R� ( R t signumt sigframe( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR( s
( R& R' R( R R� R� R� R( ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s - S �R c B� s2 e Z d Z d � Z d � Z d � Z d � Z RS( u"
Manage the Halite server
c K� s# t t | � j | � | | _ d S( uY
Create a halite instance
:param dict hopts: The halite options
N( R* R R t hopts( R R7 R2 ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR s c C� s2 t | _ | j | d d | d d | d �d S( Nu hoptsR3 u log_queueR4 u log_queue_level( R5 R6 R ( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR " s
c C� s" i | j d 6| j d 6| j d 6S( Nu hoptsu log_queueu log_queue_level( R7 R3 R4 ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR! * s
c C� s- t j j j | j j � t j | j � d S( u!
Fire up halite!
N( R R= RQ RR RS R& t haliteR� R7 ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRc 1 s ( R& R' R( R R R! Rc ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR s
R c B� s_ e Z d Z d d � Z d � Z d � Z d � Z d � Z d � Z e
j d � Z d � Z
RS(
uZ
Starts up the master request server, minions send results to this
interface.
c K� s> t t | � j | � | | _ | | _ | | _ | | _ d S( u
Create a request server
:param dict opts: The salt options dictionary
:key dict: The user starting the server and the AES key
:mkey dict: The user starting the server and the RSA key
:rtype: ReqServer
:returns: Request server
N( R* R R R R R R ( R R R t mkeyR R2 ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR > s
c C� sJ t | _ | j | d | d | d d | d d | d d | d �d S(
Nu optsu keyu mkeyR u secretsR3 u log_queueR4 u log_queue_level( R5 R6 R ( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR S s
c C� s@ i | j d 6| j d 6| j d 6| j d 6| j d 6| j d 6S( Nu optsu keyu mkeyu secretsu log_queueu log_queue_level( R R R R R3 R4 ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR! ^ s
c C� s* | j | � t t | � j | | � d S( N( t destroyR* R R( ( R R5 R6 ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR( h s
c
C� s� | j d k r( t j j j | j � n | j d k rP t j j j | j � n t j j j | j � | j d k r� | j t
_ n t j j
| j d d � } t j j | � r"yV t j j j � r� t j | t j � r� t j | t j t j B� n t j | � Wq"t j k
r q"Xn t j j j d d d d � | _ g } t } xg t | j � D]V \ } } t j j! j" j# | � } | j$ | j � | j% | � | d k r_t& } q_q_Wi } t j j j � r3| j | d <| j | d <| r3t' j( r3t) | j d
� d k r3t j* d � d | j d
<q3n t j j j+ t, j- t, j. � �r xj t/ t) | j d
� � D]O } d j0 | � } | j j1 t2 d
| j | j3 | j4 | | f d | d | �qlWWd QX| j j5 � d S( u(
Binds the reply server
u cachediru .dfnR� u ReqServer_ProcessManagerR� i u tcpu log_queueu log_queue_levelu worker_threadsuD TCP transport supports only 1 worker on Windows when using Python 2.u MWorker-{0}R� R2 N(6 R3 R� R Rl R t! set_multiprocessing_logging_queueR4 t! set_multiprocessing_logging_levelt setup_multiprocessing_loggingR R Re Rg Rh R Rj R= Rx Ry Rz R{ R| Rw R} R~ R� R� RQ R
R R5 R RN R t ReqServerChannelR R Rk RF R Rn R+ R� R R R R R R� R t MWorkerR R Rc (
R R� t req_channelsRM RN R R* R2 t indR� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __bindl sX (
(
c C� s | j � d S( u(
Start up the ReqServer
N( t _ReqServer__bind( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRc � s c C� s@ t | d � r< | j j � | j j | � | j j � n d S( Nu process_manager( t hasattrR R2 R3 R4 ( R R5 ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR: � s
c C� s | j � d S( N( R: ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __del__� s N( R& R' R( R� R R R! R( RC Rc R R R: RE ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR 9 s
? R? c B� st e Z d Z d � Z d � Z d � Z d � Z d � Z e j j
d � � Z d � Z d � Z
d � Z d
� Z RS( ud
The worker multiprocess instance to manage the backend operations for the
salt master.
c K� s~ | | d <| | _ t t | � j | � | | _ | | _ | | _ | | _ d | _ t j
d � � | _ t j � | _
d S( u.
Create a salt master worker process
:param dict opts: The salt options
:param dict mkey: The user running the salt master and the AES key
:param dict key: The user running the salt master and the RSA key
:rtype: MWorker
:return: Master worker
u namei c S� s i d d 6d d 6S( Ni u meanu runs( ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt <lambda>� s N( R� R* R? R R R@ R9 R t k_mtimet collectionst defaultdictR� R- t
stat_clock( R R R9 R R@ R� R2 ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s
c C� s� t | _ t t | � j d | d d | d � | d | _ | d | _ | d | _ | d | _ | d | _ | d
t
_ d S( NR3 u log_queueR4 u log_queue_levelu optsu req_channelsu mkeyu keyu k_mtimeu secrets( R5 R6 R* R? R R R@ R9 R RG R R ( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s
c C� sT i | j d 6| j d 6| j d 6| j d 6| j d 6t j d 6| j d 6| j d 6S( Nu optsu req_channelsu mkeyu keyu k_mtimeu secretsu log_queueu log_queue_level( R R@ R9 R RG R R R3 R4 ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR! � s
c C� sD x$ t | d d � D] } | j � q Wt t | � j | | � d S( Nu req_channels( ( t getattrt closeR* R? R( ( R R5 R6 t channel( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR( � s c C� s| t � t � | _ | j j � x* | j D] } | j | j d | j �q* Wy | j j � Wn t t f k
rw n Xd S( u(
Bind to the local port
t io_loopN(
R R RN t make_currentR@ t post_forkt _handle_payloadR� t KeyboardInterruptt
SystemExit( R t req_channel( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRB s
c C� sN | d } | d } i | j d 6| j d 6| | � } t j j | � � d S( u�
The _handle_payload method is the key method used to figure out what
needs to be done with communication to the server
Example cleartext payload generated for 'salt myminion test.ping':
{'enc': 'clear',
'load': {'arg': [],
'cmd': 'publish',
'fun': 'test.ping',
'jid': '',
'key': 'alsdkjfa.,maljf-==adflkjadflkjalkjadfadflkajdflkj',
'kwargs': {'show_jid': False, 'show_timeout': False},
'ret': '',
'tgt': 'myminion',
'tgt_type': 'glob',
'user': 'root'}}
:param dict payload: The payload route to the appropriate handler
u encu loadu aesu clearN( t _handle_aest
_handle_cleart tornadot gent Return( R R/ R t loadt ret( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRQ s
c C� s� t j � } | | } | j | d | j | d d | | j | d | j | d <| | j | j d k r� | j j j i | | j d 6| j d 6| j d 6t | j d � � t j
d � � | _ | | _ n d S(
uK
Calculate the master stats and fire events with stat info
u meanu runsi u master_stats_event_iteru timeu workeru statsc S� s i d d 6d d 6S( Ni u meanu runs( ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRF 6 s N( R- R� RJ R t aes_funcsRD R� R� R RH RI ( R R� t cmdt endt duration( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt _post_stats, s
BDc C� s� t j d | d � | d } | j j | � } | sG i i d d 6f S| j d rz t j � } | j | d c d 7<n | | � i d d 6f } | j d r� | j | | � n | S( u�
Process a cleartext command
:param dict load: Cleartext payload
:return: The result of passing the load to a function in ClearFuncs corresponding to
the command specified in the load's 'cmd' key.
u& Clear payload received with command %su cmdu
send_clearu funu master_statsu runsi ( Rl t tracet clear_funcst
get_methodR R- R� R` ( R RZ R] t methodR� R[ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRV 9 s
c � s d | k r t j d | � i S| d } t j d | d � � j j | � } | sg i i d d 6f S� j d r� t j � } � j | d c d 7<n � f d � } t t j
t i | d
6� j d 6� � � | | � } Wd QX� j d r� j | | � n | S(
u�
Process a command sent via an AES key
:param str load: Encrypted payload
:return: The result of passing the load to a function in AESFuncs corresponding to
the command specified in the load's 'cmd' key.
u cmdu Received malformed command %su$ AES payload received with command %su sendu funu master_statsu runsi c � s � j j | d | � S( Nu cmd( R\ t run_func( R� ( R ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRe b s u datau optsN(
Rl R� Ra R\ Rc R R- R� R t functoolst partialR R` ( R R� R] Rd R� Re R[ ( ( R s/ /usr/lib/python2.7/site-packages/salt/master.pyRU N s&
c C� s^ t j j j | j � t | j | j � | _ t | j � | _
t j j j � | j
� d S( u'
Start a Master Worker
N( R R= RQ RR R� t
ClearFuncsR R Rb t AESFuncsR\ R t
reinit_cryptot _MWorker__bind( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRc n s ( R& R' R( R R R! R( Rk RW RX t coroutineRQ R` RV RU Rc ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR? � s "
t TransportMethodsc B� s e Z d Z d Z d � Z RS( u�
Expose methods to the transport layer, methods with their names found in
the class attribute 'expose_methods' will be exposed to the transport layer
via 'get_method'.
c C� s[ | | j k rG y t | | � SWqW t k
rC t j d | � qW Xn t j d | � d S( uM
Get a method which should be exposed to the transport layer
u Requested method not exposed: %sN( t expose_methodsRK t AttributeErrorRl R� ( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRc � s
( ( R& R' R( Rn Rc ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRm | s Ri c B� s� e Z d Z d5 Z d � Z d � Z d � Z d � Z d! � Z d" � Z d# � Z
e
Z d$ � Z d% � Z
d& � Z d' � Z d( � Z d) � Z d* � Z d+ � Z d, � Z d- � Z d. � Z d/ � Z d0 � Z d1 � Z d2 � Z d3 � Z d4 � Z RS(6 uQ
Set up functions that are available when the load is encrypted with AES
u
verify_minionu _master_topsu
_ext_nodesu _master_optsu _mine_getu _mineu _mine_deleteu _mine_flushu
_file_recvu _pillaru
_minion_eventu _handle_minion_eventu _returnu _syndic_returnu
minion_runneru pub_retu
minion_pubu minion_publishu revoke_authu _serve_fileu
_file_findu
_file_hashu _file_hash_and_statu
_file_listu _file_list_emptydirsu _dir_listu
_symlink_listu
_file_envsc C� s� | | _ t j j j | j | j d d t �| _ t j j | � | _ t j j j
| � | _ t j j
| j d � | _ t j j | j d t d t d t �| _ | j � t j j j | � | _ d S( u�
Create a new AESFuncs
:param dict opts: The salt options
:rtype: AESFuncs
:returns: Instance for handling AES operations
u sock_dirR8 u conf_filet statest rendt ignore_config_errorsN( R R R= RD RE RF R/ R0 R1 RA RB RC t clientt get_local_clientt localt miniont MasterMinionR5 t mminiont _AESFuncs__setup_fileserverR" R# t RemoteFuncs( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s +
c C� s� d d l } | j j | j � | _ | j j | _ | j j | _ | j j | _
| j j | _ | j j
| _ | j j | _ | j j | _ | j j | _ | j j | _ d S( uK
Set the local file objects from the file server interface
i N( R� R� R� R t fs_t
serve_filet _serve_filet
_find_filet
_file_findt file_hasht
_file_hasht file_hash_and_statt _file_hash_and_statt file_listt
_file_listt file_list_emptydirst _file_list_emptydirst dir_listt _dir_listt symlink_listt
_symlink_listt file_envst
_file_envs( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __setup_fileserver� s c C� s
t j j j | j | � s t St j j | j d d | � } y t j j
| � } WnV t t f k
r~ t
j d | � t St t t f k
r� } t
j d | | � n Xy# t j j | | � d k r� t SWn# t k
r� } t
j d | � n Xt
j d | � t S( ui
Take a minion id and a string signed with the minion private key
The string needs to verify as 'salt' with the minion public key
:param str id_: A minion ID
:param str token: A string signed with the minion private key
:rtype: bool
:return: Boolean indicating whether or not the token can be verified.
u pki_diru minionsuz Salt minion claiming to be %s attempted to communicate with master, but key could not be read and verification was denied.u" Unable to load public key "%s": %sR u Unable to decrypt token: %sud Salt minion claiming to be %s has attempted to communicate with the master and could not be verified( R R= R] t valid_idR RF Re Rg Rh R t get_rsa_pub_keyt IOErrorR� Rl R� R� t
IndexErrorR� R� t public_decryptR5 ( R R� t tokent pub_patht pubR� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt __verify_minion� s* c C� s | j | | � S( ui
Take a minion id and a string signed with the minion private key
The string needs to verify as 'salt' with the minion public key
:param str id_: A minion ID
:param str token: A string signed with the minion private key
:rtype: bool
:return: Boolean indicating whether or not the token can be verified.
( t _AESFuncs__verify_minion( R R� R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt
verify_minion� s c � s� d | j k r t St | j d t � s- t St � f d � d D� � rM t S� d j d � rd t S| j � d � d � s� t j d
� d � t S� j d � g } xc | j d D]T } t
j | � d � r� t | j d | t � r | j
| j d | � q q� q� Wd � d k rq� d j d � � d <g } x% � d D] } | j | j � � qGW| � d <n | j j | � d � d � d � j d d
� d t �S( u
Verify that the passed information authorized a minion to execute
:param dict clear_load: A publication load from a minion
:rtype: bool
:return: A boolean indicating if the minion is allowed to publish the command in the load
u peerc 3� s | ] } | � k Vq d S( N( ( t .0R ( t
clear_load( s/ /usr/lib/python2.7/site-packages/salt/master.pys <genexpr>
s u funu argu tgtu retu toku idu publish.uO Minion id %s is not who it says it is and is attempting to issue a peer commandu ,u tgt_typeu globt publish_validate( u funu argu tgtu retu toku id( R RF R� R9 t anyRi R� Rl R� t popt ret matchR� t extendR Rk RC t
auth_checkRJ R5 ( R R� t permsR� t arg_t arg( ( R� s/ /usr/lib/python2.7/site-packages/salt/master.pyt __verify_minion_publish� s@
"
c � s� t � f d � | D� � r t Sd � k rQ t j d � d t � d d � t S| j � d � d � s� t j d � d � t Sd � k r� � j d � n � S( u�
A utility function to perform common verification steps.
:param dict load: A payload received from a minion
:param list verify_keys: A list of strings that should be present in a
given load
:rtype: bool
:rtype: dict
:return: The original load (except for the token) if the load can be
verified. False if the load is invalid.
c 3� s | ] } | � k Vq d S( N( ( R� R ( RZ ( s/ /usr/lib/python2.7/site-packages/salt/master.pys <genexpr>@ s u toku7 Received incomplete call from %s for '%s', missing '%s'u idu co_nameu& Minion id %s is not who it says it is!( R� RF Rl R� R R� R� R� ( R RZ t verify_keys( ( RZ s/ /usr/lib/python2.7/site-packages/salt/master.pyt
__verify_load3 s
c C� s8 | j | d � } | t k r" i S| j j | d t �S( u�
Return the results from an external node classifier if one is
specified
:param dict load: A payload received from a minion
:return: The results from an external node classifier
u idu tokt skip_verify( u idu tok( t _AESFuncs__verify_loadRF R# t _master_topsR5 ( R RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� S s c C� sb i } i } | j � } x' | D] } | | k r g | | <q q W| | d <| j d | d <| j d | d <| j d | d <| j d � r� | S| j d | d <| j d | d <| j d | d <| j d | d <| j d
| d
<| j d | d <| j d | d <| j d
| d
<| j d | d <| j d | d <| j d | d <| j d | d <| S( u�
Return the master options to the minion
:param dict load: A payload received from a minion
:rtype: dict
:return: The master options
u
file_rootsu top_file_merging_strategyu env_orderu default_topu env_onlyu rendereru failhardu state_topu state_top_saltenvu
nodegroupsu state_auto_orderu state_eventsu state_aggregateu jinja_envu
jinja_sls_envu jinja_lstrip_blocksu jinja_trim_blocks( R� R RJ ( R RZ t moptst
file_rootst envst saltenv( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt _master_optsc s2
c C� s< | j | d � } | t k r" i S| j j | d t �Sd S( u�
Gathers the data from the specified minions' mine
:param dict load: A payload received from a minion
:rtype: dict
:return: Mine data from the specified minions
u idu tgtu funu tokR� N( u idu tgtu funu tok( R� RF R# t _mine_getR5 ( R RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s c C� s8 | j | d � } | t k r" i S| j j | d t �S( u�
Store the mine data
:param dict load: A payload received from a minion
:rtype: bool
:return: True if the data has been stored in the mine
u idu datau tokR� ( u idu datau tok( R� RF R# t _mineR5 ( R RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s c C� s6 | j | d � } | t k r" i S| j j | � Sd S( u
Allow the minion to delete a specific function from its own mine
:param dict load: A payload received from a minion
:rtype: bool
:return: Boolean indicating whether or not the given function was deleted from the mine
u idu funu tokN( u idu funu tok( R� RF R# t _mine_delete( R RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s c C� s< | j | d � } | t k r" i S| j j | d t �Sd S( u�
Allow the minion to delete all of its own mine contents
:param dict load: A payload received from a minion
u idu tokR� N( u idu tok( R� RF R# t _mine_flushR5 ( R RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s c � s� t � f d � d D� � r t St � d t � s7 t S| j d sH t St j j j | j � d � sk t Sd | j d } d � k r� � d d k r� t j
d � t St � d
� � j d d � | k r� t j
d | � d � t Sd � k rt j
d
� d t
� d d � t S| j � d � d � sMt j d � d � i S� j d � t j j � d � } t j j | � } t j j | � s�d � d k r�t St j j | j d d � d d | � } t j j | � j | j d � st j d | � t St j j | � } t j j | � sVy t j | � WqVt j
k
rRqVXn t j j | � r�� d d k r�d } n d } t j j j | | � �E } � d r�| j � d � n | j t j j j! � d
� � Wd QXt" S( um
Allows minions to send files to the master, files are sent to the
master file cache
c 3� s | ] } | � k Vq d S( N( ( R� R ( RZ ( s/ /usr/lib/python2.7/site-packages/salt/master.pys <genexpr>� s u idu pathu locu file_recvi u file_recv_max_sizei u# Invalid file pointer: load[loc] < 0u datau� file_recv_max_size limit of %d MB exceeded! %s will be truncated. To successfully push this file, adjust file_recv_max_size to an integer (in MB) large enough to accommodate it.u toku7 Received incomplete call from %s for '%s', missing '%s'u co_nameu& Minion id %s is not who it says it is!u ../u cachediru minionsu filesud Attempt to write received file outside of master cache directory! Requested path: %s. Access denied.u abu wbN( u idu pathu loci (# R� RF R� R� R R R= R] R� Rl R� t lenRJ R R� R� R� Re t sepRh Rg t normpatht isabsRi t dirnameR� t makedirsRj R� t fopent seekt writeR� R� R5 ( R RZ t file_recv_max_sizet sep_pathR� t cpatht cdirRd t fp_( ( RZ s/ /usr/lib/python2.7/site-packages/salt/master.pyt
_file_recv� sn
&
"
""
&c � s� t � f d � d D� � r t St j j j | j � d � sC t S� d � d d <t j j | j � d � d � j d � j d � � d � j d � d � j d i � d
� j d � d � j d
� �} | j
� } | j j � | j j d t � r�| j
j j d j � d � d i � d d 6| d 6� | j j d � t k r�| j j i � d d 6t � d d d � � q�n | S( u�
Return the pillar data for the minion
:param dict load: Minion payload
:rtype: dict
:return: The pillar data for the minion
c 3� s | ] } | � k Vq d S( N( ( R� R ( RZ ( s/ /usr/lib/python2.7/site-packages/salt/master.pys <genexpr> s u idu grainsu saltenvu envt extu extt pillar_overrideu pillar_overridet pillarenvu pillarenvt extra_minion_datau extra_minion_datau minion_data_cacheu minions/{0}u datau pillaru minion_data_cache_eventsu Minion data cache refreshu refreshu minion( u idu grains( R� RF R R= R] R� R R� t
get_pillarRJ t compile_pillarR{ t update_optsR# t cachet storeR� R5 RD R� R ( R RZ R� R� ( ( RZ s/ /usr/lib/python2.7/site-packages/salt/master.pyt _pillar s0
4c C� sC | j | d � } | t k r" i S| j j | � | j | � d S( u�
Receive an event from the minion and fire it on the master event
interface
:param dict load: The minion payload
u idu tokN( u idu tok( R� RF R# t
_minion_eventt _handle_minion_event( R RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� 4 s
c C� s | d } | j d d � d k r@ t j d | | d d � n x� | j d g � D]� } | j d i � } d | k rS | j d
� } | s� qS n | d } y/ t j j j | j | | d | j d | �Wqt t j
j f k
r} t j d
| | | � qXqS qS Wd S( u5
Act on specific events from minions
u idu tagu u _salt_erroru# Received minion error from [%s]: %su datau messageu eventsu minionsu jidRx t syndic_idu) Could not add minion(s) %s for job %s: %sN( RJ Rl R� R R= t jobt
store_minionsR Rx R� R� t SaltCacheError( R RZ R� RD t
event_datat jidRA R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� C s.
c C� sb | j d r1 d | k r1 t j d | d � t Sd | k rt j d � | j d � } t j j | j d d j | d � � } t
j j j
| � } t
j j | | | � s� t j d | d � | j d r� t j d
| d � t St j d � n | | d <n y/ t
j j j | j | d | j d
| j �Wn' t
j j k
r]t j d | � n Xd S( uU
Handle the return data sent from the minions.
Takes the return, verifies it and fires it on the master event bus.
Typically, this event is consumed by the Salt CLI waiting on the other
end of the event bus but could be heard by any listener on the bus.
:param dict load: The minion payload
u require_minion_sign_messagesu siguo _return: Master is requiring minions to sign their messages, but there is no signature in this payload from %s.u idu* Verifying signed event publish from minionu pki_diru minions/{0}u0 Failed to verify event signature from minion %s.u drop_messages_signature_failuA Drop_messages_signature_fail is enabled, dropping message from %suL But 'drop_message_signature_fail' is disabled, so message is still accepted.RD Rx u, Could not store job information for load: %sN( R Rl R� RF Ra R� Re Rg Rh R� R t serializerst msgpackt serializeR t verify_signatureR� R= R� t store_jobRD Rx R� R� R� ( R RZ t sigt this_minion_pubkeyt serialized_load( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt _returnb s0
)
#c
� s- � j d � } t | t � s* � g } n x�| D]�� t � f d � d D� � rY q1 n � j d � r� d j | j d � } | j j | � d � d � n t j j
| j d d � d � } t j j | � s>t j j | � d
} t j j | � s
t j
| � n t j j j | d � � } | j d � Wd
QXn x� t j � d � D]� \ } } i � d d 6| d 6} | j | � d � k r�� d | d <n d � k r�� d | d <n d � k r�� d | d <n d � k r�� d | d <n d � k r� d | d <n | j | � qRWq1 Wd
S( u�
Receive a syndic minion return and format it to look like returns from
individual minions.
:param dict load: The minion payload
u loadc 3� s | ] } | � k Vq d S( N( ( R� R ( RZ ( s/ /usr/lib/python2.7/site-packages/salt/master.pys <genexpr>� s u returnu jidu idu
{0}.save_loadu master_job_cacheu cachediru syndicsi u wu Nu master_idu funu argu fun_argsu outu sig( u returnu jidu id( RJ R� R� R� R� R Rx R7 Re Rg Rh t existsR R� R R= R� R� R� R R� R� R� (
R RZ t loadsR� t syndic_cache_patht path_namet wfhR R, R[ ( ( RZ s/ /usr/lib/python2.7/site-packages/salt/master.pyt _syndic_return� s>
"#
c C� s6 | j | d � } | t k r" i S| j j | � Sd S( u�
Execute a runner from a minion, return the runner's function data
:param dict clear_load: The minion payload
:rtype: dict
:return: The runner function data
u funu argu idu tokN( u funu argu idu tok( R� RF R# t
minion_runner( R R� RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s c C� s� | j | d � } | t k r" i St j j | j d d � } t j j | � s` t j | � n t j j | t j | d � � } t
j j j
| d � �! } | d | j � k s� i SWd QX| j j | d � S( u
Request the return data from a specific jid, only allowed
if the requesting minion also initialted the execution.
:param dict load: The minion payload
:rtype: dict
:return: Return data corresponding to a given JID
u jidu idu toku cachediru publish_authu rN( u jidu idu tok( R� RF Re Rg Rh R R� R� R t text_typeR R= R� R� t readRu t get_cache_returns( R RZ t
auth_cachet jid_fnR� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt pub_ret� s
"
c C� s' | j | � s i S| j j | � Sd S( uL
Publish a command initiated from a minion, this method executes minion
restrictions so that the minion publication will only work if it is
enabled in the config.
The configuration on the master allows minions to be matched to
salt functions, so the minions can only publish allowed salt functions
The config will look like this:
.. code-block:: bash
peer:
.*:
- .*
This configuration will enable all minions to execute all commands:
.. code-block:: bash
peer:
foo.example.com:
- test.*
The above configuration will only allow the minion foo.example.com to
execute commands from the test module.
:param dict clear_load: The minion pay
N( t _AESFuncs__verify_minion_publishR# t
minion_pub( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s c C� s' | j | � s i S| j j | � Sd S( uD
Publish a command initiated from a minion, this method executes minion
restrictions so that the minion publication will only work if it is
enabled in the config.
The configuration on the master allows minions to be matched to
salt functions, so the minions can only publish allowed salt functions
The config will look like this:
.. code-block:: bash
peer:
.*:
- .*
This configuration will enable all minions to execute all commands.
peer:
.. code-block:: bash
foo.example.com:
- test.*
The above configuration will only allow the minion foo.example.com to
execute commands from the test module.
:param dict clear_load: The minion payload
N( R� R# t minion_publish( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� s c C� sc | j | d � } | j j d t � s? t j d | d � | S| t k rO | S| j j | � Sd S( u2
Allow a minion to request revocation of its own key
:param dict load: The minion payload
:rtype: dict
:return: If the load is invalid, it may be returned. No key operation is performed.
:rtype: bool
:return: True if key was revoked, False if not
u idu toku allow_minion_key_revokeuK Minion %s requested key revoke, but allow_minion_key_revoke is set to FalseN( u idu tok( R� R RJ RF Rl R� R# t revoke_auth( R RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� ' s c C� sg | j d � r i i d d 6f St | | � r� yB t j � } t | | � | � } t j d | t j � | � Wq� t k
r� d } t j d | d t �q� Xn! t j d | � t i d d 6f S| d k r� | i d d 6f S| d
k rVd | k rV| j
d � d
k r3| j d d k r3| i d d 6f S| i d d 6d d 6| d d 6f S| i d d 6f S( u�
Wrapper for running functions executed with AES encryption
:param function func: The function to run
:return: The result of the master function that was called
u __u sendu funu' Master function call %s took %s secondsu u Error in function %s:
R� uH Received function %s which is unavailable on the master, returning Falseu _returnu _pillaru idu veru 2u pillar_versioni u send_privateu pillaru keyu tgt( Ri RD R- RK Rl Ra R� R� R5 RF RJ R ( R t funcRZ R� R[ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRe A s.
(#( u
verify_minionu _master_topsu
_ext_nodesu _master_optsu _mine_getu _mineu _mine_deleteu _mine_flushu
_file_recvu _pillaru
_minion_eventu _handle_minion_eventu _returnu _syndic_returnu
minion_runneru pub_retu
minion_pubu minion_publishu revoke_authu _serve_fileu
_file_findu
_file_hashu _file_hash_and_statu
_file_listu _file_list_emptydirsu _dir_listu
_symlink_listu
_file_envs( R& R' R( Rn R Ry R� R� R� R� R� t
_ext_nodesR� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� Re ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRi � sB &
4 # S # ) - # # Rh c B� s� e Z d Z d Z d � Z d � Z d � Z d
� Z d � Z d � Z d
� Z
d � Z d � Z e
d � � Z e d � Z d � Z d � Z RS( u~
Set up functions that are safe to execute when commands sent to the master
without encryption and authentication
u pingu publishu get_tokenu mk_tokenu wheelu runnerc C� s� | | _ | | _ t j j j | j | j d d t �| _ t j j | j d � | _ t j j
j | � | _ t j
j | � | _ t j j | j d t d t d t �| _ t j j | � | _ t j j j | | � | _ d S( Nu sock_dirR8 u conf_fileRp Rq Rr ( R R R R= RD RE RF Rs Rt Ru RA RB RC t autht LoadAutht loadauthRv Rw R5 Rx t wheelt Wheelt wheel_R" R# t
LocalFuncs( R R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR { s + c C� s | j | � \ } } } } | j j | | d | �} | j d � } | rV i | d 6S| j d � } | d k r| j j | j d g � | d | j d i � � } | s� i i | d 6d j | | � d
6d 6St | t � r� d | k r� | Sx| | D] }
| j |
d � q� Wn[ d | k r\| d } t j j
| � j � rn| j j d d � } qnn t j j j � } yG | j d � } t j j | j � } | j | | j d i � | � SWnU t k
r }
t j d | |
� i i |
j j d 6|
j d
6t j |
� d
6d 6SXd S( uJ
Send a master control function back to the runner system
R u erroru usernameu useru auth_listu funu kwargu nameu; Authentication failure of type "{0}" occurred for user {1}.u messageu rootu- Exception occurred while introspecting %s: %su argsN( t _prep_auth_infoR� t check_authenticationRJ RC t runner_checkR� R� R9 R� R� R R� t AuthUsert is_sudoR R= R� R� R: R; t asynchronousR� Rl R� RS R& R� R R� ( R R� t auth_typet err_nameR t sensitive_load_keysR� R� t usernameR� R, t funRL R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR: � sF
c C� s� | j | � \ } } } } | j j | | d | �} | j d � } | rV i | d 6S| j d � } | d k r| j j | j d g � | d | j d i � � } | s� i i | d 6d j | | � d
6d 6St | t � r� d | k r� | Sx| | D] }
| j |
d � q� Wn[ d | k r\| d } t j j
| � j � rn| j j d d � } qnn t j j j � } y� t j j j | j � } | j d � } t | d d
�}
i d j | � d 6| d 6|
d 6| d 6} | j j | t | d g d
� � | j j | d t | �} | d | d <| d | d <| j j | t | d g d
� � i |
d 6| d 6SWn� t k
r�} t j d | | � d j | | j j | � | d <t | d <| j j | t | d g d
� � i |
d 6| d 6SXd S( uI
Send a master control function back to the wheel system
R u erroru usernameu useru auth_listu funu kwargu nameu; Authentication failure of type "{0}" occurred for user {1}.u messageu roott prefixu wheelu wheel.{0}u jidu tagu newt full_returnu returnu successu retu datau- Exception occurred while introspecting %s: %su) Exception occurred in wheel {0}: {1}: {2}N(! R� R� R� RJ RC t wheel_checkR� R� R9 R� R� R R� R� R� R R= R� R� R� t gen_jidR RD R� R� t call_funcR5 R� Rl R� RS R& RF ( R R� R� R R R R� R� R R R, R� R Rv R� R[ R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � sb
""
"
c C� s- | j j | � } | s) t j d � d S| S( u�
Create and return an authentication token, the clear load needs to
contain the eauth key and the needed authentication creds.
u0 Authentication failure of type "eauth" occurred.u ( R� t mk_tokenRl R� ( R R� R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR s
c C� s$ d | k r t S| j j | d � S( uZ
Return the name associated with a token or False if the token is invalid
u token( RF R� t get_tok( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt get_token s c
C� s� | j d i � } t j j | j d � } | j | d � sQ | j | d � r� t j d | d | d � i i d d 6d d 6d
6S| j d i � j d t � } | j
j | d | j d
d � | � } | j d t � � } | j d t � � } | j d t
� } | j | � \ } }
} } | d k rL| j j | | d | �}
n | j j | | � }
|
j d g � } d j | � } |
j d
� r�t j | � i i d d 6d d 6d
6S| d k s�| d k r�| r�| j
j | | d | d | d | j d
d � d | d d g �} | s�| d k ri| rid | k rid | k rit j d | d | d � n t j | � i i d d 6d d 6d
6S| d k r�|
j d � } | | d <t j d | � q�| d k r�| j j | � | d <q�n | j j d � s>| s>i d! d" 6i d( d# 6| d 6d$ j | d � d
6d% 6Sn | j | | � } | d( k rui d! d" 6i d& d
6d% 6S| j | | | | | � } | j | d' | �| j | � i d! d" 6i | d# d# 6| d 6| d 6d% 6S() ut
This method sends out publications to the minions, it can only be used
by the LocalClient.
u kwargsu publisher_acl_blacklistu useru funuq %s does not have permissions to run %s. Please contact your local administrator if you believe this is in error.
u AuthorizationErroru nameu Authorization error occurred.u messageu erroru delimiteru tgtu tgt_typeu globu minionsu missingu ssh_minionsR u auth_listu. Authentication failure of type "{0}" occurred.u AuthenticationErroru Authentication error occurred.u argRA t whitelistu saltutil.find_jobu eauthu usernameu8 Auth configuration for eauth "%s" and user "%s" is emptyu tokenu Minion tokenized user = "%s"u
order_mastersu clearu encu jidu/ Master could not resolve minions for target {0}u loadu Master failed to assign jidt ssh_minionsN( RJ R t aclt PublisherACLR t user_is_blacklistedt cmd_is_blacklistedRl R� R RC t
check_minionsR� RF R� R� R� R� R� R� Rm t load_nameR� t _prep_jidt _prep_pubt
_send_ssh_pubt _send_pub( R R� t extrat
publisher_aclt delimitert _resRA t missingR
R� R R R R� t auth_listt err_msgt
authorizedR R� R/ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt publish# s�
+
c C� s| g } d } d | k r0 d } d } d g } n< d | k rW d } d } d d g } n d } d } | j } | | | | f S( Nu tokenu TokenAuthenticationErroru eauthu EauthAuthenticationErroru usernameu passwordu useru UserAuthenticationError( R� R ( R R� R R R� R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR� � s c C� s� | j d � r | d n d } | j d t � } d j | j d � } y# | j j | d | d | � } WnH t t f k
r� d j | j d � d � } t
j | � i | d
6SX| S( u3
Return a jid for this publication
u jidu nocacheu {0}.prep_jidu master_job_cachet nocachet
passed_jiduK Failed to allocate a jid. The requested returner '{0}' could not be loaded.u .i u errorN( RJ R� RF R� R Rx R7 R� R� R Rl R� ( R R� R R" R! R� R� t msg( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s
c C� sI xB t | j � D]1 \ } } t j j j j | � } | j | � q Wd S( uQ
Take a load and send it across the network to connected minions
N( R R R RN R R R R ( R RZ RN R R* ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s c C� s: t | d � s3 t j j j j d | j � | _ n | j S( Nu _ssh_clientR� ( RD R Rs t ssht SSHClientR t _ssh_client( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt
ssh_client� s $c C� sU | j d t k rQ | t k rQ t j d � t j d | j j d | � j � n d S( uK
Take a load and send it across the network to ssh minions
u enable_ssh_minionsu Send payload to ssh minionsR� R2 N( R R5 Rl Rm R� R� R' R] R� ( R RZ R
( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s
c
C� s� | | d <| j d i � j d t � } | j j i | d 6| d � i | d d 6| d d 6| d d 6| d d 6| d d 6| d d 6| d 6| d
6} | j j | t | d d g d � � | j d
r�d j | j d
� } t } yL t j j
j | j j
| � }
d |
j
k r6t j d | j d
� n Wn4 t t f k
rmt } t j d | j d
� n X| r�y% | j j
| | d | d | �Wq�t k
r�t j d d t �q�Xq�n y8 d j | j d � } | j j
| | d | | � WnK t k
r(t j d | j d � n$ t k
rKt j d d t �n Xi d d 6} i | d d 6| d d 6| d d 6| d d 6| d d 6} d | j k r�| j d | d <n d | k r�| d | d <n | t k r�| | d <n d | k r | d | d <n d | k r)| d | d <n d | k rF| d | d <n d | k r'd | d k r|| d j d � | d <n d | d k r�| d j d � | d <n d | d k r�| d j d � | d <n d | d k r�| d j d � | d <n d | d k r'| d j d � | d <q'n d | k rft j d! | d | d | d � | d | d <n t j d" | d | d � t j d# | � | S($ u�
Take a given load and perform the necessary steps
to prepare a publication.
TODO: This is really only bound by temporal cohesion
and thus should be refactored even further.
u jidu kwargsu delimiteru minionsu tgt_typeu tgtu useru funu argu missingu newu jobu
ext_job_cacheu
{0}.save_loadu� The specified returner used for the external job cache '%s' does not have a 'minions' kwarg in the returner's save_load function.u_ The specified returner used for the external job cache "%s" does not have a save_load function!RA u, The specified returner threw a stack trace:
R� u master_job_cacheu] The specified returner used for the master job cache "%s" does not have a save_load function!u aesu encu retu master_idu idu tou
ret_configu metadatau module_executorsu
executor_optsu
ret_kwargsu( User %s Published command %s with jid %su Published command %s with jid %su Published command details %s( RJ R RD R� R R R� R5 R R= R� t get_function_argspecRx R7 Rl R� Ro R� RF R� R� Rm (
R RA R� R� R R R t new_job_loadR� t save_load_funct arg_specR/ RZ ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR � s�
&
%
"
c C� s | S( u3
Send the load back to the sender.
( ( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt ping] s ( u pingu publishu get_tokenu mk_tokenu wheelu runner( R& R' R( Rn R R: R� R R R R� R R t propertyR' RF R R R, ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyRh k s 7 G n �t
FloMWorkerc B� s) e Z d Z d � Z d � Z d � Z RS( u6
Change the run and bind to be ioflo friendly
c C� s t j | | | � d S( N( R? R ( R R R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR h s c C� s2 t j j j | j j � t j j | j | j � | _
t j j | j � | _ t
j d � | _ | j j t
j � | _ | j j d d � d k r� d j | j j d d � � | _ n( d j t j j | j d d
� � | _ t j d | j � t
j � | _ | j j | j t
j � | j j | j � d S(
uR
Prepare the needed objects and socket for iteration within ioflo
i u ipc_modeu u tcpu tcp://127.0.0.1:{0}u tcp_master_workersi� u ipc://{0}u sock_diru workers.ipcu ZMQ Worker binding to socket %sN( R R= R RR RS R& R� Rh R R Rb Ri R\ R t Contextt contextt sockett REPRJ R� t w_uriRe Rg Rh Rl R� t Pollert pollert registert POLLINt connect( R ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR n s "c C� s� yu | j j d � } | rt | j j � } | j � | j j | � } | j j | j | � � } | j j | � n WnN t
k
r� � n; t k
r� } t | t
j � r� | j t j k r� d Sn Xd S( u)
Handle a single request
i N( R5 t pollR1 t recvt _update_aesR1 R� t dumpsRQ t sendRR R� R� R t ZMQErrort errnot EINTR( R t polledt packageR/ R[ R� ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt handle_request� s
$( R& R' R( R R RC ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyR. d s (o R( t
__future__R R R R R� R Rf Re R� R� R- R? R Rw t loggingRH R R� t salt.serializers.msgpackR t salt.extR t salt.ext.six.movesR t salt.utils.zeromqR R R R t tornado.genRW t
salt.cryptt salt.clientt salt.client.ssh.clientt salt.exceptionst salt.payloadt salt.pillart
salt.statet salt.runnert salt.autht
salt.wheelt salt.miniont salt.keyt salt.aclt salt.enginest salt.daemons.masterapit salt.defaults.exitcodest salt.transport.servert salt.log.setupt salt.utils.argst salt.utils.atomicfilet salt.utils.cryptt salt.utils.eventt salt.utils.filest salt.utils.gitfst salt.utils.gzip_utilt salt.utils.jidt salt.utils.jobt salt.utils.mastert salt.utils.minionst salt.utils.platformt salt.utils.processt salt.utils.schedulet salt.utils.ssdpt salt.utils.stringutilst salt.utils.usert salt.utils.verifyt salt.configR
t
salt.defaultsR t salt.transportR t salt.utils.debugR
R R R t salt.utils.odictR R� R5 R� t ImportErrorRF R8 R t tornado.stack_contextR t salt.utils.ctxR t getLoggerR& Rl t objectR R= RQ t$ SignalHandlingMultiprocessingProcessR) R� R� R R R? Rm Ri Rh R. ( ( ( s/ /usr/lib/python2.7/site-packages/salt/master.pyt <module> s� " "
) � �� ' � �� � �� �
Mini Shell