Current File : //proc/227033/task/227033/root/proc/227033/root/lib/python2.7/site-packages/salt/state.pyc
�
���^c # @@ sT d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l j j Z d d l Z d d l! Z d d l" Z d d l# j$ Z$ d d l% Z d d l& m' Z( m) Z* d d l+ m, Z, m- Z- d d l. m/ Z/ m0 Z0 d d l1 m2 Z2 m3 Z3 d d l4 j j5 Z5 d d l6 Z6 d d l7 m8 Z8 d d l9 m: Z: m; Z; m< Z< e
j= e> � Z? e@ d
d d d
d d d d d d d d g � ZA e@ d d d d d d g � ZB e@ d d d d d d! d" d# d$ d d d d% d& d' d( d) d* d+ d, d- d. d/ d0 d1 d2 d3 d4 d5 d6 d7 d8 d9 d: g" � ZC eA jD eB � jD eC � ZE d; � ZF eF e2 _G d< � ZH d= � ZI d> � ZJ d? � ZK d@ � ZL dA � ZM dB � ZN dC � ZO dD � ZP dE � ZQ dF � ZR dG � ZS dH � ZT dI � ZU dJ eV f dK � � YZW dL eX f dM � � YZY dN eX f dO � � YZZ dP eX f dQ � � YZ[ dR e[ f dS � � YZ\ dT eZ f dU � � YZ] dV e\ f dW � � YZ^ dX eX f dY � � YZ_ d S(Z u�
The State Compiler is used to execute states in Salt. A state is unlike
an execution module in that instead of just executing a command, it
ensures that a certain state is present on the system.
The data sent to the state calls is as follows:
{ 'state': '<state module name>',
'fun': '<state function name>',
'name': '<the name argument passed to all states>'
'argn': '<arbitrary argument, can have many of these>'
}
i ( t absolute_importt print_functiont unicode_literalsN( t serializet deserialize( t compile_templatet compile_template_str( t SaltRenderErrort SaltReqTimeoutError( t OrderedDictt DefaultOrderedDict( t six( t mapt ranget
reload_moduleu onchangesu
onchanges_anyu onfailu
onfail_anyu onfail_stopu prerequ prerequiredu watchu watch_anyu requireu require_anyu listenu onchanges_inu onfail_inu prereq_inu watch_inu
require_inu listen_inu funu stateu check_cmdu failhardu onlyifu unlessu retryu orderu parallelu reload_modulesu
reload_grainsu
reload_pillaru runasu runas_passwordu
fire_eventu saltenvu useu use_inu __env__u __sls__u __id__u __orchestration_jid__u
__pub_useru __pub_argu __pub_jidu __pub_funu __pub_tgtu __pub_retu __pub_pidu __pub_tgt_typeu
__prereq__c C@ s
t | � S( N( t id( t self( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _odict_hashable� s c C@ s; | j d � \ } } } } i | d 6| d 6| d 6| d 6S( uN
Take a low tag and split it back into the low dict that it came from
u _|-u stateu __id__u nameu fun( t split( t tagt statet id_t namet fun( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
split_low_tag� s
c C@ s
d j | � S( uJ
Generate the running dict tag string from the low data structure
u/ {0[state]}_|-{0[__id__]}_|-{0[name]}_|-{0[fun]}( t format( t low( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _gen_tag� s c C@ s t j j j | � S( u*
Make tag name safe for filenames
( t saltt utilst filest safe_filename_leaf( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
_clean_tag� s c C@ s> i d j | � d 6d j | � d 6d d 6d d 6} t | � S( Nu
listen_{0}u nameu __id__u Listen_Erroru stateu fun( R R ( R R R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _l_tag� s
c C@ s| t j j � } | t j j � t j j � } t j j � } | j � j � } | | } | j d | j d } | | f S( uk
Generate a NULL duration for when states do not run
but we want the results to be consistent.
i@B g @�@( t datetimet utcnowt nowt timet isoformatt secondst microseconds( t utc_start_timet local_start_timet utc_finish_timet
start_timet deltat duration( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _calculate_fake_duration� s
c C@ s; t j j | d � } t j j | � s7 t j | � n | S( ug
Return the directory that accumulator data is stored in, creating it if it
doesn't exist.
u accumulator( t ost patht joint isdirt makedirs( t cachedirt fn_( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt get_accumulator_dir� s c C@ s> t t | � � } d | k r: i | | | j d � d 6S| S( u.
Trim any function off of a requisite
u .i ( t nextt iterR ( t reqt reqfirst( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt trim_req� s c C@ s� t � } | | k r | S| | | k r- | Sx\ | | | D]L } t | t � sW q< n t | � d k ro q< n | j t t | � � � q< W| S( uA
Return a set of the arguments passed to the named state
i ( t sett
isinstancet dictt lent addR8 R9 ( R R t hight argst item( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
state_args� s c C@ sC g } | | k r( | j | | f � n| d k r� xt j | � D]> \ } } | d | k rD | j | t t | � � f � qD qD Wn� x� | D]� } | | | k r� t | | | t � r;xx | | | D]e } t | t � s� q� n t | � d k r� q� n | t t | � � | k r� | j | | f � q� q� Wq;q� q� W| S( u�
Scan high data for the id referencing the given name and return a list of (IDs, state) tuples that match
Note: if `state` is sls, then we are looking for all IDs that match the given SLS
u slsu __sls__i ( t appendR t iteritemsR8 R9 R> t listR? R@ ( R R RB t ext_idt nidRD t arg( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt find_name� s$ )
$c C@ s� g } x� t j | � D]� \ } } y | d } Wn6 t k
rh | d k r t j d | | � q q q X| | k r x9 | D]. } | j d � r� q| n | j | | f � q| Wq q W| S( uT
Scan for all ids in the given sls and return them in a dict; {name: state}
u __sls__u __exclude__u2 Invalid non-dict item '%s' in high data. Value: %ru __( R RG t TypeErrort logt errort
startswithRF ( t slsRB t retRJ RD t sls_tgtt st_( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt find_sls_ids s
c C@ s! d } t | t � rd | k r | d } | sZ | d rH | d } q�d j | � } nNt | t � r�d | k r� t | d t j � r� d j | d � } q� n t g t j | � D] } t | t � ^ q� � r�t g t j | � D] } d | k od | k ^ q� � r�d } x� | D] } | | d } | rR| t d
f k rRd
} n | | d } | r�| t d
f k r�d
} n | d j | | | � 7} q Wq�q�n | s�t j | d � } n | d t
k s�| d d
k r�t j | � qt j
| � q n t j t j | � � d
S( u-
Format the state into a log message
u u changesu commentu No changes made for {0[name]}u diffu File changed:
{0}u oldu newu Made the following changes:
u absentu" '{0}' changed from '{1}' to '{2}'
u resultN( R> R? R R t string_typest allt
itervaluest Falset Nonet text_typet TrueRN t infoRO ( RR t msgt chgt xt pkgt oldt new( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
format_log s<
14
& c C@ s" t | | | | | � } | j � S( uQ
Compile the master side low state data, and build the hidden state file
( t MasterHighStatet compile_highstate( t master_optst minion_optst grainsR t saltenvRT ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt master_compileH s c C@ s' y t | � Wn t k
r" t SXt S( N( t hashRM RY R\ ( t obj( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
ishashableP s
c C@ sI | d r | d d } n | d d } i | d 6d d 6i d 6t d 6S( uo
Returns a mocked return dict with information about the run, without
executing the state function
u argsi u kwargsu nameu Not called, mockedu commentu changesu result( R\ ( t cdataR ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt mock_retX s
t
StateErrorc B@ s e Z d Z RS( u!
Custom exception class.
( t __name__t
__module__t __doc__( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRq i s t Compilerc B@ sM e Z d Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z RS( uB
Class used to compile and manage the High Data structure
c C@ s | | _ | | _ d S( N( t optst rend( R Rv t renderers( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt __init__t s c K@ sJ t | | j | j d | j d | j d | � } | s= | S| j | � S( u2
Enforce the states in a template
u rendereru renderer_blacklistu renderer_whitelist( R Rw Rv t pad_funcs( R t templatet kwargsRB ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt render_templatex s
c C@ s� x�| D]�} t | | t � s� t | | t j � r� d | | k r | | j d � } t | � d k r� d j | d t | � !� | d <n i | d g | d 6| | <q q q q� n t � } xt | | � D]� } | j d � r� q� n t | | | t
� s q� n d | k r�| j d � } t | � d k r[d j | d t | � !� | d <n | d | k rqq� n | | j | � | | | d <| | | d j | d � | j
| d � q� n | j
| � q� Wq W| S( uI
Turns dot delimited function refs into function strings
u .i i i u _( R> R? R RV R R@ R2 R= t sortedRP RH t popRF RA ( R RB R t compst skeyst key( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRz � s:
# #
c C@ sj g } t | t � s% | j d � n t � } x5t j | � D]$\ } } | j d � r_ q> n t | t j � s� | j d j | | d t | � j
� � n t | t � s� d j | | � } | j | � q> n x�| D]�} | j d � r� q� n t | | t � s&| j d j | | d � � q� d } d | k rE| d 7} n x�| | D]�} t | t j � r�| d 7} d
| j � k r�| j d j | | | d � � q�qPt | t � rPt
t | � � }
|
d k r�t | |
t � s
| j d j |
| | d � � n�i | d 6| | <x�| |
D]} t | t j � rQi | d 6} n t | t � s�d j | | d � } | j | � q)n t
t | � � } | | }
d | k r�| j d j | | | d | | j d � � � n t |
� s | j d j t j |
� | d � � q)n | | | |
<|
| k r)| | |
k r�| |
| | k r�| |
d | | |
k r�d j | d | |
� } | j | � q�q�q�q)q)Wt t | � � d k r�| j d j | | d � � q�q�qPqPW| s2| d k s� | d
k rq� n | j d j | | d � � q� | d k r� | j d j | | d � � q� q� Wq> W| S( uT
Verify that the high data is viable and follows the data structure
u, High data is not a dictionary and is invalidu __u= ID '{0}' in SLS '{1}' is not formed as a string, but is a {2}u __sls__u4 The type {0} in {1} is not formatted as a dictionaryu0 State '{0}' in SLS '{1}' is not formed as a listi u .i u u� The function "{0}" in state "{1}" in SLS "{2}" has whitespace, a function with whitespace is not supported, perhaps this is an argument that is missing a ":"u requireu watchu prerequ onchangesuJ The {0} statement in state '{1}' in SLS '{2}' needs to be formed as a listu stateu iduM Requisite declaration {0} in SLS {1} is not formed as a single key dictionaryuu Invalid requisite type '{0}' in state '{1}', in SLS '{2}'. Requisite types must not contain dots, did you mean '{3}'?u$ Illegal requisite "{0}", is SLS {1}
u< A recursive requisite was found, SLS "{0}" ID "{1}" ID "{2}"uE Multiple dictionaries defined in argument of state '{0}' in SLS '{1}'u0 No function declared in state '{0}' in SLS '{1}'u7 Too many functions declared in state '{0}' in SLS '{1}'( u requireu watchu prerequ onchanges( R> R? RF R R RG RP RV R t typeRr RH t stripR8 R9 t findRn R[ R@ ( R RB t errorst reqsR t bodyt errR R RK t argfirstR: t req_keyt req_val( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt verify_high� s�
c C@ s� d } xi | D]a } d | k r
t | d t � s8 q
n | d } | | d k rn | d k rn | d } qn q
q
Wx| D]� } d | k r� | | d <qy n t | d t t f � s� | d d k r� | d | d <q� | d d k r� d | d <q� | | d <n d | k r-| d | j d � d | d <n | d d k rV| d | d | d <n t j j j | d
� | d
<qy W| j d d � � | S(
ux
Sort the chunk list verifying that the chunks follow the order
specified in the order options.
i u orderi id u lasti@B u firstu
name_orderg ��@u nameR� c S@ s | d d j | � f S( Nu orderu {0[state]}{0[name]}{0[fun]}( R ( t chunk( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt <lambda>d s ( R> t intt floatR R R t datat decodet sort( R t chunkst capR� t chunk_order( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt order_chunksE s2
"!c C@ s� g } xyt j | � D]h\ } } | j d � r7 q n xDt j | � D]3\ } } t � } g } | j d � rw qG n i | d 6| d 6} d | k r� | d | d <n d | k r� | d | d <n | | d <x� | D]� }
t |
t j � r| j |
� q� n t |
t � r� xl t j |
� D]X \ } } | d k rkx* | D]" }
|
| k r?| j |
� q?q?Wq q | j |
� q Wq� q� W| rCd } x� | D]� } t
j | � } t | t � r�t t j
| � � } | | d <t t | j | | � � n
| | d <| | d <| d } x% | D] } | | d
<| j | � qWq�WqG t
j | � } x% | D] } | | d
<| j | � qYWqG Wq W| j | � } | S( u�
"Compile" the high data as it is retrieved from the CLI or YAML into
the individual state executor structures
u __u stateu nameu __sls__u __env__u __id__u namesi u
name_orderu fun( R RG RP R= R> RV RA R? RF t updatet copyt deepcopyR8 t iterkeysRH R R� ( R RB R� R R� R t runt funcst namesR� RK R� t valt _namet
name_ordert entryt livet low_nameR ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt compile_high_datag s`
c
C@ sz d | k r | St � } t � } | j d � } x� | D]� } t | t j � r` | j | � n t | t � r8 t | � d k r� q8 n t t j | � � } | d k r� | j | d � q� | d k r� | j | d � q� q8 q8 W| rIx] t j
| � D]I \ } } | j d � rq� n | j d d � | k r� | j | � q� q� Wn x* | D]" } | | k rP| j | � qPqPW| S( ui
Read in the __exclude__ list and remove all excluded objects from the
high data
u __exclude__i u slsu idu __u __sls__u (
R= R R> R RV RA R? R@ R8 R� RG RP t get(
R RB t ex_slst ex_idt excludet excR� R R� R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
apply_exclude� s4
(
Rr Rs Rt Ry R} Rz R� R� R� R� ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRu p s 1 � " 9t Statec B@ s� e Z d Z d, d, d, d, d, e d d, d � Z d � Z d � Z d � Z d � Z d � Z
d � Z d � Z d
� Z
d � Z d, d, d � Z d
� Z d � Z d � Z d � Z d � Z d � Z d, d � Z d � Z d � Z d � Z d � Z d � Z e j j j j d d � d, d, d d � � Z! d � Z" d � Z# d � Z$ d � Z% d! � Z& d" � Z' d# � Z( e d$ � Z) e d% � Z* d& � Z+ d' � Z, d, d( � Z- d) � Z. d* � Z/ d+ � Z0 RS(- u+
Class used to execute salt states
u statesc
C@ s� | | _ d | k r. t j j | � | d <n | | _ | | _ | | _ | d k r� y | j � } Wq� t k
r� t
j | � j � } q� Xn | | _ t
j d � | r� | j r� | | j d <n~ | j � | j d <| j rEt j j j | j d | j | j j d d � | j j d d � | j j d t � � | j d <n t
j d � | p[i | _ | j � t � | _ t � | _ i | _ d
| _ | | _ t
j t | � � | _ i | _ | | _ d S( Nu grainsu# Gathering pillar data for state runu pillaru pillar_source_merging_strategyu smartu rendereru yamlu pillar_merge_listsu, Finished gathering pillar data for state runi (! t
states_loaderR t loaderRi Rv t proxyt _pillar_overrideRZ t lowert AttributeErrorR R[ t _pillar_encRN t debugt _gather_pillarR t
dictupdatet mergeR� RY t state_cont load_modulesR= t activet mod_initt pret _State__run_numt jidR t instance_idt inject_globalst mocked(
R Rv t pillar_overrideR� t
pillar_encR� t contextR� R� t initial_pillar( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRy � sD
"
c C@ s~ | j r&| j r� yS t j j j | j | j d t d t | d d � d | j d | j d �| _ Wq� t
k
r� } t j d | � q� Xn t
| j t j � r� y" t j | j d t j �| _ Wq� t
k
r� } t j d � t j | � q� Xn t
| j t � s&t j d
� d | _ q&n t j j | j | j d | j d | j d
d | j d | j j d � �} | j � S( uK
Whenever a state run starts, gather the pillar data fresh
t translate_newlinesRx u rendRv t
valid_rendu decrypt_pillar_renderersu% Failed to decrypt pillar override: %st Loaderu" Failed to load CLI pillar overrideu. Pillar override was not passed as a dictionaryu grainsu idu saltenvR� t pillarenvu pillarenvN( R� R� R R t cryptt decryptR\ t getattrRZ Rv t ExceptionRN RO R> R RV t
yamlloadert loadt SaltYamlSafeLoadert exceptionR? t pillart
get_pillarR� t compile_pillar( R R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� � s>
c C@ s� y# | j d j | d | d � Wn t k
r7 d SXd j | d � } | d | j k r� | | j j k r� | j | | � } | s� d S| j j | d � q� n d S( u�
Check the module initialization function, if this is the first run
of a state package that has a mod_init function, then execute the
mod_init function in the state module.
u {0}.{1}u stateu funNu {0}.mod_init( t statesR t KeyErrorR� t _dictRA ( R R t minitt mret( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _mod_init% s #
c C@ s� | j d d � } d | k r, | d } n | t k rH | d g } n t | t � s[ | S| d | k r� | j d � r� d j | d � } | | j k r� y' | j | | | | � } t | d <Wq� t k
r� t j d | d � q� Xq� n | S( uQ
Execute the aggregation systems to runtime modify the low chunk
u
config.optionu state_aggregateu aggregateu stateu __agg__u {0}.mod_aggregateu( Failed to execute aggregate for state %s(
t functionsR\ R> RH R� R R� RM RN RO ( R R t runningR� t agg_optt agg_fun( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _mod_aggregate8 s
c C@ s$ i t d 6g d 6} i } d | j d k rJ | j d j d � | d <n d | k r� | j | | � } | d | d <| d j | d � d | k r� | d | d <q� n d | k r | j | | � } | d p� | d | d <| d j | d � d | k r | d p| d | d <q n | S( uR
Check that unless doesn't return 0, and that onlyif returns a 0.
u resultu commentu shellu grainsu onlyifu
skip_watchu unless( RY Rv R� t _run_check_onlyifRF t _run_check_unless( R t low_dataRR t cmd_optst _ret( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
_run_checkM s" c C@ s i t d 6} t | d t � s0 | d g } n
| d } x� | D]� } t | t j � sx | j i d d 6t d 6� | S| j d | d t d t | �} t j d | � | d k r� | d t k r� | j i d
d 6t d 6t d 6� | S| d k rA | j i d d 6t d 6� qA qA W| S(
uR
Check that unless doesn't return 0, and that onlyif returns a 0.
u resultu onlyifu( onlyif execution failed, bad type passedu commentu cmd.retcodet ignore_retcodet python_shellu Last command return code: %si u onlyif condition is falseu
skip_watchu onlyif condition is true(
RY R> RH R RV R� R� R\ RN R� ( R R� R� RR t low_data_onlyifR� t cmd( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� i s&
"c C@ s i t d 6} t | d t � s0 | d g } n
| d } x� | D]� } t | t j � sx | j i d d 6t d 6� | S| j d | d t d t | �} t j d | � | d k r� | d t k r� | j i d
d 6t d 6t d 6� qA | d k rA | j i d d 6t d 6� | SqA W| S(
uR
Check that unless doesn't return 0, and that onlyif returns a 0.
u resultu unlessu* unless condition is false, bad type passedu commentu cmd.retcodeR� R� u Last command return code: %si u unless condition is trueu
skip_watchu unless condition is false(
RY R> RH R RV R� R� R\ RN R� ( R R� R� RR t low_data_unlessR� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� � s&
c C@ s� i t d 6} i } d | j d k rC | j d j d � | d <n x� | d D]� } | j d | d t d t | �} t j d | � | d k r� | d t k r� | j i d
d 6t d 6� qN | d k rN | j i d d 6t d 6� | SqN W| S(
uD
Alter the way a successful state run is determined
u resultu shellu grainsu check_cmdu cmd.retcodeR� R� u Last command return code: %si u( check_cmd determined the state succeededu commentu% check_cmd determined the state failed( RY Rv R� R� R\ RN R� R� ( R R� RR R� R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _run_check_cmd� s
c C@ s
d | _ d S( u-
Rest the run_num value to 0
i N( R� ( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
reset_run_num� s c C@ sj | j d k r3 t j j | j | j i � | _ n3 t j j | j | j | j | j d | j �| _ d S( uU
Read the state loader value and loadup the correct states subsystem
u thoriumR� N(
R� R R� t thoriumRv R� R� R t serializersR� ( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _load_states� s $c C@ s� t j d � t j j | j � | _ t j j | j | j d | j d | j �| _ t
| t � ra| j d t
� rat
| d t j � r� i | d | d 6g } n& t
| d t � r� | d } n i } x� | D]� } xz | D]r } t j j | j | | | j � } | r� xA | D]6 } d j | | | j d � � } | | | j | <qWq� q� Wq� Wqan t j j | j � | _ | j � t j j | j | j d | j d | j �| _ d S(
u1
Load the modules into the state
u( Loading fresh modules for state activityR R� u provideru stateu {0}{1}u .R� N( RN R] R R� R Rv t minion_modsR� R� R� R> R? R� RY R RV RH t raw_modR t rindexR� R� t renderR� Rw ( R R� R� t providerst providert modR� t funct f_key( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� � s6
&
c C@ s� t j d � | j d j d � d k rx y t t � Wqx t k
rW t j d � qx t k
rt t j d � qx Xn | j � | j j d t
� r� | j j d t � r� | j d � n d S(
u)
Refresh all the modules
u Refreshing modules...u grainsu osu MacOSuB Error encountered during module reload. Modules were not reloaded.u localu multiprocessingu saltutil.refresh_modulesN(
RN R� Rv R� R t sitet RuntimeErrorRO RM R� RY R\ R� ( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt module_refresh� s
+c C@ s� t } | j d t � rJ t j d � t j j | j � | j d <t } n | j d t � r� t j d � | j � | j d <t } n | d s� | j d t � r� | j
� n d S| j d
t � s� | r� | j
� d S| d d k rk| d
d k r| d j d � rh| j
� qhq�| d
d k r8| j
� q�| d
d k r�d | d k rh| j
� qhq�n | d d k r�| j
� n d S( u�
Check to see if the modules for this state instance need to be updated,
only update if the state is a file or a package and if it changed
something. If the file function is managed check to see if the file is a
possible module type, e.g. a python, pyx, or .so. Always refresh if the
function is recurse, since that can lay down anything.
u
reload_grainsu Refreshing grains...u grainsu
reload_pillaru Refreshing pillar...u pillaru changesu force_reload_modulesNu reload_modulesu stateu fileu funu managedu nameu .pyu .pyxu .pyou .pycu .sou recurseu symlinku binu pkgu ports( u .pyu .pyxu .pyou .pycu .so( u pkgu ports( RY R� RN R� R R� Ri Rv R\ R� R� t endswith( R R� RR t _reload_modules( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
check_refresh� s8
c
C@ si g } d | k r" | j d � n d | k r> | j d � n d | k rZ | j d � n | d r� t | d t j � r� | j d j | d d | k r� d j | d � n d
t | d � j � � n | r� | S| d d | d } | | j k rod | k rV| j d j | | d � � | j j | � } | rl| j d
j | � � qlq0| j d j | � � n� t j
j j | j | � } d } d } t | j t
� r�t | j � } n t | j t � r�t | j � } n xN t | | � D]< } | j | | k r�| j d j | j | | � � q�q�Wd
} d | k rKd } n d | k r�d j | d � | j k r�d | k r�| d j | j d � � n | j d � | d <d } q�d } n | rex� | | D]� }
t t |
� � } | d | k r�t j | d |
| � s.t j | d |
| � r^d j | d |
| d � } | j | � q^q�q�Wn | S( uR
Verify the data, return an error statement if something is wrong
u stateu Missing "state" datau funu Missing "fun" datau nameu Missing "name" datau3 ID '{0}' {1}is not formed as a string, but is a {2}u __sls__u
in SLS '{0}' u u .u& State '{0}' was not found in SLS '{1}'u Reason: {0}u# Specified state '{0}' was not foundi u# Missing parameter {0} for state {1}u requireu watchu
{0}.mod_watchu __id__u? Recursive require detected in SLS {0} for require {1} in ID {2}( RF R> R RV R R� Rr R� t missing_fun_stringR R RC t get_function_argspecRH R@ t defaultst tupleR
t extendR R8 R9 t fnmatch(
R R� R� t fullt reasont aspect arglent deflent indt reqdecR: R; R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt verify_data! s~ !"
c C@ s� g } t | t � s% | j d � n t � } x�t j | � D]�\ } } y | j d � rb w> n Wn t k
rv n Xt | t j � s� | j d j | | d t
| � j � � n t | t � s� d j | | � } | j | � q> n x�| D]�} | j d � r q� n | | d k rA| j d j | | d | � � q� n t | | t
� st| j d j | | d � � q� d } d | k r�| d
7} n x�| | D]�} t | t j � r�| d
7} d | j � k rl| j d j | | | d � � qlq�t | t � r�t t | � � }
|
d
k r[t | |
t
� s[| j d j | | d � � q[n |
d k rlt | |
t
� s�| j d j |
| | d � � n�t d | � | | <x{| |
D]o} t | t j � r�i | d 6} n t | t � sd j | | d � } | j | � q�n t t | � � } | | }
d | k rv| j d j | | | d | | j d � � � n t |
� s�| j d j |
� � q�n | | | |
<|
| k r�| | |
k r*| |
| | k r'| |
d | | |
k r$d j | d | |
� } | j | � q$q'q*q�q�Wt t
| � � d
k ri| j d j | | d � � qiqlq�q�W| s�| d k s� | d k r�q� n | j d j | | d � � q� | d
k r� | j d j | | d � � q� q� Wq> W| S( uT
Verify that the high data is viable and follows the data structure
u, High data is not a dictionary and is invalidu __uX ID '{0}' in SLS '{1}' is not formed as a string, but is a {2}. It may need to be quoted.u __sls__u4 The type {0} in {1} is not formatted as a dictionaryu� ID '{0}' in SLS '{1}' contains a short declaration ({2}) with a trailing colon. When not passing any arguments to a state, the colon must be omitted.u0 State '{0}' in SLS '{1}' is not formed as a listi u .i u u� The function "{0}" in state "{1}" in SLS "{2}" has whitespace, a function with whitespace is not supported, perhaps this is an argument that is missing a ":"u namesuM The 'names' argument in state '{0}' in SLS '{1}' needs to be formed as a listu requireu watchu prerequ onchangesuJ The {0} statement in state '{1}' in SLS '{2}' needs to be formed as a listR u iduM Requisite declaration {0} in SLS {1} is not formed as a single key dictionaryuu Invalid requisite type '{0}' in state '{1}', in SLS '{2}'. Requisite types must not contain dots, did you mean '{3}'?u3 Illegal requisite "{0}", please check your syntax.
u stateu< A recursive requisite was found, SLS "{0}" ID "{1}" ID "{2}"uE Multiple dictionaries defined in argument of state '{0}' in SLS '{1}'u0 No function declared in state '{0}' in SLS '{1}'u7 Too many functions declared in state '{0}' in SLS '{1}'N( u requireu watchu prerequ onchanges( R> R? RF R R RG RP R� RV R R� Rr RZ RH R� R8 R9 R� Rn R@ ( R RB R� R� R R� R� R R RK R� R: R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� { s�
c C@ s1 g } x$ | D] } | j | j | � � q
W| S( uD
Verify the chunks in a list of low data structures
( R R
( R R� R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
verify_chunks s
c C@ sq d } xi | D]a } d | k r
t | d t � s8 q
n | d } | | d k rn | d k rn | d } qn q
q
Wx� | D]� } d | k r� | | d <qy n t | d t t f � s� | d d k r� | d | d <q� | d d k r� d | d <q� | | d <n d | k r-| d | j d � d | d <n | d d k ry | d | d | d <qy qy W| j d
d � � | S( ux
Sort the chunk list verifying that the chunks follow the order
specified in the order options.
i u orderi id u lasti@B u firstu
name_orderg ��@R� c S@ s | d d j | � f S( Nu orderu {0[state]}{0[name]}{0[fun]}( R ( R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� @ s ( R> R� R� R R� ( R R� R� R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� " s0
" c C@ s� g } x�t j | � D]�\ } } | j d � r7 q n x�t j | � D]�\ } } t � } g } | j d � rw qG n i | d 6| d 6}
| d k r� | |
d <n d | k r� | d |
d <n d | k r� | d |
d <n | |
d <x� | D]� } t | t j � r| j | � q� n t | t � r� x� t j | � D]� \ } }
| d k r�xu |
D]" } | | k rX| j | � qXqXWq9| d k r�q9q9| d k r�t |
t j � r�| |
| <q9|
|
| <q9Wq� q� W| r�d } x� | D]� } t
j |
� } t | t � rGt t j
| � � } | | d <t t | j | | � � n
| | d <| | d
<| d 7} x% | D] } | | d <| j | � qlWq�WqG t
j |
� } x% | D] } | | d <| j | � q�WqG Wq W| j | � } | S(
u�
"Compile" the high data as it is retrieved from the CLI or YAML into
the individual state executor structures
u __u stateu nameu __orchestration_jid__u __sls__u __env__u __id__u namesi u
name_orderu funN( R RG RP R= RZ R> RV RA R? RF R� R� R8 R� RH R R� R� ( R RB t orchestration_jidR� R R� R R� R� R� R� RK R� R� R� R� R� R� R� R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� C sl
c C@ s g } d | k r | | f S| j d � } x�| D]�} x�t j | � D]�\ } } | | k r� t d � | D� � } t | | | � } t | � d k r� | j d j | | j d d � | j d d � � � qH q� | d d } n x t j | � D]�\ } }
| j d � rq� n | | | k r:|
| | | <q� n x�|
D]�} t
} x~t t | | | � � D]b}
t | t j
� r�t | | | |
t j
� r�| | | j |
� | | | j |
| � t } qhn t | t � rht | | | |
t � rht t | � � } | t t | | | |
� � k r�| t k rg| | | |
| j | | � n | | | | |
<t } n | d
k r�t t | | | |
� � d k r�| | | | |
<q�qhqhW| sA| | | j | � qAqAWq� WqH Wq2 W| | f S( uM
Pull the extend data and add it to the respective high data
u
__extend__c s@ s$ | ] } | j d � s | Vq d S( u __N( RP ( t .0R` ( ( s. /usr/lib/python2.7/site-packages/salt/state.pys <genexpr>� s i u� Cannot extend ID '{0}' in '{1}:{2}'. It is not part of the high state.
This is likely due to a missing include statement or an incorrectly typed ID.
Ensure that a state with an ID of '{0}' is available
in environment '{1}' and to SLS '{2}'u __env__u baseu __sls__i u __u nameu names( R R RG R8 RL R@ RF R R� RP RY R
R> RV t insertR\ R? R9 t STATE_REQUISITE_KEYWORDSR ( R RB R� t extt ext_chunkR R� t
state_typet idsR R� RK R� t hindR� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt reconcile_extend� sZ
!0*$ $ $ (c C@ s� d | k r | St � } t � } | j d � } x� | D]� } t | t j � r` | j | � n t | t � r8 t | � d k r� q8 n t t j | � � } | d k r� | j | d � q� | d k r� | j | d � q� q8 q8 W| rrx� t j
| � D]r \ } } | j d � rq� n | j d d � } | s8q� n x0 | D]( }
t
j
| |
� r?| j | � q?q?Wq� Wn x* | D]" } | | k ry| j | � qyqyW| S( ui
Read in the __exclude__ list and remove all excluded objects from the
high data
u __exclude__i u slsu idu __u __sls__u ( R= R R> R RV RA R? R@ R8 R� RG RP R� R ( R RB R� R� R� R� R� R R� RQ t ex_R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� � s<
c #
C@ s8
d d d d d d d d h } | j d d
d d d
h � } i } g } x t j | � D]n \ } } t | t � sy qX n xJ t j | � D]9 \ } } | j d � r� q� n x | D]
}
t |
t � r� t |
� d k r� q� n t t |
� � } | | k rq� n | j d � d } |
| }
t |
t � r�x�t j |
� D]p\ } } t
} | | k rlt � | | <n d | k r�| j d j
| | | | d | | j d � � � | j d � d } n | | | k r�g | | | <n | d | | d <| d | | d <xs t t | | | � � D]W } t t | | | | � � | k r!| | | | | j i | | 6� t } q!q!W| r�q>n | | | j i i | | 6g | 6� q>Wn t |
t � r� g } x�|
D]�} t | t � s�| | k r2g | | D] } | j d � s�| ^ q�} i | | d 6} q�t
} x� t | � D]� } x� g t | | � D] } | j d � s_| ^ q_D]i } x` t | | | � D]J } t | t � r�d | k r�| d | k r�i | | 6} t } q�q�q�Wq~WqEW| s�q�q�n t | � d k rq�n t t | � � } | | } | d k rPt | | � } n | j | | f � d | k r�| j d j
| | | | d | | j d � � � | j d � d } n x�| D]�} | \ } } | d k rC| | k r�t � | | <n | | | k rg | | | <n | | | j i i | | 6g d 6� n | d k r�t | | | � } xw | D]o \ } } | | k r�t � | | <n | | | k r�g | | | <n | | | j i i | | 6g d 6� qhWq�n | d k rAt | | | � } x9| D]1\ } } | s qn t | | | � } | | k rLt � | | <n | | | k rmg | | | <n | j | � } x� | | | D]� }
t |
t � s�q�n t |
� d k r�q�n t t |
� � | k r�q�n t t j |
� � d k r�q�n t t j |
� � d k r q�n | | | j |
� q�WqWq�n | d k r�t | | | � } x9| D]1\ } } | s~qfn t | | | � } | | k r�t � | | <n | | | k r�g | | | <n | j | � } x� | | | D]� }
t |
t � sq�n t |
� d k r q�n t t |
� � | k r<q�n t t j |
� � d k r]q�n t t j |
� � d k r~q�n | | | j |
� q�WqfWq�n t
} | | k r�t � | | <n | | | k r�g | | | <n | d | | d <| d | | d <xs t t | | | � � D]W } t t | | | | � � | k r# | | | | | j i | | 6� t } q# q# W| r� q�n | | | j i i | | 6g | 6� q�Wq�Wq� q� q� Wq� WqX Wg | d <x5 t j | � D]$ \ } } | d j i | | 6� q� W| j | � \ }! }" | j |" � |! | f S( uG
Extend the data reference with requisite_in arguments
u
require_inu watch_inu onfail_inu onchanges_inu useu use_inu prerequ prereq_inu requireu watchu onfailu onfail_stopu onchangesu __i u _i u .uj Invalid requisite in {0}: {1} for {2}, in SLS '{3}'. Requisites must not contain dots, did you mean '{4}'?u __sls__u __env__u nameu slsu prerequiredu namesu
__extend__( t unionR RG R> R? RP R@ R8 R9 R RY R RF R R� R
R\ RH RU RL RE R� R R (# R RB t req_int
req_in_allR R� R R� R R� RK R� t rkeyt itemst _stateR t foundR t hingesR` t _ind_hight _idt jt pstatet pnamet tupt ext_idsRI t
_req_statet ext_argst ignore_argst loc_argsR� t req_in_hight
req_in_errors( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt requisite_in� s\
!
!
2
c C@ s� t j j � } t | � } y& | j | d | d | d � } Wnc t k
r� } t j d | d t j �t j
� } i t d 6| d 6i d 6d j | � d
6} n Xt j j � } | | }
|
j
d |
j d } | | d
<t j j | j d | j � } t j j | t j j j | � � }
t j j | � s_y t j | � Wq_t k
r[q_Xn t j j j |
d � � } | j t | � � Wd QXd S( uZ
The target function to call that will create the parallel thread/process
u fullu argsu kwargsu' An exception occurred in this state: %st exc_info_on_loglevelu resultu nameu changesu( An exception occurred in this state: {0}u commenti@B g @�@u durationu cachediru wb+N( R" R# R R� R� RN R� t loggingt DEBUGt tracebackt
format_excRY R R' R( R0 R1 R2 Rv R� R R t hashutilst sha1_digestR3 R4 t OSErrorR t fopent writet msgpack_serialize( R R Ro R R) R RR R� t trbR+ R- R. t troott tfilet fp_( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _call_parallel_target� s:
c C@ s� | j d � p d
g d p, | d j d � } | sS | j d | j d � � } n t j j j d | j d | | | f � } | j � i | d 6d
d 6i d 6d
d 6| d 6} | S( uG
Call the state defined in the given cdata in parallel
u argsi u kwargsu nameu __id__t targetRC u resultu changesu Started in a separate processu commentu procN( R� RZ R R t processt MultiprocessingProcessR? t start( R Ro R R t procRR ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
call_parallel� s /
u
content_checku unifyi c
C@ s� t j j � } | t j j � t j j � } t j d t | d t j � r^ | d j � n | d | j � j
� � | j | � } | ri t d 6| d d 6i d 6d d 6} x' | D] } | d c d j
| � 7<q� W| j | d <| j d 7_ t | � | j | | � | Si t d 6| d d 6i d 6} | j d
d/ � | j d
<| d d k rd
| k r| d
| j d <n | j d d/ � | j d <| j d � s�t j d | d | d t | d t j � r�| d j � n | d � n d | k r| j | � n d j
| � }
t j j j | j |
| d i |
d 6d t �} i t j | � d 6| rwt j | � n i d 6| j d 6| r�t j | � n i d 6} d | k r�t j | d � | d <n | j r�| j | j � n | j d � r?t! j" | j | d j# j$ d }
t% t! j" | j | d j# j$ d <n z�yd | k rid j
| � | j k s�d | k r�d j
| � | j k r�| j | j& | � � n | j' j d t � s$d! | k r�t j | d! � | d <q$t | d" j d# d/ � t j � r$t j | d" d# � | d <q$n d | k r=d$ | d <n d% | k rZ| d% | d% <n d | k sv| d t k r | | j _ | j( r�t) | � } nc | j d � r�| j d& � r�| j* | | � } n/ | j+ | � | j | d | d' | d" � } i | j _ n d( | k rId) j
| � | j k rI| j | j, | � � n Wn� t- k
r} t j. d* | d+ t/ j0 �t1 j2 � } | j d' � p�d/ g d, p�| d" j d � } | s�| j d | j d- � � } n i t d 6| d 6i d 6d. j
| � d 6} n XWd/ | j d � r;|
t! j" | j | d j# j$ d <n | j j3 d
d/ � | j j3 d d/ � Xt | t4 � su| Sd0 | k r�| j5 d0 g � j6 | d0 � n d | k r�| j � n | j d � r�t | d <| S| j d1 � | d1 <| j | d <| j d 7_ t | � | j | | � t j j � } t j j � t j j � } | | } | | } | j � j
� | d2 <| | } | j7 d3 | j8 d4 } | | d5 <| d- | d- <t j d6 t | d t j � r�| d j � n | d | j � j
� | � d7 | k r� | j9 | d7 � | d7 <t! j" | j | d j# j$ d s� | d7 d8 | d k r� | d7 d9 | k r� | d7 d: } | d7 d; d, k r�| t: j; d, | d7 d; � } n t j d< | � | j< d= | � | j= | | | d> | d �} | } | } d? j> d@ j
| | d | d � | d s+ d n | d g � | d <| d5 | d5 | dA | d5 <| d k r} | d2 | d2 <q} q� q� q� dB j> | d s� d n | d dC j
| d7 d9 | d7 d: | d7 d8 | d7 d; � g � | d <n | S(D uk
Call a state directly with the low data structure, verify data
before processing.
u Running state [%s] at time %su nameu resultu changesu u commentu {0}
u __run_num__i u runasu stateu cmdu passwordu runas_passwordu
__prereq__u Executing state %s.%s for [%s]u funu provideru {0[state]}.{0[fun]}t initial_retu fullt expected_extra_kwsu __low__u __running__u __instance_id__u __lowstate__u __env__u testu unlessu {0[state]}.mod_run_checku onlyifu lock_saltenvu saltenvu kwargsu envu baseu __orchestration_jid__u parallelu argsu check_cmdu {0[state]}.mod_run_check_cmdu' An exception occurred in this state: %sR0 i u __id__u( An exception occurred in this state: {0}Nu warningsu __sls__u
start_timei@B g @�@u durationu3 Completed state [%s] at time %s (duration_in_ms=%s)u retryu untilu attemptsu intervalu splayuQ State result does not match retry until value, state will be re-run in %s secondsu
test.sleept retriesu
uJ Attempt {0}: Returned a result of "{1}", with the following comment: "{2}"i� u u� The state would be retried every {1} seconds (with a splay of up to {3} seconds) a maximum of {0} times or until a result of {2} is returned(? R" R# R$ RN R] R> R RV R� R% R& R
RY R R� Rd R� R� RZ R� R� R R RC t format_callR� t STATE_INTERNAL_KEYWORDSt immutabletypest freezeR� R[ R� R� t syst modulesRs t __opts__R\ R� Rv R� Rp RE t format_slotsR� R� R� R1 R2 R3 R4 R R? t
setdefaultR R' R( t verify_retry_datat randomt randintR� t callR2 ( R R R� R� RH R) R* R� RR R� t state_func_nameRo R� t testR� R; R R+ t timezone_deltat local_finish_timeR- R. t intervalt retry_rett orig_ret( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRU s6 &
&
"% $$ "!
$
/ %
& "!
$ c C@ s� t j d | � | j d d � } t | � d k rH t j d | � | S| d d k ry t j d | � t j d � | St j j j | d � \ } } } | s� | | j k r� t j d | � t j d � | St j d
| | | � | j | | | � S( Nu Evaluating slot: %su :i i u Malformed slot: %si u saltuk Only execution modules are currently supported in slots. This means slot should start with "__slot__:salt:"u[ Execution module should be specified in a function call format: test.arg('arg', kw='kwarg')u Calling slot: %s(%s, %s)(
RN R� R R@ t warningR R RC t parse_functionR� ( R t slott fmtR RC R| ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt __eval_slot� s
"
c C@ s� d t | d � f d | d j � f f } x� | D]~ \ } } xo | D]g \ } } t j j j | d t �} t | t j � sF | j
d � r� qF n | j | � | | | <qF Wq3 Wd S( u�
Read in the arguments from the low level slot syntax to make a last
minute runtime call to gather relevant data for the specific routine
u argsu kwargst keepu __slot__:N( t enumerateR R R R� R� R\ R> R R[ RP t _State__eval_slot( R Ro t ctxt atypet avaluesR RK ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRP s c C@ s� i t d 6d d 6d d 6d d 6} i t d 6t d 6t d 6t d 6} i } t | t � r� x� t j | � D]r \ } } | | k r� t | | | � r� | | | | <q� t j d | | | � | | | | <qi | | | | <qi Wn t j d � | } | S(
u3
verifies the specified retry data
u untili u attemptsi u splayi u intervaluF An invalid value was passed for the retry %s, using default value '%s'ud State is set to retry, but a valid dict for retry configuration was not found. Using retry defaults( R\ t boolR� R> R? R RG RN R] ( R t
retry_datat retry_defaultst
expected_datat validated_retry_datat expected_keyt
value_type( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRR s0
c C@ s� i } d | j d k r� x� | D]� } d j | d | d � } x� | j d d D]� } t j | | � rS d j | | � } t | � } i i d 6t d 6| d 6| j d
6| d d 6| | <| j d 7_ | j | � PqS qS Wq! Wn i } x� | D]� } d
| k r| j d
� | St | � } | | k r}| j | � }
|
d k rOPn | j | | | � } | j
| | � r}| Sn t � | _ q� Wx* t
r�| j | � r�Pn t j d � q�Wt t | j � � t | j � � � } | S( uU
Iterate over a list of chunks and call them, checking for requires.
u state_runs_disabledu grainsu {0}.{1}u stateu funu\ The state function "{0}" is currently disabled by "{1}", to re-enable, run state.enable {1}.u changesu resultu commentu __run_num__u __sls__i u __FAILHARD__u killg{�G�z�?( Rv R R R RY R� t removeR t check_pauset
call_chunkt check_failhardR= R� R\ t reconcile_procsR% t sleepR? RH R ( R R� t disabledR t state_t patt commentt _tagR� R t actionRR ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt call_chunksA sL
(c C@ ss t | � } | j j d t � r% t S| j d | j d � ro | | k ro | | d d k rb t S| | d St S( uK
Check if the low data chunk should send a failhard signal
u testu failhardu resultN( R Rv R� RY RZ ( R R R� R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRr r s %
c C@ s� | j s
d St j j | j d d | j � } t j � } t j j | � r�y2x+t r}d } t j j
j | d � �} y t | j
� � } Wn> t j k
r� | d k r� d S| d 7} t j d � wS n X| d } d } | | k r� | } n d
| k r d
} n | rcd | | k rLt j � } | | | | d k rLd Sn d
| | k rgd
Sn d St j d � Wd QXqS WWq�t k
r�}
t j d | � d SXn d S( u@
Check to see if this low chunk has been paused
Nu cachediru state_pausei u rbi
i u __id__u u __all__u durationu runu killu4 Failed to read in pause data for file located at: %s( R� R0 R1 R2 Rv R% t isfileR\ R R R R8 t msgpack_deserializet readt msgpackt UnpackValueErrorRt R� RN RO ( R R t
pause_pathRC t triesR> t pdatR R� R$ R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRp sH "
c C@ si t � } xS| D]K} | | j d � } | r | j � sKt j j | j d | j t j j
j | � � } t j j | � s� i t
d 6d d 6| | d d 6i d 6} n y7 t j j j | d � � } t | j � � } Wd QXWnA t t f k
r%i t
d 6d
d 6| | d d 6i d 6} n X| | j | � | | j d � q[| j t
� q q Wt
| k S( uG
Check the running dict for processes and resolve them
u procu cachediru resultu! Parallel process failed to returnu commentu nameu changesu rbNu Parallel cache failure( R= R� t is_aliveR0 R1 R2 Rv R� R R R5 R6 R| RY R R8 R} R~ R7 t IOErrorR� R RA ( R R� t retsetR RD t ret_cacheRR R> ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRs � s4
c C@ s� t } d | k rv d j | d � | j k rm d | k rW | d j | j d � � qs | j d � | d <qv t } n d | k r� d j | d � | j k r� d | k r� | d j | j d � � q� | j d � | d <q� t } n d | k r� t } n d | k rt } n d | k r%t } n d | k r:t } n d | k rOt } n d
| k rdt } n d | k ryt } n d | k r�t } n | s�d
d f S| j | � i g d 6g d 6g d 6g d 6g d 6g d 6g d
6g d 6g d 6} | rg | d <n x�| D]�} | | k r
| | d k r
x�| | D]�} t | t j
� r_i | d 6} n t | � } t } x`| D]X}
t t
| � � } | | } | d k r�qxn | d k r�t j |
d | � rxt } | | j |
� qxqxn y� t | t j
� rkt j |
d | � s/t j |
d | � rq| d k sK|
d | k rht } | | j |
� qhqqn t � Wqxt k
r�}
t d j | |
d � � � qxt k
r�t d j | |
d � � � qxXqxW| s7d d! f Sq7Wq
q
Wt � } xt j | � D]�\ } } t � } | j d � rH| j d � rH| j } n | } x* t rz| j | � rjPn t j d � qQWx�| D]�}
t |
� } | | k r�| j d � q�n | j d � r�| | d t k r| j d � q�qn' | | d t k r| j d � q�n | j d � rS| | d s@| j d � q�| j d � q�n | j d � r�| | d r�| j d � q�n | j d � r�| | d d k r�| j d � s�| j d � q�n | j d � r
| | d d k r
| j d � s3| j d � q3q�| | j d t � r�| j d
� q�q�W| j d � r�d
| k s^d | k r}d | k r}| j d � q}n d | k r�d | k r�| j d � n d | k r�| j d � q�n d | k r�d | k r�| j d � q�q�n | j | � qWd | k rd } n� d | k r-d } n� d | k rWd | k rNd
} q�d } n] d | k rxd
| k rxd } n< d | k r�d | k r�d } n d | k r�d } n d
} | | f S(" u`
Look into the running data to check the status of all requisite
states
u watchu
{0}.mod_watchu stateu requireu watch_anyu require_anyu prerequiredu prerequ onfailu
onfail_anyu onchangesu
onchanges_anyu metu idu slsu __sls__u nameu __id__uD Could not locate requisite of [{0}] present in state with name [{1}]u unmetg{�G�z�?u resultu failu changesu onchangesmetu changeu premetu preu
__state_ran__u _any( N( ( RY R R� R R R\ Rs RZ R> R RV R< R8 R9 R RF R� R RM R= RG RP R� R% Rt R RA R� R� Ro R� ( R R R� R� R� t presentR� t r_stateR: R R� R� R� R� t fun_statst req_statst run_dictR t status( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt check_requisite� s$
## c @ sn � j j d � rj� j j d t � s. | rj� j j d � sU d � f d � } n
� j d } i | d 6} | t k r� t j j j � j � j d t
j | d � g d � } n� t | t
j
� r� t j j j � j � j d t
j | � g d � } nE t j j j � j d
� j d t
j | d � g d � } | | d
<i � j d 6} | | | d | �n d S( u
Fire an event on the master bus
If `fire_event` is set to True an event will be sent with the
chunk name in the tag and the chunk result in the event data.
If `fire_event` is set to a string such as `mystate/is/finished`,
an event will be sent with the string added to the tag and the chunk
result in the event data.
If the `state_events` is set to True in the config, then after the
chunk is evaluated an event will be set up to the master with the
results.
u localu state_eventsu
master_uric @ s2 t j j j � j � j d d t �j | | � S( Nu sock_dirt listen( R R t eventt get_master_eventRv RY t
fire_event( RR R t preload( R ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� � s u event.fire_masteru retu idu nameu state_resultu progu __run_num__u jobu lenu jidR� N( Rv R� R\ RZ R� R R R� t tagifyR� R R[ R> RV ( R t chunk_rett lengthR� t ev_funcRR R R� ( ( R s. /usr/lib/python2.7/site-packages/salt/state.pyR� x s .
/ + /
c C@ s�
| j | | | � } | j | � t | � } | j d � sP | j j | � n d d d d d d d d d
g } | j d � s� | j d � | j | | | d t �\ } } n | j | | | � \ } } | d
k r4i } g } x�| D]�} g | | <| | k r
q� n x�| | D]}}
t |
t
j � r@i |
d 6}
n t |
� }
t
} t t |
� � } |
| }
x
| D]} |
d9 k r�qun | d k r�t j | d |
� ru| d k r�t | d <n | j | � t } ququn t j | d |
� st j | d |
� ru| d k s,| d | k rw| d k rEt | d <n | d k r^t | d <n | j | � t } qwququW| s| | j |
� qqWq� W| d s�| d s�| d s�| d s�| d s�| j d � r d } x� t
j | � D]x \ } } | s q�n | d j d: | � 7} xG | D]? } t t | � � } | | }
| d j d d | |
� 7} q)Wq�W| j d � r�| j } n | } t � \ } } i i d 6t
d 6| d 6| d 6| d 6| j d 6| d d 6| | <| j d! 7_ | j | | t | � d" | j d# � �| SxH| D]@} t | � } | | k r%| | j k r-| j d � r�| | j k r�t | d <| j | | | � | j | <| S| SnP | | k r�t j d$ � i i d 6t
d 6d$ d 6| j d 6| d d 6| | <n | j d! 7_ | j | | t | � d" | j d# � �| S| j | | | � } | j | | � ret | d% <| Sq%q%W| j d � r�| j | | | � \ } } | j | | | � | j | <| j | d r| d& k ri d d 6| j | d <d9 | j | d <qn | j | | | � } | j | | � ry
t | d% <| SnE| d' k r�| j d � rn| j | | | � | j | <qy
| j | | | � | | <n�| d( k r"| | j k r�| j | | | <| j | | d <| d | | d <n4t � } x� t
j | � D]� } x� | D]� } t | � } | j j | | j | � � } | d9 k rDqn | d t
k rd) j d* | d d+ | d � } | j | � qqWq�Wd, j d- j d. � | D� � � } t � \ } } i i d 6t
d 6| d 6| d 6| d 6| j d 6| d d 6| | <| | | j | <| j d! 7_ nW| d& k r�| j d � r�| j | | | � } | d r�| j d/ t
� r�| j! � } | d0 | d1 <d2 | d0 <| | d3 <| j | | | � } n | | | <n�| d4 k rF t � \ } } i i d 6t d 6| d 6| d 6d5 d 6| j d 6| d d 6} | | | <| | j | <| j d! 7_ n3| d k r� t � \ } } i i d 6t d 6| d 6| d 6d6 d 6t
d7 6| j d 6| d d 6| | <| j d! 7_ n� | d k r2
t � \ } } i i d 6t d 6| d 6| d 6d8 d 6t
d7 6| j d 6| d d 6| | <| j d! 7_ nG | j d � r`
| j | | | � | j | <n | j | | | � | | <| | k r�
| j | | t | � d" | j d# � �n | S(; ud
Check if a chunk has any requires, execute the requires and then
the chunk
u prerequiredu requireu require_anyu watchu watch_anyu prerequ onfailu
onfail_anyu onchangesu
onchanges_anyu
__prereq__R� u unmetu idu slsu __sls__u nameu __id__u stateu __prerequired__u) The following requisites were not found:
u {0}{1}:
u i u {0}{1}: {2}
i u changesu resultu durationu
start_timeu commentu __run_num__i R� u
fire_eventu Recursive requisite foundu __FAILHARD__u changeu metu failu {sls}.{_id}RQ R# u! One or more requisite failed: {0}u , c s@ s | ] } t j | � Vq d S( N( R R[ ( R t i( ( s. /usr/lib/python2.7/site-packages/salt/state.pys <genexpr>B
s u
skip_watchu funu sfunu mod_watchu __reqs__u preu No changes detectedu3 State was not run because onfail req did not changeu
__state_ran__u< State was not run because none of the onchanges reqs changedNu (" R� R� R R� R� RA RF R� R\ R> R RV R< RY R8 R9 RZ R RG R R� R/ R� R� R@ RU RN RO Rq Rr R= RX R2 R� ( R R R� R� R t
requisitesR� R� t lostt requisiteR: R R� R� R� Rx t lreqst lreqR� R, R. t ctagt failed_requisitest req_lowst req_lowt req_tagt req_retR� t _cmtRR t pre_ret( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRq � s�
$
"
)
)
,c @ s� g } i } x� | D]� } | | | d | d | d f <d | k rt | j i | d | d | d | d f 6� n d | k r xd | d D]U } xL t j | � D]; \ � } | j i i | d | d 6g � | d f 6� q� Wq� Wq q Wg } i } x/| D]'}
x t j |
� D]
\ � } x�| D]�} t | t � s�t } xL | D]D } | d | k so| d | k rIi | d | d 6} t } qIqIW| s�q'q�n xzt j | � D]i\ � � t � � f d � | D� � s8i i d j � � � d 6d
j � � � d 6t d 6i d 6t � � � 6}
| j
|
� q�n g t j | � D]4 \ } } � | d
k rH� | k rHt | � ^ qH} x�| D]�} | | k r�q�n | | d r�t � f d � | D� � s@i i d j � d
� d � d 6d
j � d
� d � d 6t d 6i d 6t � d
� d � 6}
| j
|
� q�n g t j | � D]6 \ } } � d
| d
k rP� d | k rP| ^ qP} x� | D]{ } | j � } | d | d <d | d <d j | d � | d <x* t
D]" } | | k r�| j | � q�q�W| j | � q�Wq�q�Wq�Wq'WqWq� W| j | � } | j
| � x. | D]& } | j | | d <| j d 7_ qLW| j
| � | S( uX
Find all of the listen routines and call the associated mod_watch runs
u stateu __id__u nameu listenu listen_inu lookupc 3@ s+ | ]! } � | d k o" � | k Vq d S( i N( ( R t cref( t lkeyt lval( s. /usr/lib/python2.7/site-packages/salt/state.pys <genexpr>�
s u( Referenced state {0}: {1} does not existu commentu listen_{0}:{1}u resultu changesi c 3@ s3 | ]) } � d | d k o* � d | k Vq d S( i i N( ( R R� ( R� ( s. /usr/lib/python2.7/site-packages/salt/state.pys <genexpr>�
s i u funu sfunu mod_watchu listener_{0}u __run_num__( RF R RG R> R? RY R\ t anyR R! R� R R� R R R{ R� ( R R� R� t listenerst crefsR� t l_inR� t mod_watchersR� t l_dictt listen_toR t rerrorR� R� t to_tagst to_tagt
new_chunksR R: RR R� ( ( R� R� R� s. /usr/lib/python2.7/site-packages/salt/state.pyt call_listen�
s�
0 >
J
L
(
c
@ sH g } � j | � \ } } | j | � | j � j | � � | rH | S� j | � \ } } | j | � � j | � } | r� | S� j | | � } | r� | S� j | � } � j | | � } � f d � } | � � j d k rDt
j j � j
d d � j � } t
j j | � rDy t
j | � WqAt k
r=qAXqDn | S( uI
Process a high data call and ensure the defined states.
c @ sn t j j t � j d � � j � } y! t j | � t j d | � Wn! t k
ri t j d | � n Xd S( Nu cachediru Deleted accumulator data file %su* File %s does not exist, no need to cleanup(
R0 R1 R2 R7 Rv R� Ro RN R� R7 ( t accum_data_path( R ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _cleanup_accumulator_data�
s
u cachediru state_pauseN( R R R� R/ R� R� R{ R� R� RZ R0 R1 R2 Rv R| Ro R7 (
R RB R R� t
ext_errorsR. R� RR R� R� ( ( R s. /usr/lib/python2.7/site-packages/salt/state.pyt call_high�
s4
"
c
C@ sl g } | s | | f St | t � sE | j d j | � � | | f Sd
} x= | D]5 } | | k rR | j d j | | � � | | f SqR Wx�| D]�} t | | t � s(t | | t j � r(d | | k r| | j d � } i | d g | d 6| | <q� n | j d j | | � � q� q(n t � } x*t | | � D]} | j d
� r]qBn | | | d k r�| j d j | | | � � qBn t | | | t � s�qBn d | k rM| j d � } | d | k r�| j d j | | � � qBn | | j | � | | | d <| | | d j | d � | j
| d � qBn | j
| � qBWq� W| | f S( Nu, Template {0} does not render to a dictionaryu includeu excludeu extendsuO The '{0}' declaration found on '{1}' is invalid when rendering single templatesu .i i u* ID {0} in template {1} is not a dictionaryu _u� ID '{0}' in template {1} contains a short declaration ({2}) with a trailing colon. When not passing any arguments to a state, the colon must be omitted.uP ID '{0}' in template '{1}' contains multiple state declarations of the same type( u includeu excludeu extends( R> R? RF R R RV R R= R~ RP RZ RH R RA (
R RB R{ R� t
invalid_itemsRD R R� R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR} �
sd
c C@ si t | | j | j d | j d | j d � } | s: | S| j | | � \ } } | r\ | S| j | � S( u2
Enforce the states in a template
u rendereru renderer_blacklistu renderer_whitelist( R Rw Rv R} R� ( R R{ RB R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
call_templateM s
c C@ si t | | j | j d | j d | j d � } | s: | S| j | d � \ } } | r\ | S| j | � S( uQ
Enforce the states in a template, pass the template as a string
u rendereru renderer_blacklistu renderer_whitelistu <template-str>( R Rw Rv R} R� ( R R{ RB R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt call_template_str] s
N(1 Rr Rs Rt RZ RY Ry R� R� R� R� R� R� R� R� R� R� R� R� R
R� R R� R� R R� R/ R? RE R R t
decoratorsR t
OutputUnifierRU Rd RP RR R{ Rr Rp Rs R� R� Rq R� R� R} R� R� ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� � s` ' +
" * Z � ! A D ( � + � % 1
- � ' � I 1 O t
BaseHighStatec B@ s" e Z d Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z
d � Z d
� Z d � Z
d � Z d
� Z d � Z e d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z e d � Z d � Z d d d e d d d � Z d � Z d � Z d � Z RS( u
The BaseHighState is an abstract base class that is the foundation of
running a highstate, extend it and add a self.state object of type State.
When extending this class, please note that ``self.client`` and
``self.matcher`` should be instantiated and handled.
c C@ sR | j | � | _ d | _ | j � | _ t j j | j � | _ t � | _
d S( Ni' ( t _BaseHighState__gen_optsRv t iordert _BaseHighState__gather_availt availR t payloadt Serialt serialR t building_highstate( R Rv ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRy v s
c C@ s7 i } x* | j � D] } | j j | � | | <q W| S( uH
Gather the lists of available sls data from the master
( t _get_envst clientt list_states( R R� Rj ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt __gather_avail} s c C@ sm d | k r | d r | Sn | j j � } t | t � s� d | d <t | d <t j j j d � | d <i | d <i t j
g d 6| d <n�| d | d <| j d t � | d <| d j d
� r� | d | d <nT | d j d � r t j j j | d d � | d <n t j j j | d � | d <| j d
d � | d
<| j d i � | d <| j d | d � | d <| d | d <| j d | j d � � | d <| j d | j d g � � | d <| j d | j d � � | d <| j d � | d <| j d | j d t � � | d <| j d i � | d <| j d i � | d <| j d t � | d <| j d t � | d <| S( u�
The options used by the High State object are derived from options
on the minion and the master, or just the minion if the high state
call is entirely local.
u local_stateu
jinja|yamlu rendereru failhardu top.slsu state_topu
nodegroupsu baseu
file_rootsu salt://u /i u state_top_saltenvu state_auto_orderu top_file_merging_strategyu env_orderu default_topu state_eventsu state_aggregateu jinja_envu
jinja_sls_envu jinja_lstrip_blocksu jinja_trim_blocksN( R� Rg R> R? RY R R t urlt createt syspathst BASE_FILE_ROOTS_DIRR� RP RZ ( R Rv t mopts( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
__gen_opts� sD
$ " "c C@ s" d g } d | j k rT | j g t | j d � D] } | | k r2 | ^ q2 � n | j j d g � } t � } g | D]' } | | k p� | j | � sy | ^ qy } | j j � } | r� | r� g | D] } | | k r� | ^ q� S| r� | S| j g | D] } | | k r� | ^ q� � | Sd S( uM
Pull the file server environments out of the master options
u baseu
file_rootsu env_orderN( Rv R RH R� R= RA R� t envs( R R� R` t env_ordert memberst envt client_envs( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� � s 4 #,c C@ sJ t t � } t t � } t t � } d } | j d } | d k rp | j d rp | j d sp t d � � qp n | j d r | j j | j d | j d � } | rd } t | | j j | j j d | j j d
| j j d d | j d �g | | j d <qgi g | | j d <nJd } | j j d
t
� } | rct | t j
� rct j | � } n x� | ru| g n | j � D]� } | j j | j d | � } | r| d } | | j t | | j j | j j d | j j d
| j j d d | �� q| | j i � t j d | � qW| d k rg| d k rg| j j d d � rgt j d | � n | d k r�t j d t | j j d � � n xs t j | � D]b \ } } xS | D]K }
d |
k r�q�n x# |
d D] } | | j | � q�W|
j d � q�Wq�Wx7| rEg } x� t j | � D]� \ } }
| j | � |
sPq+n x� |
D]� } x� t j | j | | � D]� } | | | k r�qwn | | j t | j j | | � j d t
� | j j | j j d | j j d
| j j d | � � | | j | � qwWqWWq+Wx* | D]" } | | k r | j | � q q WqW| S( u&
Gather the top files
i u top_file_merging_strategyu sameu saltenvu default_topuX top_file_merging_strategy set to 'same', but no default_top configuration option was setu state_topi u rendereru renderer_blacklistu renderer_whitelistRj u state_top_saltenvu# No contents loaded for saltenv '%s'u mergeu env_orderu top_file_merging_strategy is set to '%s' and multiple top files were found. Merging order is not deterministic, it may be desirable to either set top_file_merging_strategy to 'same' or use the 'env_order' configuration parameter to specify the merging order.u� No contents found in top file. If this is not expected, verify that the 'file_roots' specified in 'etc/master' are accessible. The 'file_roots' configuration is: %su
file_rootsu includeu destN( R
RH Rv R R� t
cache_fileR R Rw R� RY R> R RV R[ R� RF RN R� RZ R] t reprRG R R t filterR� t get_state( R t topst includet doneR t merging_strategyt contentst state_top_saltenvRj t ctopst ctopRQ t popsR� t sls_match( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt get_tops� s�
!
.
c C@ s� | j d } y\ d j | � } t | | � } t | d � sh d j | � } t j | � t | � � n Wn0 t t f k
r� t j d | � | j } n X| | � S( u-
Cleanly merge the top files
u top_file_merging_strategyu _merge_tops_{0}u __call__u '{0}' is not callableu? Invalid top_file_merging_strategy '%s', falling back to 'merge'(
Rv R R� t hasattrRN RO RM R� R] t _merge_tops_merge( R R� R� t
merge_attrt
merge_funcR^ ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
merge_topsE s
c
C@ s� t t � } | j d t t � � } x� | D]� } xz t j | � D]i \ } } | d k r_ qA n y+ x$ | D] } | | | | | | <qi WWqA t k
r� t d � � qA XqA Wq+ Wx� t j | � D]� \ } } x� | D]� } x� t j | � D]� \ } } | d k r q� nJ | | k r.t j d | | � q� n% | | k rSt j d | | � q� n y+ x$ | D] } | | | | | | <q]WWq� t k
r�t d � � q� Xq� Wq� Wq� W| S( u�
The default merging strategy. The base env is authoritative, so it is
checked first, followed by the remaining environments. In top files
from environments other than "base", only the section matching the
environment from the top file will be considered, and it too will be
ignored if that environment was defined in the "base" top file.
u baseu includeu, Unable to render top file. No targets found.u� Section for saltenv '%s' in the '%s' saltenv's top file will be ignored, as the top_file_merging_strategy is set to 'merge' and the saltenvs do not matchu� Section for saltenv '%s' in the '%s' saltenv's top file will be ignored, as this saltenv was already defined in the 'base' top file( R
R R R RG RM R RN R� (
R R� t topt base_topsR� Rj t targetst tgtt cenvR� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� Y s@
c C@ s� t t � } x�t j | � D]�\ } } t g | D] } | i k ^ q2 � rA| j d } | j | g � } t g | D] } | i k ^ qv � r� t j d | | � q n x� | D]� } x} t j | � D]Y \ } }
| | k r� q� n t j d | | � x$ |
D] } | | | | | | <q� WPq� Wt j d | | � q� Wq q x� | D]� } x� t j | � D]� \ } }
| d k r|q^n% | | k r�t j d | | � q^n y+ x$ |
D] } | | | | | | <q�WWq^t
k
r�t d � � q^Xq^WqHWq W| S( u�
For each saltenv, only consider the top file from that saltenv. All
sections matching a given saltenv, which appear in a different
saltenv's top file, will be ignored.
u default_topum The '%s' saltenv has no top file, and the fallback saltenv specified by default_top (%s) also has no top fileuD The '%s' saltenv has no top file, using the default_top saltenv (%s)ul The '%s' saltenv has no top file, and no matches were found in the top file for the default_top saltenv (%s)u includeu� Section for saltenv '%s' in the '%s' saltenv's top file will be ignored, as the top_file_merging_strategy is set to 'same' and the saltenvs do not matchu, Unable to render top file. No targets found.( R
R R RG RW Rv R� RN RO R� RM R ( R R� R� R� R� R` t default_topt
fallback_topsR� Rj R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _merge_tops_same� sN %
%
c
C@ s� d � } t t � } xdt j | � D]S} xJ| D]B} x9t j | � D](\ } } | d k rf qH n y� x� | D]� } | | | k r� | | | | | | <qp n | | | | � \ } }
| | | | � \ } } g }
| p� | } | d k r|
j | � n |
j |
� |
j g | D] } | |
k r | ^ q � |
| | | <qp WWqH t k
rot d � � qH XqH Wq2 Wq% W| S( u>
Merge the top files into a single dictionary
c S@ sa d } g } xH | D]@ } t | t � r1 | } n t | t j � r | j | � q q W| | f S( N( RZ R> R? R RV RF ( R� t
match_typeR� RD ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _read_tgt� s
u includeu, Unable to render top file. No targets found.N(
R
R R RX RG RZ RF R RM R ( R R� R� R� R� R� Rj R� R� t m_type1t m_states1t m_type2t m_states2t mergedR� R` ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt _merge_tops_merge_all� s0
,
c C@ s� g } t | t � s& | j d � | Sxmt j | � D]\\ } } | d k rT q6 n t | t j � s | j d j | � � n | d k r� | j d � n t | t � s� | j d j | � � n x� t j | � D]� } t | t � s� | j d � q� n x� | D]� } t | t � rVxp t j | � D]( } | s'| j d j | | � � q'q'Wqt | t j � r| s�| j d j | � � q�qqWq� Wq6 W| S(
u:
Verify the contents of the top file data
u! Top data was not formed as a dictu includeu5 Environment {0} in top file is not formed as a stringu u# Empty saltenv statement in top fileu@ The top file matches for saltenv {0} are not formatted as a dictu; Malformed topfile (state declarations not formed as a list)u> Improperly formatted top file matcher in saltenv {0}: {1} fileu+ Environment {0} contains an empty sls index( R> R? RF R RG RV R RX RH ( R R� R� Rj t matchest slsmodst slsmodR� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt verify_tops� sF
c C@ sG y | j � } Wn' t k
r9 } t j d | j � i SX| j | � S( uA
Returns the high data derived from the top file
u Unable to render top file: %s( R� R RN RO R� ( R R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt get_top$
s c
@ s9 t t � � x� t j | � D]� \ � } � j d rQ � � j d k rQ q qQ n xL t j | � D]; \ } } � � � � f d � � � | | � j d � qa Wq W� j � } x� | D]z � � j � g � } � j j d � r� | � } | } n | } | � } | g | D] } | | k r| ^ q� � <q� W� S( u�
Search through the top high data for matches and return the states
that this minion needs to execute.
Returns:
{'saltenv': ['state1', 'state2', ...]}
u saltenvc @ s? t | t j � r | g } n � j d | | | � r;� � k rP g � � <n x� | D]� } d | k r� | j d � } x0 t j | � D] \ } } � | | | � q� Wn t | t j � r� � � j | � qW t | t � rW | j � \ } } | � j k rqW n | � k r g � | <n � | j | � qW qW Wn d S( Nu confirm_top.confirm_topu subfilter(
R> R RV t matchersR RG RF R? t popitemR� ( t _matcht _datat _optsRD t _tmpdatat matchR� t env_keyt inc_sls( t _filter_matchesR� Rj R ( s. /usr/lib/python2.7/site-packages/salt/state.pyR >
s,
u
nodegroupsu master_tops_first( R
R R RG Rv t _master_topsR� (
R R� R� R R� t ext_matchest top_file_matchest firstt secondR` ( ( R R� Rj R s. /usr/lib/python2.7/site-packages/salt/state.pyt top_matches/
s$
1c C@ s
| j j � S( u�
Get results from the master_tops system. Override this function if the
execution of the master_tops needs customization.
( R� t master_tops( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR e
s c C@ s� | j d s d S| j j d t | � d t �} | d ru t j j | j � | j d <| j j � | j j d <n | j j � d S( ui
If autoload_dynamic_modules is True then automatically load the
dynamic modules
u autoload_dynamic_modulesNu saltutil.sync_allt refreshu grainsu pillar(
Rv R R� RH RY R R� Ri R� R� ( R R� t syncd( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt load_dynamicl
s
c
C@ sf g } | s6 | j j | | � } | j d t � } n1 | } t j j | � sg | j d j | � � n d } | s� | j d j | | � � nyL t
| | j j | j j
d | j j
d | j j
d | | d | �} Wn� t k
r }
d j | | |
� } t j | � | j | � nZ t k
rx}
d j | |
� } t j | d
t j �| j d j | t j � � � n Xy | j d j | | � � Wn t k
r�n X| rVt | t � s�| j d
j | � � q\g } d | k r.t | d t � s d j | � }
| j |
� q.| j d � } n | j | | | | � | j | | | | � | j | | | | � x�| D]�} d } t | t � r�| j � \ } } n | } | | j k r�d j | | | | � } t j! | � | j | � qwn | j" d � r
t# j$ d | � } | r0| j% � \ } } n2 d j | | | � } t j! | � | j | � qwt& | � } | j' d � } | j d d � j( d � r�| j d � n | t& | � k r�d j | | | � } t j! | � | j | � qwn d j) | | | g � } n | | k rh| d k r.g } n | | k sSt* j+ | j | | � r_| g } q�g } n2 g | D]% } t* j+ | j | | � ro| ^ qo} t& | � d k s�| | k r�t* j+ | j | | � p�| g } x=| D]� } t& | � d k r| d n | } d j | | � } | | k r�| j, | | | | � \ } }
| rn| j- | | | � | j. | � n |
r�| j/ |
� q�q�q�Wqwd } | s�d j | | | | k r�d j) | � n | � } n3 t& | � d k r d j | | d j) | � � } n t j | � | j | � qwWy | j0 | � Wq\t1 k
rRt j d | � q\Xn i } | | f S(! uL
Render a state file and retrieve all of the include states
u destu6 Specified SLS {0} on local filesystem cannot be found.ug Specified SLS {0} in saltenv {1} is not available on the salt master or through a configured fileserveru rendereru renderer_blacklistu renderer_whitelistt rendered_slsu# Rendering SLS '{0}:{1}' failed: {2}u+ Rendering SLS {0} failed, render error: {1}R0 u {0}
{1}u {0}:{1}u' SLS {0} does not render to a dictionaryu includeu6 Include Declaration in SLS {0} is not formed as a listu _xenvuH Nonexistent saltenv '{0}' found in include of '{1}' within SLS '{2}:{3}'u .u ^(\.+)(.*)$u= Badly formatted include {0} found in include in SLS '{2}:{3}'u sourceu u /init.slsu inituW Attempted relative include of '{0}' within SLS '{1}:{2}' goes beyond top level package i i u_ Unknown include: Specified SLS {0}: {1} is not available on the salt master in saltenv(s): {2} u , um Ambiguous include: Specified SLS {0}: {1} is available on the salt master in multiple available saltenvs: {2}u/ Could not render SLS %s. Syntax error detected.N(2 R� R� R� RY R0 R1 R| RF R RZ R R Rw Rv R RN t criticalR� R1 R2 R3 R4 RA R� R> R? RH R t _handle_extendt _handle_excludet _handle_state_declsR R� RO RP t reR t groupsR@ R R� R2 R R� t render_statet merge_included_statesR� R t _handle_iorderRM ( R RQ Rj t modsR� t localR� t
state_dataR6 R R� R^ R� R� R t xenv_keyR R t levelst level_countt p_compst
resolved_envst aenvt sls_targetst
sls_targett r_envt mod_tgtt nstate( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR z
s
#
%
%
" '
c C@ s[ | j d rWxG| D]<} x3| | D]'} t | t j � sC q% n t | | t � s\ q% n t | | | t � sy q% n t } | j d � r� q% n xa | | | D]Q } t | t � r� t | � d k r� t t j
| � � d k r� t } q� q� q� q� W| s% t | | | t � sq% n | | | j i | j
d 6� | j
d 7_
q% q% Wq Wn | S( u:
Take a state and apply the iorder system
u state_auto_orderu _i u orderi ( Rv R> R RV R? RH RY RP R@ R8 R� R\ RF R� ( R R R t s_decR RK ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR 3 s0
c C@ s x| D]
} t | | t � s� | d k r2 q n | d k rD q n t | | t j � r� d | | k r� | | j d � } i | d 6| d 6| d g | d 6| | <q q� n | j d j | | � � q n t � } x� t | | � D]� } | j d � rq� n t | | | t � s!q� n d | k r�| j d � } | d | k rk| j d
j | | � � q� n | | j
| � | | | d <| | | d j | d � | j | d � q� n | j | � q� Wd | | k r�| | | d <n d | | k r | | | d <q q Wd S( u=
Add sls and saltenv components to the state
u
__extend__u __exclude__u .u __sls__u __env__i i u% ID {0} in SLS {1} is not a dictionaryu _uK ID '{0}' in SLS '{1}' contains multiple state declarations of the same typeN( R> R? R RV R RF R R= RH RP R RA ( R R RQ Rj R� R R� R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR X sL
c C@ s� d | k r�| j d � } t | t � sD | j d j | � � d Sx)| D]!} t | | t � s� | j d j | | � � qK n d | | k r� | | | d <n d | | k r� | | | d <n x� t | | � D]� } | j d � r� q� n t | | | t � sq� n d | k r� | j d � } | | j | � | | | d <| | | d j | d
� q� q� WqK W| j d g � j | � n d S( u`
Take the extend dec out of state and apply to the highstate global
dec
u extendu0 Extension value in SLS '{0}' is not a dictionaryNu5 Extension name '{0}' in SLS '{1}' is not a dictionaryu __sls__u __env__u _u .i i u
__extend__( R R> R? RF R RH RP R RQ ( R R RQ Rj R� R R R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR � s2
(c C@ si d | k re | j d � } t | t � sI d j | � } | j | � n | j d g � j | � n d S( uh
Take the exclude dec out of the state and apply it to the highstate
global dec
u excludeu6 Exclude Declaration in SLS {0} is not formed as a listu __exclude__N( R R> RH R RF RQ R ( R R RQ Rj R� R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR � s c C@ s� | j } g } t � } g } x�t j | � D]x\ } } xi| D]a} | | j k rr t j | j | | � } nA d | j k r� t j | j d | � } n | j d j | � � | s� | g } n x� | D]� } d j | | � }
|
| k r� q� n | j | | | | � \ } } | r0| j
| | | � n x^ t | � D]O \ }
} d | k r>d j | � } | | k r�d j | | � | |
<q�q>q>W| j | � q� WqA Wq. W| j
| � | | f S( up
Gather the state files and render them into a single unified salt
high data structure.
u __env__u8 No matching salt environment for environment '{0}' foundu {0}:{1}u is not availableu SLS {0} in saltenvu, No matching sls found for '{0}' in env '{1}'( R� R= R RG R� R R� RF R R R Rc R t clean_duplicate_extends( R R� t highstatet
all_errorsR t
statefilesRj R� R� RQ R( R R� R� RO t this_sls( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt render_highstate� sB
c C@ s� d | k r� g } xI d � | d D� D]3 } x* | D]" } | | k r4 | j | � q4 q4 Wq' Wg | D] } i | d | d 6^ qe | d <n d S( Nu
__extend__c s@ s | ] } t j | � Vq d S( N( R RG ( R R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pys <genexpr>� s i i ( RF ( R R- t highextR RD t t( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR, � s
c C@ s d | k r1 | j d g � j | j d � � n d | k rb | j d g � j | j d � � n xv | D]n } | | k ri | | | | k r� | j d j | | | d | | d | | d | | d � � q� qi qi Wy | j | � Wn' t k
r| j d j | � � n Xd S( Nu
__extend__u __exclude__u� Detected conflicting IDs, SLS IDs need to be globally unique.
The conflicting ID is '{0}' and is found in SLS '{1}:{2}' and SLS '{3}:{4}'u __env__u __sls__u- Error when rendering state with contents: {0}( RQ R R RF R R� t
ValueError( R R- R R� R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR � s*
c C@ s( | r
t Sd | j j d k r$ t St S( u�
Check the pillar for errors, refuse to run the state if there are
errors in the pillar and return the pillar errors
u _errorsu pillar( R\ R Rv RY ( R t force( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
_check_pillar s
c C@ s� | s
| Si } t | t � s1 | j d � } n xc | D][ } xR | | D]F } | | k rI | | k rq | | n g | | <| | j | � qI qI Wq8 W| S( ux
Reads over the matches and returns a matches dict with just the ones
that are in the whitelist
u ,( R> RH R RF ( R R� t whitelistt ret_matchesR� RQ ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt matches_whitelist s
u highstatec C@ sK d } i i t d 6d d 6d d 6i d 6d d 6| 6} t j j | j d
d j | � � } | r� t j j | � r� t j j j
| d � �, }
| j j |
� } | j
j | | � SWd
QXq� n g } y | j � }
Wnl t k
r} d | | d <| | d c t j | j � 7<| St k
rCt j � } | j | � | SX| | j |
� 7} | j |
� } | s�d } | | | d <| S| j | | � } | j | � | j | � s�| d g 7} | | j
j d d 7} nv | j | � \ } } | rFt | t j � r| j d � } n d | k r9| d j! | � qF| | d <n | | 7} | rZ| S| sd| St j j j" d � �� y� t j j# j$ � r�| j
j% d d d | g d t d d �n t j j j
| d � �2 }
y | j j& | |
� Wn t' k
r n XWd
QXWn' t( t) f k
r1t* j d | � n XWd
QX| j
j | | � S( uP
Run the sequence to execute the salt highstate for this minion
u no_|-states_|-states_|-Noneu resultu No states found for this minionu commentu No Statesu nameu changesi u __run_num__u cachediru {0}.cache.pu rbNu Unable to render top file: uQ No Top file or master_tops data matches found. Please see master log for details.u4 Pillar failed to render with the following messages:u pillaru _errorsu ,u __exclude__i? u cmd.runu attribu -RR� t output_loglevelu quietu w+bu2 Unable to write to "state.highstate" cache file %s(+ RY R0 R1 R2 Rv R R| R R R R8 R� R� R R� R� R R R[ RO R� R3 R4 RF R� R R9 R R6 R1 R> RV R R t set_umaskt platformt
is_windowsR� t dumpRM R� R7 RN ( R R� t cachet
cache_nameR5 R7 R t tag_nameRR t cfnR> RB R� R� R; R� R^ R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt call_highstate1 s�
c C@ sa g } | j � } | | j | � 7} | j | � } | j | � \ } } | | 7} | r] | S| S( u9
Return just the highstate or the errors
( R� R� R R1 ( R R� R� R� RB R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRf � s
c C@ s� | j � } | j | � } | j | � \ } } | j j | � \ } } | | 7} | | j j | � 7} | j j | � \ } } | | 7} | j j | � } | r� | S| j j | � } | S( u�
Compile the highstate but don't run it, return the low chunks to
see exactly what the highstate will execute
( R� R R1 R R R� R/ R� R� ( R R� R� RB R� R� R. R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt compile_low_chunks� s
c
C@ s g } | j � } | | j | � 7} | r/ | S| j | � } i } x� | j j � D]� \ } } i g d 6g d 6d d 6d d 6d d 6} | j | � } xo | D]g } | d c d 7<| | k r� | d c d 7<| d j | � q� | d c d 7<| d j | � q� W| | | <qT W| S( u^
Return all used and unused states for the minion based on the top match data
u usedu unusedi u count_allu
count_usedu count_unusedi ( R� R� R R� R R� RF (
R R� R� R� t state_usageRj R� t env_usaget env_matchesR ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt compile_state_usage� s0
N(! Rr Rs Rt Ry R� R� R� R� R� R� R� R� R� R� R R R RY R R R R R R1 R, R R6 R9 RZ RC Rf RD RH ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� n s< / z 3 ? & 3 6 � % 9
1 P t HighStatec B@ sk e Z d Z g Z d d d d d e d d d � Z d � Z e d � � Z e d � � Z
e d � � Z RS( u�
Generate and execute the salt "High State". The High State is the
compound state derived from a group of template files stored on the
salt master or in the local cache.
u statesc
C@ s� | | _ t j j | j � | _ t j | | � t | j | | | d | d | d | d | d | �| _ t j j
| j � | _
| | _ i | _ g | _
d S( NR� R� R� R� R� ( Rv R t
fileclientt get_file_clientR� R� Ry R� R R� R� R� t _pydsl_all_declst _pydsl_render_stack(
R Rv R� R� R� R� R� R� R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRy � s c C@ s | j j | � d S( N( t stackRF ( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt push_active� s c C@ s
g | _ d S( N( RN ( t cls( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt clear_active s c C@ s | j j � d S( N( RN R ( RP ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
pop_active s c C@ s( y | j d SWn t k
r# d SXd S( Ni����( RN t
IndexErrorRZ ( RP ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt
get_active
s
N( Rr Rs Rt RN RZ RY Ry RO t classmethodRQ RR RT ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRI � s t MasterStatec B@ s& e Z d Z d � Z d d d � Z RS( u9
Create a State object for master side compiling
c C@ s t j | | � d S( N( R� Ry ( R Rv t minion( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRy s c C@ s� t j d � t j j | j | j d � | _ t j j | j � | _ t j j | j � | _ t j j
| j | j | j | j � | _
t j j | j | j d | j
�| _ d S( u1
Load the modules into the state
u( Loading fresh modules for state activityu idR� N(
RN R] R R� t FunctionWrapperRv R� R� R R� R� R� Rw ( R R� R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyR� s
*N( Rr Rs Rt Ry RZ R� ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRV s Re c B@ s e Z d Z d d � Z RS( u7
Execute highstate compilation from the master
c C@ sk t j | � } d | d <| d | d <| d | d <| d | d <| | d <| | d <t j | | � d S( Nu localu file_clientu master_rootsu
file_rootsu rendereru state_topu idu grains( R� R� RI Ry ( R Rg Rh Ri R Rj Rv ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRy 4 s
N( Rr Rs Rt RZ Ry ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRe 0 s t RemoteHighStatec B@ s2 e Z d Z d � Z d � Z d � Z d � Z RS( u3
Manage gathering the data from the master
c C@ sY | | _ | | _ t j j | j � | _ t j j j j | j d � | _
t | _ d S( Nu
master_uri(
Rv Ri R R� R� R� t transportR� t
ReqChannelt factoryt channelRY t _closing( R Rv Ri ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRy F s
"c C@ sZ i | j d 6| j d 6d d 6} y | j j | d d d d �SWn t k
rU i SXd S(
u7
Return the state data from the master
u grainsu optsu
_master_stateu cmdR� i t timeouti@ N( Ri Rv R] t sendR ( R R� ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt compile_masterN s
c C@ s' | j r
d St | _ | j j � d S( N( R^ R\ R] t close( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt destroyZ s c C@ s | j � d S( N( Rc ( R ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt __del__a s ( Rr Rs Rt Ry Ra Rc Rd ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyRY A s
(` Rt t
__future__R R R R0 RM R� R� R R1 R" R3 R R% RS t salt.loaderR t salt.miniont salt.pillart salt.fileclientt salt.utils.argst salt.utils.cryptt salt.utils.datat salt.utils.decorators.statet salt.utils.dictupdatet salt.utils.eventt salt.utils.filest salt.utils.hashutilst salt.utils.immutabletypesR RK t salt.utils.platformt salt.utils.processt salt.utils.urlt
salt.syspathsR� t salt.transport.clientt salt.serializers.msgpackR R: R R} t
salt.templateR R t salt.exceptionsR R t salt.utils.odictR R
t salt.utils.yamlloaderR� R t salt.extR t salt.ext.six.movesR R
R t getLoggerRr RN t frozensetR t STATE_REQUISITE_IN_KEYWORDSt STATE_RUNTIME_KEYWORDSR RJ R t __hash__R R R R! R/ R7 R< RE RL RU Rd Rk Rn Rp R� Rq t objectRu R� R� RI RV Re RY ( ( ( s. /usr/lib/python2.7/site-packages/salt/state.pyt <module>
s
, � V� � � � � � � � �� � � � jA
Mini Shell