Current File : //proc/227033/root/lib/python2.7/site-packages/salt/fileclient.pyc
�
���^c @@ sz d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z d d l m
Z
m Z m Z d d l Z d d l m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l! Z d d l" Z d d l# Z d d l$ Z d d l% m& Z& d d l' m( Z( d d l) j* j( j+ j, Z, d d l- m. Z. m/ Z/ d d l0 m1 Z1 m2 Z2 e j3 e4 � Z5 d
Z6 e7 d � Z8 d � Z9 d
e: f d � � YZ; d e; f d � � YZ< d e; f d � � YZ= d e= f d � � YZ> e> Z? d e: f d � � YZ@ d S( u"
Classes that manage file clients
i ( t absolute_importt print_functiont unicode_literalsN( t parse_response_start_linet HTTPHeaderst HTTPInputError( t CommandExecutionErrort MinionError( t SaltSwift( t six( t HTTPErrort URLError( t urlparset
urlunparsei� c C@ sX | j d d � } | r- | d k r- d } n i t d 6t d 6t d 6j | t � | � S( u[
Read in the ``file_client`` option and return the correct type of file
server
u file_clientu remoteu localu pillar( t gett RemoteClientt FSClientt PillarClient( t optst pillart client( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt get_file_client3 s
c C@ s� t j s t | t � r | Si } x] t j | � D]L \ } } t | t � rv y | j � } Wqv t k
rr qv Xn | | | <q4 W| S( u�
Convert top level keys from bytes to strings if possible.
This is necessary because Python 3 makes a distinction
between these types.
( R t PY3t
isinstancet dictt iteritemst bytest decodet UnicodeError( t srct outputt keyt val( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt decode_dict_keys_to_strB s
t Clientc B@ s� e Z d Z d � Z d � Z d � Z d � Z d � Z e j d e
d � � Z e
d � Z d e
d e
e
d
� Z d d d � Z d e
e
d � Z d e
d
� Z d e
d � Z d e
e
e
e
d � Z d � Z d d � Z d d d � Z d d d � Z d d d � Z d e
d � Z d � Z e
d � Z d d e
e
d � Z e
d e
e
e
d � Z d e
d e
d � Z e
d � Z RS( u/
Base class for Salt file interactions
c C@ s= | | _ t j j | j � | _ t j j | j � | _ d S( N( R t saltt loadert utilst payloadt Serialt serial( t selfR ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt __init__Z s c C@ s | j | d � d S( Nu opts( R* ( R) t state( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt __setstate__d s c C@ s i | j d 6S( Nu opts( R ( R) ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt __getstate__i s c C@ sF | j d � s' t d j | � � � n t j j j | � \ } } | S( uV
Make sure that this path is intended for the salt master and trim it
u salt://u Unsupported path: {0}( t
startswithR t formatR# R% t urlt parse( R) t patht file_patht saltenv( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt _check_protol s c C@ s� t j j | � r | } n t j j | � } t � } x_ t j j j | d t �D]B \ } } } x0 | D]( } t j j | | � } | j
| � qh WqR W| S( uF
Helper util to return a list of files in a directory
t followlinks( t osR2 t isdirt dirnamet setR# R% t os_walkt Truet joint add( R) t destt destdirt filelistt roott dirst filest nameR2 ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt _file_local_listu s +
u basec c@ s� | j | � } t j j j | d | | � } t j j | � } t j j j d � �k t j j | � rw t j
| � n y t j | � Wn+ t k
r� } | j
t
j k r� � q� n X| VWd QXd S( uV
Return the local location to cache the file, cache dirs will be made
u filesi? N( t get_cachedirR# R% R2 R= R7 R9 RD t set_umaskt isfilet removet makedirst OSErrort errnot EEXIST( R) R2 R4 t cachedirR? R@ t exc( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt
_cache_loc� s
c C@ sQ | d k r | j d } n1 t j j | � sM t j j | j d | � } n | S( Nu cachedir( t NoneR R7 R2 t isabsR= ( R) RO ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRG � s
u c C@ s
t � d S( ub
Copies a file from the local files or master depending on
implementation
N( t NotImplementedError( R) R2 R? RK R4 t gzipRO ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt get_file� s c C@ s
t � d S( u%
List the empty dirs
N( RT ( R) R4 t prefix( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt file_list_emptydirs� s c C@ s" | j | d t | d | d | �S( ue
Pull a file down from the file server and store it in the minion
file cache
u RO t source_hash( t get_urlR< ( R) R2 R4 RO RY ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt
cache_file� s c C@ s^ g } t | t j � r* | j d � } n x- | D]% } | j | j | | d | �� q1 W| S( um
Download a list of files stored on the master and put them in the
minion file cache
u ,RO ( R R t string_typest splitt appendR[ ( R) t pathsR4 RO t retR2 ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt cache_files� s
#c C@ sR g } xE | j | � D]4 } | j | j t j j j | � | d | �� q W| S( uU
Download and cache all files on a master in a specified environment
RO ( t file_listR^ R[ R# R% R0 t create( R) R4 RO R` R2 ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt cache_master� s &c C@ s� g } | j t j j j | � � } | j d � s@ | d } n t j d | | � x� | j | � D]� } t j j j | � } | j � rc | j
| � rc t j j j | | | � r� | j
t j j j | � | d | �} | r� | j | � q� q� qc qc W| r�| j | � } t j j j | d | � } x� | j | � D]n } t j j j | � } | j
| � r;d j | | � }
t j j |
� s�t j |
� n | j |
� q;q;Wn | S( uE
Download all of the files in a subdir of the master
u /u+ Caching directory '%s' for environment '%s'RO u filesu {0}/{1}( R5 R# R% t dataR t endswitht logt infoRb t stripR. t stringutilst check_include_excludeR[ R0 Rc R^ RG R2 R= RX R/ R7 R8 RK ( R) R2 R4 t
include_emptyt include_patt exclude_patRO R` t fn_R? t
minion_dir( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt cache_dir� s4
!
c K@ sp t j j | j d d | j d � � } t j j | � } t j j | � s\ t j | � n t j | | � | S( uJ
Cache a local file on the minion in the localfiles cache
u cachediru
localfilesu /(
R7 R2 R= R t lstripR9 R8 RK t shutilt copyfile( R) R2 t kwargsR? R@ ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt cache_local_file s c C@ sl t j j | j d d | � } t j j | j d d � } | j | � } | j | � } t | j | � � S( uL
List files in the local minion files and localfiles caches
u cachediru filesu
localfiles( R7 R2 R= R RF t sortedt union( R) R4 t filesdestt localfilesdestt fdestt ldest( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt file_local_list s
c C@ s g S( u3
This function must be overwritten
( ( R) R4 RW ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRb ' s c C@ s g S( u3
This function must be overwritten
( ( R) R4 RW ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt dir_list- s c C@ s i S( u3
This function must be overwritten
( ( R) R4 RW ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt symlink_list3 s c C@ s@ | j d � r< t j j j | � \ } } | r< | } q< n t j j j | � rW t n t } t j j
| j d d | j d � � } t j j
| j d d | | j d � � } | j
| | d | �} t j j | � r� | r� t j j j | � S| St j j | � r&| r"t j j j | � S| St j j | � r<| Sd S( u�
Returns the full path to a file if it is cached locally on the minion
otherwise returns a blank string
u salt://u cachediru
localfilesu |/u filesRO u ( R. R# R% R0 R1 t
is_escapedR< t FalseR7 R2 R= R Rr t _extrn_patht existst escape( R) R2 R4 RO t senvt escapedt localsfilesdestRy t extrndest( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt is_cached9 s$ ! " c C@ s� t � } x� | j | � D]� } t j j j � rF | j d d � } n | j d � r | j d � r� | j | j d d � d � q� | j | j d d � d � q q Wt | � S( uj
Return a list of all available sls modules on the master for a given
environment
u \u /u .slsu /init.slsu .i����i����(
R: Rb R# R% t platformt
is_windowst replaceRf R> Rw ( R) R4 t statesR2 ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt list_statesW s $c C@ s� d | k r! | j d d � } n t j j j | d � } t j j j | d � } xD | | g D]6 } | j | | d | �} | r` i | d 6| d 6Sq` Wi S( u�
Get a state file from the master and store it in the local minion
cache; return the location of the file
u .u /u .slsu /init.slsRO u sourceu dest( R� R# R% R0 Rc R[ ( R) t slsR4 RO t sls_urlt init_urlR2 R? ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt get_stateh s c C@ s� g } | j | � j d � } | j d d � } t | � d k rK d } n
| d } x� | j | d | �D]� } y | t | � d k r� wk n Wn t k
r� qk n X| t | � j d � }
| j | j t j
j j | � d j
| |
� t | | � � qk Wy� x� | j | d | �D]� } y | t | � d k r@wn Wn t k
rWqn X| t | � j d � }
d j
| |
� } t j j | � s�t j | � n | j | � qWWn t k
r�n X| j � | S( uB
Get a directory recursively from the salt-master
u /i i u i RW u {0}/{1}( R5 t rstript rsplitt lenRb t
IndexErrorRr R^ RV R# R% R0 Rc R/ R< RX R7 R2 R8 RK t TypeErrort sort( R) R2 R? R4 RU RO R` t separatedRW Ro t minion_relpatht minion_mkdir( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt get_dirw sD
c % @ sA t | � } | j } t j j | j | j � j t j � }
| d k r� t j j | � si | j
dI � r� | j s� t | j � d k r� | j j
d � r� | j
d � d } n d } t j j j � r� t j j j | � } n t j j | | � } n | r1| j � t j k r1d j | |
f � }
d } n | dJ k r�t j j |
� sgt d j |
� � � n | d k r�t j j j |
d
� � } | j � }
Wd QX|
S|
S| d k r� j | | | | d
| �� � r| d k rt j j j � d
� � } | j � }
Wd QX|
S� S| rct j j | � } t j j | � sO| rYt j | � q`d SqOn� | sO� j | | d
| �} | d k ryh | j
d � d } t j j j t | � } t j j! j" | | � | k r�t# j$ d | | | � | SWqt% t& t' t( f k
rqXn t j j | � } t j j | � sOt j | � qOn | j d k rBy� d � f d � } � j d d d d | j d | j d d t) d | d d d | d � d | d � d | d � d | d! t* � d" | d# � d$ | d% t) � d& | d' t* � �
| SWqBt+ k
r>} t, d( j | | � � � qBXn | j d) k ry� t- j. � } | j/ | j0 | j1 � | j2 | j3 | j4 � | j j5 d � } t j j j | d* � �# } | j6 d+ j | � | j7 � Wd QX| j8 � | SWqt+ k
r} t, d, j | | � � � qXn | j d- k r�ym � f d. � } t9 | d/ d � | d0 d � | d1 d � | d2 d � � } | j: | j | j d | � | SWq�t+ k
r�t, d3 j | � � � q�Xn i } | j3 d k rb| j dK k rb| j } | j; d6 � } | d k r | | d } n t< | j | | j | j= | j | j> f � } | j3 | j4 f | d7 <n | } d � z�y@d t) d g � � f d8 � } | r�g � � � f d9 � } n9 d: j | � } t j j j | d* � � � � f d; � } t j j? j | d< t* d= | d> | d? | j3 d@ | j4 dA � j@ | �} dB | k r\t, dC j | dD | � � � n | r�� dE ryd j � � SdF j � � S� jA � d � t j j jB | | � | SWnk tC k
r�} t, dG j | jD | tE jF jG | jD � � � n. tH k
r } t, dH j | | jI � � � n XWd � d k r<� jA � n Xd S(L u/
Get a single file from a URL.
u /u \i i����u
index.htmlu :u fileu u Path '{0}' is not absoluteu rbNu saltRO u =u@ Cached copy of %s (%s) matches source_hash %s, skipping downloadu s3c @ sX d | � j k r" � j d | Sy � j d d | SWn t t f k
rS | SXd S( ua
Get value of s3.<key> from Minion config or from Pillar
u s3.u pillaru s3N( R t KeyErrorR� ( R t default( R) ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt s3_opt� s u s3.queryt methodu GETt bucketR2 t
return_bint
local_filet actionR u keyt keyidu keyidt service_urlu service_urlt
verify_sslu
verify_sslt locationu locationt
path_styleu
path_stylet https_enableu https_enableu( Could not fetch from {0}. Exception: {1}u ftpu wbu RETR {0}u6 Could not retrieve {0} from FTP server. Exception: {1}u swiftc @ sL | � j k r � j | Sy � j d | SWn t t f k
rG | SXd S( u^
Get value of <key> from Minion config or from Pillar
u pillarN( R R� R� ( R R� ( R) ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt swift_opt' s u
keystone.useru keystone.tenantu keystone.auth_urlu keystone.passwordu Could not fetch from {0}u httpu httpsu @u authc @ s� � d t k r[� d d k r[| j � rh d � d k rh � d t k rZ d � d <n t � d <d S� d j | � d � d k r[� d j d � } | j d � s� t � d <� d <n\ d } | j d � } x0 | D]( } d | k r� | j d � d
} q� q� W| � d <t � d <� d � d k o;t k n rXd � d <� d <qXq[n � d d k r�y t | � } Wn t k
r�d SX| j
d k � d <t � � d <n d S( Ni i u Content-Typei u textu utf-8u ;u encodingu encoding=i����i- i. i/ i3 ( i- i. i/ i3 ( R� RR Ri R< t
parse_lineR R. R] R R t codeR ( t hdrt content_typet encodingt fieldst field( t
write_body( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt on_headerj s6
$
c @ s> � d r: � d r* | j � d � } n � j | � n d S( Ni i ( R R^ ( t chunk( t resultR� ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt on_chunk� s
u {0}.partc @ s � d r � j | � n d S( Ni ( t write( R� ( t destfpR� ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR� � s
t streamt streaming_callbackt header_callbackt usernamet passwordR u handleu Error: {0} reading {1}u errori t u HTTP error {0} reading {1}: {3}u Error reading {0}: {1}( u /u \( u fileu ( u httpu https(J R t schemeR7 R2 R= t netlocR� t sepRR R8 Rf t queryR� R] R# R% R� R� t sanitize_win_patht lowert stringt ascii_lowercaseRS R R/ RD t fopent readRV R9 RK R� t
HASHES_REVMAPt hashutilst get_hashRg t debugt AttributeErrorR� t IOErrorRL R� R< t ExceptionR t ftplibt FTPt connectt hostnamet portt loginR� R� Rr t
retrbinaryR� t quitR t
get_objectt rfindR
t paramst fragmentt httpR t closet renameR
R� t BaseHTTPServert BaseHTTPRequestHandlert responsesR t reason( R) R0 R? RK R4 t no_cacheRO RY t url_datat
url_schemet url_patht strpatht fp_Re R@ t formR� RP t ftpt remote_file_pathR� t
swift_connt
get_kwargsR� t at_sign_post fixed_urlR� R� t dest_tmpR� ( ( R� R� R) R� s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRZ � s* !1
"
2
# u jinjac K@ si d | k r | j d � n | | d <t | � } | j | | d | �} | sd t j j | � rh d S| t j j j k r� t j j j | | | � }
n t
j d | � d S|
d s� t
j d |
d � d S| s� | j | | d | �} t
} n t j j | � } t j j | � sQ| r3t j | � qQt j j j |
d � d Sn t j |
d | � | S( u<
Cache a file then process it as a template
u envu saltenvRO u u7 Attempted to render template with unavailable engine %su resultu( Failed to render template with error: %su data( t popR R[ R7 R2 R� R# R% t templatest TEMPLATE_REGISTRYRg t errorR� R< R9 R8 RK RD t safe_rmRs t move( R) R0 R? t templateRK R4 RO Ru R� t sfnRe R@ ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt get_template� s:
c C@ s t | � } t j j j � r9 t j j j | j � } n | j } | j d � d } | d k rq | j
d } n1 t j j | � s� t j j
| j
d | � } n | j r� d j
| j | j g � } n | j } t | � t k r� t j j j | � } n t j j j
| d | | | � S( u;
Return the extrn_filepath for a given url
u @i����u cachediru -u extrn_filesN( R R# R% R� R� R2 R� R� R] RR R R7 RS R= R� R� t MAX_FILENAME_LENGTHR� t
sha256_digest( R) R0 R4 RO R� R� t file_name( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR� s( ( t __name__t
__module__t __doc__R* R, R- R5 RF t
contextlibt contextmanagerRR RQ RG R� RV RX R[ Ra Rd Rq Rv R} Rb R~ R R� R� R� R� RZ R� R� ( ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR" V sL
2 :� -R c B@ s� e Z d Z d d � Z d e d d d d � Z d d d � Z d d d � Z d d d � Z d d � Z
d d � Z d d
� Z d d � Z
d � Z d
� Z d � Z RS( u6
Used by pillar to handle fileclient requests
u basec C@ s� i d d 6d d 6} t j j j | � rA t j j j | � } n x` | j d j | g � D]E } t j j | | � } t j j
| � r[ | | d <| | d <| Sq[ W| S( u&
Locate the file path
u u pathu relu pillar_roots( R# R% R0 R� t unescapeR R R7 R2 R= RI ( R) R2 R4 t fndRB t full( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt
_find_file) s
u c C@ s> | j | � } | j | | � } | j d � } | s: d S| S( u�
Copies a file from the local files directory into :param:`dest`
gzip compression settings are ignored for local files
u pathu ( R5 R R ( R) R2 R? RK R4 RU RO R t fnd_path( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRV ; s c C@ s� g } | j d � } x� | j d j | g � D]� } x� t j j j t j j | | � d t �D]� \ } } } g | D]$ } t j
j | j | � sv | ^ qv | (xN | D]F } t j j t j j | | � | � }
| j
t j j j |
� � q� Wq` Wq/ W| S( u�
Return a list of files in the given environment
with optional relative prefix path to limit directory traversal
u /u pillar_rootsR6 ( Ri R R R# R% R2 R; R7 R= R< t
fileservert is_file_ignoredt relpathR^ Re R ( R) R4 RW R` R2 RB RC RD t dt fnameR
( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRb N s +2
$(c C@ s� g } | j d � } x� | j d j | g � D]� } x� t j j j t j j | | � d t �D]} \ } } } g | D]$ } t j
j | j | � sv | ^ qv | (| r` | r` | j t j j
j t j j | | � � � q` q` Wq/ W| S( u�
List the empty dirs in the pillar_roots
with optional relative prefix path to limit directory traversal
u /u pillar_rootsR6 ( Ri R R R# R% R2 R; R7 R= R< R R R^ Re R R
( R) R4 RW R` R2 RB RC RD R ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRX ` s +26c C@ s� g } | j d � } x� | j d j | g � D]o } xf t j j j t j j | | � d t �D]: \ } } } | j
t j j j t j j
| | � � � q` Wq/ W| S( u{
List the dirs in the pillar_roots
with optional relative prefix path to limit directory traversal
u /u pillar_rootsR6 ( Ri R R R# R% R2 R; R7 R= R< R^ Re R R
( R) R4 RW R` R2 RB RC RD ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR~ q s +3c C@ sf y | j | � } Wn@ t k
rU } t j j | � sN t j d | | � d S| Sn X| j | | � S( uU
Return either a file path or the result of a remote find_file call.
u5 specified file %s is not present to generate hash: %sN( R5 R R7 R2 RI Rg t warningRR R ( R) R2 R4 t err( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt __get_file_path s
c C@ s� i } | j | | � } | d k r( | Sy | d } Wn t k
rO | } n X| j j d d � } t j j j | d | �| d <| | d <| S( u�
Return the hash of a file, to get the hash of a file in the pillar_roots
prepend the path with salt://<file on server> otherwise, prepend the
file with / for a local file.
u pathu hash_typeu md5R� u hsumN( t _PillarClient__get_file_pathRR R� R R R# R% R� R� ( R) R2 R4 R` R R t hash_type( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt hash_file� s
c C@ s� i } | j | | � } | d k r. | d f Sy | d } | j d � } WnJ t k
r� | } y t t j | � � } Wq� t k
r� d } q� Xn X| j j d d � } t j
j j | d | �| d <| | d <| | f S( u7
Return the hash of a file, to get the hash of a file in the pillar_roots
prepend the path with salt://<file on server> otherwise, prepend the
file with / for a local file.
Additionally, return the stat result of the file, or None if no stat
results were found.
u pathu statu hash_typeu md5R� u hsumN(
R RR R R� t listR7 t statR� R R# R% R� R� ( R) R2 R4 R` R R t fnd_statR ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt hash_and_stat_file� s"
c C@ s
| j | � S( uW
Return a list of the files in the file server's specified environment
( Rb ( R) R4 ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt list_env� s c C@ s | j S( u-
Return the master opts data
( R ( R) ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt master_opts� s c C@ s/ g } x" | j d D] } | j | � q W| S( u3
Return the available environments
u pillar_roots( R R^ ( R) R` R4 ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt envs� s c C@ s i S( uX
Originally returned information via the external_nodes subsystem.
External_nodes was deprecated and removed in
2014.1.6 in favor of master_tops (which had been around since pre-0.17).
salt-call --local state.show_top
ends up here, but master_tops has not been extended to support
show_top in a completely local environment yet. It's worth noting
that originally this fn started with
if 'external_nodes' not in opts: return {}
So since external_nodes is gone now, we are just returning the
empty dict.
( ( R) ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt master_tops� s
N( R� R� R R R� RR RV Rb RX R~ R R R R R R R ( ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR % s"
R c B@ s� e Z d Z d � Z d � Z d � Z d � Z d e d d d d � Z d d d � Z
d d d � Z d d d
� Z d d d � Z
d d � Z d d
� Z d d � Z d d � Z d � Z d � Z d � Z RS( u4
Interact with the salt master file server.
c C@ sh t j | | � t | _ t j j j j | j � | _
t | j
d � r[ | j
j | _ n d | _ d S( Nu authu (
R" R* R� t _closingR# t transportR t
ReqChannelt factoryR t channelt hasattrt auth( R) R ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR* � s c C@ s% t j j j j | j � | _ | j S( uD
Reset the channel, in the event of an interruption
( R# R R R R R R ( R) ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt _refresh_channel� s c C@ s | j � d S( N( t destroy( R) ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt __del__ s c C@ sZ | j r
d St | _ d } y
| j } Wn t k
r< n X| d k rV | j � n d S( N( R R< RR R R� R� ( R) R ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR# s
u u basec C@ s} t j j j | � \ } } | r* | } n t j j j � s� | j | | � \ } } y | d }
Wq� t t f k
r� d }
q� Xn | j
| | � } d }
| d k r� t j d | | � t
S| d k r3t j j | � s� | j d! � r3t j j | t j j | � � } t j d | t j j | � | � n | } | s�| j | � } t j d | | | � | j | | d | ��
}
|
} Wd QXn t j d
| | | � | rBt j j | � rBt j j j � s| j | | � \ } } y | d } Wq/t t f k
rd } q/Xn | j
| | � } d } | | k rB| Sn t j d | | � d } d } | j | � } i | d 6| d
6d d 6} | r�t | � } | | d <n d } | rDt j j | � } t j j | � s)| r"y t j | � Wq&t k
r } | j t j k r � q q&Xq)t
Sn t j j j | d � } n
t j d � x�t r?| smd | d <n | j � | d <| j! j" | d t �} t# j$ r�t% | � } n y�| d s�| r+| d r+| j | d | d | ��? }
|
} t j j j |
d � � } | j& | d � Wd QXWd QXn d | k r�| d k r�| d 7} t j j' j( | t j j) j* | j+ d d � � � } | | d k r�t j, d | | � wTq�n Pn | s$| j | d | d | ��M }
|
} t j j | � rt j j j- | � n t j j. j/ | d � } Wd QXn | j+ d d � rRt j j0 j1 | d � } n
| d } t# j$ r�t2 | t3 � r�| j4 � } n | j& | � WqTt t5 f k
r;} y t6 | � j7 } Wn& t8 k
r�t# j9 t6 | � � } n X| d 7} t j, d | | | | � | j: � | d k r<t j; d | | | � Pq<qTXqTW| rf| j< � t j= d | | � n t j d | | � | S(" u�
Get a single file from the salt-master
path must be a salt server location, aka, salt://path/to/file, if
dest is omitted, then the downloaded file will be placed in the minion
cache
i u u( Could not find file '%s' in saltenv '%s'u /u \u; In saltenv '%s', '%s' is a directory. Changing dest to '%s'u9 In saltenv '%s', looking at rel_path '%s' to resolve '%s'RO Nu< In saltenv '%s', ** considering ** path '%s' to resolve '%s'u6 Fetching file from saltenv '%s', ** attempting ** '%s'u pathu saltenvu _serve_fileu cmdu gzipu wb+u No dest file foundu loct rawu datau destu hsumi i u hash_typet md5u( Bad download of file %s, attempt %d of 3uK Data transport is broken, got: %s, type: %s, exception: %s, attempt %d of 3uT Data transport is broken, got: %s, type: %s, exception: %s, retry attempts exhaustedu0 Fetching file from saltenv '%s', ** done ** '%s'u3 In saltenv '%s', we are ** missing ** the file '%s'( u /u \(> R# R% R0 t split_envR� R� R R� R� RR R Rg R� R� R7 R2 R8 Rf R= t basenameR9 R5 RQ RI t intRK RL RM RN RD R� R< t tellR t sendR R R! R� R� R� Rj t to_strR R
t rm_rft
atomicfilet atomic_opent gzip_utilt
uncompressR t strt encodeR� t typeR� R� t text_typeR" R� R� Rh ( R) R2 R? RK R4 RU RO R� t hash_servert stat_servert mode_servert
dest2checkt rel_patht
cache_destt
hash_localt
stat_localt
mode_localt d_triest transport_triest loadRo R@ RP Re t ofilet hsumt data_type( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRV s
!!
3
!
c C@ sS i | d 6| d 6d d 6} t j rC t j j j | j j | � � S| j j | � S( u.
List the files on the master
u saltenvu prefixu
_file_listu cmd( R t PY2R# R% Re R R R+ ( R) R4 RW RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRb � s
(c C@ sS i | d 6| d 6d d 6} t j rC t j j j | j j | � � S| j j | � S( u3
List the empty dirs on the master
u saltenvu prefixu _file_list_emptydirsu cmd( R RE R# R% Re R R R+ ( R) R4 RW RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRX � s
(c C@ sS i | d 6| d 6d d 6} t j rC t j j j | j j | � � S| j j | � S( u-
List the dirs on the master
u saltenvu prefixu _dir_listu cmd( R RE R# R% Re R R R+ ( R) R4 RW RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR~ � s
(c C@ sS i | d 6| d 6d d 6} t j rC t j j j | j j | � � S| j j | � S( u=
List symlinked files and dirs on the master
u saltenvu prefixu
_symlink_listu cmd( R RE R# R% Re R R R+ ( R) R4 RW RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR � s
(c C@ s� y | j | � } Wn� t k
r� } t j j | � sT t j d | | � i d
f Si } | j j d d � } t
j j j
| d | �| d <| | d <| Sn Xi | d 6| d 6d d 6} | j j | � S( u;
Common code for hashing and stating files
u5 specified file %s is not present to generate hash: %su hash_typeu md5R� u hsumu pathu saltenvu
_file_hashu cmdN( R5 R R7 R2 RI Rg R
RR R R R# R% R� R� R R+ ( R) R2 R4 R R` R RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt __hash_and_stat_file s"
c C@ s | j | | � S( u�
Return the hash of a file, to get the hash of a file on the salt
master file server prepend the path with salt://<file on server>
otherwise, prepend the file with / for a local file.
( t! _RemoteClient__hash_and_stat_file( R) R2 R4 ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR s c C@ s� | j | | � } y | j | � } Wng t k
r� } t j j | � sS | d f Sy | t t j | � � f SWq� t k
r� | d f SXn Xi | d 6| d 6d d 6} | j
j | � } y | j d � } Wn t
k
r� d } n X| | f S( uu
The same as hash_file, but also return the file's mode, or None if no
mode data is present.
u pathu saltenvu
_file_findu cmdu statN( R R5 R R7 R2 RI RR R R R� R R+ R R� ( R) R2 R4 t hash_resultR RA R t stat_result( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR s&
c C@ sL i | d 6d d 6} t j r< t j j j | j j | � � S| j j | � S( uW
Return a list of the files in the file server's specified environment
u saltenvu
_file_listu cmd( R RE R# R% Re R R R+ ( R) R4 RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR : s
(c C@ sE i d d 6} t j r5 t j j j | j j | � � S| j j | � S( u9
Return a list of available environments
u
_file_envsu cmd( R RE R# R% Re R R R+ ( R) RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR C s
(c C@ sE i d d 6} t j r5 t j j j | j j | � � S| j j | � S( u-
Return the master opts data
u _master_optsu cmd( R RE R# R% Re R R R+ ( R) RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR K s
(c C@ s� t j d � i d d 6| j d d 6| j d 6} | j rT | j j d � | d <n t j r| t j j j
| j j | � � S| j j | � S( uI
Return the metadata derived from the master_tops system
u� The _ext_nodes master function has been renamed to _master_tops. To ensure compatibility when using older Salt masters we will continue to invoke the function as _ext_nodes until the Magnesium release.u
_ext_nodesu cmdu idu optsR# u tok(
Rg R� R R! t gen_tokenR RE R# R% Re R R R+ ( R) RA ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR S s
(N( R� R� R R* R" R$ R# R� RR RV Rb RX R~ R RG R R R R R R ( ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR � s* �
R c B@ s e Z d Z d � Z RS( ui
A local client that uses the RemoteClient but substitutes the channel for
the FSChan object
c C@ s> t j | | � t | _ t j j | � | _ t � | _ d S( N(
R" R* R� R R# R t FSChanR t DumbAuthR! ( R) R ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR* m s ( R� R� R R* ( ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyR h s RL c B@ s e Z d Z d � Z RS( ua
The dumbauth class is used to stub out auth calls fired from the FSClient
subsystem
c C@ s | S( N( ( R) t clear_tok( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRJ ~ s ( R� R� R RJ ( ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyRL y s (A R t
__future__R R R R RM t loggingR7 R� Rs R� t tornado.httputilR R R t salt.utils.atomicfileR# t salt.exceptionsR R t salt.clientt salt.loadert salt.payloadt salt.transport.clientt salt.fileservert salt.utils.datat salt.utils.filest salt.utils.gzip_utilt salt.utils.hashutilst salt.utils.httpt salt.utils.patht salt.utils.platformt salt.utils.stringutilst salt.utils.templatest salt.utils.urlt salt.utils.versionst salt.utils.openstack.swiftR t salt.extR t! salt.ext.six.moves.BaseHTTPServert extt movesR� t salt.ext.six.moves.urllib.errorR
R t salt.ext.six.moves.urllib.parseR R
t getLoggerR� Rg R� R� R R! t objectR" R R R t LocalClientRL ( ( ( s3 /usr/lib/python2.7/site-packages/salt/fileclient.pyt <module> sZ � � ��� }
Mini Shell