Current File : //lib/python2.7/site-packages/salt/fileserver/roots.pyc
�
���^c @@ s2 d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l
Z d d l Z d d l Z d d l
Z d d l Z d d l Z d d l Z d d l Z d d l m Z e j e � Z d d � Z d � Z d � Z d � Z d
� Z d � Z d � Z d
� Z d � Z d � Z d S( u�
The default file server backend
This fileserver backend serves files from the Master's local filesystem. If
:conf_master:`fileserver_backend` is not defined in the Master config file,
then this backend is enabled by default. If it *is* defined then ``roots`` must
be in the :conf_master:`fileserver_backend` list to enable this backend.
.. code-block:: yaml
fileserver_backend:
- roots
Fileserver environments are defined using the :conf_master:`file_roots`
configuration option.
i ( t absolute_importt print_functiont unicode_literalsN( t sixu basec K@ s� d | k r | j d � n t j j | � } i d d 6d d 6} t j j | � rX | S| t d k r� d t d k r� t j d | � d } q� | Sn d � } d | k rRy t d | t | d � } Wn# t k
r� | St
k
r� | SXt j j | | � } t j j | � rNt
j j t | � rN| | d <| | d <| | � S| Sxq t d | D]a } t j j | | � } t j j | � rat
j j t | � ra| | d <| | d <| | � SqaW| S(
u7
Search the environment for the relative path.
u envu u pathu relu
file_rootsu __env__u: salt environment '%s' maps to __env__ file_roots directoryc S@ s9 y! t t j | d � � | d <Wn t k
r4 n X| S( u0
Stat the file and, assuming no errors were found, convert the stat
result to a list of values and add to the return dict.
Converting the stat result to a list, the elements of the list
correspond to the following stat_result params:
0 => st_mode=33188
1 => st_ino=10227377
2 => st_dev=65026
3 => st_nlink=1
4 => st_uid=1000
5 => st_gid=1000
6 => st_size=1056233
7 => st_atime=1468284229
8 => st_mtime=1456338235
9 => st_ctime=1456338235
u pathu stat( t listt ost statt Exception( t fnd( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt _add_file_stat< s
!
u index( t popR t patht normpatht isabst __opts__t logt debugt intt
IndexErrort
ValueErrort joint isfilet saltt
fileservert is_file_ignored( R t saltenvt kwargsR R t roott full( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt find_file( sB
(
(
c C@ s t t d � S( u-
Return the file server environments
u
file_roots( t sortedR ( ( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt envsm s c
C@ s d | k r | j d � n i d d 6d d 6} d | k sT d | k sT d | k rX | S| d sf | S| d | d <| j d d � } t j j | d � } t j j j | d
� �f } | j
| d � | j t d � } | r | r t j j
j | | � } | | d <n | | d <Wd QX| S(
u?
Return a chunk from a file based on the data received
u envu u datau destu pathu locu saltenvu relu gzipu rbu file_buffer_sizeN( R
t gett NoneR R R R t utilst filest fopent seekt readR t gzip_utilt compress( t loadR t rett gzipt fpatht fp_t data( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt
serve_filet s&
$
c C@ s y- t j j t j j t d d d � t � Wn t t f k
rF n Xt j j t d d d � } i t
d 6i g d 6d 6d d 6} t j j t t d � } i } t j j | � r�t j
j j | d � �� } x� | D]� } t j
j j | � } yb | j d
d � j d d
� \ } } | | | <| | j | | � k rT| d d j | � n Wq� t k
r{t j d | | � q� Xq� WWd QXn t j j | | � | d <t | j � � } t | j � � } t | | � | d d <t | | � | d d <t j j | � }
t j j |
� s*t j |
� n t j
j j | d � �O } xE t j | � D]4 \ } } | j! t j
j j" d j# | | � � � qUWWd QXt j d t
� rt j
j$ j% d t d t d d t d t
�} | j& | t j
j$ j' d d g d d �� n d S( uL
When we are asked to update (regular interval) lets reap the cache
u cachediru rootsu hashu mtime_mapu changedu filesu backendu
file_rootsu rbu
u u :i u+ Skipped invalid cache mtime entry in %s: %sNu removedu addedu wbu {0}:{1}
u fileserver_eventsu masteru sock_diru transportt optst listenu updatet prefixu
fileserver(( R R t reap_fileserver_cache_dirR R R R R t IOErrort OSErrort Falset generate_mtime_mapt existsR" R# R$ t stringutilst
to_unicodet replacet splitR t appendR R t warningt diff_mtime_mapt sett keysR t dirnamet makedirsR t iteritemst writet to_bytest formatt eventt get_eventt
fire_eventt tagify( t mtime_map_pathR. t
new_mtime_mapt
old_mtime_mapR- t linet file_patht mtimet old_filest new_filest mtime_map_path_dirRH ( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt update� s^
$
c C@ s� d | k r | j d � n d | k s4 d | k r8 d S| d } | d } | t d k ru d t d k ru d } n i } | s� t j j | � r� | St d | d <t j j t d d d
| d j | d t d � � } t j j | � ry� t j j
j | d
� �� } y. t j j j
| j � � j d � \ } } WnM t k
r�t j d � y t j | � Wn t k
r|n Xt | | � SXt t j j | � � | k r�| | d <| SWd QXWqt j t f k
rt j d � y t j | � Wn t k
rn Xt | | � SXn t j j j | t d � | d <t j j | � } t j j | � s�y t j | � Wq�t k
r�}
|
j t j k r�q�� q�Xn d j | d t j j | � � } t j j
j | d � � } | j! | � Wd QX| S( uL
Return a file hash, the hash type is set in the master config file
u envu pathu saltenvu u
file_rootsu __env__u hash_typeu cachediru rootsu hashu {0}.hash.{1}u relu rbu :u= Fileserver attempted to read incomplete cache file. Retrying.u hsumNu> Fileserver encountered lock when reading cache file. Retrying.u {0}:{1}u w(" R
R R R R R RG R8 R R" R# R$ R9 R: R& R< R R R t unlinkR5 t file_hasht strt getmtimet errorR4 t hashutilst get_hashRB RC t errnot EEXISTt flopenRE ( R) R R R R* t
cache_pathR- t hsumRQ t cache_dirt errt cache_object( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyRW � sj
.
"c @ s� d | k r | j d � n | d } | t d k rf d t d k r_ t j d | � d } qf g Sn t j j t d d d � } t j j | � s� y t j | � Wq� t j k
r� t j
d | � g SXn t j j | d
j t j
j j | � � � } t j j | d j t j
j j | � � � } t j j t | | | � \ } } } | d k r^| S| r�i t � d 6t � d
6t � d 6i d 6� � f d � } xw t d | D]g }
x^ t j
j j |
d t d �D]= \ } } }
| � d
|
| | � | � d |
| |
� q�Wq�Wt � d � � d <t � d
� � d
<t � d � � d <| r�y t j j t � | | � Wq�t k
r�q�Xn � j | g � Sg S( uX
Return a dict containing the file lists for files, dirs, emtydirs and symlinks
u envu saltenvu
file_rootsu __env__u: salt environment '%s' maps to __env__ file_roots directoryu cachediru
file_listsu rootsu Unable to make cachedir %su {0}.pu .{0}.wu filesu dirsu
empty_dirsu linksc @ sF d � } x6| D].} t j j | | � } t j d | � t j j j | � } t j d | | sh d n d � | r� t d r� q n | t j j | | � � } t j d | | � t j
j t | � r� q n | j | � y' t j
| � s� d j | � n Wn t k
rn X| r t j j j | � } t j d | | � t j j j � r�| j d
� r�t j d | | � | } n | j d � r�t j j | | � }
n! t j j t j j | � | � }
| t j j t j j t j j |
� � t j j | � � � } t j d | | � | j d � s>| � d
| <q>q q Wd S( u9
Add the files to the target set
c S@ s& t j j d k r" | j d d � S| S( uZ
Translate path separators for Windows masterless minions
u \u /( R R t sepR; ( R ( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt _translate_sepR s u roots: Processing %su roots: %s is %sa linku not u u fileserver_ignoresymlinksu roots: %s relative path is %su
empty_dirsu# roots: %s symlink destination is %su \\u) roots: %s is a UNC path, using %s insteadu ..u linksN( R R R R t traceR R" t islinkR t relpathR R t addt listdirR t readlinkt platformt
is_windowst
startswithRB t realpathR ( t tgtt fs_roott
parent_dirt itemsRf t itemt abs_patht is_linkt rel_patht link_destt joinedt rel_dest( R* ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt _add_toN sX
t followlinksu fileserver_followsymlinksN( R
R R R R R R t isdirRC RZ t criticalRG R R" R# t safe_filename_leafR t check_file_list_cacheR! R@ t os_walkR t write_file_list_cachet NameErrorR ( R) t formR t
list_cachedirt
list_cachet w_lockt cache_matcht
refresh_cachet
save_cacheR| R R t dirsR# ( ( R* s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt _file_lists' sZ
--
G
c C@ s
t | d � S( uV
Return a list of all files on the file server in a specified
environment
u files( R� ( R) ( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt file_list� s c C@ s
t | d � S( u>
Return a list of all empty directories on the master
u
empty_dirs( R� ( R) ( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt file_list_emptydirs� s c C@ s
t | d � S( u8
Return a list of all directories on the master
u dirs( R� ( R) ( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt dir_list� s c C@ s� d | k r | j d � n i } | d t d k rJ d t d k rJ | Sd | k rl | d j d � } n d } t | d � } t g t j | � D]' \ } } | j | � r� | | f ^ q� � S( uK
Return a dict of all symlinks based on a given path on the Master
u envu saltenvu
file_rootsu __env__u prefixu /u u links( R
R t stripR� t dictR RD Ro ( R) R* R2 t symlinkst keyt val( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt symlink_list� s $ (! t __doc__t
__future__R R R R R] t loggingt salt.fileserverR t salt.utils.eventt salt.utils.filest salt.utils.gzip_utilt salt.utils.hashutilst salt.utils.patht salt.utils.platformt salt.utils.stringutilst salt.utils.versionst salt.extR t getLoggert __name__R R R R/ RU RW R� R� R� R� R� ( ( ( s9 /usr/lib/python2.7/site-packages/salt/fileserver/roots.pyt <module> s2 E I O �
Mini Shell