Current File : //lib/python2.7/site-packages/salt/fileserver/minionfs.pyo
�
���^c @@ s d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l
Z d d l Z d d l Z d d l
Z d d l Z d d l Z d d l m Z e j e � Z d Z d � Z d � Z d d � Z d
� Z d � Z d � Z d
� Z d � Z d � Z d S( u�
Fileserver backend which serves files pushed to the Master
The :mod:`cp.push <salt.modules.cp.push>` function allows Minions to push files
up to the Master. Using this backend, these pushed files are exposed to other
Minions via the Salt fileserver.
To enable minionfs, :conf_master:`file_recv` needs to be set to ``True`` in the
master config file (otherwise :mod:`cp.push <salt.modules.cp.push>` will not be
allowed to push files to the Master), and ``minionfs`` must be added to the
:conf_master:`fileserver_backends` list.
.. code-block:: yaml
fileserver_backend:
- minionfs
.. note::
``minion`` also works here. Prior to the 2018.3.0 release, *only*
``minion`` would work.
Other minionfs settings include: :conf_master:`minionfs_whitelist`,
:conf_master:`minionfs_blacklist`, :conf_master:`minionfs_mountpoint`, and
:conf_master:`minionfs_env`.
.. seealso:: :ref:`tutorial-minionfs`
i ( t absolute_importt print_functiont unicode_literalsN( t sixu minionfsc C@ s& t t d k r t St d r" t St S( u+
Only load if file_recv is enabled
u fileserver_backendu file_recv( t __virtualname__t __opts__t False( ( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt __virtual__8 s c C@ s' t j j j | d t d d t d �S( uN
Check if the minion is exposed, based on the whitelist and blacklist
t whitelistu minionfs_whitelistt blacklistu minionfs_blacklist( t saltt utilst stringutilst check_whitelist_blacklistR ( t minion( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt _is_exposedA s
u basec K@ sd i d d 6d d 6} t j j | � r* | S| t � k r= | St j j | � d k ri t j d | � | St j j j
t d � } | t | � j
t j j � } y | j t j d � \ } } Wn t k
r� | SXt | � s� | St j j t d d | d
| � } t j j | � r`t j j t | � r`| | d <| | d <t t j | � � | d <| S| S( u6
Search the environment for the relative path
u u pathu relu top.slsuI minionfs will NOT serve top.sls for security reasons (path requested: %s)u minionfs_mountpointi u cachediru minionsu filesu stat( t ost patht isabst envst basenamet logt debugR
R t urlt strip_protoR t lent lstript sept splitt
ValueErrorR t joint isfilet
fileservert is_file_ignoredt listt stat( R t tgt_envt kwargst fndt
mountpointR t pushed_filet full( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt find_fileL s6
c C@ s t d g S( u]
Returns the one environment specified for minionfs in the master
configuration.
u minionfs_env( R ( ( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyR q s c
C@ s i d d 6d d 6} | d s" | S| d | d <| j d d
� } t j j | d � } t j j j | d � �� } | j | d � | j
t d � } | r� t j
r� t j j j | � r� | j t � } n | r� | r� t j j j | | � } | | d <n | | d <Wd
QX| S( u3
Return a chunk from a file based on the data received
CLI Example:
.. code-block:: bash
# Push the file to the master
$ salt 'source-minion' cp.push /path/to/the/file
$ salt 'destination-minion' cp.get_file salt://source-minion/path/to/the/file /destination/file
u u datau destu pathu relu gzipu rbu locu file_buffer_sizeN( t gett NoneR R t normpathR
R t filest fopent seekt readR R t PY3t is_binaryt decodet __salt_system_encoding__t gzip_utilt compress( t loadR& t rett gzipt fpatht fp_t data( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt
serve_filey s
%
c C@ sE y* t j j t j j t d d � t � Wn t j k
r@ n Xd S( uL
When we are asked to update (regular interval) lets reap the cache
u cachediru
minionfs/hashN( R
R t reap_fileserver_cache_dirR R R R R* t error( ( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt update� s c
C@ s@ | d } i } d | k r, | j d � n | d t � k rC i S| s] t j j | � ra | St d | d <t j j t d d d | d d j | d t d � � } t j j | � r�y� t j
j j | d
� �� } y. t j
j
j | j � � j d � \ } } Wn, t k
r5t j d � t | | � | SXt j j | � | k r\| | d
<| SWd QXWq�t j k
r�t j d � t | | � | SXn t j
j j | t d � | d
<t j j | � } t j j | � s�t j | � n d j | d
t j j | � � } t j
j j | d � � } | j | � Wd QX| S( uL
Return a file hash, the hash type is set in the master config file
u pathu envu saltenvu hash_typeu cachediru minionfsu hashu {0}.hash.{1}u relu rbu :u= Fileserver attempted to read incomplete cache file. Retrying.u hsumNu> Fileserver encountered lock when reading cache file. Retrying.u {0}:{1}u w( t popR R R R R R t formatt existsR
R R. R/ R t
to_unicodeR1 R R R R t file_hasht getmtimeR@ t hashutilst get_hasht dirnamet makedirst flopent write(
R8 R& R R9 t
cache_pathR< t hsumt mtimet cache_dirt cache_object( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyRF � sR
.
"c C@ s� d | k r | j d � n | d t � k r3 g St j j j t d � } | j d d � j d � } | r� | j | t
j j � r� | t
| t
j j � } n t
j j t d d � } t
j | � } | r | j d � \ } } } | s� g S| | k rt j d | � g S| g } n g } xa| D]Y} t | � sDq,n t
j j | | d
� } t
j j | � s�t j d t
j j | | � � q,n t
j j | | � }
x� t j j j |
d t �D]� \ } } } x� | D]� }
t
j j t
j j | |
� � rq�n t
j j t
j j | |
� | � } | j d
� r@q�n t
j j | | | � } t j j t | � s�| j | � q�q�Wq�Wq,W| S( uR
Return a list of all files on the file server in a specified environment
u envu saltenvu minionfs_mountpointu prefixu u /u cachediru minionsu3 No files found in minionfs cache for minion ID '%s'u filesu2 minionfs: could not find files directory under %s!t followlinksu ../( RB R R
R R R R R+ t stript
startswithR R R R R t listdirt partitionR t warningR t isdirR t os_walkR t islinkt relpathR R! t append( R8 R' t prefixt minions_cache_dirt minion_dirst
tgt_miniont _R9 R t minion_files_dirt walk_dirt rootR. t fnameR\ t rel_fn( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt file_list� sV
+
! c
C@ s= d | k r | j d � n | d t � k r3 g St j j j t d � } | j d d � j d � } | r� | j | t
j j � r� | t
| t
j j � } n t
j j t d d � } t
j | � } | r | j d � \ } } } | s� g S| | k rt j d | � g S| g } n g } xt
j | � D] } t | � sMq5n t
j j | | d
� } t
j j | � s�t j d t
j j | | � � q5n t
j j | | � }
x� t j j j |
d t �D]d \ } } } t
j j | | � } | d k s�| j d � rq�n | j t
j j | | | � � q�Wq5W| S( ub
Return a list of all directories on the master
CLI Example:
.. code-block:: bash
$ salt 'source-minion' cp.push /absolute/path/file # Push the file to the master
$ salt 'destination-minion' cp.list_master_dirs
destination-minion:
- source-minion/absolute
- source-minion/absolute/path
u envu saltenvu minionfs_mountpointu prefixu u /u cachediru minionsu3 No files found in minionfs cache for minion ID '%s'u filesu2 minionfs: could not find files directory under %s!RS u .u ..u ../( u .u ..( RB R R
R R R R R+ RT RU R R R R R RV RW R RX R RY RZ R R\ R] (
R8 R' R^ R_ R` Ra Rb R9 R Rc Rd Re R\ ( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt dir_list2 sJ +'( t __doc__t
__future__R R R R t loggingt salt.fileserverR
t salt.utils.filest salt.utils.gzip_utilt salt.utils.hashutilst salt.utils.patht salt.utils.stringutilst salt.utils.urlt salt.utils.versionst salt.extR t getLoggert __name__R R R R R* R R> RA RF Rh Ri ( ( ( s< /usr/lib/python2.7/site-packages/salt/fileserver/minionfs.pyt <module> s. % "
E E
Mini Shell