Current File : //lib/python2.7/site-packages/salt/states/archive.pyo
�
���^c @@ s� d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l
m Z d d l m Z d d l m Z d d l m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z e j! e" � Z# d � Z$ d
� Z% d � Z& d � Z' d
� Z( d d � Z* d � Z+ d � Z, d � Z- d d e. e. d d d e. e. e. d d d e. d e/ e/ d d d � Z0 d S( u0
Extract an archive
.. versionadded:: 2014.1.0
i ( t absolute_importt print_functiont unicode_literalsN( t closing( t six( t shlex_quote( t urlparse( t CommandExecutionErrort CommandNotFoundErrorc C@ s= | d k r t Sy t j j | � SWn t k
r8 t SXd S( u�
Return a bool telling whether or ``path`` is absolute. If ``path`` is None,
return ``True``. This function is designed to validate variables which
optionally contain a file path.
N( t Nonet Truet ost patht isabst AttributeErrort False( R ( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt _path_is_abs% s
c C@ s6 | r | d c d 7<n | r2 | d c d 7<n d S( uq
Common code to add additional explanation to the state's comment field,
both when test=True and not
u commentu , due to source_hash updateu* , due to absence of one or more files/dirsN( ( t rett source_hash_triggert contents_missing( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt _add_explanation4 s c C@ s/ i t j j j | d t d �d 6t d d 6S( Nt formu hash_typeu hsum( t saltt utilst hashutilst get_hasht __opts__( R ( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt
_gen_checksum? s #c C@ sQ yr d j t j j | t d � d f � } t j d | � rq t j j j d t j j | � d j
d � � } n Wn� t k
r} t j
| � j d � r� t j j | � \ } } t j j j d | j d � | j
d � � } qt | � j d
� rt j j j d | � } q� n Xt j j j t d d | � } t j d
| | � | S( Nu .u cachediru hashu ..[/\\]u locali����u /\u
path is onu :u Cannot mix UNCu uncu archive_hashu1 Using checksum file %s for cached archive file %s( t joinR R t relpathR t ret matchR R t
splitdrivet lstript
ValueErrorR t text_typet
startswitht rstript strt logt debug( R R t exct driveR ( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt _checksum_file_pathD s& ( ) c C@ s
t | � } t j j | � } t j j | � s@ t j | � n t | � } | j d � } | j d � } | r | r g } yOys t j j
j | d � �U } xK | D]C } y& | j | j
d � j d d � � Wq� t k
r� q� q� Xq� WWd QXWn1 t t f k
r%} | j t j k r&� q&n Xt j j
j | d � �� } xA | D]9 } | d | k rk| | d <n | j d j | � � qHW| g | D] }
|
d ^ q�k r�| j d j | | � � n Wd QXWq t t f k
r} t j d
| | j � d t �q Xn d S( Nu hash_typeu hsumu ru
u :i u wi u {0}:{1}
u$ Failed to update checksum for %s: %st exc_info( R+ R R t dirnamet isdirt makedirsR t getR R t filest fopent appendR% t splitR" t IOErrort OSErrort errnot ENOENTt writet formatR' t warningt __str__R
( R t
checksum_filet checksum_dirt
source_sumt hash_typet hsumt linest fp_t lineR) t x( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt _update_checksum_ s>
&
#&c C@ s� | d k r t d } n t | � } yk t j j j | d � �M } xC | D]7 } | j d � j d d � \ } } | | k rJ PqJ qJ Wd SWd QXWn t t
t f k
r� d SXi | d 6| d 6Sd S( Nu hash_typeu ru
u :i u hsum( R R R+ R R R1 R2 R% R4 R5 R6 R" ( R R R= RC RD R@ RA ( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt _read_cached_checksum� s
! c C@ s, t | d | j d t d � �} | | k S( NR u hash_type( RG R0 R ( t cachedR? t
cached_sum( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt _compare_checksum� s c C@ s d t d d d g d t �k S( Nu bsdtaru cmd.runu taru --versiont python_shell( t __salt__R ( ( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt
_is_bsdtar� s c C@ s) y t j | � Wn t k
r$ n Xd S( u3
Attempt to remove the specified directory
N( R t rmdirR6 ( t name( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt _cleanup_destdir� s
c T ' K@ s� i | d 6t d 6i d 6d d 6} t j j j | � } d | k oL d | k r� | j d g � j d � t | j d � � } | j d � nN d | k r� t | j d � � } n* d | k r� t | j d � � } n t } t
| � rd
j | � | d <| Snc | rd | d <| Sn | j t
j � } t
j j | � rXd j | � | d <| Sn | t
j 7} t
| � r�d
| d <| Sn t
| � r�d | d <| Snr | t k ry) t
j j | | � j d t
j � } Wn t k
r�t } n X| rd j | � | d <| Sn n | t k o.t
j j | � rUt | d <d j | � | d <| Sn | p^|
rt j j j � r�d | d <| Sn | r�t d | � } | d k r�d j | � | d <| Sn n d } |
rt d |
� } | d k rd j |
� | d <| Sn n d } n
d } } | o%| rD| j d g � j d � n y t d | | t � d } Wn. t k
r�} t | d <| j | d <| Sn X| r�t | d <d j | � | d <| Sn t | � } | j } t
j j | j | j � j t
j � } | o| j � t! j" k r3d j | | g � } d } n | p?| j } | t j j# j$ k }! |! r�t
j j% t
j j& | � � } t
j j | � r�d j t j j' j( | � � | d <| Sn n d d d! f }" | rt j j# j) | � } | t k rd" j d# j |" � � | d <| Sn n y | j � } Wn t* k
r:n X| |" k rmd$ j | d# j |" � � | d <| Sn | t k o�t+ | t, j- � r�t, j. | � } n t }# | o�| d k r�y% t/ t0 j1 d% | � j2 d& � � }# Wn t* t3 f k
r�n Xn | d! k r�| rp| t k r/t4 j5 d' | � t } n | rGd( | d <| Sn | rmd) t k rjd* | d <| Sn n n | r�| t k r�t4 j5 d+ | � t } n" | r�| j d g � j d, � n n n | r�d- | d <| Sn | d k rd. t k rd/ | d <| Sn n d d! f }$ | o!| |$ k rGd0 j d# j |$ � � | d <| Sn | r�| t k rbd1 } nN t+ | t t, j6 f � r�y t/ | � } Wn t7 k
r�d2 | d <| Sn Xn n | r y) t d3 d4 | d5 | d6 | d7 t � }% Wn$ t k
r} | j | d <| Sn Xn i }% |! r!| }& nLt8 d8 r^t | d <d9 j t j j' j( | � � | d <| Sn d: t9 k r�d; j t j j' j( | � � | d <| Sn y, t9 d: | d5 | d6 | d< | d7 t �}' WnU t k
r } d= j t j j' j( | � | j: � � }( t4 j; |( � |( | d <| Sn Xt4 j< d> |' � |' d rJ t d? | d7 t �}& n# t4 j< d@ t j j' j( | � � |' St= |& � }) | o� | o� | r� t> |& � n | d! k o� | r"
t4 j< dA | � y t dB |& dC t d7 t �}* Wn t k
r� n0 X|* r
dD j t j j' j( | � � | d <| Sn n y2 t dE |& dF | dG | dH |# dC t dI t �}+ Wn� t k
r3 } t }+ g }, | r�
|, j dJ � n | o�
| p�
|
r�
|, j dK � n | j }( |, r" |( dL 7}( | d k r�
|( dM 7}( n
|( dN 7}( |( dO j | � 7}( x! |, D] }- |( dP j |- � 7}( q Wn |( | d <| Sn X| oo |+ t k oo t? |+ dQ � d& k po t? |+ dR � d k r� dS j | t
j j | dT � | � | d <| Sn |
}. t }/ y t
j j | � }0 Wn t7 k
r� t }0 n X|0 r2|+ t k r[ y t
j@ | � t }. WnN tA k
rW } | jB tB jC k r4 t }. n dU j | | j: � � | d <| Sn Xn�g }1 x |+ dV tD jE f |+ dW dX � f |+ dY tD jF f f D]� \ }2 }3 x� |2 D]� }4 t j j j | |4 � }5 y? t
j@ |5 j t
j � � jG }6 |3 |6 � r
|1 j |4 � n Wn] tA k
rg
} | jB tB jC k r;
t }. t }/ n) | jB tB jH k rd
| j: � | d <| Sn n Xq� Wq� W|1 r/dL dZ j g |1 D] }7 d[ j |7 � ^ q�
� }8 d\ j | � | d <t8 d8 o�
| o�
|+ t k r�
t | d <| d c d] j |8 � 7<| Sn | o
|+ t k r,| r8| d c d^ j |8 � 7<| Sn� g }, x� |1 D]� }4 t
j j | |4 � }5 yF t j j# jI |5 j t
j � � | d j d_ g � j |5 � t }. Wn; tA k
r�} | jB tB jC k r�|, j | j: � � n n XqEW|, r)d` }( x! |, D] }- |( dP j |- � 7}( q�W|( | d <| Sn n n n |. oX| oX|) t k oXtJ |& |) � rjt }. t }9 n t }9 t }: |. rW|! o�| o�| r�t da | |% db � | d <| d r�dc j t j j' j( | � |% db � | d <| Sn n t8 d8 r]t | d <dd j t j j' j( | � | � | d <| o0|+ t k rF| d c de 7<n tK | |9 |/ � | Sn | ol|+ t k r�g }, t4 j< df | � x� |+ dQ |+ dR D]� }4 t
j j | |4 � }5 yP t4 j< dg |5 � t j j# jI |5 j t
j � � | d j d_ g � j |5 � Wn; tA k
r@} | jB tB jC k r=|, j | j: � � n n Xq�W|, r�dh }( x! |, D] }- |( dP j |- � 7}( qXW|( | d <| Sn n t
j jL | � r�t9 di | dj | dk t �t }: n t4 j< dl |& | � y[| d! k rt| rCy, t d) |& | dG | dm | dn | | �}; Wn* t tM f k
r?} | j | d <| Sn Xn. t do |& | dG | dm | dn | dp | | �}; n�| d k r�y t d. |& | dm | | �}; Wn* t tM f k
r�} | j | d <| Sn Xn\| t k r�y` tN tO jP |& dq � � �B }< |< jQ t j jR jS | � � |< jT � }; | r5|; | }; n Wdr QXWnLtO jU k
r�t j j jV ds � r\t dt ds du |& g dv t dw t �d k r.t4 j< dx � dy }= t dz |= j tW |& � � d{ | dv t �}> |> d| d k r |: r�tX | � n t | d <|> | d <| Sn tY � r!|> d} }; n
|> d~ }; n+ |: rAtX | � n t | d <d | d <| Sn+ |: rotX | � n t | d <d� | d <| Sn Xn�t j j jV d � r�d� | d <| Sn tZ j[ | � }? d g }@ d� }A g }B x� t\ |? � D]{ \ }C }D |D j d� � r|B j |D � nP |C d k r-|B j |D � n4 |D }E |E j] d� d � }E |E j] d� d � }E |A |E }A q�Wt^ d� j � d� k r�d� |A }A n |@ j |A � |@ j_ |B � |@ j_ d� |& g � t dz |@ d{ | dv t �}> |> d| d k r�t | d <|> | d <| Sn tY � r|> d} }; n
|> d~ }; |; r,d� }; n Wn$ t k
rS} | j | d <| Sn Xn g }F g }G | pl|
r�| r�t
j jL | � r�| g }H g }I g }J n g }H | g }I g }J n- |+ t k r�|+ dQ }H |+ dR }I |+ d� }J n g }K | r |K j d� � n |
r|K j d� � n d# j |K � }L t` g d� | f d� |
f f D] \ }7 }M |M r_|7 |M f ^ qA� }N x|H D]}O t
j j | |O � }5 t
j jL |5 � r�t8 d8 r�|F j |5 � n n� t4 j< d� |L |O t8 d8 r�d� n d � t9 di |5 dj | d� |
d� |K �}P t4 j< d� |P � |P ja d � r3t | d d� <n y |P d rQ|G j |5 � n Wn* tb t7 f k
r~t4 jc d� |P |O � n XqoWx'|I |J D]}Q t
j j | |Q � }5 y t
j@ |5 � }R WnP tA k
r} t8 d8 r | jB tB jC k r�|F j |5 � n |G j |5 � n n� X| d k o'| |R jd k pB| d k oB| |R je k r�t8 d8 r`t | d d� <nF y% t
jf |5 | | � t | d d� <Wn tA k
r�|G j |Q � n Xn q�Wn |. rat? |; � d k r2|: r�| g | d d� <n |; | d d� <d� j t j j' j( | � | � | d <tK | |9 |/ � t | d <n, t | d <d� j t j j' j( | � � | d <nm t | d <|0 r�d� j | � | d <n
d� | d <t8 d8 r�| d ja d� � r�t | d <| d c d� 7<n n |F r%| r�t | d <n | d c d� 7<x' |F D] }S | d c dP j |S � 7<q�Wn |G rrt | d <| d c d� 7<x' |G D] }S | d c dP j |S � 7<qLWn |! r�| r�t4 j< d� |& � nQ t4 j< d� |& � t9 d� | d7 t �}' |' d r�| j d g � j |' d � n n | S(� u�M
.. versionadded:: 2014.1.0
.. versionchanged:: 2016.11.0
This state has been rewritten. Some arguments are new to this release
and will not be available in the 2016.3 release cycle (and earlier).
Additionally, the **ZIP Archive Handling** section below applies
specifically to the 2016.11.0 release (and newer).
Ensure that an archive is extracted to a specific directory.
.. important::
**Changes for 2016.11.0**
In earlier releases, this state would rely on the ``if_missing``
argument to determine whether or not the archive needed to be
extracted. When this argument was not passed, then the state would just
assume ``if_missing`` is the same as the ``name`` argument (i.e. the
parent directory into which the archive would be extracted).
This caused a number of annoyances. One such annoyance was the need to
know beforehand a path that would result from the extraction of the
archive, and setting ``if_missing`` to that directory, like so:
.. code-block:: yaml
extract_myapp:
archive.extracted:
- name: /var/www
- source: salt://apps/src/myapp-16.2.4.tar.gz
- user: www
- group: www
- if_missing: /var/www/myapp-16.2.4
If ``/var/www`` already existed, this would effectively make
``if_missing`` a required argument, just to get Salt to extract the
archive.
Some users worked around this by adding the top-level directory of the
archive to the end of the ``name`` argument, and then used ``--strip``
or ``--strip-components`` to remove that top-level dir when extracting:
.. code-block:: yaml
extract_myapp:
archive.extracted:
- name: /var/www/myapp-16.2.4
- source: salt://apps/src/myapp-16.2.4.tar.gz
- user: www
- group: www
With the rewrite for 2016.11.0, these workarounds are no longer
necessary. ``if_missing`` is still a supported argument, but it is no
longer required. The equivalent SLS in 2016.11.0 would be:
.. code-block:: yaml
extract_myapp:
archive.extracted:
- name: /var/www
- source: salt://apps/src/myapp-16.2.4.tar.gz
- user: www
- group: www
Salt now uses a function called :py:func:`archive.list
<salt.modules.archive.list>` to get a list of files/directories in the
archive. Using this information, the state can now check the minion to
see if any paths are missing, and know whether or not the archive needs
to be extracted. This makes the ``if_missing`` argument unnecessary in
most use cases.
.. important::
**ZIP Archive Handling**
*Note: this information applies to 2016.11.0 and later.*
Salt has two different functions for extracting ZIP archives:
1. :py:func:`archive.unzip <salt.modules.archive.unzip>`, which uses
Python's zipfile_ module to extract ZIP files.
2. :py:func:`archive.cmd_unzip <salt.modules.archive.cmd_unzip>`, which
uses the ``unzip`` CLI command to extract ZIP files.
Salt will prefer the use of :py:func:`archive.cmd_unzip
<salt.modules.archive.cmd_unzip>` when CLI options are specified (via
the ``options`` argument), and will otherwise prefer the
:py:func:`archive.unzip <salt.modules.archive.unzip>` function. Use
of :py:func:`archive.cmd_unzip <salt.modules.archive.cmd_unzip>` can be
forced however by setting the ``use_cmd_unzip`` argument to ``True``.
By contrast, setting this argument to ``False`` will force usage of
:py:func:`archive.unzip <salt.modules.archive.unzip>`. For example:
.. code-block:: yaml
/var/www:
archive.extracted:
- source: salt://foo/bar/myapp.zip
- use_cmd_unzip: True
When ``use_cmd_unzip`` is omitted, Salt will choose which extraction
function to use based on the source archive and the arguments passed to
the state. When in doubt, simply do not set this argument; it is
provided as a means of overriding the logic Salt uses to decide which
function to use.
There are differences in the features available in both extraction
functions. These are detailed below.
- *Command-line options* (only supported by :py:func:`archive.cmd_unzip
<salt.modules.archive.cmd_unzip>`) - When the ``options`` argument is
used, :py:func:`archive.cmd_unzip <salt.modules.archive.cmd_unzip>`
is the only function that can be used to extract the archive.
Therefore, if ``use_cmd_unzip`` is specified and set to ``False``,
and ``options`` is also set, the state will not proceed.
- *Permissions* - Due to an `upstream bug in Python`_, permissions are
not preserved when the zipfile_ module is used to extract an archive.
As of the 2016.11.0 release, :py:func:`archive.unzip
<salt.modules.archive.unzip>` (as well as this state) has an
``extract_perms`` argument which, when set to ``True`` (the default),
will attempt to match the permissions of the extracted
files/directories to those defined within the archive. To disable
this functionality and have the state not attempt to preserve the
permissions from the ZIP archive, set ``extract_perms`` to ``False``:
.. code-block:: yaml
/var/www:
archive.extracted:
- source: salt://foo/bar/myapp.zip
- extract_perms: False
.. _`upstream bug in Python`: https://bugs.python.org/issue15795
name
Directory into which the archive should be extracted
source
Archive to be extracted
.. note::
This argument uses the same syntax as its counterpart in the
:py:func:`file.managed <salt.states.file.managed>` state.
source_hash
Hash of source file, or file with list of hash-to-file mappings
.. note::
This argument uses the same syntax as its counterpart in the
:py:func:`file.managed <salt.states.file.managed>` state.
.. versionchanged:: 2016.11.0
If this argument specifies the hash itself, instead of a URI to a
file containing hashes, the hash type can now be omitted and Salt
will determine the hash type based on the length of the hash. For
example, both of the below states are now valid, while before only
the second one would be:
.. code-block:: yaml
foo_app:
archive.extracted:
- name: /var/www
- source: https://mydomain.tld/foo.tar.gz
- source_hash: 3360db35e682f1c5f9c58aa307de16d41361618c
bar_app:
archive.extracted:
- name: /var/www
- source: https://mydomain.tld/bar.tar.gz
- source_hash: sha1=5edb7d584b82ddcbf76e311601f5d4442974aaa5
source_hash_name
When ``source_hash`` refers to a hash file, Salt will try to find the
correct hash by matching the filename part of the ``source`` URI. When
managing a file with a ``source`` of ``salt://files/foo.tar.gz``, then
the following line in a hash file would match:
.. code-block:: text
acbd18db4cc2f85cedef654fccc4a4d8 foo.tar.gz
This line would also match:
.. code-block:: text
acbd18db4cc2f85cedef654fccc4a4d8 ./dir1/foo.tar.gz
However, sometimes a hash file will include multiple similar paths:
.. code-block:: text
37b51d194a7513e45b56f6524f2d51f2 ./dir1/foo.txt
acbd18db4cc2f85cedef654fccc4a4d8 ./dir2/foo.txt
73feffa4b7f6bb68e44cf984c85f6e88 ./dir3/foo.txt
In cases like this, Salt may match the incorrect hash. This argument
can be used to tell Salt which filename to match, to ensure that the
correct hash is identified. For example:
.. code-block:: yaml
/var/www:
archive.extracted:
- source: https://mydomain.tld/dir2/foo.tar.gz
- source_hash: https://mydomain.tld/hashes
- source_hash_name: ./dir2/foo.tar.gz
.. note::
This argument must contain the full filename entry from the
checksum file, as this argument is meant to disambiguate matches
for multiple files that have the same basename. So, in the
example above, simply using ``foo.txt`` would not match.
.. versionadded:: 2016.11.0
source_hash_update : False
Set this to ``True`` if archive should be extracted if source_hash has
changed. This would extract regardless of the ``if_missing`` parameter.
.. versionadded:: 2016.3.0
skip_verify : False
If ``True``, hash verification of remote file sources (``http://``,
``https://``, ``ftp://``) will be skipped, and the ``source_hash``
argument will be ignored.
.. versionadded:: 2016.3.4
keep_source : True
For ``source`` archives not local to the minion (i.e. from the Salt
fileserver or a remote source such as ``http(s)`` or ``ftp``), Salt
will need to download the archive to the minion cache before they can
be extracted. To remove the downloaded archive after extraction, set
this argument to ``False``.
.. versionadded:: 2017.7.3
keep : True
Same as ``keep_source``, kept for backward-compatibility.
.. note::
If both ``keep_source`` and ``keep`` are used, ``keep`` will be
ignored.
password
**For ZIP archives only.** Password used for extraction.
.. versionadded:: 2016.3.0
.. versionchanged:: 2016.11.0
The newly-added :py:func:`archive.is_encrypted
<salt.modules.archive.is_encrypted>` function will be used to
determine if the archive is password-protected. If it is, then the
``password`` argument will be required for the state to proceed.
options
**For tar and zip archives only.** This option can be used to specify
a string of additional arguments to pass to the tar/zip command.
If this argument is not used, then the minion will attempt to use
Python's native tarfile_/zipfile_ support to extract it. For zip
archives, this argument is mostly used to overwrite exsiting files with
``o``.
Using this argument means that the ``tar`` or ``unzip`` command will be
used, which is less platform-independent, so keep this in mind when
using this option; the CLI options must be valid options for the
``tar``/``unzip`` implementation on the minion's OS.
.. versionadded:: 2016.11.0
.. versionchanged:: 2015.8.11,2016.3.2
XZ-compressed tar archives no longer require ``J`` to manually be
set in the ``options``, they are now detected automatically and
decompressed using the xz_ CLI command and extracted using ``tar
xvf``. This is a more platform-independent solution, as not all tar
implementations support the ``J`` argument for extracting archives.
.. note::
For tar archives, main operators like ``-x``, ``--extract``,
``--get``, ``-c`` and ``-f``/``--file`` should *not* be used here.
list_options
**For tar archives only.** This state uses :py:func:`archive.list
<salt.modules.archive.list_>` to discover the contents of the source
archive so that it knows which file paths should exist on the minion if
the archive has already been extracted. For the vast majority of tar
archives, :py:func:`archive.list <salt.modules.archive.list_>` "just
works". Archives compressed using gzip, bzip2, and xz/lzma (with the
help of the xz_ CLI command) are supported automatically. However, for
archives compressed using other compression types, CLI options must be
passed to :py:func:`archive.list <salt.modules.archive.list_>`.
This argument will be passed through to :py:func:`archive.list
<salt.modules.archive.list_>` as its ``options`` argument, to allow it
to successfully list the archive's contents. For the vast majority of
archives, this argument should not need to be used, it should only be
needed in cases where the state fails with an error stating that the
archive's contents could not be listed.
.. versionadded:: 2016.11.0
force : False
If a path that should be occupied by a file in the extracted result is
instead a directory (or vice-versa), the state will fail. Set this
argument to ``True`` to force these paths to be removed in order to
allow the archive to be extracted.
.. warning::
Use this option *very* carefully.
.. versionadded:: 2016.11.0
overwrite : False
Set this to ``True`` to force the archive to be extracted. This is
useful for cases where the filenames/directories have not changed, but
the content of the files have.
.. versionadded:: 2016.11.1
clean : False
Set this to ``True`` to remove any top-level files and recursively
remove any top-level directory paths before extracting.
.. note::
Files will only be cleaned first if extracting the archive is
deemed necessary, either by paths missing on the minion, or if
``overwrite`` is set to ``True``.
.. versionadded:: 2016.11.1
user
The user to own each extracted file. Not available on Windows.
.. versionadded:: 2015.8.0
.. versionchanged:: 2016.3.0
When used in combination with ``if_missing``, ownership will only
be enforced if ``if_missing`` is a directory.
.. versionchanged:: 2016.11.0
Ownership will be enforced only on the file/directory paths found
by running :py:func:`archive.list <salt.modules.archive.list_>` on
the source archive. An alternative root directory on which to
enforce ownership can be specified using the
``enforce_ownership_on`` argument.
group
The group to own each extracted file. Not available on Windows.
.. versionadded:: 2015.8.0
.. versionchanged:: 2016.3.0
When used in combination with ``if_missing``, ownership will only
be enforced if ``if_missing`` is a directory.
.. versionchanged:: 2016.11.0
Ownership will be enforced only on the file/directory paths found
by running :py:func:`archive.list <salt.modules.archive.list_>` on
the source archive. An alternative root directory on which to
enforce ownership can be specified using the
``enforce_ownership_on`` argument.
if_missing
If specified, this path will be checked, and if it exists then the
archive will not be extracted. This path can be either a directory or a
file, so this option can also be used to check for a semaphore file and
conditionally skip extraction.
.. versionchanged:: 2016.3.0
When used in combination with either ``user`` or ``group``,
ownership will only be enforced when ``if_missing`` is a directory.
.. versionchanged:: 2016.11.0
Ownership enforcement is no longer tied to this argument, it is
simply checked for existence and extraction will be skipped if
if is present.
trim_output : False
Useful for archives with many files in them. This can either be set to
``True`` (in which case only the first 100 files extracted will be
in the state results), or it can be set to an integer for more exact
control over the max number of files to include in the state results.
.. versionadded:: 2016.3.0
use_cmd_unzip : False
Set to ``True`` for zip files to force usage of the
:py:func:`archive.cmd_unzip <salt.modules.archive.cmd_unzip>` function
to extract.
.. versionadded:: 2016.11.0
extract_perms : True
**For ZIP archives only.** When using :py:func:`archive.unzip
<salt.modules.archive.unzip>` to extract ZIP archives, Salt works
around an `upstream bug in Python`_ to set the permissions on extracted
files/directories to match those encoded into the ZIP archive. Set this
argument to ``False`` to skip this workaround.
.. versionadded:: 2016.11.0
enforce_toplevel : True
This option will enforce a single directory at the top level of the
source archive, to prevent extracting a 'tar-bomb'. Set this argument
to ``False`` to allow archives with files (or multiple directories) at
the top level to be extracted.
.. versionadded:: 2016.11.0
enforce_ownership_on
When ``user`` or ``group`` is specified, Salt will default to enforcing
permissions on the file/directory paths detected by running
:py:func:`archive.list <salt.modules.archive.list_>` on the source
archive. Use this argument to specify an alternate directory on which
ownership should be enforced.
.. note::
This path must be within the path specified by the ``name``
argument.
.. versionadded:: 2016.11.0
archive_format
One of ``tar``, ``zip``, or ``rar``.
.. versionchanged:: 2016.11.0
If omitted, the archive format will be guessed based on the value
of the ``source`` argument. If the minion is running a release
older than 2016.11.0, this option is required.
.. _tarfile: https://docs.python.org/2/library/tarfile.html
.. _zipfile: https://docs.python.org/2/library/zipfile.html
.. _xz: http://tukaani.org/xz/
**Examples**
1. tar with lmza (i.e. xz) compression:
.. code-block:: yaml
graylog2-server:
archive.extracted:
- name: /opt/
- source: https://github.com/downloads/Graylog2/graylog2-server/graylog2-server-0.9.6p1.tar.lzma
- source_hash: md5=499ae16dcae71eeb7c3a30c75ea7a1a6
2. tar archive with flag for verbose output, and enforcement of user/group
ownership:
.. code-block:: yaml
graylog2-server:
archive.extracted:
- name: /opt/
- source: https://github.com/downloads/Graylog2/graylog2-server/graylog2-server-0.9.6p1.tar.gz
- source_hash: md5=499ae16dcae71eeb7c3a30c75ea7a1a6
- options: v
- user: foo
- group: foo
3. tar archive, with ``source_hash_update`` set to ``True`` to prevent
state from attempting extraction unless the ``source_hash`` differs
from the previous time the archive was extracted:
.. code-block:: yaml
graylog2-server:
archive.extracted:
- name: /opt/
- source: https://github.com/downloads/Graylog2/graylog2-server/graylog2-server-0.9.6p1.tar.lzma
- source_hash: md5=499ae16dcae71eeb7c3a30c75ea7a1a6
- source_hash_update: True
u nameu resultu changesu u commentu keep_sourceu keepu warningsu` Both 'keep_source' and 'keep' were used. Since these both do the same thing, 'keep' was ignored.u {0} is not an absolute pathu0 Name of the directory path needs to be specifiedu! {0} exists and is not a directoryu. Value for 'if_missing' is not an absolute pathu8 Value for 'enforce_ownership_on' is not an absolute pathu ..u3 Value for 'enforce_ownership_on' must be within {0}u Path {0} existsu: User/group ownership cannot be enforced on Windows minionsu file.user_to_uidu User {0} does not existi����u file.group_to_gidu Group {0} does not existuV The 'source_hash_update' argument is ignored when 'source_hash' is not also specified.u file.source_listi u Invalid source "{0}"u :u fileu Source file '{0}' does not existu taru raru zipu� Could not guess archive_format from the value of the 'source' argument. Please set this archive_format to one of the following: {0}u , u� Invalid archive_format '{0}'. Either set it to a supported value ({1}) or remove this argument and the archive format will be guesseed based on file extension.u/ --strip(?:-components)?(?:\s+|=)["']?(\d+)["']?i uf Presence of CLI options in archive.extracted state for '%s' implies that use_cmd_unzip is set to True.u� 'use_cmd_unzip' cannot be set to False if CLI options are being specified (via the 'options' argument). Either remove 'use_cmd_unzip', or set it to True.u archive.cmd_unzipuP archive.cmd_unzip function not available, unzip might not be installed on minionuf Presence of a password in archive.extracted state for '%s' implies that use_cmd_unzip is set to False.u� Using a password in combination with setting 'use_cmd_unzip' to True is considered insecure. It is recommended to remove the 'use_cmd_unzip' argument (or set it to False) and allow Salt to extract the archive using Python's built-in ZIP file support.u: The 'password' argument is only supported for zip archivesu
archive.unraruP archive.unrar function not available, rar/unrar might not be installed on minionuQ The 'options' argument is only compatible with the following archive formats: {0}id u? Invalid value for trim_output, must be True/False or an integeru file.get_source_sumt sourcet source_hasht source_hash_namet saltenvu testuZ Archive {0} would be cached (if necessary) and checked to discover if extraction is neededu file.cachedu4 Unable to cache {0}, file.cached state not availablet skip_verifyu Failed to cache {0}: {1}u file.cached: %su cp.is_cachedu failed to download %su. Checking %s to see if it is password-protectedu archive.is_encryptedt cleanue Archive {0} is password-protected, but no password was specified. Please set the 'password' argument.u archive.listt archive_formatt optionst strip_componentst verboseu 'if_missing' must be setuC Ownership cannot be managed without setting 'enforce_ownership_on'.u
u_ If the source archive is a tar archive compressed using a compression type not natively supported by the tar command, then setting the 'list_options' argument may allow the contents to be listed. Otherwise, if Salt is unable to determine the files/directories in the archive, the following workaround(s) would need to be used for this state to proceedu@ The following workarounds must be used for this state to proceedu4 (assuming the source file is a valid {0} archive):
u
- {0}u top_level_dirsu top_level_filesu Archive does not have a single top-level directory. To allow this archive to be extracted, set 'enforce_toplevel' to False. To avoid a '{0}-bomb' it may also be advisable to set a top-level directory by adding it to the 'name' value (for example, setting 'name' to {1} instead of {2}).u some_diru; Failed to check for existence of if_missing path ({0}): {1}u dirsu filesc S@ s t j | � o t j | � S( N( t statt S_ISLNKt S_ISDIR( RE ( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt <lambda>V s u linksu
u - {0}u The below paths (relative to {0}) exist, but are the incorrect type (file instead of directory, symlink instead of file, etc.).us Since the 'clean' option is enabled, the destination paths would be cleared and the archive would be extracted.{0}un To proceed with extraction, set 'force' to True. Note that this will remove these paths before extracting.{0}u removedu� One or more paths existed by were the incorrect type (i.e. file instead of directory or vice-versa), but could not be removed. The following errors were observed:
u file.check_hashu hsumu. {0} does not match the desired source_hash {1}u% Archive {0} would be extracted to {1}u$ , after cleaning destination path(s)u% Cleaning archive paths from within %su Removing %suL One or more paths could not be cleaned. The following errors were observed:
u file.directoryt userR/ u Extracting %s to %st trim_outputt passwordu
archive.unzipt
extract_permsu rNu xzu cmd.retcodeu -tRK t ignore_retcodeue Tar file is XZ-compressed, attempting decompression and extraction using XZ Utils and the tar commandu( xz --decompress --stdout {0} | tar xvf -u cmd.run_allt cwdu retcodeu stderru stdoutu Failed to read from tar archive using Python's native tar file support. If archive is compressed using something other than gzip or bzip2, the 'options' argument may be required to pass the correct options to the tar command in order to extract the archive.u` Failed to read from tar archive. If it is XZ-compressed, install xz-utils to attempt extraction.u> tar command not available, it might not be installed on minionu xu -u fu osu openbsdu -fu no tar output so faru top_level_linksu useru groupu; Enforcing %s ownership on %s using a file.directory state%su (dry-run only)t groupt recurseu file.directory: %su updated ownershipu2 Bad state return %s for file.directory state on %su directories_createdu extracted_filesu {0} extracted to {1}u No files were extracted from {0}u
{0} existsu( All files in archive are already presentu> . Ownership would be updated on one or more files/directories.uR
While trying to enforce user/group ownership, the following paths were missing:
ul
While trying to enforce user/group ownership, Salt was unable to change ownership on the following paths:
u Keeping cached source file %su Cleaning cached source file %su file.not_cached(g R R R t argst clean_kwargst
setdefaultR3 t boolt popR
R R: R% R t sepR t isfileR R R$ t Exceptiont existst platformt
is_windowsRL t __env__R t strerrort _urlparset schemeR t netloct lowert stringt ascii_lowercaseR1 t LOCAL_PROTOSt realpatht
expandusert urlt redact_http_basic_autht guess_archive_typeR t
isinstanceR t string_typesR# t intR t searchRe R" R' t infot
integer_typest TypeErrorR t
__states__R< t exceptionR( RG RF t lent lstatR6 R7 R8 R[ R] R\ t st_modet ENOTDIRt rm_rfRJ R R. R R t tarfilet opent
extractallt stringutilst to_strt getnamest ReadErrort whicht
_cmd_quoteRP RM t shlexR4 t enumeratet replacet
__grains__t extendt dictR0 t KeyErrorR; t st_uidt st_gidt lchown(T RO RQ RR RS t source_hash_updateRU Ra RX t list_optionst forcet overwriteRV R_ Re t
if_missingR` t
use_cmd_unzipRb t enforce_toplevelt enforce_ownership_onRW t kwargsR t keep_sourcet not_relt uidt gidt source_matchR) t urlparsed_sourcet urlparsed_schemet urlparsed_patht source_hash_basenamet source_is_localt valid_archive_formatsRY t supports_optionsR? RH t resultt msgt existing_cached_source_sumt
encrypted_zipt contentst errorst errort extraction_neededR t if_missing_path_existst incorrect_typet path_listt funcR t full_patht path_modeRE t incorrect_pathsR t created_destdirR1 t tart cmdt resultst tar_optst tar_cmdt
tar_shortoptst tar_longoptst positiont optt
append_optt enforce_missingt enforce_failedt enforce_dirst
enforce_filest
enforce_linksRf t recurse_strt yt
owner_changesR- t
dir_resultt filenamet file_statt item( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt extracted� s� � �"
&
@
#(1 t __doc__t
__future__R R R R7 t loggingR R R� R[ Rx R� t
contextlibR t salt.extR t salt.ext.six.movesR R� t salt.ext.six.moves.urllib.parseR Rt t salt.utils.argsR t salt.utils.filest salt.utils.hashutilst salt.utils.patht salt.utils.platformt salt.utils.urlt salt.exceptionsR R t getLoggert __name__R' R R R R+ RF R RG RJ RM RP R R
R� ( ( ( s7 /usr/lib/python2.7/site-packages/salt/states/archive.pyt <module> sb $
Mini Shell