Current File : //usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyc
�
���^c @@ st d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l m Z d d l
m Z d d l m Z d d l Z d d l Z d d l Z d d l m Z d Z d Z e � Z d
j d d � Z e j e j Be j BZ! i d d
6g d 6d d 6d d 6i d 6d d 6d d 6Z# i d d 6d d 6Z$ d Z% e j& e' � Z( d Z) d � Z* d � Z+ d e f d � � YZ, e, � Z- d � Z. d � Z/ e e0 d d � Z1 e d d � Z2 e d d! � Z3 e0 d" d d4 d e0 d d# � Z4 d$ e f d% � � YZ5 e j6 d d5 d& � Z7 e j6 d d6 d' � Z8 d d( � Z9 d" d) � Z: d" d* � Z; d+ � Z< d, � Z= e+ d" d d d d7 e0 d d- � � Z> e+ d" d. e j6 d d d d8 d d e0 e0 d e0 d d/ � � Z? e+ d" d. d d d e0 e@ d d9 e0 e0 e0 d d0 �
� ZA d1 � ZB e+ d" d. d d d: d e0 d d e0 e0 e j6 e0 e0 d d e0 d d2 � � ZC d d; d3 � ZD d S(< u�
Management of zc.buildout
.. versionadded:: 2014.1.0
.. _`minitage's buildout maker`: https://github.com/minitage/minitage/blob/master/src/minitage/core/makers/buildout.py
This module is inspired by `minitage's buildout maker`_
.. note::
The zc.buildout integration is still in beta; the API is subject to change
General notes
-------------
You have those following methods:
* upgrade_bootstrap
* bootstrap
* run_buildout
* buildout
i ( t absolute_importt print_functiont unicode_literalsN( t six( t range( t urlopen( t CommandExecutionErroru2 We did not get any expectable answer from buildoutu u {0}
u -iP u statusu logsu commentu outu
logs_by_levelu outlogu outlog_by_levelu, http://downloads.buildout.org/1/bootstrap.pyi u, http://downloads.buildout.org/2/bootstrap.pyi u buildoutc C@ s t S( u0
Only load if buildout libs are present
( t __virtualname__( ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt __virtual__K s c @ s) t j � � f d � } � j | _ | S( Nc
@ sb t j | � } x= g | D] } d | k r | ^ q D] } | j | d � q5 Wt j � } | j d d � } | j d d � } | j d d � } | j d d � } | j d d � } t j � }
y� t | | d | d | d
| �}
|
d k r�t j � }
d t } } � | | � } t | t � s=t
|
d | �}
q�| j d
t � rX| }
q�t |
d | j d t � d | j d d � d | j d | � �}
n Wn7 t
k
r�t j d � }
t j |
� t |
� n Xt j � xy d d d g D]h } |
| r�t |
| t j � r�d j g |
| j d � D] } | j � r2| ^ q2� |
| <q�q�W|
S( Nu __pubu directoryu .u onlyifu unlessu runasu envt directoryt runast envu t outu merged_statusest statusu statust commentu commentu outu outlogu
( ( t copyt deepcopyt popt Nonet BASE_STATUSt gett _check_onlyif_unlesst Truet
isinstancet dictt _validt Falset _set_statust Exceptiont tracebackt
format_exct LOGt errort _invalidt clearR t string_typest joint splitt strip( t at kwt art kt stR t onlyift unlessR
R R
R R t tracet log( t func( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _call_callbackU sP ,
&( R R" t __doc__( R0 t kwargsR1 ( ( R0 s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _salt_callbackR s
2 t _Loggerc B@ sz e Z d Z d � Z d � Z d � Z d � Z d � Z d � Z e Z d
� Z
d � Z e d � � Z
e d
� � Z RS( u infou warnu debugu errorc C@ s g | _ i | _ d S( N( t _msgst _by_level( t self( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt __init__� s c C@ sq t | t j � s$ | j d � } n | | j k rC g | j | <n | j j | | f � | j | j | � d S( Nu utf-8( R R t text_typet decodeR7 R6 t append( R8 t levelt msg( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _log� s c C@ s | j d | � d S( Nu debug( R? ( R8 R> ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt debug� s c C@ s | j d | � d S( Nu info( R? ( R8 R> ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt info� s c C@ s | j d | � d S( Nu error( R? ( R8 R> ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyR � s c C@ s | j d | � d S( Nu warn( R? ( R8 R> ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt warn� s c C@ sR x | j D] } g | j | <q
Wx* t t | j � � D] } | j j � q7 Wd S( N( R7 R t lenR6 R ( R8 t i( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyR" � s c C@ s | j j | g � S( N( R7 R ( R8 R= ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt get_logs� s c C@ s | j S( N( R6 ( R8 ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt messages� s c C@ s | j S( N( R7 ( R8 ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt by_level� s ( u infou warnu debugu error( t __name__t
__module__t levelsR9 R? R@ RA R RB t warningR" RE t propertyRF RG ( ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyR5 � s c C@ s( t | t j � r$ | j d � } n | S( Nu utf-8( R R R: t encode( t string( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _encode_string� s c C@ s� t | d � | d <t | d � | d <| d r� xA t | d � D]. \ } } | d t | d � f | d | <qD Wxf d D][ } | d
j | g � } | r} x5 t | � D]$ \ } } t | � | d
| | <q� Wq} q} Wn | S( Nu outu outlog_by_levelu logsi i u erroru warnu infou debugu
logs_by_level( u erroru warnu infou debug( RO t enumerateR ( R
RD t datat loggert logsR/ ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _encode_status� s
&
&c C@ s� | | d <| | d <t j | d <t j j � | d <d \ } } | | d <| r� t | t j � r� | t 7} | d 7} | d j t | � � 7} | t 7} n | d r�| t 7} | d 7} | t 7} | t 7} | d
7} | t 7} x: | d D]. \ } } | d j | j
� t | � � 7} q� Wx� d D]� } | d j | g � } | r'| d j | j
� � 7} x+ t | � D] \ }
} t | � | |
<qpW| d j
| � 7} | d 7} q'q'W| t 7} n | | d <| | d <t | � S( u'
Assign status data to a dict.
u outu statusu logsu
logs_by_levelu u commentu OUTPUT:
u {0}
u
Log summary:
u Log summary by level:
u
{0}: {1}
u erroru warnu infou debugu
{0}:
u
u outlogu outlog_by_level( u u ( u erroru warnu infou debug( R RF RG R R R R# t HRt formatRO t upperR RP R$ RT ( t mR R
R t outlogt outlog_by_levelR= R> RR RS t idxR/ ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyR � sB
c C@ s t | d t d | d | �S( u
Return invalid status.
R
R R ( R R ( RX R R ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyR! � s c C@ s t | d t d | d | �S( u
Return valid status.
R
R R ( R R ( RX R R ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyR s u .c
C@ s� d } t j j | � } t | t � r9 d j | � } n t j d j | � � | s^ d } n t
d | d | d | d | d | d | d
t �} | d d | d
} | d k r� | d | k r� t | � � n | | d <| r� | } n | S( u�
Run a command.
output
return output if true
directory
directory to execute in
runas
user used to run buildout as
env
environment variables to set when running
exitcode
fails if cmd does not return this exit code
(set to None to disable check)
use_vt
Use the new salt VT to stream output [experimental]
u u Running {0}u debugu cmd.run_allt cwdt output_loglevelR
R t use_vtt python_shellu stdoutu
u stderru retcodeu outputN(
R t ost patht abspathR t listR$ R R@ RV t __salt__R t _BuildoutError(
t commandt outputR R
R t exitcodeR^ t loglevelt retR ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _Popen s"
Re c B@ s e Z d Z RS( u!
General Buildout Error.
( RH RI R2 ( ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyRe ; s c C@ sj t } yF | d d g } t | d | d | d t �} d | k rK t } n Wn t k
re t } n X| S( Nu -cuR 'import pkg_resources;print pkg_resources.get_distribution("distribute").location'R
R Rg u distribute-0.6( R Rk R R ( t pythonR
R t old_distributet cmdRj ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _has_old_distributeA s
c C@ sp t } yL | d d g } t | d | d | d t �} d | j � k rQ t } n Wn t k
rk t } n X| S( Nu -cug 'import pkg_resources;print not pkg_resources.get_distribution("setuptools").version.startswith("0.6")'R
R Rg u true( R Rk R t lowerR ( Rl R
R t new_stRn Rj ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _has_setuptools7Q s
c
C@ s, d d g } g } | s! g } n x� t j | � D]z } t j j | | � } | j d � r} t j j | � r} | j | � n t j j | � r1 | | k r1 | j | � q1 q1 Wxv | D]n } xe t j j j
| � D]N \ } } } x< | D]4 } | j d � r� | j t j j | | � � q� q� Wq� Wq� W| S( u�
Find all buildout configs in a subdirectory.
only buildout.cfg and etc/buildout.cfg are valid in::
path
directory where to start to search
cfg
a optional list to append to
.
├── buildout.cfg
├── etc
│ └── buildout.cfg
├── foo
│ └── buildout.cfg
└── var
└── buildout.cfg
u varu partsu .cfg( R` t listdirRa R$ t endswitht isfileR< t isdirt saltt utilst os_walk(
Ra t cfgst ignoredt dirsRD t fit fpatht pt idst ifs( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt
_find_cfgsa s !
%
+c C@ s| yX t j j j t j j t j j | � d � � �" } t j j j | j
� � } Wd QXWn t t f k
rw d } n X| S( u5
Get the current bootstrap.py script content
u bootstrap.pyNu (
Rw Rx t filest fopenR` Ra R$ Rb t stringutilst
to_unicodet readt OSErrort IOError( R t fict
oldcontent( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _get_bootstrap_content� s
c C@ s� t j j | � } d } y� t | � } x} | D]u } t j j j | � �X } t j d t
� } t j j j | j
� � } d | k s� | j | � r� d } n Wd QXq. Wt | � } d | k s� d | k s� d | k r� d } n Wn t t f k
r� n X| S( u, Check for buildout versions.
In any cases, check for a version pinning
Also check for buildout.dumppickedversions which is buildout1 specific
Also check for the version targeted by the local bootstrap file
Take as default buildout2
directory
directory to execute in
i u ^zc\.buildout\s*=\s*1u buildout.dumppicki Nu --download-baseu --setup-sourceu --distribute( R` Ra Rb R� Rw Rx R� R� t ret compilet RE_FR� R� R� t searchR� R� R� ( R t buildoutverR� t fR� t buildout1ret dfict bcontent( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _get_buildout_ver� s&
c C@ s t | � } t j | t t � S( uy
Get the most appropriate download URL for the bootstrap script.
directory
directory to execute in
( R� t
_URL_VERSIONSR t DEFAULT_VER( R t v( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _get_bootstrap_url� s c C@ s t j j t j j | � d � S( uX
Get the local marker directory.
directory
directory to execute in
u .buildout( R` Ra R$ Rb ( R ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt
_dot_buildout� s c C@ s� | r t | } n t | � } t | � } t j d j | � � t j j | � } t j j | d � } d } y�t
| � }
t | � } |
} t }
t } | sCyZ t j j
| � s� t j | � n t j j j t j j | d j | � � � � Wd QXWqCt t f k
r?t j d � t | � j � } t }
t } qCXn d | k r�t }
| j � } | j d d � d
j | � } n |
r�d } t j j j | d � �# } | j t j j j | � � Wd QXn | r t j j j t j j | d j | � � d � � } | j d
� Wd QXn Wn] t t f k
r~|
rt j j j | d � �# } | j t j j j |
� � Wd QXqn Xi | d 6S( u�
Upgrade current bootstrap.py with the last released one.
Indeed, when we first run a buildout, a common source of problem
is to have a locally stale bootstrap, we just try to grab a new copy
directory
directory to execute in
offline
are we executing buildout in offline mode
buildout_ver
forcing to use a specific buildout version (1 | 2)
onlyif
Only execute cmd if statement on the host return 0
unless
Do not execute cmd if statement on the host return 0
CLI Example:
.. code-block:: bash
salt '*' buildout.upgrade_bootstrap /srv/mybuildout
u Using {0}u bootstrap.pyu u {0}.updated_bootstrapNu! Bootstrap updated from repositoryu socket.setdefaulttimeouti u) import socket;socket.setdefaulttimeout(2)u
u Bootstrap updatedu wu foou comment( R� R� R� R R@ RV R` Ra Rb R$ R� R� R Rv t makedirsRw Rx R� R� R� R� RA t _urlopenR� R t
splitlinest insertt writeR� t to_str( R R, R- R
R t offlinet buildout_vert booturlt b_pyR R� t dbuildRQ t updatedt dledt ldataR� t afic( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt upgrade_bootstrap� s\ #
%)u buildout.cfgc @ C@ s t j j | � } t | � } d } t d | d | d | � } t d | d | d | � } | r� | r� | r� | r� t } t } n | r� | r� | r� | r� t } t } n | r� | r� | r� | r� t } t } n | r� | r� | r� | r� t } t } n | r$| r$| r$| r$t } t } n | rM| rM| rM| rMt } t } n | rv| rv| rv| rvt } t } n | r�| r�| r�| r�t } t } n | r�| r�| r�| r�t } t } n | r�| r�| r�| r�t } t } n | r| r| r| rt } t } n | rE| rE| rE| rEt } t } n | ro| ro| ro| rot } t } n | r�| r�| r�| r�t } t } n | r�| r�| r�| r�t } t } n | r�| r�| r�| r�t } t } n | r| rt } n | r t } t j d � n | rTt } | d k rTt j d � | d 7} qTn t j j
| � svt j | � n t | d |
d
| �t j j
| d � } t j j j | � �" } t j j j | j � � } Wd QX| t k r�d
| k r�| d
7} n | r'd | k r'| d j | � 7} n yH | rnt d | � d } t d | � d } t j d | | � n WnA t t f k
r�} t j d j | � d t j t j � �n Xd j | | � } t | d | d | d |
d | d | �} | d } i | d 6| d 6S( u�
Run the buildout bootstrap dance (python bootstrap.py).
directory
directory to execute in
config
alternative buildout configuration file to use
runas
User used to run buildout as
env
environment variables to set when running
buildout_ver
force a specific buildout version (1 | 2)
test_release
buildout accept test release
offline
are we executing buildout in offline mode
distribute
Forcing use of distribute
new_st
Forcing use of setuptools >= 0.7
python
path to a python executable to use in place of default (salt one)
onlyif
Only execute cmd if statement on the host return 0
unless
Do not execute cmd if statement on the host return 0
use_vt
Use the new salt VT to stream output [experimental]
CLI Example:
.. code-block:: bash
salt '*' buildout.bootstrap /srv/mybuildout
u Rl R
R u6 Forcing to use setuptools as we have setuptools >= 0.7i u Using distribute !u
--distributeR� R� u bootstrap.pyNu --accept-buildout-test-releasesu "-c"u -c {0}u user.infou uidu gidu) BUILDOUT bootstrap permissions error: {0}t exc_infou {0} bootstrap.py {1}R Ri R^ u outputu commentu out( R` Ra Rb R� Ro Rr R R R RK Rv R� R� R$ Rw Rx R� R� R� R� R� RV Rd t chownR� R� t _loggerR t isEnabledFort loggingt DEBUGRk ( R t configRl R, R- R
R t
distributeR� t test_releaseR� Rq R^ Ri R� t bootstrap_argst has_distributet
has_new_stR� R� t contentt uidt gidt excRn Rj Rg ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt bootstrap, s� ?
!
c
C@ s< t j j | � } t j j | d d � }
t j j | d � } g } | rh t j d � | j d � n | r� t j j | � r� t j d � | j d � n | r� t j d � | j d � n | r� t j d
� | j d � n |
rt j d � | j d
� n g g } } | r�x� | D]� } t j d j | � � d j |
| d j | � | � } | j | � | j t
| d | d | d | d t d | d | �� q!Wno t j d � d j |
| d j | � � } | j | � | j t
| d | d | d | d | d t d | �� i d j | � d 6d j | � d 6S( u
Run a buildout in a directory.
directory
directory to execute in
config
alternative buildout configuration file to use
offline
are we executing buildout in offline mode
runas
user used to run buildout as
env
environment variables to set when running
onlyif
Only execute cmd if statement on the host return 0
unless
Do not execute cmd if statement on the host return 0
newest
run buildout in newest mode
force
run buildout unconditionally
verbose
run buildout in verbose mode (-vvvvv)
use_vt
Use the new salt VT to stream output [experimental]
CLI Example:
.. code-block:: bash
salt '*' buildout.run_buildout /srv/mybuildout
u binu buildoutu .installed.cfgu$ Buildout is running in verbose mode!u -vvvvvvvu' Buildout is running in non newest mode!u -Nu# Buildout is running in newest mode!u -nu$ Buildout is running in offline mode!u -ou" Buildout is running in debug mode!u -Du Installing single part: {0}u {0} -c {1} {2} install {3}u R R
R Rg Ri R^ u Installing all buildout partsu {0} -c {1} {2}u
u commentu out( R` Ra Rb R$ R R@ R< t existsRA RV Rk R ( R R� t partsR, R- R� t newestR
R t verboseR@ R^ Ri t bcmdt
installed_cfgt argvt cmdst outputst partRn ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt run_buildout sX 8
c C@ s� t j � } d | d <t | d <g | d <xe| D]]} | d t k rX | d | d <n | d } t | d � } | d } | d } | d } | d } | r| d s� d | d <n | d c d
7<| d c t 7<t | � } | d c d j | � 7<| d c t 7<n | rN| d s,d | d <n | d c d j t | � � 7<n | r�| d skd | d <n t | � } | d c d
j t � 7<| d c | 7<n | r�| d s�d | d <n | d c d
j t � 7<| d c t | � 7<n | d j g | D] } | d t | d � f ^ q� xa | D]Y }
|
| d k rXg | d |
<n | d |
j g | |
D] } t | � ^ qq� q1Wq1 Wt | � S( Nu statusu merged_statusesu outu commentu logsu
logs_by_levelu outlog_by_levelu outlogu u
u {0}
u
{0}
u
{0}i i (
R R R R R RO RU RV t extendRT ( t statusesR
R+ R R RS t
logs_by_levelRZ RY R' R/ ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt _merge_statusesj sZ
.
,c C@ s� t j d j | | � � t | d | d | d | d | d | d | d | d | d
| d | d | � } t d
| d | d | d | d |
d | d | d |
d | d | d | � } t | | g � S( u6
Run buildout in a directory.
directory
directory to execute in
config
buildout config to use
parts
specific buildout parts to run
runas
user used to run buildout as
env
environment variables to set when running
buildout_ver
force a specific buildout version (1 | 2)
test_release
buildout accept test release
new_st
Forcing use of setuptools >= 0.7
distribute
use distribute over setuptools if possible
offline
does buildout run offline
python
python to use
debug
run buildout with -D debug flag
onlyif
Only execute cmd if statement on the host return 0
unless
Do not execute cmd if statement on the host return 0
newest
run buildout in newest mode
verbose
run buildout in verbose mode (-vvvvv)
use_vt
Use the new salt VT to stream output [experimental]
CLI Example:
.. code-block:: bash
salt '*' buildout.buildout /srv/mybuildout
u Running buildout in {0} ({1})R� R� R� R� Rq R R
R� Rl R^ Ri R R� R� R� R@ ( R RA RV R� R� R� ( R R� R� R
R R� R� R� Rq R� R� Rl R@ R� R, R- R^ Ri t boot_rett buildout_ret( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt buildout� s2 N c
C@ sp d } t j � } t j j | � rYt j j | � } t | d <t d } | d k r� t | t
j � s� | s� t | d � q� q� t | t
j � r� | | d | d | d | �d k r� t | d � q� q� n | d k rYt | t
j � s| rSt | d � qSqVt | t
j � rV| | d | d | d | d t �d k rSt | d � qSqVqYn | d rl| } n | S(
Nu statusu cmd.retcodeu onlyif condition is falseR\ R
R i u unless condition is trueR_ (
R R R R` Ra R� Rb R Rd R R R# R ( R, R- R R
R Rj R
t retcode( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyR s.
$ *
( ( ( ( ( ( ( ( (E R2 t
__future__R R R R` R� R� t sysR R t salt.extR t salt.ext.six.movesR t! salt.ext.six.moves.urllib.requestR R� t salt.utils.filesRw t salt.utils.patht salt.utils.stringutilst salt.exceptionsR t INVALID_RESPONSEt VALID_RESPONSEt objectt NOTSETRV RU t St Mt UR� R R R� R� t getLoggerRH R� R R R4 R5 R RO RT R R R! R Rk Re t
executableRo Rr R� R� R� R� R� R� R� R R� R� R� R ( ( ( s; /usr/lib/python2.7/site-packages/salt/modules/zcbuildout.pyt <module> s�
9/ ' + & % R�] 0X
Mini Shell