Current File : //lib/python2.7/site-packages/salt/loader.pyc
�
���^c @@ s� d Z d d l m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m! Z! d d l" m# Z# d d l$ m% Z% d d l& m' Z' d d l( m) Z) e j* d
d d f k r�d d l+ Z, d d l- Z, e. Z/ n d d l0 Z0 e1 Z/ y d d
l2 m3 Z3 Wn! e4 k
r%d d
l5 m3 Z3 n Xy d d l6 Z6 e. Z7 Wn e4 k
rUe1 Z7 n Xe j8 e9 � Z: e j; j< e j= j> � Z? d Z@ e/ r^d ZA d
ZB d ZC d ZD g ZE x* e, jF jG D] ZH eE jI eH d eC f � q�Wx* e, jF jJ D] ZH eE jI eH d eA f � q�Wx* e, jF jK D] ZH eE jI eH d eB f � qWi e, jF jL eA 6e, jF jM eB 6e, jF jN eC 6ZO n e0 jP � ZE e jQ d jR e j* d
� � ZS d d d f ZT eU aV eU eU e. eU eU eU d � ZW d � ZX eU eU e. eU eU d � ZY eU eU eU e1 eU e1 eU eU d � ZZ d d � Z[ d � Z\ d � Z] eU d � Z^ eU eU eU eU d � Z_ eU eU eU d � Z` eU eU e_ d � Za eU d! � Zb d" � Zc eU eU d# � Zd d$ � Ze d% � Zf d& � Zg eU d' � Zh d( � Zi eU eU eU d) � Zj d* � Zk eU eU d+ � Zl eU eU d, � Zm d- � Zn eU eU d. � Zo eU eU d/ � Zp eU d0 � Zq d1 � Zr e1 eU d2 � Zs d3 � Zt eU eU eU d4 � Zu d5 � Zv eU eU eU d6 � Zw d7 � Zx d8 � Zy d9 � Zz d: � Z{ eU eU eU d; � Z| d< � Z} d= � Z~ d> � Z d? e3 f d@ � � YZ� dA e ja j� j� f dB � � YZ� dC � Z� d S(D u�
The Salt loader is the core to Salt's plugin system, the loader scans
directories for python loadable code and organizes the code into the
plugin interfaces used by Salt.
i ( t absolute_importt print_functiont unicode_literalsN( t zipimporter( t LoaderError( t check_render_pipe_str( t Depends( t six( t
reload_modulei i i ( t MutableMappingu salt.loadedi u rbu \.cpython-{0}{1}(\.opt-[1-9])?u parallels.avail_sizesu parallels.avail_locationsu proxmox.avail_sizesc C@ s~ t t | | | | | | | � | d | d | �} i }
| j � | r[ t | | � } n x | D] } | | |
| <qb W|
S( Nt tagt pack( t
LazyLoadert _module_dirst _load_allt FilterDictWrapper( t optst ext_typeR
R t int_typet ext_dirst
ext_type_dirst base_patht filter_namet funcst rett key( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt
static_loaderm s&
c C@ s3 | j } | j r/ | d d j | j � 7} n | S( us
Makes a string describing the target of an EntryPoint object.
Base strongly on EntryPoint.__str__().
u :u .( t module_namet attrst join( t ept s( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt _format_entrypoint_target� s c C@ s� | d k r | } n t j j | p' t | p0 | � } t j j | d | � } g } | r;| d k ry d j | � } n | | k r� | j | | � n t r;| r;x� t j d | � D]y }
y1 |
j
� } x | � D] } | j | � q� WWq� t k
r0}
t
j d t |
� |
� t
j d d t �q� Xq� Wq;n g } x� | j d g � D]� } t j j | | � } t j j | � r�| j d | � qTn t j j | d j | � � } t j j | � rT| j d | � qTqTW| | | | g S(
Nu extension_modulesu {0}_dirsu salt.loaderu, Error getting module directories from %s: %su+ Full backtrace for module directories errort exc_infou module_dirsi u _{0}( t Nonet ost pathR t SALT_BASE_PATHt formatt extendt HAS_PKG_RESOURCESt
pkg_resourcest iter_entry_pointst loadt appendt Exceptiont logt errorR t debugt Truet gett isdirt insert( R R R
R R R R t sys_typest ext_typest ext_type_typest entry_pointt loaded_entry_pointR$ t exct cli_module_dirst _dirt maybe_dir( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR
� s: ! ! c
C@ so | s | j d d � } n t t | d d � | d d d i | d 6| d 6| d 6d | d
| d | �} | | j d <| j d
t � }
|
r't |
t � r'x� |
D]| } y t | |
| | � } Wn t k
r� Pq� X| r� x> | D]3 }
d j
| |
|
j d � � } | |
| | <q� Wq� q� Wn | rkt j
j j d d | d t �} | j i t d 6d d �n | S( uI
Load execution modules
Returns a dictionary of execution modules appropriate for the current
system by evaluating the __virtual__() function in each module.
:param dict opts: The Salt options dictionary
:param dict context: A Salt context that should be made present inside
generated modules in __context__
:param dict utils: Utility functions which should be made available to
Salt modules in __utils__. See `utils_dirs` in
salt.config for additional information about
configuration.
:param list whitelist: A list of modules which should be whitelisted.
:param bool initial_load: Deprecated flag! Unused.
:param str loaded_base_name: A string marker for the loaded base name.
:param bool notify: Flag indicating that an event should be fired upon
completion of module loading.
.. code-block:: python
import salt.config
import salt.loader
__opts__ = salt.config.minion_config('/etc/salt/minion')
__grains__ = salt.loader.grains(__opts__)
__opts__['grains'] = __grains__
__utils__ = salt.loader.utils(__opts__)
__salt__ = salt.loader.minion_mods(__opts__, utils=__utils__)
__salt__['test.ping']()
u whitelist_modulesu modulesu moduleR
R u __context__u __utils__u __proxy__t whitelistt loaded_base_namet static_modulesu __salt__u providersu {0}{1}u .u minionR t listenu completeu /salt/minion/minion_mod_completeN( R2 R" R R
R t Falset
isinstancet dictt raw_modt TypeErrorR& t rindext saltt utilst eventt get_eventt
fire_eventR1 ( R t contextRI R> t initial_loadR? t notifyR@ t proxyR t providerst modR t funct f_keyt evt( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt minion_mods� s4 -
! u modulesc C@ sa t t | | d � | d d d t d i | d 6�} | | j k rG i S| j | � t | j � S( uE
Returns a single module loaded raw and bypassing the __virtual__ function
.. code-block:: python
import salt.config
import salt.loader
__opts__ = salt.config.minion_config('/etc/salt/minion')
testmod = salt.loader.raw_mod(__opts__, 'test', None)
testmod['test.ping']()
u moduleR
u rawmodulet virtual_enableR u __salt__( R R
RB t file_mappingt _load_moduleRD t _dict( R t namet functionsRR t loader( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyRE s
c C@ s t t | d � | d d �S( u1
Return functions used in the meta proxy
u metaproxyR
( R R
( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt metaproxy9 s c C@ s t t | d � | d d �S( u-
Return the matcher services plugins
u matchersR
( R R
( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt matchersE s c C@ sD i | d 6| d 6| d 6| d 6} t t | d � | d d d | �S( u,
Return the master services plugins
u __salt__u __runners__u __proxy__u __utils__u enginesR
R ( R R
( R R\ t runnersRI RP R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt enginesP s
c C@ sJ t t | d � | d d d i | d 6| d 6| d 6�} | | j d <| S( u=
Returns the proxy module for this salt-proxy-minion
u proxyR
R u __salt__u __ret__u __utils__u __proxy__( R R
R ( R R\ t returnersR> RI R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyRP ` s
c C@ sF t t | d d � | d d d | d i | d 6| d 6| p> i d 6�S( u&
Returns the returner modules
u returnersu returnerR
R> R u __salt__u __context__u __proxy__( R R
( R R\ R> RM RP ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyRb p s c C@ sB t t | d d d �| d d d | d i | d 6| p: i d 6�S( u%
Returns the utility modules
u utilsR u
utils_dirsR
R> R u __context__u __proxy__( R R
( R R> RM RP ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyRI } s c C@ sY t t | d � | d d d i | d 6| d 6t | � d 6�} | | j d <t | d � S( u%
Returns the pillars modules
u pillarR
R u __salt__u __context__u __utils__u __ext_pillar__u .ext_pillar( R R
RI R R ( R R\ RM R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt pillars� s
c C@ sZ d | k r i St | d j � � } t t | d d � | d d d | �} t | d � S( u"
Returns the tops modules
u master_topsu topsu topR
R> u .top( t listt keysR R
R ( R R> R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt tops� s c C@ sD | d k r i } n t t | d � | d d d | d i | d 6�S( u$
Returns the wheels modules
u wheelR
R> R u __context__N( R" R R
( R R> RM ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt wheels� s c C@ sD t t | d d d �| d d �} t | d � } | | j d <| S( u�
Returns the outputters modules
:param dict opts: The Salt options dictionary
:returns: LazyLoader instance, with only outputters present in the keyspace
u outputR u outputter_dirsR
u .outputu __salt__( R R
R R ( R R t wrapped_ret( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt
outputters� s
c C@ s t t | d � | d d �S( u�
Returns the serializers modules
:param dict opts: The Salt options dictionary
:returns: LazyLoader instance, with only serializers present in the keyspace
u serializersR
( R R
( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt serializers� s c C@ s t t | d � | d d �S( u�
Returns the tokens modules
:param dict opts: The Salt options dictionary
:returns: LazyLoader instance, with only token backends present in the keyspace
u tokensR
( R R
( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt eauth_tokens� s c C@ s5 t t | d � | d d d | d i t | � d 6�S( un
Returns the auth modules
:param dict opts: The Salt options dictionary
:returns: LazyLoader
u authR
R> R u __salt__( R R
RV ( R R> ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt auth� s c C@ s5 t t | d � | d d d | d i t | � d 6�S( u)
Returns the file server modules
u
fileserverR
R> R u __utils__( R R
RI ( R t backends( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt
fileserver� s
c C@ s6 t t | d � | d d d | d i | d 6| d 6�S( u$
Returns the roster modules
u rosterR
R> R u
__runner__u __utils__( R R
( R t runnerRI R> ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt roster� s c C@ sP i | d 6| d 6i d 6} t t | d � | d d d | �} | | j d <| S( u*
Load the thorium runtime modules
u __salt__u
__runner__u __context__u thoriumR
R u __thorium__( R R
R ( R R\ R` R R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt thorium s
c
C@ si t t | d � | d d d i | d 6| p. i d 6d | �} | | j d <| | j d <| | j d <| S(
u�
Returns the state modules
:param dict opts: The Salt options dictionary
:param dict functions: A dictionary of minion modules, with module names as
keys and funcs as values.
.. code-block:: python
import salt.config
import salt.loader
__opts__ = salt.config.minion_config('/etc/salt/minion')
statemods = salt.loader.states(__opts__, None, None)
u statesR
R u __salt__u __proxy__R> u
__states__u __utils__u __serializers__( R R
R ( R R\ RI Rj R> RP R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt states s
c
C@ sC t t | d � | d d d i | d 6| d 6| p5 i d 6d g �S( u�
Load the beacon modules
:param dict opts: The Salt options dictionary
:param dict functions: A dictionary of minion modules, with module names as
keys and funcs as values.
u beaconsR
R u __context__u __salt__u __proxy__t
virtual_funcs( R R
( R R\ RM RP ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt beacons8 s !c
C@ sF t t | d d d d t j j t d � �| d d �} t | d � S( ug
Returns the custom logging handler modules
:param dict opts: The Salt options dictionary
u log_handlersR u handlersR u logR
u .setup_handlers( R R
R# R$ R R% R ( R R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt log_handlersI s c
C@ sz t t | d d t j j t t j j d d � � �| d d d i | d 6| j d i � d 6| j d
i � d 6| d 6�S(
u4
Returns the custom logging handler modules
u wrapperR u clientu sshR
R u __salt__u grainsu
__grains__u pillaru
__pillar__u __context__( R R
R# R$ R R% R2 ( R R\ RM ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt ssh_wrapper\ s $c C@ s� i | d 6| j d i � d 6} | r3 | | d <n | p< i | d <t t | d d d d �| d
d d | �} t | d � } t | d
| | d | d � s� d j | d
� } t j | � t | � � n | S( u$
Returns the render modules
u __salt__u grainsu
__grains__u
__states__u __proxy__u renderersu renderR u render_dirsR
R u .renderu rendereru renderer_blacklistu renderer_whitelistu_ The renderer {0} is unavailable, this error is often because the needed software is unavailable( R2 R R
R R R& R. t criticalR ( R R\ Rr RP R R t rendt err( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt renderq s*
!
c C@ s% t t | d d d d �| d d �S( u�
Returns the grain functions
.. code-block:: python
import salt.config
import salt.loader
__opts__ = salt.config.minion_config('/etc/salt/minion')
grainfuncs = salt.loader.grain_funcs(__opts__)
u grainsu grainR u grains_dirsR
( R R
( R RP ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt grain_funcs� s c C@ sE t j j | � s# t j d � d
St t j � t j j | � � } | | j d d � k r� t j d | | j d d � � d
S| j d t
� r� t j d � d
St j d � yv t j j
| � } t j j j | d � �+ } t j j j | j | � d t �} Wd
QX| s!t j d � d
S| SWn t t f k
r@d
SXd
S( u`
Returns the grains cached in cfn, or None if the cache is too old or is
corrupted.
u! Grains cache file does not exist.u grains_cache_expirationi, un Grains cache last modified %s seconds ago and cache expiration is set to %s. Grains cache expired. Refreshing.u refresh_grains_cacheu+ refresh_grains_cache requested, Refreshing.u Retrieving grains from cacheu rbt preserve_tuplesNu> Cached grains are empty, cache might be corrupted. Refreshing.( R# R$ t isfileR. R0 R" t intt timet getmtimeR2 RB RH t payloadt SerialRI t filest fopent datat decodeR+ R1 t IOErrort OSError( R t cfnt grains_cache_aget serialt fp_t
cached_grains( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt _load_cached_grains� s.
"
*
c C@ s� d d l } t j j | d d � } | rZ | j d t � rZ t | | � } | rg | Sn
t j d � | j d t � r} i S| j d t � t k } d | k rri } | j
| j j | d d
| j j
d � � | j d | d � } | j d g � } | j
| j j | | d d
t �� | j
| j j | | d d
t �� d | k re| d | d <q|i | d <n
i | d <i }
t | d | �} | r�| j � n x� | D]y } | j d � s�q�n t j d | � | | � }
t |
t � s�q�n | r| j j j
|
|
� q�|
j
|
� q�Wx>| D]6} | j d � s2| d k rYq2n yx t j d | � | j j j | | � j } i } d | k r�| | d <n d | k r�|
| d <n | | | � }
WnS t k
r&| j j j � rt j d � n t j d | | | d t �q2n Xt |
t � s<q2n | r[| j j j
|
|
� q2|
j
|
� q2W| j d t � r`| r`y� | j d d } | d | k rH| d | k rH| | d � rHyR | j d d } | | d � }
| r
| j j j
|
|
� n
|
j
|
� WqEt k
rAt j d d t �qEXqHn Wq`t k
r\q`Xn |
j
| d � | j d t � r�| j j j! d � �y� | j j j" � r�d d l# } | j$ j% j& d j' | � � n | j j j( | d � �V } y& | j) j* | � } | j+ |
| � Wn& t, k
rB} t j- d | � � n XWd QXWnH t k
r�} t j- d | | � t j j. | � r�t j/ | � q�n XWd QXn | r�| j j j
|
| d � n |
j
| d � | j j0 j1 |
d! t �S(" ug
Return the functions for the dynamic grains and the values for the static
grains.
Since grains are computed early in the startup process, grains functions
do not have __salt__ or __proxy__ available. At proxy-minion startup,
this function is called with the proxymodule LazyLoader object so grains
functions can communicate with their controlled device.
.. code-block:: python
import salt.config
import salt.loader
__opts__ = salt.config.minion_config('/etc/salt/minion')
__grains__ = salt.loader.grains(__opts__)
print __grains__['id']
i Nu cachediru grains.cache.pu grains_cacheu, Grains refresh requested. Refreshing grains.u skip_grainsu grains_deep_mergeu conf_fileu SALT_MINION_CONFIGu default_includeu includet verboseu grainsRP u core.u Loading %s grainu _errorsu proxyud The following CRITICAL message may not be an error; the proxy may not be completely established yet.uF Failed to load grains defined in grain file %s in function %s, error:
R! u proxy_merge_grains_in_moduleu proxytypeu .grainsu .initializedu& Failed to run proxy's grains function!i? u attrib -R "{0}"u w+bu$ Failed to serialize grains cache: %su+ Unable to write to grains cache file %s: %sR| (2 t salt.configR# R$ R R2 RB R� R. R0 R1 t updatet configt load_configt DEFAULT_MINION_OPTSt include_configR{ t cleart
startswitht traceRC RD RI t
dictupdatet argst get_function_argspecR- t platformt is_proxyt infoRw R t KeyErrorR� t set_umaskt
is_windowst salt.modules.cmdmodt modulest cmdmodt
_run_quietR& R� R� R� t dumpRF R/ R} t unlinkR� R� ( R t
force_refreshRP RH R� R� t grains_deep_merget pre_optst default_includet includet grains_dataR R R t
parameterst kwargst proxytypeR� R� t e( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt grains� s�
!
c K@ sc | j d g � } | j d g � } t t j j t d � g | d d d d t �} | | | � S( u<
Directly call a function inside a loader directory
u argsu dirsu modulesR
RW N( R2 R R# R$ R R% R" RB ( t funR� R� t dirsR ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt callp s c C@ s| | d k r i } n | d k r* i } n t t | d d d d �| d d d i | d 6| d 6d | �} | | j d
<| S( u<
Directly call a function inside a loader directory
u runnersu runnerR u runner_dirsR
R u __utils__u __context__R> u __salt__N( R" R R
R ( R RI RM R> R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyRo � s
c C@ s% t t | d d d d �| d d �S( u<
Directly call a function inside a loader directory
u queuesu queueR u
queue_dirsR
( R R
( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt queues� s c
C@ sb | d k r i } n t t | d � | d d d i | d 6| d 6| d 6t | | � d 6d | �S(
u)
Make a very small database call
u sdbR
R u __sdb__u __opts__u __utils__u __salt__R> N( R" R R
RV ( R R\ R> RI ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt sdb� s c C@ s1 t t | d d t j j t d � �| d d �S( uS
Return modules for SPM's package database
.. versionadded:: 2015.8.0
u pkgdbR u spmR
( R R
R# R$ R R% ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt pkgdb� s c C@ s1 t t | d d t j j t d � �| d d �S( uP
Return modules for SPM's file handling
.. versionadded:: 2015.8.0
u pkgfilesR u spmR
( R R
R# R$ R R% ( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt pkgfiles� s c C@ s� t t | d d d t j j t d � d d �| d d d i t j j | � d 6d
d 6�} x. t
D]& } t j d | � | j
| d
� qc W| S( u$
Return the cloud functions
u cloudsu cloudR R R
R u __utils__u __active_provider_name__uZ '%s' has been marked as not supported. Removing from the list of supported cloud functionsN( R R
R# R$ R R% RH R] RI R" t LIBCLOUD_FUNCS_NOT_SUPPORTEDR. R� t pop( R R\ t funcname( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt clouds� s
c C@ s t t | d � | d d �S( u*
Return the network api functions
u netapiR
( R R
( R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt netapi� s c C@ sY t t | d d � | d d d i | d 6| p1 i d 6| p> i d 6�} | | j d <| S( u&
Returns the executor modules
u executorsu executorR
R u __salt__u __context__u __proxy__u
__executors__( R R
R ( R R\ RM RP t executors( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR� � s *
c
C@ s: t t | d d � | d d d i | d 6i | d 6d 6�S( u&
Returns the returner modules
u cacheR
R u __opts__u serialu __context__( R R
( R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt cache
s
c B@ sf | e j k r d Sd j | j d � d � } e j e | � � } | | j f d U| e j | <d S( Nu# '''Salt loaded {0} parent module'''u .i����( t sysR� R& t splitt typest
ModuleTypet strt __dict__( R[ t codet module( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt _generate_module s c C@ s | j t � r d Sd S( Nu intu ext( R� R% ( t module_path( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt _mod_type! s R c B@ sD e Z d Z d � Z d � Z d � Z d � Z d � Z d � Z RS( ux
Create a dict which wraps another dict with a specific key suffix on get
This is to replace "filter_load"
c C@ s | | _ | | _ d S( N( RZ t suffix( t selft dR� ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt __init__. s c C@ s | | j | <d S( N( RZ ( R� R t val( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt __setitem__2 s c C@ s | j | =d S( N( RZ ( R� R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt __delitem__5 s c C@ s | j | | j S( N( RZ R� ( R� R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt __getitem__8 s c C@ s
t | j � S( N( t lenRZ ( R� ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt __len__; s c c@ sA x: | j D]/ } | j | j � r
| j | j d � Vq
q
Wd S( Nu ( RZ t endswithR� t replace( R� R ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt __iter__> s ( t __name__t
__module__t __doc__R� R� R� R� R� R� ( ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR ( s R c B@ s� e Z d Z e j j j Z d d d d d d e d d d d �
Z
d � Z d � Z d � Z
d � Z d � Z d � Z d � Z d
� Z d � Z d � Z d
� Z d � Z d � Z d d � Z RS( u�
A pseduo-dictionary which has a set of keys which are the
name of the module and function, delimited by a dot. When
the value of the key is accessed, the function is then loaded
from disk and into memory.
.. note::
Iterating over keys will cause all modules to be loaded.
:param list module_dirs: A list of directories on disk to search for modules
:param dict opts: The salt options dictionary.
:param str tag: The tag for the type of module to load
:param func mod_type_check: A function which can be used to verify files
:param dict pack: A dictionary of function to be packed into modules as they are loaded
:param list whitelist: A list of modules to whitelist
:param bool virtual_enable: Whether or not to respect the __virtual__ function when loading modules.
:param str virtual_funcs: The name of additional functions in the module to call to verify its functionality.
If not true, the module will not load.
:returns: A LazyLoader object which functions as a dictionary. Keys are 'module.function' and values
are function references themselves which are loaded on-demand.
# TODO:
- move modules_max_memory into here
- singletons (per tag)
u modulec C@ s� i | _ | d k r i n | | _ | d k r9 i } n | j d � } t j j j d | � | _ | j | � | _
| | _ | | _ | p� t
| _ | p� t | _ d | j k r� d | j d <n xd t j | j � D]P \ }
} | d k r� | j j |
i � t j j j | j |
� | j |
<q� q� W| | _ | | _ t | _ i | _ i | _ t � | _ | rq| n g | _ | d k r�g } n | | _ t | j
j d j | j | j d d k r�d n d � g � � | _ i | _! d g | _" x= t# D]5 \ } } } | | | f | j! | <| j" j$ | � q�Wt% j& � | _' | j( � t) t* | � j+ � t, d j | j � � t, d j | j | � � t, d
j | j � � t, d j | j | � � d S(
uz
In pack, if any of the values are None they will be replaced with an
empty context-specific dict
u multiprocessingt
threadsafeu __context__u disable_{0}{1}i����u su u {0}.intu {0}.int.{1}u {0}.extu {0}.ext.{1}N(- t inject_globalsR" R R2 RH RI RM t ContextDictt context_dictt _LazyLoader__prep_mod_optsR t module_dirsR
t LOADED_BASE_NAMER? R� t mod_type_checkR t iteritemst
setdefaultt NamespacedDictWrapperR> RW R1 RN t missing_modulest loaded_modulest sett loaded_filesR@ Rs R& t disabledt
suffix_mapt suffix_ordert SUFFIXESR, t threadingt RLockt _lockt _refresh_file_mappingt superR R� R� ( R� R� R R
R? R� R R> RW R@ RP Rs t threadsafetyt kt vR� t modet kind( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR� a sZ )
c C@ s< t t | � j | � } | j r4 t | j � | � S| Sd S( u�
Override the __getitem__ in order to decorate the returned function if we need
to last-minute inject globals
N( R� R R� R� t global_injector_decorator( R� t itemRS ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR� � s c C@ s� | d k r t j | | � Sy t j | | � SWn t k
rC n X| | j k r� | j r� xQ | j | � D]= } | | j k r� qm n | j | � rm | | j k rm Pqm qm Wn | | j k r� | j | St | � � d S( u�
Allow for "direct" attribute access-- this allows jinja templates to
access things like `salt.test.ping()`
u __getstate__u __setstate__N( u __getstate__u __setstate__( t objectt __getattribute__t __getattr__t AttributeErrorR� t loadedt _iter_filesR� RY ( R� t mod_nameR[ ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR� � s
c C@ s� | j d � d } | | j k r/ d j | � Sy | j | } Wn t k
r] d j | � SX| d k rz d j | | � Sd j | � Sd S( u�
Return the error string for a missing function.
This can range from "not available' to "__virtual__" returned False
u .i u '{0}' is not available.u% '{0}' __virtual__ returned False: {1}u '{0}' __virtual__ returned FalseN( R� R� R& R� R� R" ( R� t
function_nameR t reason( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt missing_fun_string� s
c @ s� | j j d t � t k ri y* t d � a t j � t � | j d <Wqi t k
re t j
d � qi Xn | j j d t � t k r� t � | j d <n t r� d d t f | j d <n d d t
j f | j d <t j j j � | _ g � � f d � } x�| j D]�} y# t d � t j | � D� � } Wn t k
rBqn Xt j r�yJ g t t j t j j | d
� � � D] } t j j d
| � ^ qt} Wn t k
r�q�X| j | � n x�| D]�} y�t j j | � \ } } | j d � r�w�n t j j | � \ } }
t j r�t! j" | | � } y/ t# � j$ � j% d � j& d
d � d � } Wn t' t( t) f k
r{d } n Xy | j d j* | � } Wq�t+ k
r�t j, d | | | � w�q�Xn d } |
| j k r�w�n | | j- k rt j, d | � w�n t j j | | � }
|
d k r�t j |
� } xH | j. D]7 } d | k rXq@n d j/ | � } | | k r@Pq@q@Ww�n y& | j | d } | j | d } Wn t+ k
r�n� Xd | |
f k r�| |
k r�t j0 d |
| j | d � n t j r0|
d k r0| d k r0| | k raw�qan1 | s[| j. j* |
� | j. j* | � k raw�n t j r�| r�|
d k r�w�n |
|
| f | j | <Wq�t k
r�q�q�Xq�WqWx: | j1 D]/ } | j d � d } | d d f | j | <q�Wd S( u7
refresh the mapping of the FS on disk
u
cython_enableu pyximportu .pyxu] Cython is enabled in the options but not present in the system path. Skipping Cython modules.u enable_zip_modulesu .zipu c @ s � j | � d S( u
Hack so we can get the optimization level that we replaced (if
any) out of the re.sub call below. We use a list here because
it is a persistent data structure that we will be able to
access after re.sub is called.
u ( R, ( t obj( t opt_match( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt _replace_pre_ext s
c s@ s! | ] } | d k r | Vq d S( u __pycache__N( ( t .0t x( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pys <genexpr> s u __pycache__u _i u -i����i u optimization_orderu� Disallowed optimization level %d for module name '%s', skipping. Add %d to the 'optimization_order' config option if you do not want to ignore this optimization level.u, Skipping %s, it is disabled by configurationu __init__{0}i u' Module/package collision: '%s' and '%s'u .pycu .u .oN(2 R R2 R1 t
__import__t pyximportt installt tupleR� t ImportErrorR. R� t
USE_IMPORTLIBt MODULE_KIND_PKG_DIRECTORYt impt
PKG_DIRECTORYRH RI t odictt OrderedDictRX R� t sortedR# t listdirR� R t PY3R$ R R' R� R� t splitextt PY3_PRE_EXTt subR~ R� t groupt rsplitR� t
IndexErrort
ValueErrort indexR� R� R� R� R& R/ R@ ( R� R t mod_dirR� R t
pycache_filest filenamet dirnamet basenamet f_noextt extt opt_levelt opt_indext fpatht subfilesR� t init_filet curr_extt curr_opt_indext smod( ( R s/ /usr/lib/python2.7/site-packages/salt/loader.pyR� � s�
G
,
! +
c C@ sj | j �[ t t | � j � t � | _ i | _ i | _ t | d � rW | j � n t
| _ Wd QXd S( u
Clear the dict
u optsN( R� R� R R� R� R� R� R� t hasattrR� RB RN ( R� ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR� � s
c C@ s� d | j k rM | j d i � | j d <t j j j | j d � | j d <n d | j k r� | j d i � | j d <t j j j | j d � | j d <n i } x< t | j � � D]( \ } } | d k r� q� n | | | <q� W| S( u;
Strip out of the opts any logger instance
u
__grains__u grainsu
__pillar__u pillaru logger( R R2 R� RH RI RM R� Rd t items( R� R t mod_optsR R� ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt __prep_mod_opts� s %% c c@ sk | | j k r | Vn x% | j D] } | | k r! | Vq! q! Wx% | j D] } | | k rI | VqI qI Wd S( uW
Iterate over all file_mapping files in order of closeness to mod_name
N( RX ( R� R R� ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR � s c @ sd � f d � t � � D� } xA | D]9 } | j j � j d � r# t | � | j | � q# q# Wd S( Nc 3@ s9 | ]/ } t t � | � � j � r t � | � Vq d S( N( RC t getattrt __class__( R t sname( RR ( s/ /usr/lib/python2.7/site-packages/salt/loader.pys <genexpr>� s u .( t dirR� R� R t _reload_submodules( R� RR t
submodulest submodule( ( RR s/ /usr/lib/python2.7/site-packages/salt/loader.pyR7 � s
c (
@ s> d } � j | d \ } } � j j | � t j j | � } z�y�t j j | � | d k r t j
| | t j � � } n�| d k r� t
| t � t � g � } | j d � } t | � d k r� | } q)| } xP| d D] } t | | � } q� Wn,| d k r!t | � j
| � } n� j | } y. d j � j � j | � � j | f � }
Wn8 t k
r�d j � j � j | � � j | � }
n X| d k r}t rIt j j t j j f t j j t j j! f t j j" t j j# f g } t j j$ | | � } | j% |
� }
|
d k r*t& � � n |
j' j
� } | t j( |
<n t) j
|
d | | � } � j* s)� j+ | � q)n� t r�t, | d |
| � } t j- j. |
| d | �}
|
d k r�t& � � n |
j' j
� } | t j( |
<n= t/ j0 j1 j2 | | d � � } t) j
|
| | | � } Wd QXWn�t3 k
r@� n�t& k
r�} d
t4 j5 | � k r�d j � j | � } t6 j7 | � | � j8 | <n t6 j9 d � j | d
t: �| � j8 | <t; St< k
r�} t6 j= d � j | d
t: �| � j8 | <t; St> k
r�} y- t? j@ t jA � d � d \ } } } } Wn t< k
rNnM Xt j j d d d � } | jB | � r�d | k r�t jC t/ jD jE jF � n t6 j= d � j | d
t: �| � j8 | <t; SXWd t j jG | � XtH | d � r| jI jJ � jK � n � jK | _I x0 t4 jL � jM � D] \ } } tN | | | � q"W| jO jP d d � d } t | d d � } tQ jR | � ry | � jK � Wqt k
r�} t6 j= | � qt< k
r�d } t6 j9 d � j | | d
t: �| � j8 | <| � j8 | <t; SXn � jS r�d g � jT } x� | D]� } � jU | | | � \ } } } } | d k rrt6 jV d � j | | � n | t: k r#| � j8 k r#| � j8 | <| � j8 | <t; Sq#Wn d' } d � jK k r9� j d( k r9tH | d � s� jK d d | jW k r6d | jW k r6d } | � j8 | <| � j8 | <t; Sq9n t | d t; � t; k rdt6 jX d! | � n | g tY | � }! tZ � f d" � |! D� � }" x?t | d t[ | � � D]%}# |# j\ d# � r�q�n t | |# � }$ tQ jR |$ � r�t] |$ t^ j_ � r�q�n t | d$ i � j` |# |# � }% x� |! D]� }& y d j |& |% f � }' Wn# t k
rhd% j |& |% � }' n X|' � ja k r�|$ � ja |' <n |% |" |& k r$tN |" |& |% |$ � |$ |" |& |% <� jb |$ | � q$q$Wq�Wy tc jd � ja � j | � Wn# te k
r } t6 jX d& | � n Xx |! D] }& |" |& � jf |& <q Wt: S() Ni u .pyxu .ou .i u .zipu {0}.{1}.{2}.{3}u R] u magic numberuv Failed to import {0} {1}. Bad magic number. If migrating from Python2 to Python3, remove all .pyc files and try again.u Failed to import %s %s:
R! uC Failed to import %s %s, this is due most likely to a syntax error:
i����u saltu utilsu
process.pyu _handle_signalsu3 Failed to import %s %s as the module called exit()
u __opts__u __init__u __init__ failedu Error loading %s.%s: %su __virtual__u proxyu grainsu __proxyenabled__u proxytypeu *u! not a proxy_minion enabled moduleu __load__uT The functions from module '%s' are being loaded from the provided __load__ attributec 3@ s0 | ]& } | � j j | � j � � f Vq d S( N( R� R2 t mod_dict_class( R R ( R� ( s/ /usr/lib/python2.7/site-packages/salt/loader.pys <genexpr>� s u _u __func_alias__u {0}.{1}uB Depends.enforce_dependencies() failed for the following reason: %s( ( u grainsu proxy(g R" RX R� t addR# R$ R# R� R, R t load_modulet tempfilet
gettempdirR
t globalst localsR� R� R3 R R� R R? R� R
RF R& R t importlibt machineryt SourceFileLoadert SOURCE_SUFFIXESt SourcelessFileLoadert BYTECODE_SUFFIXESt ExtensionFileLoadert EXTENSION_SUFFIXESt
FileFindert find_specR R] R� R RN R7 t MODULE_KIND_MAPt utilt spec_from_file_locationRH RI R� R� R� R t text_typeR. t warningR� R0 R1 RB R- R/ t
SystemExitt tracebackt
extract_tbR! R� t exitt defaultst exitcodest EX_OKt removeR/ t __opts__R� R R� R t setattrR� R t inspectt
isfunctionRW Rs t _process_virtualR� t __proxyenabled__R� Rd RD R6 R� RC t functoolst partialR2 RZ t _apply_outputterR t enforce_dependenciest RuntimeErrorR� (( R� R[ RR R) R� t
fpath_dirnamet top_modt compst subnamet desct
mod_namespacet loader_detailst file_findert specR] t fn_R: t error_msgR/ t _t callert tgt_fnt p_namet p_valueR t module_initR� t
err_stringt virtual_funcs_to_processt virtual_funct virtual_rett virtual_errt virtual_aliasest mod_namest mod_dictt attrRS R� t tgt_modt
full_funcname( ( R� s/ /usr/lib/python2.7/site-packages/salt/loader.pyRY � sN
"
-
!
#
c @ sh t � t j � s! t d � � n d � k rE t d j � � � � n � j d d � \ } } � j �� | � j k s� � � j k r� t S� j
r� | � j
k r� t j d � | � j
� t � � � n � � f d � } d } t } xt t r]y: | | � } | r(| t k r(� j � t } w� n PWq� t k
rY| s� � j � t } q� q� q� Xq� WWd QX| S( u3
Load a single item if you have it
u The key must be a string.u .u" The key '{0}' should contain a '.'i uN Failed to load function %s because its module (%s) is not in the whitelist: %sc @ sU xN � j | � D]= } | � j k r+ q n � j | � r � � j k r t Sq Wt S( N( R R� RY RZ R1 RB ( R R[ ( R R� ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt _inner_load� s N( RC R t string_typesR� R& R� R� R� RZ R1 R> R. R/ R" RB R� R� ( R� R R Rn R R t reloaded( ( R R� s/ /usr/lib/python2.7/site-packages/salt/loader.pyt _load� s<
c C@ sb | j �S xB | j D]7 } | | j k s | | j k r> q n | j | � q Wt | _ Wd QXd S( u"
Load all of them
N( R� RX R� R� RY R1 R� ( R� R[ ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR � s
c C@ s* | j � t � | _ | j � Wd QXd S( N( R� R� R� R ( R� ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt reload_modules s
c C@ sA t | d � r= | j } | j | k r= | | j | _ q= n d S( uC
Apply the __outputter__ variable to the functions
u
__outputter__N( R/ t
__outputter__R� ( R� RS RR t outp( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR`
s u __virtual__c C@ s� t | d t � � } yd } t | d � r+t j | j � r+y� t j � } t | | � � } t | t � r� | d } | d } n | j j
d t � r� t j � | } d j | | � } t
j | � n WnD t k
r}
d j | j |
� } t
j | d t j �d } n Xt | d | � } | sb| d k rRt
j d
| j | � n t | | | f S| t k r�| | k r�t
j d | | � t | d � s�t j j j d d
j | j | | � � n | | k r�t
j d | j | | � n | } q+| t k r+| | k r+| t k r(| } q(q+n Wn` t k
rUt
j d | d t �n: t k
r�t
j d | j | d t �t | | | f SXt | d | f S( u"
Given a loaded module and its default name determine its virtual name
This function returns a tuple. The first value will be either True or
False and will indicate if the module should be loaded or not (i.e. if
it threw and exception while processing its __virtual__ function). The
second value is the determined virtual name, which may be the same as
the value provided.
The default name can be calculated as follows::
module_name = mod.__name__.rsplit('.', 1)[-1]
u __virtual_aliases__u __virtual__i i u
virtual_timeru) Virtual function took {0} seconds for {1}u] Exception raised when processing __virtual__ function for {0}. Module will not be loaded: {1}t exc_info_on_loglevelu __virtualname__u� %s.__virtual__() is wrongly returning `None`. It should either return `True`, `False` or a new name. If you're the developer of the module '%s', please fix this.u Loaded %s as virtual %su Hydrogenu� The '{0}' module is renaming itself in its __virtual__() function ({1} => {2}). Please set it's virtual name as the '__virtualname__' module attribute. Example: "__virtualname__ = '{2}'"u� The module '%s' is showing some bad usage. Its __virtualname__ attribute is set to '%s' yet the __virtual__() function is returning '%s'. These values should match!u KeyError when loading %sR! u. Failed to read the virtual function for %s: %sN( R3 R
R" R/ RZ R[ t __virtual__R RC R R2 RB R& R. RO R- R� R/ t loggingt DEBUGR1 R� RH RI t versionst
warn_untilR� R0 R
( R� RR R Rv Ry t error_reasont startt virtualt endt msgR: t virtualname( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR\ sh !
N( R� R� R� RH RI R R R: R" R1 R� R� R� R R� R� R� R R7 RY R� R R� R` R\ ( ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyR D s4 G �
� 5 c @ s � f d � } | S( u�
Decorator used by the LazyLoader to inject globals into a function at
execute time.
globals
Dictionary with global variables to inject
c @ s% t j � � � � f d � � } | S( Nc @ s0 t j j j � � � � � | | � SWd QXd S( N( RH RI RM t func_globals_inject( R� R� ( t fR� ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt wrapper� s ( R^ t wraps( R� R� ( R� ( R� s/ /usr/lib/python2.7/site-packages/salt/loader.pyt inner_decorator� s !( ( R� R� ( ( R� s/ /usr/lib/python2.7/site-packages/salt/loader.pyR� � s (� R� t
__future__R R R R# t reR� R R� RZ R= R^ R� RQ R� t zipimportR R� RH t salt.defaults.exitcodest
salt.syspathst salt.utils.argst salt.utils.contextt salt.utils.datat salt.utils.dictupdatet salt.utils.eventt salt.utils.filest salt.utils.lazyt salt.utils.odictt salt.utils.platformt salt.utils.versionst salt.exceptionsR t
salt.templateR t salt.utils.decoratorsR t salt.extR t salt.ext.six.movesR t version_infot importlib.machineryRA t importlib.utilR1 R R RB t collections.abcR R t collectionsR) R( t getLoggerR� R. R$ t abspatht syspathst INSTALL_DIRR% R� t MODULE_KIND_SOURCEt MODULE_KIND_COMPILEDt MODULE_KIND_EXTENSIONR R� RB RH R� R, RD RF RC RE RG RK t get_suffixest compileR& R R� R" R R R R
RV RE R^ R_ Ra RP Rb RI Rc Rf Rg Ri Rj Rk Rl Rn Rp Rq Rr Rt Ru Rv Rz R{ R� R� R� Ro R� R� R� R� R� R� R� R� R� R� R t lazyt LazyDictR R� ( ( ( s/ /usr/lib/python2.7/site-packages/salt/loader.pyt <module> s
) K
%� � � � R
Mini Shell