Current File : //usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyo
�
���^c @@ s d d l m Z m Z d d l Z d d l Z d d l m Z m Z m Z d d l Z d d l
m Z d d l m
Z
d d l m Z d d l m Z m Z m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z y d d l Z Wn e k
r#e Z n Xe j e! � Z" d e
f d
� � YZ# d � Z$ d � Z% e! d
k r e& e j' � d k r�e( d d e j) �e j* d � n e j' d \ Z+ Z, Z- e$ e+ � r�e j* d � n yF e j. � d k re j/ j0 j1 � e j* d � n e j/ j0 j1 � Wn e2 k
r9Z3 e j* d � n Xe j4 � e j5 d � y� e j. � Z6 e6 d k r�e j/ j0 j1 � e j/ j7 j8 e j9 j: e+ e
j; � d � � Z< e< j= d j> e6 � � Wd QXe j* d � n Wn e2 k
r�Z3 e j* d � n Xe j/ j0 j1 � e% e, e+ e- � n d S( i ( t absolute_importt print_functionN( t Popent PIPEt STDOUT( t InspectorSnapshotException( t EnvLoader( t kiwiproc( t
AllowedDirt
IgnoredDirt Packaget PayloadFilet PackageCfgFile( t CommandExecutionErrort Inspectorc
B@ sO e Z d Z d d d g Z d d d d d g Z d d
d d g Z d
d d d d d d d d d g
Z d/ d/ d/ d � Z d � Z d � Z
d/ d/ d � Z d � Z d � Z
d � Z d � Z d � Z d � Z d! � Z d" � Z d# � Z d$ � Z d% � Z d& � Z d' � Z d( � Z d) � Z d* d+ � Z e d
d, d- � Z d, d
d. � Z RS(0 s /etc/salt/miniont
configurationt payloadt allt proct sysfst devtmpfst tmpfss fuse.gvfs-fuse-daemont autofst cifst nfst nfs4s /tmps /var/tmps /lost+founds /var/runs /var/lib/rpms /.snapshotss /.zfss /etc/sshs /roots /homec C@ s# t j | d | d | d | �d S( Nt cachedirt piddirt pidfilename( R t __init__( t selfR R R ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyR 8 s c C@ s | j j d t � | S( s6
Open new snapshot.
:return:
t new( t dbt opent True( R ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt create_snapshot; s c C@ s | j j � | S( sF
Open an existing, latest snapshot.
:return:
( R R! ( R ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt reuse_snapshotD s
c G@ sD t | g t | � d t d t d t d | p4 t j �j d | � S( s2
Call an external system command.
t stdoutt stdint stderrt envt input( R t listR R t ost environt communicate( R t commandR) R( t params( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt _syscallM s (c C@ s[ | j j � j d � d k r( | j � S| j j � j d � d k rP | j � St � Sd S( sS
Package scanner switcher between the platforms.
:return:
t os_familyt Debiant Suset redhatN( R3 R4 ( t grains_coret os_datat gett _Inspector__get_cfg_pkgs_dpkgt _Inspector__get_cfg_pkgs_rpmt dict( R ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt
_get_cfg_pkgsT s
c C@ s t � } xt j j j | j d d d d d � d � j t j � D]� } | j
� } | sb qD n t � | | <x� t j j j | j d d d d d | � d � j t j � D]M } | j
� } | s� q� n | j
� j d d � \ } } | | j | � q� W| | sD | j
| � qD qD W| S( sY
Get packages with configuration files on Dpkg systems.
:return:
s
dpkg-querys -Wfs ${binary:Package}\ni s ${Conffiles}\nt i N( R: t saltt utilst stringutilst to_strR0 t Nonet splitR+ t linesept stripR* t appendt pop( R t datat pkg_namet pkg_cfg_itemt pkg_cfg_filet pkg_cfg_sum( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt __get_cfg_pkgs_dpkga s" #
$
c C@ s� | j d d d d d d d � \ } } t � } d } g } t j j j | � } xv | j t j � D]b } | j
� } | s� qd n | j d � s� | r� | r� | | | <n | } g } qd | j | � qd W| r� | r� | | | <n | S( sG
Get packages with configuration files on RPM systems.
t rpms -qas
--configfiless
--queryformats %{name}-%{version}-%{release}\nt /N(
R0 RA R: R= R> R? R@ RB R+ RC RD t
startswithRE ( R t outt errRG RH t pkg_configst line( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt __get_cfg_pkgs_rpm~ s&
c
C@ s� t � } x�| j � D]�\ } } t � } t � } | j j � j d � d k r� t j j j | j
d d d d | � d � j t
j � } nj | j j � j d � d k r� t j j j | j
d d d d d
d d d
d | �
d � j t
j � } n x� | D]� } | j � } | s | j d � d k s | j d � d j d � d k rVq n | j d � d } | | k r | j | � q q W| r | | | <q q W| S( s�
Filter out unchanged packages on the Debian or RPM systems.
:param data: Structure {package-name -> [ file .. file1 ]}
:return: Same structure as data, except only files that were changed.
R1 R2 t dpkgs --verifyi R3 R4 RM s -Vs --nodepss
--nodigests
--nosignatures --nomtimes
--nolinktos c R< t 5i����N( s Suses redhat( R: t itemsR* R5 R6 R7 R= R> R? R@ R0 RA RB R+ RC RD t findRE ( R RG t f_dataRH t pkg_filest cfgst cfg_dataRS t cfg_file( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt _get_changed_cfg_pkgs� s* $
> c C@ s� d } d } x� | j � D]� \ } } t � } | | _ | | _ | j j | � xL | D]D } t � } | | _ | | _ | | _ | j j | � | d 7} qW W| d 7} q Wd S( sZ
Save configuration packages. (NG)
:param data:
:return:
i i N( RW R
t idt nameR t storeR t pkgidt path( R RG t pkg_idt
pkg_cfg_idRH RR t pkgt
pkg_configt cfg( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt _save_cfg_packages� s
c
C@ s� d } x� d | f d | f d | f f D]� \ } } x� | D]� } t j | � } t � } | | _ | | _ | | _ | j | _ | j | _ | j
| _ | j | _
| j | _ | j | _ | j | _ | d 7} | j j | � q; Wq( Wd S( s�
Save payload (unmanaged files)
:param files:
:param directories:
:param links:
:return:
i t ft dt li N( R+ t statR R_ Rc t p_typet st_modet modet st_uidt uidt st_gidt gidt st_sizet p_sizet st_atimet atimet st_mtimet mtimet st_ctimet ctimeR Ra (
R t filest directoriest linkst idxRn t p_listt p_objt statsR ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt
_save_payload� s"
.
c C@ sf | j j � j d � d k r( | j � S| j j � j d � d k rP | j � St � t � t � f S( s>
Build a in-memory data of all managed files.
R1 R2 R3 R4 ( s Suses redhat( R5 R6 R7 t" _Inspector__get_managed_files_dpkgt! _Inspector__get_managed_files_rpmR* ( R ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt _get_managed_files� s
c C@ sg t � } t � } t � } x*t j j j | j d d
d
d d � d � j t j � D]� } | j
� } | st qV n x� t j j j | j d d
d
d | � d � j t j � D]� } | j
� } | s� | d k r� q� n t j j | � r� | j
| � q� t j j | � r | j
| � q� t j j | � r� | j
| � q� q� WqV Wt | � t | � t | � f S( sZ
Get a list of all system files, belonging to the Debian package manager.
s
dpkg-querys -Wfs ${binary:Package}\ni RU s -LRN s ./t .N( RN s ./R� ( t setR= R> R? R@ R0 RA RB R+ RC RD Rc t isdirt addt islinkt isfilet sorted( R t dirsR R} RH t resource( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt __get_managed_files_dpkg� s& # A c C@ s' t � } t � } t � } x� t j j j | j d d
d
d � d � j t j � D]� } | j
� } | sq qS n | j d d � j d � } | d d d k r� | j | d � qS | d d d k r� | j | d � qS | d d d k rS | j | d � qS qS Wt
| � t
| � t
| � f S( sZ
Get a list of all system files, belonging to the RedHat package manager.
RM s -qlavi s R< Rk i����Rl t -N( R� R= R> R? R@ R0 RA RB R+ RC RD t replaceR� R� ( R R� R R} RS ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt __get_managed_files_rpm s > c G@ s� t � } t � } t � } t j | t j � r{xHt j | � D]4} t j j | | � } t } x/ | D]' } | j t | � � rh t
} qh qh qh W| s@ t j j | � s@ t j | t j � r� q@ n t j
j j | � r� | j | � q@ t j j | � rR| j | � | j | | � \ } }
} | j | � | j |
� | j | � q@ t j j | � r@ | j | � q@ q@ Wn t | � t | � t | � f S( sW
Walk implementation. Version in python 2.x and 3.x works differently.
( R* R+ t accesst R_OKt listdirRc t joinR" RO t strt Falset existsR= R> R� RE R� t _get_all_filest extendR� R� ( R Rc t excludeR} R� R t objt validt ex_objt f_objt d_objt l_obj( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyR� * s0
0
c C@ s| | \ } } } | \ } } } t t t | � j | � � � t t t | � j | � � � t t t | � j | � � � f S( sK
Get the intersection between all files and managed files.
( R� R* R� t
difference( R t managedt
system_allt m_filest m_dirst m_linkst s_filest s_dirst s_links( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt _get_unmanaged_filesI s
c
C@ s� t � } xB | j j t � D]. } t j j | j � r | j | j � q q Wt � } | s� xE | j j t � D]. } t j j | j � rp | j | j � qp qp Wn t � } t � } t � } x� g | p� t j d � D] } | r� | ^ q� D]� } | d d k rd j
| � } n | | k s� t j j | � r;q� n | j | | � \ }
} } | j
|
� | j
| � | j
| � q� W| j | j � | | | f � S( s"
Scan the system.
RN i s /{0}( R* R R7 R R+ Rc R� RE R R� t formatR� R� R� R� R� (
R t allowedt allowed_dirt ignoredt ignored_dirt all_filest all_dirst all_linkst ptht
entry_patht e_filest e_dirst e_links( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt
_scan_payloadT s, 5
c K@ s� | j j d t � t � } | t | j � O} t j j j � } x� | j � D]{ \ } } | | j
k r� x | D] } | j | d � qp WqN n x5 | D]- } | d | j k r� | j | d � q� q� WqN Wt
� } x` t t
| � � D]L } t } x' | D] }
| j |
� r� t } Pq� q� W| r� | j | � q� q� Wx0 | D]( } t � } | | _ | j j | � q@Wg | j d d � j d � D] }
|
r�|
^ q�} x0 | D]( } t � } | | _ | j j | � q�W| S( sJ
Prepare full system scan by setting up the database etc.
R t mount_pointt typet filtert t ,( R R! R" R� t IGNORE_PATHSR= R> t fsutilst _get_mountsRW t
IGNORE_MOUNTSR� t IGNORE_FS_TYPESR* R� RO R� RE R Rc Ra R7 RB R ( R t kwargst
ignored_fst mountst deviceRG t mptt ignored_allt entryR� t e_entryR� t dir_objt elmR� R� ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt _prepare_full_scans s>
4
c C@ s? d d l m } d d l m } | | j � | _ | | _ d S( s3
Initialize some Salt environment.
i ( t
minion_config( t coreN( t salt.configR� t salt.grainsR� t DEFAULT_MINION_CONFIG_PATHt __opts__R5 ( R R� t g_core( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt _init_env� s c C@ s= | j � | j | j | j � � � | j | j � � d S( s0
Take a snapshot of the system.
N( R� Ri R^ R; R� R� ( R Rp ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt snapshot� s
i c K@ s� | | j k r' t d j | � � � n t | j � rE t d � � n | j | � t j d j | t t j
j | j � t j
j | j � | � � d S( s0
Take a snapshot of the system.
s Unknown mode: '{0}'s Inspection already in progress.s. nice -{0} python {1} {2} {3} {4} & > /dev/nullN(
t MODER R� t is_alivet pidfileR
R� R+ t systemt __file__Rc t dirnamet dbfile( R Rp t priorityR� ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt request_snapshot� s
t qcow2c C@ s1 t t _ t j d t d | � j | � j d � S( sk
Export description for Kiwi.
:param local:
:param path:
:return:
t grainsR� t something( t __salt__R t KiwiExportert
__grains__t loadt export( R t descriptiont localRc R� ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyR� � s c C@ s> t d k r. d } t j | � t | � � n t d � � d S( sj
Build an image using Kiwi.
:param format:
:param path:
:return:
sX Unable to build the image due to the missing dependencies: Kiwi module is not available.s Build is not yet implementedN( t kiwiRA t logt errorR
( R R� Rc t msg( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt build� s
N( t __name__t
__module__R� R� R� R� R� RA R R# R$ R0 R; R8 R9 R^ Ri R� R� R� R� R� R� R� R� R� R� R� R� R� R� ( ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyR . s:
+ c C@ s� yH t j j j | � �) } t j t | j � j � � d � Wd QXt SWnK t
k
r� } t j | t j � r� t j
j | � r� t j | � n t SXd S( s&
Check if PID is still alive.
i N( R= R> R} t fopenR+ t killt intt readRD R" t ExceptionR� t W_OKRc R� t unlinkR� ( R� t fp_t ex( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyR� � s ('c C@ s t | | � j � j | � d S( s
Main analyzer routine.
N( R R$ R� ( R� R� Rp ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt main� s t __main__i s, This module is not intended to use directly!t filei t ws {0}
(? t
__future__R R R+ t syst
subprocessR R R t loggingt" salt.modules.inspectlib.exceptionsR t salt.modules.inspectlibR R t salt.modules.inspectlib.entitiesR R R
R R t salt.utils.cryptR= t salt.utils.filest salt.utils.fsutilst salt.utils.patht salt.utils.stringutilst salt.exceptionsR
R� t ImportErrorRA t getLoggerR� R� R R� R� t lent argvt printR' t exitR� R� Rp t forkR> t cryptt
reinit_cryptot OSErrorR� t setsidt umaskt pidR} R� Rc R� t PID_FILER� t writeR� ( ( ( sE /usr/lib/python2.7/site-packages/salt/modules/inspectlib/collector.pyt <module> sd (
� �
-
Mini Shell