Current File : //usr/lib/python2.7/site-packages/salt/utils/process.pyc
�
���^c @� s� d Z d d l m Z m Z m Z m Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l
Z
d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z m! Z! d d l" m# Z# e j$ e% � Z& e' Z( y d d l) Z) e* Z( Wn e+ k
r�n Xy d d l, Z, e* Z- Wn e+ k
r�e' Z- n Xd � Z. e* d � Z/ d
� Z0 d � Z1 d � Z2 d
� Z3 d � Z4 d � Z5 d � Z6 d d � Z7 d � Z8 d e9 f d � � YZ: d e9 f d � � YZ; d e j< e f d � � YZ= d e= f d � � YZ> e j? d � � Z@ d e9 f d � � YZA d S( uE
Functions for daemonizing and otherwise modifying running processes
i ( t absolute_importt with_statementt print_functiont unicode_literalsN( t NewStyleClassMixIn( t six( t queuet range( t genc C� s( t r$ t j t j � d | � n d S( u4
Append "name" to the current process title
u N( t HAS_SETPROCTITLEt setproctitlet getproctitle( t name( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt appendproctitle8 s c C� s� d d l } yE t j � } | d k rP | j j j � t j | j j j � n Wn? t
k
r� } t j d | j
| � t j | j j j � n Xt j d � t j � t j d � yE t j � } | d k r� | j j j � t j | j j j � n Wn? t
k
r=} t j d | j
| � t j | j j j � n X| j j j � | r�| j j j d d � �^ } t | t j � t | t j � t | t j � t | d � t | d � t | d
� Wd QXn d S( u
Daemonize a process
i Nu fork #1 failed: %s (%s)u /i u fork #2 failed: %s (%s)u /dev/nullu r+i i ( t salt.utils.cryptt ost forkt utilst cryptt
reinit_cryptot _exitt defaultst exitcodest EX_OKt OSErrort logt errort errnot syst exitt
EX_GENERICt chdirt setsidt umaskt filest fopent dup2t stdint stdoutt stderr( t redirect_outt saltt pidt exct dev_null( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt daemonize@ s:
c C� s� t | t � r | } n8 y | j � } Wn% t j k
rO t j d | � d SXt | t � rh | } n8 y | j � } Wn% t j k
r� t j d | � d SXt j | | � d S( u�
Duplicate file descriptor fd to fd2, closing the latter first if necessary.
This method is similar to os.dup2 but ignores streams that do not have a
supported fileno method.
u! Unsupported operation on file: %rN( t
isinstancet intt filenot iot UnsupportedOperationR t warnR R$ ( t file1t file2t fno1t fno2( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR$ r s c C� sQ d t j d k r d S| j d t � s- d St j j d � rC d St t � d S( u}
Daemonize a module function process if multiprocessing is True and the
process is not being called by salt-call
u salt-calli Nu multiprocessingu win( R t argvt gett Truet platformt
startswithR- t False( t opts( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt daemonize_if� s c C� sG t j d | g d t j d t j �} | j � | j � } | d k S( Nu systemd-notifyR& R' i ( t
subprocesst Popent PIPEt communicatet poll( t actiont processt status( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt systemd_notify_call� s '
c C� s) y d d l } Wn� t k
r� t j j j d � r� t d � r� t j d � } | r� | j d � r{ d j
| d � } n yF t j t j t j
� } | j | � | j d j � � | j � Wn t j k
r� t d
� SXt Sn t SX| j j � r%y | j j d � SWq%t k
r!q%Xn d S( u6
Notify systemd that this process has started
i Nu systemd-notifyu --bootedu
NOTIFY_SOCKETu @u {0}i u READY=1u --ready( t systemd.daemont ImportErrorR) R t patht whichRH R t getenvR< t formatt sockett AF_UNIXt
SOCK_DGRAMt connectt sendallt encodet closeR R: R= t daemont bootedt notifyt SystemError( t systemdt
notify_sockett sock( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt notify_systemd� s.
c
C� s� t j j | � } t j j | � r; | r; t j | � n y> t j j j | d � � } | j t
t j � � � Wd QXWn t k
r� n Xt
j d | � t j j j � r� t Sd d l } y' | j | � } | d } | d } WnF t t f k
r.t j j d j | � � t j t j j j � n Xt j � | k rEd Sy t j | | | � Wnd t k
r�} d j | | � } t
j d | d
t �t j j d j | � � t j | j � n Xt
j d | | � d S(
u
Save the pidfile
u w+Nu Created pidfile: %si i i u? Failed to set the pid to user: {0}. The user is not available.
u8 Failed to set the ownership of PID file {0} to user {1}.u %s Traceback follows:t exc_infou {0}
u Chowned pidfile: %s to user: %s(! R RK t dirnamet isdirt makedirsR) R R" R# t writet strt getpidt IOErrorR t debugR; t
is_windowsR: t pwdt getpwnamt KeyErrort
IndexErrorR R' RN R R R t EX_NOUSERt getuidt chownR R (
t pidfilet usert pdirt ofileRh t pwnamt uidt gidt errt msg( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt set_pidfile� s@ #
c C� s t j j | � S( u5
Determine if a pidfile has been written out
( R RK t isfile( Ro ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt
check_pidfile� s c C� sc y> t j j j | � � } | j � j � } Wd QXt | � SWn t t t t
f k
r^ d SXd S( u5
Return the pid from a pidfile as an integer
Ni����( R) R R" R# t readt stripR/ R Re t TypeErrort
ValueError( Ro t pdfR* ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt get_pidfile� s i
c C� s� | s
d Sy� d } xu | j � r� | j � | d 7} t j d � | j � r | | k r t j d | j � t j | j t j
� q q WWn t t f k
r� n Xd S( u>
Generic method for cleaning up multiprocessing procs
Ni i g�������?u( Process did not die with terminate(): %s(
t is_alivet terminatet timet sleepR R R* R t killt signalt SIGKILLt AssertionErrort AttributeError( t proct
wait_for_killt waited( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt
clean_proc s
!c C� se t | t j � r! t | � } n t r4 t j | � Sy t j | d � t SWn t
k
r` t SXd S( u@
Use OS facilities to determine if a process is running
i N( R. R t string_typesR/ t
HAS_PSUTILt psutilt
pid_existsR R� R: R R= ( R* ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt
os_is_running s
t
ThreadPoolc B� s5 e Z d Z d d d � Z d d d � Z d � Z RS( u%
This is a very VERY basic threadpool implementation
This was made instead of using multiprocessing ThreadPool because
we want to set max queue size and we want to daemonize threads (neither
is exposed in the stdlib version).
Since there isn't much use for this class as of right now this implementation
Only supports daemonized threads and will *not* return results
TODO: if this is found to be more generally useful it would be nice to pull
in the majority of code from upstream or from http://bit.ly/1wTeJtM
i c C� s� | d k r t j � } n | | _ t j | � | _ g | _ xL t | � D]> } t j
d | j � } t | _
| j � | j j | � qL Wd S( Nt target( t Nonet multiprocessingt cpu_countt num_threadsR t Queuet
_job_queuet _workersR t threadingt Threadt _thread_targetR: RV t startt append( t selfR� t
queue_sizet _t thread( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt __init__; s
c C� sg | d k r g } n | d k r* i } n y! | j j | | | f � t SWn t j k
rb t SXd S( N( R� R� t
put_nowaitR: R t FullR= ( R� t funct argst kwargs( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt
fire_asyncR s c C� s� x� t r� yM y/ | j j d d � \ } } } | j j � Wn t j k
rT w n XWn t k
rl q n Xy' t j d | | | � | | | � Wq t k
r� } t j | d t �q Xq Wd S( Nt timeouti u4 ThreadPool executing func: %s with args=%s kwargs=%sR^ (
R: R� R9 t task_doneR t EmptyR� R Rf t Exception( R� R� R� R� Rv ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� ] s
N( t __name__t
__module__t __doc__R� R� R� R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� . s
t ProcessManagerc B� sq e Z d Z d
d d � Z d
d
d
d � Z d � Z d � Z d � Z e j
e d � � Z d � Z
d � Z RS( uD
A class which will manage processes that should be running
i c C� sm i | _ | | _ | j d k r3 | j j | _ n | | _ t j � | _ t j
t j � | _ t
| _ d S( N( t _process_mapR R� t __class__R� R� R Rd t _pidR� t getsignalt SIGTERMt _sigterm_handlerR: t _restart_processes( R� R R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� y s c C� sr | d k r g } n | d k r* i } n t j j j � rt t � t | � k rl t | t � rl t } n t } | rd | k r� t
| d � r� | j | d <q� t j j
j � | d <n d | k rt
| d � r� | j | d <q t j j
j � | d <qqn | d k r�t | t j � r?d j | j | j � } q�d j | j t j | j � d k rud j | j � n d | j � } n t t j � t | � k r�t | t j � r�| | | � } n$ t j d | d | d
| d | � } t | t � r"t t j t j � � | j! � Wd QXn
| j! � t j" d
| | j# � i | d 6| d 6| d 6| d 6| j$ | j# <| S( u�
Create a processes and args + kwargs
This will deterimine if it is a Process class, otherwise it assumes
it is a function
u log_queueu log_queue_levelu {0}.{1}u
{0}{1}.{2}u
<type 'type'>u .{0}u R� R� R� R Nu Started '%s' with pid %su tgtu argsu kwargsu Process(% R� R) R R; Rg t typet MultiprocessingProcesst
issubclassR: R= t hasattrt log_queueR t setupt! get_multiprocessing_logging_queuet log_queue_levelt! get_multiprocessing_logging_levelR. t typest FunctionTypeRN R� R� R t text_typeR� R� t Processt$ SignalHandlingMultiprocessingProcesst default_signalsR� t SIGINTR� R� Rf R* R� ( R� t tgtR� R� R t need_log_queueRF ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt add_process� sP --$
c C� s� | j t k r d St j d | j | d | | j | d j � | j | d j d � | j | j | d | j | d | j | d � | j | =d S( uY
Create new process (assuming this one is dead), then remove the old one
Nu7 Process %s (%s) died with exit status %s, restarting...u tgtu Processi u argsu kwargs( R� R= R t infoR� t exitcodet joinR� ( R� R* ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt restart_process� s c C� s
t | _ d S( N( R= R� ( R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt stop_restarting� s c C� s� t j j j � r. | t j t j f k r. d Sxu t j | j j
� � D][ } y t j | | � WqG t
k
r� } | j t j t j f k r� � n | j | =qG XqG Wd S( N( R) R R; Rg R� R� R� R t iterkeysR� t copyR R� R R t ESRCHt EACCES( R� t signal_R* R+ ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt send_signal_to_processes� s c c� s+ t j d � t | j � t j t j � t j k rN t j t j | j � n t j t j � t j k r� t j t j | j � n x� t
r&t j d � yK | j � | r� t
j d � Vn
t j d � t | j � d k r� Pn Wq� t k
r� Pq� t k
r"} | j t j k r � n Pq� Xq� Wd S( u:
Load and start all available api modules
u Process Manager starting!u Process manager iterationi
i N( R Rf R
R R� R� R� t SIG_DFLt
kill_childrenR� R: t tracet check_childrenR R� R� t lenR� R Re R t EINTR( R� t asynchronousR+ ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt run� s*
c C� si | j t k re xS t j | j � D]< \ } } | d j � s" t j d | � | j | � q" q" Wn d S( u)
Check the children once
u Processu Process restart of %sN( R� R: R t iteritemsR� R� R R� R� ( R� R* t mapping( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� & s
c
O� s� t j t j t j � t j t j t j � t j � | j k r� t | j � r] | j | � S| j d k r� t j
t j � | � Sd Sn t j j
j � r=t j � j d k r� d St j j j t j d � �i } x_ t j | j � D]K \ } } t j d d d d t j | � g d | d | �| d
j � q� WWd QXn� x� t j | j j � � D]� \ } } t j d | | d
� | r�y t j | | d � Wq�t k
r�q�Xn y | d
j � Wn4 t k
r�} | j! t! j" t! j# f k r�� q�n X| d
j$ � sVy | j | =Wq,t% k
r(q,XqVqVWt& j& � | j' } t j d
� x� | j r�t& j& � | k r�x� t j | j j � � D]i \ } } t j d | | d
� | d
j( d � | d
j$ � s�y | j | =Wq�t% k
r�q�Xq�q�WqSWd } x| d k r| d 8} x� t j | j j � � D]� \ } } | d
j$ � sty | j | =Wq0t% k
rmq0Xq0n t j d | | d
� y t j | t j) � Wq0t k
r�} t j* | � | d
j$ � s�y | j | =Wq�t% k
r�q�Xq�q0Xq0WqW| j r�| j+ d d � } | d k r�t j, d d j( d � | j j- � D� � � t j, d | � | d | d <| j. | | � St j/ d d j( d � | j j- � D� � � t j/ d � n d S( u*
Kill all of the children
Nu MainProcessu wbu taskkillu /Fu /Tu /PIDR& R' u Processu Terminating pid %s: %si u( Waiting to kill process manager childrenu Joining pid %s: %si i u Killing pid %s: %su retryi u4 Some processes failed to respect the KILL signal: %su ; c s� s+ | ]! \ } } d j | d | � Vq d S( u Process: {0} (Pid: {1})u ProcessN( RN ( t .0t kt v( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pys <genexpr>� s u kill_children retries left: %su* Failed to kill the following processes: %sc s� s+ | ]! \ } } d j | d | � Vq d S( u Process: {0} (Pid: {1})u ProcessN( RN ( R� R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pys <genexpr>� s uL Salt will either fail to terminate now or leave some zombie processes behind(0 R� R� t SIG_IGNR� R Rd R� t callableR� R� t default_int_handlerR) R R; Rg R� t current_processR R" R# t devnullR R� R� R@ t callR� R� R� R R� R� R R R� R� R� Rj R� R� R� R� t exceptionR9 R� t itemsR� t warning(
R� R� R� R� R* t p_mapR+ t end_timet kill_iterationst available_retries( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� 0 s�
%
%
%
N( R� R� R� R� R� R� R� R� R� R t coroutineR= R� R� R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� u s E '
R� c B� s5 e Z d � Z d � Z d � Z d � Z d � Z RS( c O� s? | j d d � } | j d d � } t t | � j | | � t j j j � rv t j | � | _
t j | � | _ n | | _ | j d k r� t j
j j � | _ n t j
j j | j � | | _ | j d k r� t j
j j � | _ n t j
j j | j � t j | g i f g | _ t j
j j g i f g | _ d S( Nu log_queueu log_queue_level( t popR� t superR� R� R) R R; Rg R� t _args_for_getstatet _kwargs_for_getstateR� R R� R� t! set_multiprocessing_logging_queueR� R� t! set_multiprocessing_logging_levelt _setup_process_loggingt _after_fork_methodst shutdown_multiprocessing_loggingt _finalize_methods( R� R� R� R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� � s c C� s@ | d } | d } | j | | � | j | _ | j | _ d S( Nu argsu kwargs( R� R� R� ( R� t stateR� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt __setstate__� s
c C� sp | j } | j } d | k r. | j | d <n d | k rJ | j | d <n i | d 6| d 6| j d 6| j d 6S( Nu log_queueu log_queue_levelu argsu kwargsu _after_fork_methodsu _finalize_methods( R� R� R� R� R� R� ( R� R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt __getstate__� s
c C� s t j j j | j � d S( N( R) R R� t setup_multiprocessing_loggingR� ( R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� � s c C� s� x' | j D] \ } } } | | | � q
Wz` y t t | � j � SWnB t k
rZ � n/ t k
r� } t j d | j d t �� n XWd x' | j
D] \ } } } | | | � q� WXd S( NuJ An un-handled exception from the multiprocessing process '%s' was caught:
R^ ( R� R� R� R� t
SystemExitR� R R R R: R� ( R� t methodR� R� R+ ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� � s
( R� R� R� R� R R� R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� � s
R� c B� s5 e Z d � Z d � Z d � Z d � Z d � Z RS( c O� sK t t | � j | | � t j � | _ | j j t j | g i f � d S( N( R� R� R� R� t Eventt _signal_handledR� R� t _setup_signals( R� R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� � s c C� s
| j j � S( N( R t is_set( R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt signal_handled s c C� s0 t j t j | j � t j t j | j � d S( N( R� R� t _handle_signalsR� ( R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR s c C� s� | j j � t j t j t j � t j t j t j � d j | j j � } | t j k rj | d 7} n | t j k r� | d 7} n | d 7} t j
| � t rqy� t j
t j � � } t | d � r:xm | j d t � D]V } y | j � r� | j � n Wq� t j k
r2t j d | j t j � � q� Xq� Wn Wqqt j k
rmt j d | j t j � � qqXn t j t j j j � d S( Nu {0} received a u SIGINTu SIGTERMu . Exitingu childrent recursiveuC Unable to kill child of process %d, it does not exist. My pid is %duE Unable to kill children of process %d, it does not exist.My pid is %d( R t setR� R� R� R� RN R� R� R Rf R� R� R� R Rd R� t childrenR: t
is_runningR� t
NoSuchProcessR3 R* R R R) R R R ( R� t signumt sigframeRw RF t child( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR s6
"c C� s3 t t j t j � � t t | � j � Wd QXd S( N( R� R� R� R� R� R� R� ( R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� , s ( R� R� R� R R R R� ( ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� � s
!c g� s� i } xg | D]_ } y& t j | � } t j | t j � Wn& t k
ra } t j d | | � q
X| | | <q
Wd Vx" | D] } t j | | | � q| W~ d S( Nu+ Failed to register signal for signum %d: %s( R� R� R� R~ R R� ( t signalst old_signalsR t saved_signalR+ ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� 1 s
t SubprocessListc B� s) e Z d d d � Z d � Z d � Z RS( c C� sL | d k r g | _ n | | _ | d k r? t j � | _ n | | _ d S( N( R� t processesR� t Lockt lock( R� R R ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR� O s c C� s7 | j �( | j j | � t j d | j � Wd QXd S( Nu Subprocess %s added( R R R� R Rf R ( R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt addY s
c C� sg | j �X xP | j D]E } | j � r, q n | j � | j j | � t j d | j � q WWd QXd S( Nu Subprocess %s cleaned up( R R R� R� t removeR Rf R ( R� R� ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt cleanup^ s
N( R� R� R� R� R R ( ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyR M s
(B R� t
__future__R R R R R� R1 R R R� R R� R� t loggingR� t
contextlibR@ R� t multiprocessing.utilRO t salt.defaults.exitcodesR) t salt.utils.filest salt.utils.patht salt.utils.platformt salt.log.setupt salt.log.mixinsR t salt.extR t salt.ext.six.movesR R t tornadoR t getLoggerR� R R= R� R� R: RJ R
R R
R- R$ R? RH R] Rx Rz R� R� R� t objectR� R� R� R� R� t contextmanagerR� R ( ( ( s6 /usr/lib/python2.7/site-packages/salt/utils/process.pyt <module> sp "
2 ! 3 G� : N5
Mini Shell