Current File : //opt/alt/python37/lib/python3.7/site-packages/clcommon/__pycache__/utils.cpython-37.pyc
B
`�1b�m � @ s( d dl mZ d dl mZ d dl mZ d dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z
d dlZd dlmZmZmZmZmZmZ d dlmZ d dlmZ d dlmZm Z d dl Z d Z d
Z d Z G d d
� d
e!�Z"dd� Z#dodd�Z$dd� Z%dd� Z&dpdd�Z'dd� Z(d d � Z)d d � Z*d d!� Z+dqd"d#�Z,d$d%� Z-ee. d&�d'd(�Z/d)d*� Z0e1d&�d+d,�Z2ee. d&�d-d.�Z3edd/�ee d&�d0d1��Z4e5d2�d3d4�Z6e.e1d5�d6d7�Z7d8d9� Z8e1d&�d:d;�Z9d<d=� Z:d>d?� Z;d@dA� Z<dBdC� Z=dDdE� Z>ee1dF�dGdH�Z?e5e1dI�dJdK�Z@eee1 dL�dMdN�ZAe5d&�dOdP�ZBe.ee1e1f dQ�dRdS�ZCe.ee1e1f dQ�dTdU�ZDe.ee1e1f dQ�dVdW�ZEe.e1e1dX�dYdZ�ZFeejejGf e.d[�d\d]�ZHdreeee5ee5ef d^�d_d`�ZIe.d&�dadb�ZJe1d&�dcdd�ZKe.ee5 de�dfdg�ZLe.dh�didj�ZMe.dh�dkdl�ZNdmdn� ZOdS )s� )�print_function)�absolute_import)�divisionN)�Dict�AnyStr�Optional�Tuple�Union�List)�etree)� lru_cache)� ConfigParser�Errorz/etc/sysconfig/rhn/systemid)ZMonZTueZWedZThuZFriZSatZSunz /opt/cloudlinux/litespeed_statusc @ s e Zd Zdd� ZdS )�ExternalProgramFailedc C s t �| |� d S )N)� Exception�__init__)�self�message� r �?/opt/alt/python37/lib/python3.7/site-packages/clcommon/utils.pyr % s z ExternalProgramFailed.__init__N)�__name__�
__module__� __qualname__r r r r r r $ s r c C sp d}t j�|�r4yt �|�}W n tk
r2 Y nX | |krlyt �|� W n tk
r^ Y nX t �| |� dS )a
Create symlink link_path -> link_value if it does not exist or
points to different location
:param link_value: path that symlink should point to (symlink value)
:type link_value: str
:param link_path: path where to create symlink
:type link_path: str
N)�os�path�islink�readlink�OSError�unlink�symlink)Z
link_valueZ link_pathZlink_tor r r �create_symlink) s r c C s6 g }t j�| �r2t| d|d��}|�� }W dQ R X |S )a
Read file and return file's lines
errors param may be passed to define how handle
unicode errors, errors=None is default value of open()
:param path: path to file
:param unicode_errors_handle: how to handle unicode errors
:return: list of file's lines
�r)�errorsN)r r �isfile�open� readlines)r Zunicode_errors_handle�content�fr r r �get_file_lines@ s
r( c C s$ t | |��}|�|� W dQ R X dS )z�
Write lines to file
:param content: list of lines for writing to file
:param path: path to file
:param mode: open mode
:return: None
N)r$ �
writelines)r r& �moder' r r r �write_file_linesQ s r+ c C s( t j�| �s$td| f � t�d� dS )z6
Checks if command is present and exits if no
zNo such command (%s)� N)r r �exists�print�sys�exit)Zcmdnamer r r �
check_command^ s r1 FTc
C s� d� | �}y>|rtjntj}|r&tjntj}tj| |tj|d||d�}W n6 tk
r~ } ztd|t| �f ��W dd} ~ X Y nX |s�|� � \}
} n|� |�\}
} |r�|j
|
| fS |j
dkr�|s�td| ��nt| p�d||
f ��|
S ) a[
Runs external process and returns output
:param cmd: command and arguments as a list
:param env_data: environment data for process
:param return_full_output: if true, returns (ret_code, std_out, std_err)
@return: process stdout if is_full_output==False
else - cortege (ret_code, std_out, std_err) without any checking
� T)�stdin�stdout�stderrZ close_fds�env�textz%s. Can not run command: %sNr zError during command: %sz output of the command: %s
%s) �join�
subprocess�PIPEZSTDOUT�DEVNULL�Popenr r �str� communicate�
returncode) �cmdZenv_dataZreturn_full_outputZstd_inZconvert_to_strZcmd_lineZ std_err_objZ stdin_arg�outputZoserr�std_out�std_errr r r � run_commandg s0
&
rD c C sJ t � }|�| � |�|� tj|tjdd�}|�� \}}|j}||�� fS )z�
Executes supplied utility with supplied parameters
:param util_path: Executable file to run path
:param params: utility parameters
:return: Cortege (ret_code, utility_stdout)
T)r4 r7 ) �list�append�extendr9 r< r: r> r? �strip)Z util_pathZparams�args�processr4 �_Zretcoder r r � exec_utility� s
rL c s: t | �}� fdd�|D �}t|�t|�k}t| |d� |S )a
Delete line from file. Return True when line(s) have been deleted, False otherwise (specified line is not found)
:param path: path to file
:type path: string
:param line: line to delete without EOL ('
')
:type line: string
:rtype bool
c s g | ]}� |� d �kr|�qS )�
)�rstrip)�.0�item)�liner r �
<listcomp>� s z)delete_line_from_file.<locals>.<listcomp>zw+)r( �lenr+ )r rQ Z
file_linesZout_file_lines�foundr )rQ r �delete_line_from_file� s
rU c C sn t �� } | dkrjy,t�d�j}|t �� ks6t �� |kr:dS W n tk
rP Y nX tdt j
d� t � d� dS )zH
Check whether current user is effectively root and exit if not
r Z
clsupergidNz'Error: root privileges required. Abort.)�file���) r �geteuid�grpZgetgrnam�gr_gid� getgroups�getegid�KeyErrorr. r/ r5 r0 )ZeuidrZ r r r �is_root_or_exit� s r^ c C s t j�d�S )zV
Detects is EA4 installed
:return: True - EA4 present; False - EA4 absent
z/etc/cpanel/ea4/is_ea4)r r r# r r r r �is_ea4� s r_ c c s� |dkrt |�}d}|s<| �d�s0|s0d�| �} t�| �}nd}xh|D ]`}|rv|rf|�| �dkrf|}q�|�| �r�|}n|�|�r�|}|r�|dk r�|V n
|dk r�P d}qFW |dk r�|V dS )a
Grep pattern in file
:param multiple_search: if True - search all match,
False - search first match
:param pattern: pattern for search
:param path: path to file
:param data_from_file: read data from file for parsing
:param fixed_string: if True - search only fixed string,
False - search by regexp
:param match_any_position: if True - search any match position,
False - search only from string begin
:return: Generator with matched strings
N�^z^{}rW )r( �
startswith�format�re�compile�find�search) �patternr � fixed_stringZmatch_any_position�multiple_search�data_from_file�resultZ pattern_comprQ r r r �grep� s.
rl c C s
t �t�S )z-
:rtype: lxml.etree._ElementTree obj
)r �parse�RHN_SYSTEMID_FILEr r r r �_parse_systemid_file� s ro )�returnc C sb y>t � }x2|�d�D ]$}|�d�j| kr|�d�d jS qW W n ttttjfk
r\ dS X dS )z`
find a member in xml by name and return value
:type name: str
:rtype: str|None
�member�name�valuer N) ro �iterre r7 �IOError�
IndexErrorr] r Z
ParseError)rr Zrhn_systemid_xmlrq r r r �get_rhn_systemid_value� s rw c
C s� dd| d�}t j�| �s |S yLtjd| gdddd��� }tjd| gdddd��� }d|d < ||d
< W n< tjtfk
r� } zd | |f }||d
< W d d }~X Y nX |S )
aZ
This function is written for detect file system in which file is stored on.
E.g., the file can be stored in NFS and this can affect the normal operation of the file.
We want to receive information about FS in emergency situations during reading or writing
:param file_path: path to file, for which we want to detect file system
:return: dict, which contains two keys:
key 'success' can be equals to False if we got error or True if we got normal result
key 'details' can contais error string if key 'success' is False or result if key 'success' is True
FzFile "%s" isn't exists)�success�detailsz%df %s | tail -n 1 | awk '{print $NF}'Tz /bin/bash)�shell�
executabler7 zmount | grep "on %s type"rx ry z6We can't get file system for file "%s". Exception "%s"N)r r r- r9 � check_outputrH �CalledProcessErrorr )Z file_pathrk Z mount_point�data�errr r r �*get_file_system_in_which_file_is_stored_on
s. r� c C sD t ddd�} y| �d� | �dd�}W n tk
r> d}Y nX |S )z�
Checks if testing is enabled in /etc/yum.repos.d/cloudlinux.repo config
:return: bool value if testing enabled or not
NF)Z
interpolation�strictz /etc/yum.repos.d/cloudlinux.repozcloudlinux-updates-testingZenabled)r
�readZ
getbooleanr )�parserZresr r r �is_testing_enabled_repo6 s
r� c C s� ddl m} | � rdS dddddd�}t�� }x |D ]}||kr4|| S q4W td �}d
}|d
krfd
}n(d |krtd}nd |kr�d}n d
|kr�d}|S )z�
Returns cl version taking into account release version
E.g: release = 2.6.32-896.16.1.lve1.4.54.el6.x86_64
el6 = cl6
el8 = cl8
........
ubuntu+cl_extesions = cl8
:return appropriate version string
r, )� is_ubuntu�cl8�cl6Zcl6hZcl7Zcl7h)zel6.zel6h.zel7.zel7h.zel8.Z
os_releaseN�6�7�8)Z
lib.cleditionr� �platform�releaserw )r� Zcheck_vals_decoderr� Z check_valZret_valr r r �get_cl_versionE s.
r� )�maxsizec C sL yt dg��� } W n tjtfk
r, dS X | dkrD| �d�d S dS dS )a�
Returns virtualization type on current system.
It is reachable via virt-what utility.
E.g.: 'kvm', 'bhyve', 'openvz', 'qemu'
All acceptable outputs are listed here:
https://people.redhat.com/~rjones/virt-what/virt-what.txt
Output will be returned with at least two rows
Sample:
> kvm
>
Furthermore, there is a possibility for multiple text rows
Sample:
> xen
> xen-domU
That's why, the result will be taken from a first row.
If the output is empty, and there were no errors, the machine
is either non-virtual, or virt-what tool isn't familiar with it's
hypervisor. But the list of supported hypervisors and containers
covers all popular VMs types.
:return: virt_type - Optional[AnyStr]
- appropriate virtualization type string,
- 'physical' if there is no virtualization,
- None if there was an error
z/usr/sbin/virt-whatN� rM r Zphysical)rD rH r9 r} �FileNotFoundError�split)Zvirt_what_outputr r r �
get_virt_typeh s r� )�pidc C s. yt �| d� W n tk
r$ dS X dS dS )z�
Checks for a process existence by os.kill command
If os.kill will be used as os.kill(pid, 0), it will
just check for a presence of such PID
And if such pid can't be reached with kill method,
there will be raised OSError
r FTN)r �killr )r� r r r � check_pid� s
r� )�
pid_file_pathrp c C sN t j�| �rJt| ��0}ytt|�� �� ��S tk
r> Y nX W dQ R X dS )z�Check if process running using pid file
Arguments:
pid_file_path: path to the pid file of service
Returns:
bool: True or False
NF) r r r# r$ r� �intr� rH �
ValueError)r� r' r r r �is_process_running� s
r� c C sT t �� dkrd} t| �S t j�t�s(dS tt��}|�� �� }W dQ R X |dkS dS )z�
Detects that server works under Litespeed.
Note: be careful when modifying this method.
It is used in X-Ray, ask @dkavchuk or someone else from C-Projects team
for details
r z/tmp/lshttpd/lshttpd.pidFN�0) r rX r� r r- �LITESPEED_STATUS_FOR_USERSr$ r� rH )r� r' �statusr r r �is_litespeed_running� s
r� c C s d} t | �S )zHCheck if nginx is running
Returns:
Bool: True or False
z/run/nginx.pid)r� )r� r r r �is_nginx_running� s r� c C s t � r
dS dS )zU
Return proper passenger package according to apache version
:rtype: str
z ea-apache24-mod-alt-passengerzalt-mod-passenger)r_ r r r r �get_passenger_package_name� s r� c C s, yt dd| g� W n tk
r& dS X dS )z_
Checks that package installed on server
:param package_name: str
:rtype: bool
Zrpmz-qFT)rD r )Z package_namer r r �is_package_installed� s
r� c
C sz d} yFt jddgddt jt jdd�}|�� \}}|jdkrHd ||| f S W n* ttfk
rt } zt|�S d
}~X Y nX d
S ) z�
Check RPM DB as described in https://access.redhat.com/articles/3763
:return: None - No RPM DB errors
string_message - Error description
zjhttps://cloudlinux.zendesk.com/hc/en-us/articles/115004075294-Fix-rpmdb-Thread-died-in-Berkeley-DB-libraryz/usr/lib/rpm/rpmdb_verifyZPackagesFz /var/lib/rpmT)rz �cwdr4 r5 r7 r z&RPM DB check error: %s
%s. See doc: %sN)r9 r< r: r> r? r ru r= )Zdoc_linkZprcrB rC �er r r �get_rpm_db_errors� s
r� c C s t �� t_t �� t_dS )a(
Upon process exit, Sentry sometimes prints:
Sentry is attempting to send 1 pending error messages
Waiting up to 10 seconds
Press Ctrl-C to quit
This causes broken JSON in output.
See also this issue: https://github.com/getsentry/raven-python/issues/904
N)�io�StringIOr/ r4 r5 r r r r �!silence_stdout_until_process_exit s
r� c C s2 d|d@ }t �|�� t�| |� W dQ R X dS )a
Create directories with desired permissions
Changed in version 3.7: The mode argument no longer affects
the file permission bits of newly-created intermediate-level directories.
Because it we use umask while creating dirs
:param mod: desired permissions
i� N)�secureioZ set_umaskr �makedirs)r �modZ inverted_modr r r � mod_makedirs s
r� )�usernamerp c C s( yt �| � W n tk
r" dS X dS )z,
Check user existence in the system
FT)�pwd�getpwnamr] )r� r r r �is_user_present! s
r� )�uidrp c C s( yt �| � W n tk
r" dS X dS )z+
Check uid existence in the system
FT)r� �getpwuidr] )r� r r r �is_uid_present, s
r� )r rp c
C s: yt �| �j}W n tttfk
r* dS X t�|�}|S )z+
Check that file by path is socket
N)r �lstat�st_moder� ru r �stat�S_ISSOCK)r r* Z is_socketr r r �is_socket_file7 s
r� c C s: t jddddd�} | �� �� d }|dkr.dnt|�}|S )z?
Get number of system run level by command `runlevel`.
z/sbin/runlevelTz /bin/bash)rz r{ r7 r, �S)r9 r| rH r� r� )rA rk �levelr r r �get_system_runlevelD s r� )� service_namerp c C s� t � }y tjd| � �dddd�}W n tjtfk
r< dS X |�� �� }xJ|dd� D ]:}|�� �d�}|d d k}t|d
�}||krXd|fS qXW d S ) z�
Returns state of a service (present and enabled) for init.d system.
Returns False, False if a service doesn't exist
Returns True, False if a service exists and it's not enabled
Returns True, True if a service exists and it's enabled
z LANG=C /sbin/chkconfig --list Tz /bin/bash)rz r{ r7 )FFr, N�:Zonr )TF)r� r9 r| r} r� rH r� r� )r� ZrunlevelrA Z
state_infoZ is_activeZstate_runlevelr r r �#_get_service_state_on_init_d_systemW s&
r� c C s� y t jd| � d�ddd� dS t jtfk
r� y8t jdd| gt jt jd �}|�� |jd
krdd S d S W n t jtfk
r� d S X Y nX d
S )z�
Returns state of service (present and enabled) for systemd system
Returns False, False if a service doesn't exist
Returns True, False if a service exists and it's not enabled
Returns True, True if a service exists and it's enabled
z /usr/bin/systemctl is-enabled z
&> /dev/nullTz /bin/bash)rz r{ )TTz/usr/bin/systemctlr� )r5 r4 )r � )TF)FFN)r9 Z
check_callr} r� r< r; r> r? )r� �pr r r �$_get_service_state_on_systemd_system~ s0
r� c C s0 dt � krt| d�\}}nt| d�\}}||fS )zc
Returns state of service (present and enabled)
:param service_name: name of a service
r� )r� )r� r� r� )r� Z
is_presentZ
is_enabledr r r � service_is_enabled_and_present� s
r� )�process_file_path� strict_matchrp c C s~ t j�| �s td| � d���x\t�dg�D ]L}y.|s@| |�� ksV|rZ| d�|�� �krZdS W q* tjk
rt w*Y q*X q*W dS )a�
Check that a file in path is running.
You can get false-postive if parameter `strict_match` == False, process is
not running, but someone on server open file by path `process_file_path`
in an editor
:param process_file_path: path to a file which is run
:param strict_match: we use parameter `process_file_path` as full cmd line
with args for comparing if `strict_match` == True.
:return: True if it's running, False - is not,
zProcess file in path "z" does not exist�cmdliner2 TF) r r r- r� �psutilZ process_iterr� r8 Z
NoSuchProcess)r� r� rJ r r r �process_is_running� s r� )�dtrp c C s0 t | tjtjf�s$tdt| �� ���t| �� S )z�
Getting string representation of weekday from datetime.datetime or datetime.date.
Returns shortened version of weekday from WEEK_DAYS.
zFRequire object of type datetime.datetime or datetime.date, but passed )�
isinstance�datetime�date� TypeError�type� WEEK_DAYSZweekday)r� r r r � get_weekday� s r� )� config_path�apache_module_name�
param_name�defaultrp c
s� d|� d�}g }t | �}d}x>|D ]6}|�� }||kr<d}q"|rJ|dkrJP |r"|�|� q"W tt� dd|d��} � fdd�| D �}
|
s�|d k r�|d
fS |
s�|d kr�d d |� d
| � �fS |
d �d�} t| d �} | d
fS )a
Helper to parse httpd config for details about mpm module used
:param config_path: path for configuration file with modules
:param apache_module_name: expected mpm module. Can be `event`,
`worker`, `prefork`
:param param_name: name of parameter to find
:param default: default value for parameter, if there won't be record
:return: tuple with param value and text result of operation
Example of config file content:
<IfModule mpm_prefork_module>
.................
MaxRequestWorkers 450
</IfModule>
--
<IfModule mpm_worker_module>
.................
MaxRequestWorkers 300
</IfModule>
--
<IfModule mpm_event_module>
.................
MaxRequestWorkers 2048
</IfModule>
z<IfModule mpm_z_module>FTz </IfModule>)ri rh rj c s" g | ]}|� � �� �r|� � �qS r )rH ra )rO Z directive)r� r r rR s z/find_module_param_in_config.<locals>.<listcomp>NZOKr z.MaxRequestWorkers directive not found for mpm_z_module module in rW r2 )r( rH rF rE rl r� r� )
r� r� r� r� Zif_module_lineZ
section_linesZ mpm_linesZis_section_foundrQ Zgrep_result_listZmrw_list�partsZmax_request_workersr )r� r �find_module_param_in_config� s0
r� c
C sj d} t j�| �sdS y6t| d��}|�� �� }W dQ R X |�dd�\}}W n ttt fk
rd dS X |S )zp
Return kmodlve module's version.
Content of '/sys/module/kmodlve/version' looks like '2.0-30.el8'.
z/sys/module/kmodlve/versionr� r! N�.r, )
r r r# r$ r� rH �rsplitr ru r� )Zkmodlve_module_file_pathr' �moduleZmodule_versionrK r r r �get_kmodlve_module_version( s r� c C s8 ddi} t � }|| krdS | | }t� }||kr4dS dS )a
Find out if system has version of the kernel
(according to kmodlve module's version)
where fs.proc_can_see_other_uid and hidepid options are synchronized.
They are only synchronized if kmodlve module's version
is equal to version in synced_kmodlve_versions.
r� z2.0-30FT)r� r� )Zsynced_kmodlve_versionsZ
cl_versionZsynced_versionZcurrent_versionr r r �)proc_can_see_other_uid_and_hidepid_synced9 s r� )� pid_filenamerp c
C sZ y6t | d��"}t|�� �� �}t�|d� W dQ R X W n tttfk
rT d}Y nX |S )z�
Detrmines working daemon process pid
:param pid_filename: PID filename
:return: PID from file or None if error (file not found, etc)
r! r N) r$ r� r� rH r r� r ru r� )r� �pfr� r r r �get_process_pidL s
r� )r� c C s* t | d��}|�t�� � � W dQ R X dS )z
Writes pid file
zw+N)r$ �writer �getpid)r� r� r r r �write_pid_file\ s r� c C s, yt �| � W n ttfk
r& Y nX dS )z
Remove PID file
N)r �remover ru )r� r r r �remove_pid_filed s r� c s � �fdd�}|S )a
Set user's real uid and gid to specified ones.
Checking equality of real and effective uids is needed
because this function may be used by root
with effective uid dropped to user's uid.
In that case it is needed to set effective uid back to 0 first.
c s: t �� } t �� }| |kr"t �| � t �� � t ��� d S )N)r �getuidrX �seteuid�setgid�setuid)Zreal_uidZeff_uid)�gidr� r r �funcw s
zdemote.<locals>.funcr )r� r� r� r )r� r� r �demoten s
r� )N)NFNT)NFTFN)N)PZ
__future__r r r r� r� rc r� r r/ rY r9 r� r� r� �typingr r r r r r
Zlxmlr � functoolsr Z configparserr
r r� rn r� r� r r r r( r+ r1 rD rL rU r^ r_ rl ro r= rw r� �boolr� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r �<module> s�
%
+,#&
&- >
Mini Shell