Current File : //opt/alt/python37/lib/python3.7/site-packages/lvestats/lib/commons/__pycache__/func.cpython-37.pyc
B
��1b'; � @ sn d dl mZ d dlmZmZ d dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl Z d dl m
Z
mZ d dlmZ d dlmZmZ d dlmZ d dlmZ d d lmZ d d
lmZ d d l m Z m Z m Z d d l m!Z!m"Z" d d
l#m$Z% d dl&m'Z( d dl)m*Z* d dl+m,Z,m-Z- da.dZ/dZ0dZ1dd� Z2dd� Z3dd� Z4d^dd �Z5G d d � d e6�Z7e/fd d �Z8d_d!d"�Z9d#d$� Z:d%d&� Z;G d'd(� d(e�Z<d)d*� Z=d+d,� Z>d`d.d/�Z?dad0d1�Z@d2d3� ZAd4d5� ZBdbd7d8�ZCdcd9d:�ZDd;d<� ZEddd=d>�ZFded?d@�ZGdfdAdB�ZHdgdCdD�ZIdEdF� ZJdGdH� ZKdIdJ� ZLG dKdL� dLeM�ZNdMdN� ZOdOdP� ZPdQdR� ZQdSdT� ZRdUdV� ZSdhdWdX�ZTdYdZ� ZUeVeWd[�d\d]�ZXdS )i� )�absolute_import)�range�mapN)� gethostname�error)�urlparse)�minidom� DOMException)�
ExpatError)�FormattedException)�cpapi)� LIMIT_LVP_ID)�CPAPIExternalProgramFailed� NotSupported� ParsingError)�
MySQLGovernor�MySQLGovException)�engine)�mkdir)�uid_max)�get_max_lve_id� USER_NOTIFICATIONS_OFF_MARKERz/proc/lve/listz"/var/run/mysql-governor-config.xmlz!/etc/container/mysql-governor.xmlc C s t dkrt� a t S )z'
Get current maximum of LVE ID
N)�
MAX_LVE_IDr � r r �J/opt/alt/python37/lib/python3.7/site-packages/lvestats/lib/commons/func.py�get_current_max_lve_id& s r c C s x|r|| | } }qW | S )Nr )�a�br r r �gcd0 s r c G s" t � }x| D ]}|�|� q W |S )z�
>>> merge_dicts({1: 2}, {3: 4})
{1: 2, 3: 4}
>>> merge_dicts({1: '1', 2: '2'}, {2: 'two', 3: 'three'})
{1: '1', 2: 'two', 3: 'three'}
)�dict�update)ZdictsZ
dic_mergedZdic_r r r � merge_dicts7 s
r! �� c c s0 x*t dt| �|�D ]}| ||| � V qW dS )zS
:type chunk_length: int
:type _list: list
:rtype: Generator[list]
r N)r �len)Z_listZ chunk_length�ir r r �
get_chunksD s r% c @ s e Zd Zddd�ZdS )�LVEVersionError� c C s t �| d�|�� d S )Nz Can't detect LVE version; {})� Exception�__init__�format)�self�messager r r r) O s zLVEVersionError.__init__N)r' )�__name__�
__module__� __qualname__r) r r r r r& N s r& c C s� ybt | d��N}|�d�}yt|�d�d �S tttfk
rT td�|| ���Y nX W dQ R X W n. t t
fk
r� } z t|��W dd}~X Y nX dS )z0
:param str _lve_file:
:return int:
�r� �:r z$error parsing line '{}' from file {}N) �open�read�int�split� TypeError�
IndexError�
ValueErrorr& r* �OSError�IOError)Z _lve_fileZlve_file_streamZ lve_ver_str�er r r �get_lve_versionS s
$r= c C s8 | pt � } y | �� }W n tk
r. d}Y nX |p6dS )a
Parse governor config file and return governor mode
:type governor: MySQLGovernor
:rtype: str
:return:
if file exists and correct: "on", "single", "off", "abusers" or "all"
if governor is not installed or error occurs: "none"
NZnone)r �get_governor_moder )ZgovernorZ
governor_moder r r r> c s
r> c C s* t j�d�sdS t j�t�r"t} nt} | S )z
:rtype: str|None
z/usr/sbin/db_governorN)�os�path�exists�GOVERNOR_CONFIG�GOVERNOR_CONFIG_OLD)�governor_config_pathr r r �get_governor_config_patht s rE c
C s� t � }|dkrdS ybt�|�}xR|�d�D ]D}y(|jd j| krT|jd j�� dkS W q* tk
rl w*Y q*X q*W W n tt t
fk
r� dS X dS )z3
:rtype: bool|None
:type username: str
N�user�name�mode�ignoreF) rE r �parseZgetElementsByTagNameZ
attributes�value�lower�KeyErrorr; r
r )�usernamerD Zgovernor_configrF r r r � get_governor_ignore_for_user� s
rO c @ s e Zd ZdS )�DomainExceptionN)r- r. r/ r r r r rP � s rP c C s t � } | �� S )z/
:rtype: (str, MySQLGovException|None)
)r �get_governor_status)Zmysql_governorr r r rQ � s rQ c
C s, y
t �| �S tttfk
r& t� S X dS )z�
Get dict[user, domain], empty if cannot obtain.
:param reseller_name: reseller's name
:rtype: dict[str, str|None]
N)r Zreseller_domainsr r �AttributeErrorr )Z
reseller_namer r r �get_reseller_domains� s
rS Tc
C s` yt �| |�}W nF tttt jjt jjtfk
rV } z|rFt t
|���g S d}~X Y nX |S dS )z�
Get list of aliases for specified user's domain, or empty list.
:type username: str
:type domain: str
:type raise_exception: bool
:raises DomainException: if cannot obtain domains
:rtype: list[str]|None
N) r Z useraliasesrM r; r7 �cpapiexceptionsr � NoPanelUserr rP �str)rN �domain�raise_exceptionZ user_aliasesr< r r r � get_aliases� s rY c
C sh yt �| �}W nF tttt jjt jjtfk
rT } z|rDt t
|���g S d}~X Y nX dd� |D �S dS )z�
Get list of domains for specified user, or None.
:type username: str
:type raise_exception: bool
:raises DomainException: if cannot obtain domains
:rtype: list[str]|None
Nc S s g | ] }|d �qS )r r )�.0rW r r r �
<listcomp>� s z get_domains.<locals>.<listcomp>) r Z userdomainsrM r; r7 rT r rU r rP rV )rN rX � user_domainsr< r r r � get_domains� s r] c C s t | �}t|�dkrdS |d S )z�
:param username: user name string
:return:
if not supported in CP, or domain name is not set: None
if we can find it: domain name string
:rtype: str|None
:type username: str
r N)r] r# )rN r\ r r r �
get_domain� s r^ c C s, | � � }|�d� |�d| � |�� dS )zP
Create database
:param db_engine:
:param db_name:
:return:
�COMMITzCREATE DATABASE %sN)�connect�execute�close)� db_engine�db_name�connr r r �
init_database� s
rf �
tmp_unittest_c C s& |t t�� �dd� }t| |� |S )z�
Create database with random prefix in name
Using for unittests
:param db_engine:
:param str prefix:
:return str:
r � )rV �uuidZuuid4rf )rc �prefixrd r r r �init_database_rnd� s
rk c C s4 t | �}|jdd� }|�r0|jdkr4t�|� dS t�|jd |j �}|�� }|r�d|j kr�|�
d| � |�
d�� � d d }t t
t|�d
���d d gk r�|�
d
| � n|�
d| � nL|�r d|j k�r |�
d�}x.|� � D ]"}|d |kr�|�
d|d � q�W |�
d� |�
d| � |�� dS dS )z�
Drop database (support MySQL and PostgresSQL)
:param uri:
:param force: kill all connection and locked session before drop database
:return:
� NZsqliteTz://Z
postgresqlzBUPDATE pg_database SET datallowconn = 'false' where datname = '%s'zSHOW server_versionr �.� � zOSELECT pg_terminate_backend(procpid) FROM pg_stat_activity WHERE datname = '%s'zKSELECT pg_terminate_backend(pid) FROM pg_stat_activity WHERE datname = '%s'ZmysqlzSHOW PROCESSLIST� zKILL %sr_ zDROP DATABASE %s)r r@ �schemer? �unlink�sqlalchemy_engineZ
create_engineZnetlocr` rG ra Zfetchall�listr r5 r6 rb ) Zuri�forceZuri_rd rc re Zpg_verZcursorZfetchedr r r �
drop_database s.
rv c C s0 d} t j�| �sdS t| ��
}|�� S Q R X d S )Nz/etc/redhat-releaser' )r? r@ rA r3 �readline)r@ Z release_filer r r �
_release_line' s
rx c C s� | dkrt � } | �� }d|kr.|�d�d }nt� S || }t� }x:|�d�D ],}y|�t|�� W qN tk
rx Y qNX qNW |S )a�
Return CloudLinux version as list [major, minor]
or [] if can't obtain version
:param str release_line:
:return list: splited version
>>> cl_ver('CloudLinux Server release 5.11 (Vladislav Volkov)')
[5, 11]
>>> cl_ver('CloudLinux Server release 6.8 (Oleg Makarov)')
[6, 8]
>>> cl_ver('CloudLinux release 7.2 (Valeri Kubasov)')
[7, 2]
>>> cl_ver('Incorrect release line')
[]
N�releaserl rm )rx r6 �indexrt �appendr5 r9 )Z release_lineZrelease_line_splitedZver_indxZver_strZver�sr r r �cl_ver/ s
r} c s t jdd�}� fdd�|D �S )N)�cplogin�reseller)Zkeylsc s g | ]\}}� |kr|�qS r r )rZ r~ Z reseller_)r r r r[ Q s z#_reseller_users.<locals>.<listcomp>)r Zcpinfo)r Zcplogin_reseller_r )r r �_reseller_usersO s r� c C s4 t tdt�}y|| �S tjjk
r. t� S X d S )N�reseller_users)�getattrr r� rT ZCPAPIExceptionrt )r r� r r r �get_users_for_resellerT s
r� c C s2 t | d�� t�| |� W dQ R X t�| d� dS )z�
The equivalent console touch command
:param str fname: path to file
:param None| tuple times: (atime, mtime) if None atime and mtime are default
r Ni� )r3 r? �utime�chmod)�fname�timesr r r �touch\ s r� c s � fdd�}t | |� dS )z2
:type data: list
:type filename: str
c s t �| �}|�� � dS )z:type csv_file: fileN)�csv�writerZ writerows)Zcsv_filer� )�datar r � csv_writel s
z#atomic_write_csv.<locals>.csv_writeN)�
_atomic_write)�filenamer� r� r )r� r �atomic_write_csvg s r� c s � fdd�}t | |� dS )z1
:type data: str
:type filename: str
c s | � � � dS )z:type str_file: fileN)�write)Zstr_file)r� r r � str_writex s z#atomic_write_str.<locals>.str_writeN)r� )r� r� r� r )r� r �atomic_write_strs s r� c C sH | d }t |d�}||� |�� t�|�� � |�� t�|| � dS )zF
:type write_function: (file) -> None
:type filename: str
z.tmp�wN)r3 �flushr? �fsync�filenorb �rename)r� Zwrite_functionZtemporary_filename�fr r r r� ~ s
r� c @ s2 e Zd Zd
dd�Zedd� �Zdd� Zdd � ZdS ) � reboot_lockNc C s> || _ |d krt�� | _n|| _t�| jtjtjB d�| _d S )Ni� ) �timeoutr� �_build_lock_filenamer� r? r3 �O_WRONLY�O_CREAT�lock)r+ r� r� r r r r) � s
zreboot_lock.__init__c C s& d} t j�| �st| � t j�| d�S )Nz/var/lvez
lvestats.lock)r? r@ rA �mkdir_p�join)Z
lock_file_dirr r r r� � s z reboot_lock._build_lock_filenamec
C s� t � � }x|yt�| jtjtjB � d S tk
r� } z>|jtjkrF� n*| j d k rft � � | | j krfd S t �
d� W d d }~X Y q
X q
W d S )Ng�������?) �time�fcntl�flockr� ZLOCK_EXZLOCK_NBr; �errnoZEAGAINr� �sleep)r+ Z
start_timer< r r r � __enter__� s zreboot_lock.__enter__c C s> t �| jt j� t�| j� yt�| j� W n Y nX d S )N)r� r� r� ZLOCK_UNr? rb rr r� )r+ �typerK � tracebackr r r �__exit__� s zreboot_lock.__exit__)NN)r- r. r/ r) � staticmethodr� r� r� r r r r r� � s
r� c C s t �t�� �d S )zJ
Get current user's username based on os.getuid()
:rtype: str
r )�pwd�getpwuidr? �getuidr r r r �getuser� s r� c C s( | t � kr | tkr | t � dfS | dfS )z�
Extract container_id and bool(is_reseller) from serialized value;
:type serialized_value: int
:rtype: tuple[int, bool]
TF)r r
)Zserialized_valuer r r �deserialize_lve_id� s r� c C s | t kr|dkrt� | S | S )zo
Get serialized int by lvp_id and lve_id
:type lvp_id: int
:type lve_id: int
:rtype: int
r )r
r )Zlve_idZlvp_idr r r �serialize_lve_id� s
r� c C s( y
t � } W n tk
r" d} Y nX | S )zf
Get hostname using socket.gethostname;
Return 'N/A' if some error happens;
:return:
zN/A)r � SocketError)Zhostnamer r r � get_hostname� s
r� c C s
| t � kS )zZ
Returns is user should be skipped due to set max uid
:param user_id: user id
)r )Zuser_idr r r �skip_user_by_maxuid� s r� c C sL t | dd�}g }|r<x&|D ] }t| |dd�}|r||7 }qW tt|| ��S )z4
Returns ALL user domains: main/sub/aliases
F)rX )r] rY rt �set)rN Zinclude_aliasesZdomains�aliasesrW �aliasr r r �get_all_user_domains� s
r� c C s | � d�r| dd� } | S )z+
Cuts extra prefix www from domain
zwww.� N)�
startswith)rW r r r �normalize_domain� s
r� )rF �returnc C s" t j�t j�t�| �jdt�� S )zL
Checks if notifications are turned off by user: marker file exists
z .lvestats)r? r@ rA r� r� �getpwnam�pw_dirr )rF r r r �user_should_be_notified s r� )r" )N)T)T)rg )T)N)N)N)N)T)YZ
__future__r �builtinsr r r� r? r� ri r� r� r� Z_socketr r r� Z urllib.parser Zxml.domr r Zxml.parsers.expatr
Zclcommonr r Zclcommon.clprocr
Z clcommon.cpapi.cpapiexceptionsr r r Z clcommon.libr r Z
sqlalchemyr rs Zclcommon.clcaptainr r� Zclcommon.clfuncr Zlvestats.lib.configr r r ZLVE_FILErB rC r r r! r% r( r& r= r> rE rO rP rQ rS rY r] r^ rf rk rv rx r} r� r� r� r� r� r� �objectr� r� r� r� r� r� r� r� rV �boolr� r r r r �<module> sx
&
)
Mini Shell