Current File : //opt/alt/python37/lib/python3.7/site-packages/lvestats/lib/__pycache__/dbengine.cpython-37.pyc
B
��1b$% � @ sX d dl mZ d dl mZ d dlZd dlZd dlmZmZ d dlm Z d dl
m Z d dl m
Z
mZ d dlmZ d d lmZmZ d d
lmZ d d lmZ d Zd
\ZZZeeegZdZ dd� Z dd� Z G dd� de�Z G dd� de�Z d1dd�Z!d2dd �Z"defd d �Z#d d � Z$d!d"� Z%d3d#d$�Z&d%d&� Z'd4d'd(�Z(d)d*� Z)d5d+d,�Z*d6d-d.�Z+d7d/d0�Z,dS )8� )�print_function)�absolute_importN)�delete�func)� Inspector)�
_ModuleMarker)�RelationshipProperty� sessionmaker)�FormattedException)�Base�history)� LVE_STATS_2_TABLENAME_PREFIX)�alembic_migratez/var/lve/lvestats2.db)ZmysqlZ
postgresqlZsqliteZshamanc C s> t �| �}t|�� �}dd� |D �| }tdd� t|�D ��S )z^
Checks if views exist.
:param sqlalchemy.engine.base.Engine engine:
:return:
c S s h | ] }t | �qS � )r
)�.0�nr r �F/opt/alt/python37/lib/python3.7/site-packages/lvestats/lib/dbengine.py� <setcomp>% s z4find_not_existing_tables_or_views.<locals>.<setcomp>c s s | ]}|� td �V qdS )� N)�replacer
)r �xr r r � <genexpr>& s z4find_not_existing_tables_or_views.<locals>.<genexpr>)r � from_engine�setZget_view_names�tuple)�engine�namesZ inspectorZexistingZ not_existingr r r �!find_not_existing_tables_or_views s
r c C s t tjj�} t| �� �S )zc
Used to call engine.create_all() without views that are described as Table()
:return:
)�dictr �metadata�tables�list�values)r r r r � get_list_of_tables_without_views) s r# c @ s e Zd ZdS )�MakeDbExceptionN)�__name__�
__module__� __qualname__r r r r r$ 2 s r$ c @ s e Zd ZdS )�DatabaseConfigErrorN)r% r& r' r r r r r( 6 s r( Tc C s� | � d�}|dkr$tdddid���|rJ|tkrJtd|d�t�d�d���| � d �}|tkrv|dkrvtddd id���|tkr�td
| � d t� }n d �||�}|S )
z�
Extract and validate database connection uri from config
:param dict cfg:
:param bool check_support:
:return str:
�db_typeNz#"%(config_variable)s" not in configZconfig_variable)�message�contextz}Incorrect database type %(database_type)s. You should only use %(database_types)s. The correct db_type for mariadb is "mysql"z", ")Z
database_typeZdatabase_types�connect_stringz:///Zsqlite_db_pathz {0}://{1})�getr( �SUPPORTED_DATABASES�join�SQLITE�DEFAULT_DB_PATH�format)�cfg�
check_supportr) r, Zurir r r � cfg_get_uri: s&
r5 Fc
C s� t �d�}yt| |d�}W nN tk
rh } z0d}dt|�i} |�|| � t|| d���W dd}~X Y nX |�d| d � |d kr�d
| kr�| d
}|r�d d � }
tj j
|d
|
d�} ntj j
|||d�} | S )z�
Create sqlalchemy database engine
:param dict cfg:
:param bool just_print:
:param bool debug:
:param pool_class:
:param bool check_support:
:return:
Zinit_db_engine)r4 z2Unable to configure database connection. %(error)s�error)r* r+ NzConnecting to database: %sr) F�debugc _ s t | � d S )N)�print)ZsqlZ multiparamsZparamsr r r �dump� s z make_db_engine.<locals>.dumpZmock)ZstrategyZexecutor)ZechoZ poolclass) �logging� getLoggerr5 r( �strr6 r$ �info�
sqlalchemyr Z
create_engine) r3 Z
just_printr7 Z
pool_classr4 �logr, �e�msgr+ r9 r r r r �make_db_engineh s$
rB c C sL t �d�}|r"d|_|�t �� � ddt� t� d�}t�| �}|�� }x�t|j �
� �D ]�\}}t |t �rjqV|j
} |d �| � | |kr�dd� |�| �D �}
t�|�} xv| jD ]D} t | t�r�q�x2| jD ](}
|
j|
kr�|�d||
j| � d|d < q�W q�W qV|�d
|| | � d|d < |d �| � qVW |d �r4|�d
� |d �rH|�d� |S )N�validate_databaseF)� table_error� column_error�missing_tables�
orm_tablesrG c S s g | ] }|d �qS )�namer )r �cr r r �
<listcomp>� s z%validate_database.<locals>.<listcomp>z?Model %s declares column %s which does not exist in database %sTrE z>Model %s declares table %s which does not exist in database %srD rF zWYou can run 'lve-create-db --create-missing-tables' command to recreate missing tables.zLYou can try to recreate malformed table, or ask CloudLinux support for help.)r: r; Z propagateZ
addHandlerZ NullHandlerr! r r Zget_table_namesZ_decl_class_registry�items�
isinstancer Z
__tablename__�appendZ get_columnsr> �inspect�attrsr �columns�keyZcritical)r � hide_logging�baser? �resultZdatabase_inspectionZ real_tables�_Z_class�tableZ real_columnsZmapperZ column_prop�columnr r r rC � sB
rC c C s t | dd�}|d |d kS )NT)rR rF rG )rC )r Zinspect_resultr r r �check_need_create_db� s rX c C s" t jj| t� d� t| dd� d S )N)r T)Zstamp)r r Z
create_allr# r )r r r r � create_db� s rY c C s& |s t | �rt| � n t| |d� d S )N)Z
lve_stats_cfg)rX rY r )r Zcreate_missing_tablesr3 r r r �setup_db� s
rZ c C s t j�| � d S )N)r r Zdrop_all)r r r r � drop_tables� s r[ c C s� | � � }|�� }yzxlttjj�� �D ]X\}}|d kr>t|�}n4t|tt f�r`t||j
j |k�}nt||j
j |k�}|� |� q$W |�
� W n |�� � Y nX d S )N)ZconnectZbeginr! r r r rK r rL r rI � server_id�execute�commitZrollback)r r\ Zconn_ZtransrU Z table_objectZ delete_queryr r r �
clear_rows� s
r_ c C s t | � t| � d S )N)r[ rY )r r r r � recreate_db� s r` c C s� | � tj��tj|k��tj��t�tj �dk��t�
tj �dk�}|d k r\|�tj|k�}|d k rt|�tj|k�}dd� |D �S )Nr c S s g | ] }|d �qS )r r )r Zrecord_r r r rJ � s z(find_lost_keep_alive.<locals>.<listcomp>) Zqueryr �created�filterr\ Zgroup_byZhavingr �max�id�min)�sessionr\ �
from_timestmp� to_timestampZlost_keepaliver r r �find_lost_keep_alive� s $ri c C s� t | |||�}|sd S dd� ttjj�� �D �}||tjj< x&|D ] }tf |�}||_| � |� qBW | �
� |r�|� dt |�|f � d S )Nc S s i | ]
}d |�qS )r r )r �colr r r �
<dictcomp>� s z'fix_lost_keep_alive.<locals>.<dictcomp>z*Was fixed %s losted keep alive records: %s)
ri r! r Z __table__rP �keysr\ rQ ra �addr^ r= �len) rf r\ rg rh �log_Zlost_keep_aliveZv2_keepalive_rowZ timestampZhistory_keepaliver r r �fix_lost_keep_alive� s
rp c C s. t | d�� }t||d |||d� |�� d S )N)Zbindr\ )rg rh ro )r rp �close)r r3 rg rh ro rf r r r �fix_db s
rr )T)FFNT)FN)N)NN)NNN)NNN)-Z
__future__r r r: Zsqlalchemy.enginer> r r Z sqlalchemy.engine.reflectionr Z&sqlalchemy.ext.declarative.clsregistryr Zsqlalchemy.ormr r Zclcommon.clexceptionr
Z lvestats.ormr r r
Zlvestats.utils.dbmigratorr r1 ZMYSQLZ
POSTGRESQLr0 r. �
__author__r r# r$ r( r5 rB rC rX rY rZ r[ r_ r` ri rp rr r r r r �<module> s@
.
&'
Mini Shell