Current File : //usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyo
�
���^c @@ sI d Z d d l m Z m Z m Z d d l m Z d d l Z d d l Z d d l
m Z d d l m
Z
m Z y d d l Z e Z Wn e k
r� e Z n Xd d l Z e j e � Z d Z d � Z e e d � � Z d
� Z d � Z d � Z d
� Z d � Z d � Z d � Z! d � Z" d � Z# d � Z$ d e d � Z% d S( u�
.. versionadded:: 2016.3.0
This is a queue with postgres as the backend. It uses the jsonb store to
store information for queues.
:depends: python-psycopg2
To enable this queue, the following needs to be configured in your master
config. These are the defaults:
.. code-block:: yaml
queue.pgjsonb.host: 'salt'
queue.pgjsonb.user: 'salt'
queue.pgjsonb.pass: 'salt'
queue.pgjsonb.db: 'salt'
queue.pgjsonb.port: 5432
Use the following Pg database schema:
.. code-block:: sql
CREATE DATABASE salt WITH ENCODING 'utf-8';
--
-- Table structure for table `salt`
--
DROP TABLE IF EXISTS salt;
CREATE OR REPLACE TABLE salt(
id SERIAL PRIMARY KEY,
data jsonb NOT NULL
);
.. code-block:: bash
salt-run queue.insert test '{"name": "redis", "host": "172.16.0.8", "port": 6379}' backend=pgjsonb
salt-run queue.process_queue test all backend=pgjsonb
i ( t absolute_importt print_functiont unicode_literals( t contextmanagerN( t six( t SaltInvocationErrort SaltMasterErroru pgjsonbc C@ s t t k r t St S( N( t HAS_PGt Falset __virtualname__( ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt __virtual__A s c
c@ sN i d d 6d d 6d d 6d d 6d d 6} i } x< | j � D]. \ } } t j d j t | � | � | | <q< Wy t j | � } Wn. t j k
r� } t d
j d | � � � n X| j � } z~ y | VWnK t j
k
r} | j } t j
j t j | � � | j d � | � n$ X| r.| j d
� n
| j d � Wd | j � Xd S( u#
Return an postgres cursor
u localhostu hostu saltu useru passwordu dbnamei8 u portu
queue.{0}.{1}u5 pgjsonb returner could not connect to database: {exc}t excu ROLLBACKu COMMITN( t itemst __opts__t gett formatR t psycopg2t connectt OperationalErrorR t cursort
DatabaseErrort argst syst stderrt writeR t text_typet executet close(
t committ defaultst conn_kwargst keyt valuet connR R t errt error( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt _connG s2
&
c C@ sJ d } t j d | � | j | � | j � } g | D] } | d ^ q6 S( NuL select relname from pg_class where relkind='r' and relname !~ '^(pg_|sql_)';u
SQL Query: %si ( t logt debugR t fetchall( t curt cmdt resultt x( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt _list_tablesl s
c C@ s0 d j | � } t j d | � | j | � t S( Nu< CREATE TABLE {0}(id SERIAL PRIMARY KEY, data jsonb NOT NULL)u
SQL Query: %s( R R% R& R t True( R( t queueR) ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt
_create_tablet s
c C@ sR t � �C } d j | � } t j d | � | j | � | j � } | SWd QXd S( u6
Private function to list contents of a queue
u SELECT data FROM {0}u
SQL Query: %sN( R$ R R% R& R R' ( R. R( R) t contents( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt _list_items| s
c C@ s" t � � } t | � } Wd QX| S( u9
Return a list of Salt Queues on the Salt Master
N( R$ R, ( R( t queues( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt list_queues� s c C@ s- t | � } g | D] } | d ^ q } | S( u"
List contents of a queue
i ( R1 ( R. t
itemstuplet itemR ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt
list_items� s c C@ s t | � } t | � S( u0
Provide the number of items in a queue
( R1 t len( R. R ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt list_length� s c C@ s
| t � k S( u�
Does this queue exist
:param queue: Name of the queue
:type str
:return: True if this queue exists and
False otherwise
:rtype bool
( R3 ( R. ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt
_queue_exists� s c C@ sX t | � sD t d t � �$ } t j d | � t | | � Wd QXn t j d | � d S( NR u! Queue %s does not exist. Creatingu Queue %s already exists.( R9 R$ R- R% R& R/ ( R. R( ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt handle_queue_creation� s
c C@ sB t | � t d t � �#} t | t � r� t j j j | � } t d � j
| | � } t j d | � y | j
| � Wq� t j k
r� } d j
| � SXn t | t � r8g | D] } t j j j | � f ^ q� } t d � j
| � } t j d | � y | j | | � Wq8t j k
r4} d j
| � SXn Wd QXt S( u)
Add an item or items to a queue
R u# INSERT INTO {0}(data) VALUES('{1}')u
SQL Query: %su6 Item already exists in this queue. postgres error: {0}u! INSERT INTO {0}(data) VALUES (%s)uC One or more items already exists in this queue. postgres error: {0}N( R: R$ R- t
isinstancet dictt saltt utilst jsont dumpst strR R% R& R R t IntegrityErrort listt executemany( R. R R( R) t esct el( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt insert� s*
+c C@ s� t d t � �� } t | t � ri t d � j | t j j j | � � } t
j d | � | j | � t St | t
� r� g | D] } t j j j | � f ^ q } d j | � } t
j d | � | j | | � n Wd QXt S( u.
Delete an item or items from a queue
R u" DELETE FROM {0} WHERE data = '{1}'u
SQL Query: %su DELETE FROM {0} WHERE data = %sN( R$ R- R; R< RA R R= R> R? R@ R% R& R RC RD ( R. R R( R) RF ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt delete� s
+i c
C@ s^ d j | � } | d k r} y t | � } Wn. t k
r[ } d j | � } t | � � n Xd j | d j | � g � } n t j d | � g } t d t � �� } | j | � | j
� } t | � d k rTg | D] } t j
| d � ^ q� }
g | D] } | d ^ q� } d
j |
� } d j | | � } t j d | � | j | � n Wd QX| S(
uB
Pop one or more or all items from the queue return them.
u SELECT id, data FROM {0}u allu3 Quantity must be an integer or "all".
Error: "{0}".u u LIMIT {0};u
SQL Query: %sR i i u ','u$ DELETE FROM {0} WHERE id IN ('{1}');N( R t intt
ValueErrorR t joinR% R& R$ R- R R' R7 R R (
R. t quantityt is_runnerR) R t error_txtR R( R* R5 t idst idlistt del_cmd( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt pop� s. !
& (& t __doc__t
__future__R R R t
contextlibR R t salt.utils.jsonR= t salt.extR t salt.exceptionsR R R R- R t ImportErrorR t loggingt getLoggert __name__R% R R
R$ R, R/ R1 R3 R6 R8 R9 R: RG RH RR ( ( ( s= /usr/lib/python2.7/site-packages/salt/queues/pgjsonb_queue.pyt <module>( s8
$
Mini Shell