Current File : //opt/alt/python37/lib64/python3.7/site-packages/aiohttp/__pycache__/streams.cpython-37.pyc
B
�Z�_2P � @ s8 d dl Z d dlZd dlZd dlmZmZmZmZmZm Z m
Z
ddl m Z ddl
mZmZmZ ddlmZ yd dlmZ W n ek
r� d dlmZ Y nX dZe
d �ZG d
d � d e�ZG d d
� d
ee �ZG dd� d�ZG dd� d�Z G dd� de �Z G dd� de �Z e � Z G dd� dee �Z G dd� de e �Z!dS )� N)� Awaitable�Callable�Generic�List�Optional�Tuple�TypeVar� )� BaseProtocol)�BaseTimerContext�
set_exception�
set_result)�internal_logger)�Deque)�
EMPTY_PAYLOAD� EofStream� StreamReader� DataQueue�FlowControlDataQueue�_Tc @ s e Zd ZdZdS )r zeof stream indication.N)�__name__�
__module__� __qualname__�__doc__� r r �B/opt/alt/python37/lib64/python3.7/site-packages/aiohttp/streams.pyr s r c @ sD e Zd Zeg ee f dd�dd�Zdd�dd�Zed�d d
�ZdS ) �AsyncStreamIteratorN)� read_func�returnc C s
|| _ d S )N)r )�selfr r r r �__init__ s z AsyncStreamIterator.__init__zAsyncStreamIterator[_T])r c C s | S )Nr )r r r r � __aiter__" s z AsyncStreamIterator.__aiter__c � s< y| � � I d H }W n tk
r* t�Y nX |dkr8t�|S )N� )r r �StopAsyncIteration)r �rvr r r � __anext__% s
z AsyncStreamIterator.__anext__) r r r r r r r r! r% r r r r r s r c @ s@ e Zd Zddd�dd�Zd d�dd�Zeeef d�d d
�ZdS ) � ChunkTupleAsyncStreamIteratorr N)�streamr c C s
|| _ d S )N)�_stream)r r' r r r r 0 s z&ChunkTupleAsyncStreamIterator.__init__)r c C s | S )Nr )r r r r r! 3 s z'ChunkTupleAsyncStreamIterator.__aiter__c � s | j �� I d H }|dkr t�|S )N)r" F)r( � readchunkr# )r r$ r r r r% 6 s z'ChunkTupleAsyncStreamIterator.__anext__) r r r r r! r �bytes�boolr% r r r r r& / s r& c @ sR e Zd Zee d�dd�Zeee d�dd�Zee d�dd�Ze d�d d
�Z
d S ) �AsyncStreamReaderMixin)r c C s
t | j�S )N)r �readline)r r r r r! > s z AsyncStreamReaderMixin.__aiter__)�nr c s t � �fdd��S )zzReturns an asynchronous iterator that yields chunks of size n.
Python-3.5 available for Python 3.5+ only
c s
�� � �S )N)�readr )r. r r r �<lambda>F r" z5AsyncStreamReaderMixin.iter_chunked.<locals>.<lambda>)r )r r. r )r. r r � iter_chunkedA s z#AsyncStreamReaderMixin.iter_chunkedc C s
t | j�S )z�Returns an asynchronous iterator that yields all the available
data as soon as it is received
Python-3.5 available for Python 3.5+ only
)r �readany)r r r r �iter_anyH s z AsyncStreamReaderMixin.iter_anyc C s t | �S )a
Returns an asynchronous iterator that yields chunks of data
as they are received by the server. The yielded objects are tuples
of (bytes, bool) as returned by the StreamReader.readchunk method.
Python-3.5 available for Python 3.5+ only
)r& )r r r r � iter_chunksP s z"AsyncStreamReaderMixin.iter_chunksN) r r r r r* r! �intr1 r3 r& r4 r r r r r, = s r, c @ s� e Zd ZdZdZddd�eeee ee j
dd�dd�Z e d�d d
�Z
eeef d�d d �Zee d�d
d�Zedd�dd�Zeg df dd�dd�Zdd�dd�Zed�dd�Zed�dd�Zdd�dd �Zedd �d d �Zd<eedd �d!d"�Z dd�d#d$�Z dd�d%d&�Z e dd'�d(d)�Z ed�d*d+�Z d=eed-�d.d/�Z!ed�d0d1�Z"eeef d�d2d3�Z#eed-�d4d5�Z$d>eed-�d6d7�Z%eed-�d8d9�Z&eed-�d:d;�Z'dS )?r a* An enhancement of asyncio.StreamReader.
Supports asynchronous iteration by line, chunk or as available::
async for line in reader:
...
async for chunk in reader.iter_chunked(1024):
...
async for slice in reader.iter_any():
...
r N)�timer�loop)�protocol�limitr6 r7 r c C sv || _ || _|d | _|d kr&t�� }|| _d| _d| _d | _t �
� | _ d| _ d| _
d | _d | _d | _|| _g | _d S )N� r F)� _protocol�
_low_water� _high_water�asyncioZget_event_loop�_loop�_size�_cursor�_http_chunk_splits� collections�deque�_buffer�_buffer_offset�_eof�_waiter� _eof_waiter�
_exception�_timer�_eof_callbacks)r r8 r9 r6 r7 r r r r j s"
zStreamReader.__init__)r c C s� | j jg}| jr |�d| j � | jr0|�d� | jdkrP|�d| j| jf � | jrf|�d| j � | jr||�d| j � dd� |� S ) Nz%d bytes�eofi zlow=%d high=%dzw=%rze=%rz<%s>� )
� __class__r r@ �appendrG r< r= rH rJ �join)r �infor r r �__repr__� s
zStreamReader.__repr__c C s | j | jfS )N)r< r= )r r r r �get_read_buffer_limits� s z#StreamReader.get_read_buffer_limitsc C s | j S )N)rJ )r r r r � exception� s zStreamReader.exception)�excr c C sP || _ | j�� | j}|d k r.d | _t||� | j}|d k rLd | _t||� d S )N)rJ rL �clearrH r rI )r rV �waiterr r r r � s
zStreamReader.set_exception)�callbackr c C sB | j r2y
|� W q> tk
r. t�d� Y q>X n | j�|� d S )NzException in eof callback)rG � Exceptionr rU rL rP )r rY r r r �on_eof� s
zStreamReader.on_eofc C s� d| _ | j}|d k r$d | _t|d � | j}|d k rBd | _t|d � x8| jD ].}y
|� W qJ tk
rv t�d� Y qJX qJW | j�� d S )NTzException in eof callback) rG rH r
rI rL rZ r rU rW )r rX �cbr r r �feed_eof� s
zStreamReader.feed_eofc C s | j S )z&Return True if 'feed_eof' was called.)rG )r r r r �is_eof� s zStreamReader.is_eofc C s | j o | j S )z=Return True if the buffer is empty and 'feed_eof' was called.)rG rE )r r r r �at_eof� s zStreamReader.at_eofc � sB | j r
d S | jd kst�| j�� | _z| jI d H W d d | _X d S )N)rG rI �AssertionErrorr? �
create_future)r r r r �wait_eof� s zStreamReader.wait_eof)�datar c C sx t jdtdd� |sdS | jr>| jd | jd� | jd< d| _| jt|�7 _| jt|�8 _| j�|� d| _ dS )zDrollback reading some data from stream, inserting it to buffer head.zJunread_data() is deprecated and will be removed in future releases (#3260)r: )�
stacklevelNr )
�warnings�warn�DeprecationWarningrF rE r@ �lenrA �
appendleft� _eof_counter)r rc r r r � unread_data� s zStreamReader.unread_data)rc �sizer c C s� | j rtd��|sd S | jt|�7 _| j�|� | jt|�7 _| j}|d k rdd | _t|d � | j| j kr�| j
j s�| j
� � d S )Nzfeed_data after feed_eof)
rG r` r@ rh rE rP � total_bytesrH r
r= r; �_reading_paused�
pause_reading)r rc rl rX r r r � feed_data� s
zStreamReader.feed_datac C s" | j d kr | jrtd��g | _ d S )Nz?Called begin_http_chunk_receiving whensome data was already fed)rB rm � RuntimeError)r r r r �begin_http_chunk_receiving� s
z'StreamReader.begin_http_chunk_receivingc C sd | j d krtd��| j r"| j d nd}| j|kr4d S | j �| j� | j}|d k r`d | _t|d � d S )NzFCalled end_chunk_receiving without calling begin_chunk_receiving first���r )rB rq rm rP rH r
)r �posrX r r r �end_http_chunk_receiving s
z%StreamReader.end_http_chunk_receiving)� func_namer c � sf | j d k rtd| ��| j�� }| _ z2| jrL| j� |I d H W d Q R X n
|I d H W d d | _ X d S )NzH%s() called while another coroutine is already waiting for incoming data)rH rq r? ra rK )r rv rX r r r �_wait# s
zStreamReader._waitc � s� | j d k r| j �g }d}d}x�|r�xp| jr�|r�| j}| jd �d|�d }| �|rZ|| nd�}|�|� |t|�7 }|r~d}|| jkr$td��q$W | j r�P |r | �
d�I d H q W d � |�S )
Nr T�
r rs FzLine is too longr- r" ) rJ rE rF �find�_read_nowait_chunkrP rh r= �
ValueErrorrG rw rQ )r �lineZ line_sizeZ
not_enough�offsetZicharrc r r r r- 8 s*
zStreamReader.readliners )r. r c � s� | j d k r| j �| jrF| jsFt| dd�d | _| jdkrFtjddd� |sNdS |dk r�g }x"| �� I d H }|spP |�|� q\W d� |�S x | js�| js�| �
d �I d H q�W | � |�S )
Nrj r r � zEMultiple access to StreamReader in eof state, might be infinite loop.T)Z
stack_infor" r/ ) rJ rG rE �getattrrj r �warningr2 rP rQ rw � _read_nowait)r r. �blocks�blockr r r r/ V s*
zStreamReader.readc � s< | j d k r| j �x | js0| js0| �d�I d H qW | �d�S )Nr2 rs )rJ rE rG rw r� )r r r r r2 � s
zStreamReader.readanyc � s� x�| j dk r| j �xL| jr^| j�d�}|| jkr4dS || jkrR| �|| j �dfS t�d� qW | jrt| �d�dfS | j r~dS | �
d �I dH qW dS )
z�Returns a tuple of (data, end_of_http_chunk). When chunked transfer
encoding is used, end_of_http_chunk is a boolean indicating if the end
of the data corresponds to the end of a HTTP chunk , otherwise it is
always False.
Nr )r" TTzESkipping HTTP chunk end due to data consumption beyond chunk boundaryrs F)r" Fr) ) rJ rB �poprA r� r r� rE rz rG rw )r rt r r r r) � s
zStreamReader.readchunkc � st | j d k r| j �g }xT|dkrh| �|�I d H }|sPd�|�}t�|t|�| ��|�|� |t|�8 }qW d�|�S )Nr r" )rJ r/ rQ r> �IncompleteReadErrorrh rP )r r. r� r� �partialr r r � readexactly� s
zStreamReader.readexactlyc C s2 | j d k r| j �| jr(| j�� s(td��| �|�S )Nz9Called while some coroutine is waiting for incoming data.)rJ rH Zdonerq r� )r r. r r r � read_nowait� s
zStreamReader.read_nowaitc C s� | j d }| j}|dkrHt|�| |krH|||| � }| j|7 _n,|rj| j �� ||d � }d| _n
| j �� }| jt|�8 _| jt|�7 _| j}x |r�|d | jk r�|�d� q�W | j| jk r�| j j
r�| j � � |S )Nr rs ) rE rF rh �popleftr@ rA rB r� r< r; rn �resume_reading)r r. Z first_bufferr} rc Z chunk_splitsr r r rz � s$
z StreamReader._read_nowait_chunkc C sT g }x<| j r@| �|�}|�|� |dkr|t|�8 }|dkrP qW |rPd�|�S dS )z8 Read not more than n bytes, or whole buffer if n == -1 rs r r" )rE rz rP rh rQ )r r. Zchunks�chunkr r r r� � s
zStreamReader._read_nowait)r )rs )rs )(r r r r rm r
r5 r r r> �AbstractEventLoopr �strrS r rT �
BaseExceptionrU r r r[ r] r+ r^ r_ rb r* rk rp rr ru rw r- r/ r2 r) r� r� rz r� r r r r r Z s6 * r c @ s� e Zd Zee d�dd�Zedd�dd�Zeg df dd�d d
�Zdd�d d �Z e
d�d
d�Z e
d�dd�Z dd�dd�Z
d%eedd�dd�Zed�dd�Zd&eed�dd �Zed�d d �Zeee
f d�d d �Zeed�d!d"�Zed�d#d$�ZdS )'�EmptyStreamReader)r c C s d S )Nr )r r r r rU � s zEmptyStreamReader.exceptionN)rV r c C s d S )Nr )r rV r r r r � s z EmptyStreamReader.set_exception)rY r c C s. y
|� W n t k
r( t�d� Y nX d S )NzException in eof callback)rZ r rU )r rY r r r r[ � s
zEmptyStreamReader.on_eofc C s d S )Nr )r r r r r] s zEmptyStreamReader.feed_eofc C s dS )NTr )r r r r r^ s zEmptyStreamReader.is_eofc C s dS )NTr )r r r r r_ s zEmptyStreamReader.at_eofc � s d S )Nr )r r r r rb
s zEmptyStreamReader.wait_eofr )rc r. r c C s d S )Nr )r rc r. r r r rp
s zEmptyStreamReader.feed_datac � s dS )Nr" r )r r r r r- s zEmptyStreamReader.readliners )r. r c � s dS )Nr" r )r r. r r r r/ s zEmptyStreamReader.readc � s dS )Nr" r )r r r r r2 s zEmptyStreamReader.readanyc � s dS )N)r" Tr )r r r r r) s zEmptyStreamReader.readchunkc � s t �d|��d S )Nr" )r> r� )r r. r r r r� s z EmptyStreamReader.readexactlyc C s dS )Nr" r )r r r r r� s z EmptyStreamReader.read_nowait)r )rs )r r r r r� rU r r r[ r] r+ r^ r_ rb r* r5 rp r- r/ r2 r r) r� r� r r r r r� � s r� c @ s� e Zd ZdZejdd�dd�Zed�dd�Ze d�d d
�Z
e d�d d �Z e e
d�d
d�Ze
dd�dd�Zd eedd�dd�Zdd�dd�Zed�dd�Zee d�dd�ZdS ) r z>DataQueue is a general-purpose blocking queue with one reader.N)r7 r c C s, || _ d| _d | _d | _d| _t�� | _d S )NFr )r? rG rH rJ r@ rC rD rE )r r7 r r r r ) s zDataQueue.__init__)r c C s
t | j�S )N)rh rE )r r r r �__len__1 s zDataQueue.__len__c C s | j S )N)rG )r r r r r^ 4 s zDataQueue.is_eofc C s | j o | j S )N)rG rE )r r r r r_ 7 s zDataQueue.at_eofc C s | j S )N)rJ )r r r r rU : s zDataQueue.exception)rV r c C s. d| _ || _| j}|d k r*d | _t||� d S )NT)rG rJ rH r )r rV rX r r r r = s zDataQueue.set_exceptionr )rc rl r c C s@ | j |7 _ | j�||f� | j}|d k r<d | _t|d � d S )N)r@ rE rP rH r
)r rc rl rX r r r rp F s zDataQueue.feed_datac C s( d| _ | j}|d k r$d | _t|d � d S )NT)rG rH r
)r rX r r r r] O s
zDataQueue.feed_eofc � s� | j sX| jsX| jrt�| j�� | _y| jI d H W n$ tjtjfk
rV d | _� Y nX | j r~| j � � \}}| j
|8 _
|S | j d k r�| j �nt �d S )N)
rE rG rH r` r? ra r> ZCancelledError� TimeoutErrorr� r@ rJ r )r rc rl r r r r/ W s
zDataQueue.readc C s
t | j�S )N)r r/ )r r r r r! k s zDataQueue.__aiter__)r )r r r r r> r� r r5 r� r+ r^ r_ r r� rU r r rp r] r/ r r! r r r r r & s r c sX e Zd ZdZeeejdd�� fdd� Zd
e edd�� fdd �
Z
e d
�� fd d � Z � Z S )r zgFlowControlDataQueue resumes and pauses an underlying stream.
It is a destination for parsed data.N)r8 r9 r7 r c s" t � j|d� || _|d | _d S )N)r7 r: )�superr r; �_limit)r r8 r9 r7 )rO r r r t s z FlowControlDataQueue.__init__r )rc rl r c s0 t � �||� | j| jkr,| jjs,| j�� d S )N)r� rp r@ r� r; rn ro )r rc rl )rO r r rp | s z FlowControlDataQueue.feed_data)r c � s6 zt � �� I d H S | j| jk r0| jjr0| j�� X d S )N)r� r/ r@ r� r; rn r� )r )rO r r r/ � s zFlowControlDataQueue.read)r )
r r r r r
r5 r> r� r r rp r/ �
__classcell__r r )rO r r o s
r )"r> rC re �typingr r r r r r r Z
base_protocolr
Zhelpersr r r
�logr r � ImportErrorZtyping_extensions�__all__r rZ r r r& r, r r� r r r r r r r �<module> s0 $ /I
Mini Shell