File: //usr/lib/python3.9/site-packages/redis/asyncio/__pycache__/cluster.cpython-39.pyc
a
��b�� � @ s( d dl Z d dlZd dlZd dlZd dlZd dlmZmZmZm Z m
Z
m Z m Z m
Z
mZmZ d dlmZ d dlmZmZmZmZ d dlmZ d dlmZmZm Z d dl m Z m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z' d dl(m)Z) d d l*m+Z+m,Z, d d
l-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z; d d l<m=Z=m>Z>m?Z? d d l@mAZAmBZBmCZC ed
eDde
d eedf �ZEdZFeeeDef d�dd�ZGG dd� de�ZHG dd� de e#e)�ZIG dd� d�ZJG dd� d�ZKG dd� de e#e)�ZLe D ]4ZMeM�Nd d ��O� ZMeMd k�r�q�ePeLeMe%eM�� �q�G d d � d �ZQdS )!� N)
�Any�Deque�Dict� Generator�List�Mapping�Optional�Type�TypeVar�Union)�ResponseCallbackT)�
Connection�
DefaultParser�Encoder� parse_url)�CommandsParser)�EMPTY_RESPONSE� NEVER_DECODE�
AbstractRedis)
�PIPELINE_BLOCKED_COMMANDS�PRIMARY�
READ_COMMANDS�REPLICA�SLOT_ID�AbstractRedisCluster� LoadBalancer�block_pipeline_command�
get_node_name�parse_cluster_slots)�AsyncRedisClusterCommands)�REDIS_CLUSTER_HASH_SLOTS�key_slot)�AskError�BusyLoadingError�ClusterCrossSlotError�ClusterDownError� ClusterError�ConnectionError� DataError�MasterDownError�
MovedError�RedisClusterException�
ResponseError�SlotNotCoveredError� TimeoutError�
TryAgainError)�AnyKeyT�
EncodableT�KeyT)�
dict_merge�safe_str� str_if_bytes� TargetNodesT� ClusterNode)Z client_name�db�decode_responsesZ
encoder_class�encoding�encoding_errorsZhealth_check_interval� parser_class�password�redis_connect_funcZretryZretry_on_timeoutZsocket_connect_timeoutZsocket_keepaliveZsocket_keepalive_optionsZsocket_read_sizeZsocket_timeoutZ socket_type�username)�kwargs�returnc K s dd� | � � D �S )z0Remove unsupported or disabled keys from kwargs.c S s i | ]\}}|t v r||�qS � )�CONNECTION_ALLOWED_KEYS)�.0�k�vrB rB �9/usr/lib/python3.9/site-packages/redis/asyncio/cluster.py�
<dictcomp>U � z"cleanup_kwargs.<locals>.<dictcomp>)�items)r@ rB rB rG �cleanup_kwargsS s rK c @ s& e Zd Zeejeeee e
e d��ZdS )�
ClusterParser)ZASKZTRYAGAINZMOVED� CLUSTERDOWNZ CROSSSLOT�
MASTERDOWNN) �__name__�
__module__� __qualname__r3 r ZEXCEPTION_CLASSESr" r/ r* r% r$ r) rB rB rB rG rL X s ��rL c @ s` e Zd ZdZeeed d�dd��ZdZdTe e e
e e d e e e
e
e e edd �
d
d�Z
d d�dd�Zdd�dd�Zd d�dd�Zddddd�dd�Zeedd f d�dd�ZdZdd�d d �Zedd �d d �Ze d d�d!d"�Ze d d�d#d$�Ze d d�d%d&�Zd d�d'd(�Zd d�d)d*�Z d dd+�d,d-�Z dUe e e e
e e e d d.�d/d0�Z dVee e d d1�d2d3�Z e e
d4�d5d6�Z!e"d�d7d8�Z#e$ee e f d�d9d:�Z%eeⅆ�d<d=�Z'dd>�eee e e d d?�d@dA�Z(eee
dB�dCdD�Z)ee dE�dFdG�Z*ee d dE�dHdI�Z+e eedJ�dKdL�Z,d e-e.e f eedM�dNdO�Z/dWe e e e dPdQ�dRdS�Z0dS )X� RedisClustera�
Create a new RedisCluster client.
Pass one of parameters:
- `url`
- `host` & `port`
- `startup_nodes`
| Use ``await`` :meth:`initialize` to find cluster nodes & create connections.
| Use ``await`` :meth:`close` to disconnect connections & close client.
Many commands support the target_nodes kwarg. It can be one of the
:attr:`NODE_FLAGS`:
- :attr:`PRIMARIES`
- :attr:`REPLICAS`
- :attr:`ALL_NODES`
- :attr:`RANDOM`
- :attr:`DEFAULT_NODE`
Note: This client is not thread/process/fork safe.
:param host:
| Can be used to point to a startup node
:param port:
| Port used if **host** is provided
:param startup_nodes:
| :class:`~.ClusterNode` to used as a startup node
:param cluster_error_retry_attempts:
| Retry command execution attempts when encountering :class:`~.ClusterDownError`
or :class:`~.ConnectionError`
:param require_full_coverage:
| When set to ``False``: the client will not require a full coverage of the
slots. However, if not all slots are covered, and at least one node has
``cluster-require-full-coverage`` set to ``yes``, the server will throw a
:class:`~.ClusterDownError` for some key-based commands.
| When set to ``True``: all slots must be covered to construct the cluster
client. If not all slots are covered, :class:`~.RedisClusterException` will be
thrown.
| See:
https://redis.io/docs/manual/scaling/#redis-cluster-configuration-parameters
:param reinitialize_steps:
| Specifies the number of MOVED errors that need to occur before reinitializing
the whole cluster topology. If a MOVED error occurs and the cluster does not
need to be reinitialized on this current error handling, only the MOVED slot
will be patched with the redirected node.
To reinitialize the cluster on every MOVED error, set reinitialize_steps to 1.
To avoid reinitializing the cluster on moved errors, set reinitialize_steps to
0.
:param read_from_replicas:
| Enable read from replicas in READONLY mode. You can read possibly stale data.
When set to true, read commands will be assigned between the primary and
its replications in a Round-Robin manner.
:param url:
| See :meth:`.from_url`
:param kwargs:
| Extra arguments that will be passed to the
:class:`~redis.asyncio.connection.Connection` instances when created
:raises RedisClusterException:
if any arguments are invalid. Eg:
- db kwarg
- db != 0 in url
- unix socket connection
- none of host & url & startup_nodes were provided
)�urlr@ rA c K s | f d|i|��S )a'
Return a Redis client object configured from the given URL.
For example::
redis://[[username]:[password]]@localhost:6379/0
rediss://[[username]:[password]]@localhost:6379/0
unix://[[username]:[password]]@/path/to/socket.sock?db=0
Three URL schemes are supported:
- `redis://` creates a TCP socket connection. See more at:
<https://www.iana.org/assignments/uri-schemes/prov/redis>
- `rediss://` creates a SSL wrapped TCP socket connection. See more at:
<https://www.iana.org/assignments/uri-schemes/prov/rediss>
- ``unix://``: creates a Unix Domain Socket connection.
The username, password, hostname, path and all querystring values
are passed through urllib.parse.unquote in order to replace any
percent-encoded values with their corresponding characters.
There are several ways to specify a database number. The first value
found will be used:
1. A ``db`` querystring option, e.g. redis://localhost?db=0
2. If using the redis:// or rediss:// schemes, the path argument
of the url, e.g. redis://localhost/0
3. A ``db`` keyword argument to this function.
If none of these options are specified, the default db=0 is used.
All querystring options are cast to their appropriate Python types.
Boolean arguments can be specified with string values "True"/"False"
or "Yes"/"No". Values that cannot be properly cast cause a
``ValueError`` to be raised. Once parsed, the querystring arguments and
keyword arguments are passed to :class:`~redis.asyncio.connection.Connection`
when created. In the case of conflicting arguments, querystring
arguments always win.
rS rB )�clsrS r@ rB rB rG �from_url� s *zRedisCluster.from_url)� _initialize�_lock� cluster_error_retry_attempts�
command_flags�commands_parser�connection_kwargs�encoder�
node_flags�
nodes_manager�read_from_replicas�reinitialize_counter�reinitialize_steps�response_callbacks�result_callbacksN�� F� �
r7 )
�host�port�
startup_nodes�require_full_coverager_ rX ra rS r@ rA c K s� |sg }d| v rt d��|rrt|�}
d|
v r4t d��d|
v rP|
d dkrPt d��| �|
� | �d�}| �d|�}n|rz|s�|s�t d ��| j| d
< tf i | �� | _} | jj� � | _
| d < |r�|r�|� t ||fi | j��� t
f ||d �| j��| _t| �d
d�| �dd�| �dd��| _|| _|| _|| _d| _t� | _| jj� � | _| jj� � | _| jj� � | _ dd� | j d< d| _ t � � | _ d S )Nr8 z4Argument 'db' is not possible to use in cluster mode�pathzFRedisCluster does not currently support Unix Domain Socket connectionsr z9A ``db`` querystring option can only be 0 in cluster moderg rh a5 RedisCluster requires at least one node to discover the cluster. Please provide one of the followings:
1. host and port, for example:
RedisCluster(host='localhost', port=6379)
2. list of startup nodes, for example:
RedisCluster(startup_nodes=[ClusterNode('localhost', 6379), ClusterNode('localhost', 6378)])r> rb )ri rj r: zutf-8r; �strictr9 Fc [ s t t|�� �d fi |��S )Nr )r �list�values)�cmd�resr@ rB rB rG �<lambda>; s ��z'RedisCluster.__init__.<locals>.<lambda>�
CLUSTER SLOTST)!r+ r �update�get�
on_connectrK r[ � __class__�RESPONSE_CALLBACKS�copyrb �appendr7 � NodesManagerr^ r r\ rX r_ ra r` r rZ Z
NODE_FLAGSr] Z
COMMAND_FLAGSrY ZRESULT_CALLBACKSrc rV �asyncio�LockrW ) �selfrg rh ri rj r_ rX ra rS r@ Z url_optionsrB rB rG �__init__� sp ���
�
����
���zRedisCluster.__init__�rA c � s� | j r�| j4 I dH �� | j r�d| _ z*| j�� I dH | j�| jj�I dH W n< ty� d| _ | j�� I dH | j�d�I dH � Y n0 W d �I dH q�1 I dH s�0 Y | S )zJGet all nodes from startup nodes & creates connections if not initialized.NFTri )rV rW r^ �
initializerZ � default_node�
BaseException�close�r} rB rB rG r� A s � 2zRedisCluster.initializec � s` | j s\| j4 I dH �2 | j s2d| _ | j�� I dH W d �I dH q\1 I dH sR0 Y dS )z.Close all connections & client if initialized.NT)rV rW r^ r� r� rB rB rG r� S s
zRedisCluster.closec � s | � � I d H S �N�r� r� rB rB rG �
__aenter__[ s zRedisCluster.__aenter__��exc_type� exc_value� tracebackrA c � s | � � I d H d S r� )r� �r} r� r� r� rB rB rG � __aexit__^ s zRedisCluster.__aexit__c C s | � � �� S r� �r� � __await__r� rB rB rG r� a s zRedisCluster.__await__z Unclosed RedisCluster clientc C sb t | d�r^| js^tj| j� d| ��t| d� z | | jd�}t�� �|� W n t y\ Y n0 d S )NrV � ��source��client�message)
�hasattrrV �warnings�warn� _DEL_MESSAGE�ResourceWarningr{ �get_event_loop�call_exception_handler� RuntimeError)r} �contextrB rB rG �__del__f s zRedisCluster.__del__)�
connectionrA c � sP |� t� |�� I d H | jrL|�d�I d H t|�� I d H �dkrLtd��d S )NZREADONLYZOKzREADONLY command failed)Z
set_parserrL ru r_ Z send_commandr5 �read_response_without_lockr' )r} r� rB rB rG ru p s
zRedisCluster.on_connectc C s t | jj�� �S )z Get all nodes of the cluster.)rm r^ � nodes_cachern r� rB rB rG � get_nodes~ s zRedisCluster.get_nodesc C s | j �t�S )z%Get the primary nodes of the cluster.)r^ �get_nodes_by_server_typer r� rB rB rG �
get_primaries� s zRedisCluster.get_primariesc C s | j �t�S )z%Get the replica nodes of the cluster.)r^ r� r r� rB rB rG � get_replicas� s zRedisCluster.get_replicasc C s t �t| jj�� ��S )z!Get a random node of the cluster.)�random�choicerm r^ r� rn r� rB rB rG �get_random_node� s z RedisCluster.get_random_nodec C s | j jS )z#Get the default node of the client.)r^ r� r� rB rB rG �get_default_node� s z RedisCluster.get_default_node)�noderA c C s& |r| j |jd�std��|| j_dS )z�
Set the default node of the client.
:raises DataError: if None is passed or node does not exist in cluster.
�� node_namez1The requested node does not exist in the cluster.N)�get_node�namer( r^ r� )r} r� rB rB rG �set_default_node� s z RedisCluster.set_default_node�rg rh r� rA c C s | j �|||�S )z&Get node by (host, port) or node_name.)r^ r� �r} rg rh r� rB rB rG r� � s zRedisCluster.get_node)�key�replicarA c C s^ | � |�}| jj�|�}|s,td|� d���|rHt| jj| �dk rHdS |rRd}nd}|| S )aG
Get the cluster node corresponding to the provided key.
:param key:
:param replica:
| Indicates if a replica should be returned
|
None will returned if no replica holds this key
:raises SlotNotCoveredError: if the key is not covered by any slot.
�Slot "z " is not covered by the cluster.� N� r )�keyslotr^ � slots_cachert r- �len)r} r� r� �slotZ
slot_cache�node_idxrB rB rG �get_node_from_key� s
z RedisCluster.get_node_from_key)r� rA c C s t | j�|��S )z�
Find the keyslot for a given key.
See: https://redis.io/docs/manual/scaling/#redis-cluster-data-sharding
)r! r\ �encode)r} r� rB rB rG r� � s zRedisCluster.keyslotc C s | j S )z%Get the encoder object of the client.)r\ r� rB rB rG � get_encoder� s zRedisCluster.get_encoderc C s | j S )zGGet the kwargs passed to :class:`~redis.asyncio.connection.Connection`.)r[ r� rB rB rG �get_connection_kwargs� s z"RedisCluster.get_connection_kwargs)�command�callbackrA c C s || j |< dS )z Set a custom response callback.N)rb )r} r� r� rB rB rG �set_response_callback� s z"RedisCluster.set_response_callback)� node_flag)r� �argsr� rA c � s� |s| j �|�}|| jv r�|| jjkr0| jjgS || jjkrH| j�t �S || jj
kr`| j�t �S || jj kr|t
| jj�� �S || jjkr�t�t
| jj�� ��gS | j�| j|g|�R � I d H | jo�|tv �gS r� )rY rt r] rv Z DEFAULT_NODEr^ r� Z PRIMARIESr� r ZREPLICASr Z ALL_NODESrm r� rn ZRANDOMr� r� �get_node_from_slot�_determine_slotr_ r )r} r� r� r� rB rB rG �_determine_nodes� s$
��z RedisCluster._determine_nodes)r� r� rA c � s� � j �|�tkr t|d �S |dv rlt|�dk rFtd|g|�R � ���|dd|d � }|s�t�dt�S n@� j j
|g|�R � I d H }|s�|dv r�t�dt�S td|� ���t|�dkrƈ � |d �S � fdd �|D �}t|�dkr�t|� d
���|� � S ) Nr )ZEVALZEVALSHAr� zInvalid args in command: r� )ZFCALLZFCALL_ROz�No way to dispatch this command to Redis Cluster. Missing key.
You can execute the command by specifying target nodes.
Command: c s h | ]}� � |��qS rB )r� )rD r� r� rB rG � <setcomp>! rI z/RedisCluster._determine_slot.<locals>.<setcomp>z) - all keys must map to the same key slot)
rY rt r �intr� r+ r� Z randranger rZ Zget_keysr� �pop)r} r� r� �keys�slotsrB r� rG r� � s6
� �� �z RedisCluster._determine_slot)� target_nodesrA c C s t |t�o|| jv S r� )�
isinstance�strr] )r} r� rB rB rG �
_is_node_flag) s zRedisCluster._is_node_flagc C sP t |t�r|}n<t |t�r"|g}n*t |t�r:t|�� �}ntdt|�� ���|S )Nz�target_nodes type can be one of the following: node_flag (PRIMARIES, REPLICAS, RANDOM, ALL_NODES),ClusterNode, list<ClusterNode>, or dict<any, ClusterNode>. The passed type is )r� rm r7 �dictrn � TypeError�type)r} r� �nodesrB rB rG �_parse_target_nodes, s
��z RedisCluster._parse_target_nodes�r� r@ rA c � s� � d }g }d}�j }��dd�}|rB��|�sB��|�}d}d}t|�D �]t}�jrd��� I dH �z|s��j� d|i�I dH }|s�td� � d ���t |�dk�r�j
|d g� �R i ���I dH } |�j v r��j | ||d j | ifi ���W S | W S d
d � |D �}
t
j� ��fd d
�|D �� I dH } |�j v �rf�j | |tt|
| ��fi ���W S tt|
| ��W S W qJ t�y� } z(t| ��jjv �r�| }
n| �W Y d} ~ qJd} ~ 0 0 qJ|
�dS )a|
Execute a raw command on the appropriate cluster node or target_nodes.
It will retry the command as specified by :attr:`cluster_error_retry_attempts` &
then raise an exception.
:param args:
| Raw command args
:param kwargs:
- target_nodes: :attr:`NODE_FLAGS` or :class:`~.ClusterNode`
or List[:class:`~.ClusterNode`] or Dict[Any, :class:`~.ClusterNode`]
- Rest of the kwargs are passed to the Redis connection
:raises RedisClusterException: if target_nodes is not provided & the command
can't be mapped to a slot
r Fr� NTr� r� �!No targets were found to execute � command onc S s g | ]
}|j �qS rB �r� �rD r� rB rB rG �
<listcomp>t rI z0RedisCluster.execute_command.<locals>.<listcomp>c 3 s, | ]$}t ��j|g� �R i ����V qd S r� )r{ �
ensure_future�_execute_commandr� �r� r@ r} rB rG � <genexpr>v s ��z/RedisCluster.execute_command.<locals>.<genexpr>)rX r� r� r� �rangerV r� r� r+ r� r� rc r� r{ �gatherr� �zipr� r� rv �ERRORS_ALLOW_RETRY)r} r� r@ r� r� Ztarget_nodes_specifiedZretry_attemptsZpassed_targets�_�retr� rn �e� exceptionrB r� rG �execute_command@ sd
��
�"
��
��
�� z RedisCluster.execute_command)� target_noder� r@ rA c
� s d }}d }| j }d}|dk�r|d8 }zr|rP| j|d�}|�d�I d H d}n4|r�| j|� I d H } | j�| | jo||d tv �}d}|j|i |��I d H W S ty� � Y q t t
fy� |d7 }|dk r�t � d�I d H n| �
� I d H � Y q t�yb }
zV| jd7 _| j�rB| j| j dk�rB| �
� I d H d| _n|
| j_d}W Y d }
~
qd }
~
0 t�y� || j d k �r�t � d
�I d H Y q t�y� }
z t|
j|
jd �}d}W Y d }
~
qd }
~
0 t�y� t � d�I d H | �
� I d H � Y q0 qtd ��d S )
NFr r� r� ZASKING� � �?Tr� g�������?�rg rh zTTL exhausted.)ZRedisClusterRequestTTLr� r� r� r^ r� r_ r r# r' r. r{ �sleepr� r* r` ra �_moved_exceptionr/ r" r rg rh r% r& ) r} r� r� r@ ZaskingZmovedZ
redirect_addrZttlZ connection_error_retry_counterr� r� rB rB rG r� � s^
� ��
z RedisCluster._execute_command�ClusterPipeline)� transaction�
shard_hintrA c C s |r t d��|rt d��t| �S )z�
Create & return a new :class:`~.ClusterPipeline` object.
Cluster implementation of pipeline does not support transaction or shard_hint.
:raises RedisClusterException: if transaction or shard_hint are truthy values
z(shard_hint is deprecated in cluster modez)transaction is deprecated in cluster mode)r+ r� )r} r� r� rB rB rG �pipeline� s
zRedisCluster.pipeline)Nrd NFFre rf N)NNN)F)NN)1rO rP rQ �__doc__� classmethodr� r rU � __slots__r r� r �boolr~ r� r� r� r� r r� r� r� r
ru r� r� r� r� r� r� r� r� r1 r� r r� r r� r r� r� r� r� r� r� r r2 r� r� rB rB rB rG rR f s� F+ �
� W
��
�� �
� 3P� M � �rR c @ s� e Zd ZdZdZddefeeee ee e e
dd�dd�Z ed�d d
�Z e
e
d �d d
�ZdZdd�dd�Zdd�dd�Zed�dd�Zeee
e
d�dd�Ze
e
e
d�dd�Ze
d�dd �ZdS ) r7 z�
Create a new ClusterNode.
Each ClusterNode manages multiple :class:`~redis.asyncio.connection.Connection`
objects for the (host, port).
) �_command_stack� _connections�_free�connection_classr[ rg �max_connectionsr� rh rb � server_typeNl )rg rh r� r� r� r[ rA c K s� |dkrt �|�}||d< ||d< || _|| _t||�| _|| _|| _|| _|| _ |�
dt j �| _
g | _tj| jd�| _g | _d S )N� localhostrg rh rb )�maxlen)�socket�
gethostbynamerg rh r r� r� r� r� r[ r� rR rw rb r� � collections�dequer� r� )r} rg rh r� r� r� r[ rB rB rG r~ s"
�zClusterNode.__init__r c C s& d| j � d| j� d| j� d| j� d� S )Nz[host=z, port=z, name=z, server_type=�])rg rh r� r� r� rB rB rG �__repr__" s ���zClusterNode.__repr__)�objrA c C s t |t�o|j| jkS r� )r� r7 r� )r} r rB rB rG �__eq__( s zClusterNode.__eq__zUnclosed ClusterNode objectc C sh | j D ]\}|jrtj| j� d| ��t| d� z | | jd�}t�� �|� W n t y\ Y n0 qdqd S )Nr� r� r� )
r� � is_connectedr� r� r� r� r{ r� r� r� )r} r� r� rB rB rG r� - s
� zClusterNode.__del__c � sB t jdd� | jD �ddi�I d H }tdd� |D �d �}|r>|�d S )Nc s s | ]}t �|�� �V qd S r� �r{ r� �
disconnect)rD r� rB rB rG r� = s �z)ClusterNode.disconnect.<locals>.<genexpr>Zreturn_exceptionsTc s s | ]}t |t�r|V qd S r� )r� � Exception)rD rp rB rB rG r� C rI )r{ r� r� �next)r} r� �excrB rB rG r
; s ��� zClusterNode.disconnectc C s� | j rHtt| j ��D ](}| j �� }|jr0| S | j �|� q| j �� S t| j�| jk rz| jf i | j ��}| j�|� |S t
d��d S )NzToo many connections) r� r� r� �popleftr ry r� r� r� r[ r' )r} r� r� rB rB rG �acquire_connectionG s
z ClusterNode.acquire_connection)r� r� r@ rA c � s| z.t |v r |jdd�I d H }n|�� I d H }W n( tyV t|v rP|t Y S � Y n0 || jv rx| j| |fi |��S |S )NT)Zdisable_decoding)r r� r, r rb )r} r� r� r@ ZresponserB rB rG �parse_responseX s �
zClusterNode.parse_responser� c � s` | � � }|�|j|� d�I d H z,| j||d fi |��I d H W | j�|� S | j�|� 0 d S )NFr )r �send_packed_commandZ pack_commandr r� ry )r} r� r@ r� rB rB rG r� m s �zClusterNode.execute_commandc � s� | � � }|�|�dd� | jD ��d�I d H d}| jD ]\}z(| j||jd fi |j��I d H |_W q6 ty� } z||_d}W Y d }~q6d }~0 0 q6| j �
|� |S )Nc s s | ] }|j V qd S r� )r� �rD ro rB rB rG r� � rI z/ClusterNode.execute_pipeline.<locals>.<genexpr>Fr T) r r Z
pack_commandsr� r r� r@ �resultr r� ry )r} r� r� ro r� rB rB rG �execute_pipeline{ s" �
�� z ClusterNode.execute_pipeline)rO rP rQ r� r� r
r� r� r r r r~ r r� r r� r� r
r r r� r rB rB rB rG r7 � s2 �� � c @ s� e Zd ZdZd ed eedd�dd�Zd ee ee
ee ed d�d d
�Z d e e df e e df edd �d d
�Z
dd�dd�Zd e
edd�dd�Ze ed d�dd�Zdd�dd�Zd!e dd�dd �ZdS )"rz )r� r[ r� r� �read_load_balancerrj r� ri Fr7 N)ri rj r@ rA c K s@ dd� |D �| _ || _|| _d | _i | _i | _t� | _d | _d S )Nc S s i | ] }|j |�qS rB r� r� rB rB rG rH � rI z)NodesManager.__init__.<locals>.<dictcomp>) ri rj r[ r� r� r� r r r� )r} ri rj r@ rB rB rG r~ � s zNodesManager.__init__r� c C sJ |r.|r.|dkrt �|�}| j�t||d��S |r>| j�|�S td��d S )Nr� r� zEget_node requires one of the following: 1. node name 2. host and port)r r r� rt r r( r� rB rB rG r� � s
�zNodesManager.get_node)�old�new�
remove_oldrA c C sx |r2t |�� �D ] }||vrt�|�|��� � q|�� D ]8\}}||v rj|| |u rXq:t�|| �� � |||< q:d S r� )rm r� r{ r� r� r
rJ )r} r r r r� r� rB rB rG � set_nodes� s zNodesManager.set_nodesr c C s� | j }| j|j|jd�}|r.|jtkr\t|_n.t|j|jtfi | j��}| �| j |j
|i� || j |j v r�| j |j d }t
|_| j |j �|� | j |j �|� || j |j d< | j|kr�|| _n|g| j |j < d | _ d S )Nr� r )r� r� rg rh r� r r7 r[ r r� r� r� Zslot_idr ry �remover� )r} r� Zredirected_nodeZ old_primaryrB rB rG �_update_moved_slots� s*
��
z NodesManager._update_moved_slots)r� r_ rA c C s� | j r| �� zL|rL| j| d j}| j�|t| j| ��}| j| | W S | j| d W S ttfy� t d|� d| j
� d���Y n0 d S )Nr r� z5" not covered by the cluster. "require_full_coverage=�") r� r r� r� r Zget_server_indexr� �
IndexErrorr� r- rj )r} r� r_ Z primary_namer� rB rB rG r� � s ���z NodesManager.get_node_from_slot)r� rA c s � fdd�| j �� D �S )Nc s g | ]}|j � kr|�qS rB �r� r� r rB rG r� s
�z9NodesManager.get_nodes_by_server_type.<locals>.<listcomp>)r� rn )r} r� rB r rG r� s
�z%NodesManager.get_nodes_by_server_typec � s� | j �� i }i }g }d}d}| j�� D �]"}z6|�d�I d H �d�sNtd��|�d�I d H }d}W n� ttfy~ Y q(Y n� t y� } zF|�
� } d| v s�d| v r�W Y d }~q(ntd |� d
| � ���W Y d }~nLd }~0 t �y } z*|�
� } td |j � d
| � ���W Y d }~n
d }~0 0 t
|�d k�r`|d
d d
�s`t
| j�d k�r`|j|d
d d
< |D �]�� tdt
� ��D ] }
dd� � |
D �� |
< �qx� d } | d
} | dk�r�|j} t| d �}
|�t| |
��}|�s�t| |
tfi | j��}|||j < tt� d
�t� d �d �D ]�}
|
|v�r�g ||
< ||
�|� � fdd�tdt
� ��D �}|D ]Z}|d
} |d }
|�t| |
��}|�s�t| |
tfi | j��}||
�|� |||j < �qZnZ||
d
}|j |j k�r|�|j � d|j � d|
� �� t
|�dk�rtdd�|�� ����q�qdd}tt�D ]}
|
|v�r&d} �qB�q&|r( �qNq(|�s\td��|�s�| j�r�tdt
|�� dt� d ���|| _| j| j |dd � | j| j| j dd � | � t�d
| _ d | _ d S ) NF�INFOZcluster_enabledz(Cluster mode is not enabled on this noderr TrM rN z7ERROR sending "cluster slots" command to redis server: z . error: z6ERROR sending "cluster slots" command to redis server r� r r� c S s g | ] }t |��qS rB )r5 )rD �valrB rB rG r� O rI z+NodesManager.initialize.<locals>.<listcomp>� c s g | ] }� | �qS rB rB )rD �j�r� rB rG r� b rI re z vs z
on slot: r� z6startup_nodes could not agree on a valid slots cache: z, zORedis Cluster cannot be connected. Please provide at least one reachable node. z9All slots are not covered after query all startup_nodes. z of z covered...)r ) r �resetri rn r� rt r+ r' r. r, �__str__r r� r� rg r� r� r r7 r r[ ry r �joinr rj r� r r� r� r� r� )r} Ztmp_nodes_cacheZ tmp_slotsZ
disagreementsZstartup_nodes_reachableZ
fully_coveredZ startup_nodeZ
cluster_slotsr� r� �iZ primary_noderg rh r� Z
replica_nodesZ replica_nodeZtarget_replica_nodeZtmp_slotrB r# rG r� s�
��������
�� �
��
"
����� ���
����zNodesManager.initializer� )�attrrA c � s. d | _ tjdd� t| |��� D �� I d H d S )Nc s s | ]}t �|�� �V qd S r� r r� rB rB rG r� � s �z%NodesManager.close.<locals>.<genexpr>)r� r{ r� �getattrrn )r} r( rB rB rG r� � s ��zNodesManager.close)F)NNN)F)F)r� )rO rP rQ r� r r� r r~ r r� r� r� r r r r� r� r� r� rB rB rB rG rz � sD �� �� �
� ' �� rz c @ s& e Zd ZdZdZedd�dd�Zd d�dd �Zd d�d
d �Zddddd �d
d�Z e
e dd f d�dd�Z d d�dd�Z
ddddd �dd�Zed�dd�Zed�dd�Zeeef e d d�dd�Zd+eeee d �d d �Zd,d ed! eeee d"�d#d$�Zeed d%�d&d'�Ze e ef d d(�d)d*�Z dS )-r� a�
Create a new ClusterPipeline object.
Usage::
result = await (
rc.pipeline()
.set("A", 1)
.get("A")
.hset("K", "F", "V")
.hgetall("K")
.mset_nonatomic({"A": 2, "B": 3})
.get("A")
.get("B")
.delete("A", "B", "K")
.execute()
)
# result = [True, "1", 1, {"F": "V"}, True, True, "2", "3", 1, 1, 1]
Note: For commands `DELETE`, `EXISTS`, `TOUCH`, `UNLINK`, `mset_nonatomic`, which
are split across multiple nodes, you'll get multiple results for them in the array.
Retryable errors:
- :class:`~.ClusterDownError`
- :class:`~.ConnectionError`
- :class:`~.TimeoutError`
Redirection errors:
- :class:`~.TryAgainError`
- :class:`~.MovedError`
- :class:`~.AskError`
:param client:
| Existing :class:`~.RedisCluster` client
)r� �_clientN)r� rA c C s || _ g | _d S r� )r* r� )r} r� rB rB rG r~ � s zClusterPipeline.__init__r c � s" | j jr| j �� I d H g | _| S r� )r* rV r� r� r� rB rB rG r� � s zClusterPipeline.initializec � s | � � I d H S r� r� r� rB rB rG r� � s zClusterPipeline.__aenter__r� c � s
g | _ d S r� �r� r� rB rB rG r� � s zClusterPipeline.__aexit__c C s | � � �� S r� r� r� rB rB rG r� � s zClusterPipeline.__await__c C s
g | _ | S r� r+ r� rB rB rG � __enter__� s zClusterPipeline.__enter__c C s
g | _ d S r� r+ r� rB rB rG �__exit__� s zClusterPipeline.__exit__c C s
t | j�S r� )r� r� r� rB rB rG �__bool__� s zClusterPipeline.__bool__c C s
t | j�S r� )r� r� r� rB rB rG �__len__� s zClusterPipeline.__len__r� c O s( | j �tt| j �g|�R i |��� | S )ad
Append a raw command to the pipeline.
:param args:
| Raw command args
:param kwargs:
- target_nodes: :attr:`NODE_FLAGS` or :class:`~.ClusterNode`
or List[:class:`~.ClusterNode`] or Dict[Any, :class:`~.ClusterNode`]
- Rest of the kwargs are passed to the Redis connection
)r� ry �PipelineCommandr� )r} r� r@ rB rB rG r� � s �z ClusterPipeline.execute_commandT)�raise_on_error�allow_redirectionsrA c � s� | j s
g S z�t| jj�D ]�}| jjr4| j�� I dH z*| j| j| j ||d�I dH W W g | _ S ty� } zFt|�| j j
v r�|}| j� � I dH t �
d�I dH n|�W Y d}~qd}~0 0 q|�W g | _ ng | _ 0 dS )a
Execute the pipeline.
It will retry the commands as specified by :attr:`cluster_error_retry_attempts`
& then raise an exception.
:param raise_on_error:
| Raise the first error if there are any errors
:param allow_redirections:
| Whether to retry each failed command individually in case of redirection
errors
:raises RedisClusterException: if target_nodes is not provided & the command
can't be mapped to a slot
N)r1 r2 r� )r� r� r* rX rV r� �_executer� r� rv r� r� r{ r� )r} r1 r2 r� r� r� rB rB rG �execute s. �� zClusterPipeline.executerR r0 )r� �stackr1 r2 rA c � s� dd� |D �}i }|D ]v}|j |j� I d H }|sBtd|j� d���t|�dkr^td|j� ���|d } | j|vr�| || j< g | _| j�|� qtjdd � |� � D �� I d H }
t
|
��r�|�r&|D ]d}t |j t
ttf�r�z |j|ji |j��I d H |_ W q� t�y" } z| |_ W Y d } ~ q�d } ~ 0 0 q�|�r�|D ]b}|j } t | t��r0d
�tt|j��}
d |jd � d |
� d
| j� �}|f| jdd � | _| ��q0dd� |D �S )Nc S s" g | ]}|j rt|j t�r|�qS rB )r r� r r rB rB rG r� C s z,ClusterPipeline._execute.<locals>.<listcomp>r� r� r� z Too many targets for command r c s s | ]}t �|�� �V qd S r� )r{ r� r r� rB rB rG r� X rI z+ClusterPipeline._execute.<locals>.<genexpr>r� z
Command # � (z ) of pipeline caused error: c S s g | ]
}|j �qS rB )r r rB rB rG r� s rI )r� r� r+ r� r� r� ry r{ r� rn �anyr� r r/ r* r" r� r@ r r& �mapr4 �position)r} r� r5 r1 r2 Ztodor� ro r� r� �errorsr� r r� �msgrB rB rG r3 < sX � �
�
�� ��zClusterPipeline._execute)r� r� rA c G s, | j �|��� D ]}| j|g|�R � q| S r� )r* Z_partition_keys_by_slotrn r� )r} r� r� Z slot_keysrB rB rG �_split_command_across_slotsu s z+ClusterPipeline._split_command_across_slots)�mappingrA c C sb | j j}i }|�� D ](}t|�|d ��}|�|g ��|� q|�� D ]}| jdg|�R � qF| S )Nr ZMSET) r* r\ rJ r! r� �
setdefault�extendrn r� )r} r= r\ Z slots_pairsZpairr� �pairsrB rB rG �mset_nonatomic} s z ClusterPipeline.mset_nonatomic)TT)TT) rO rP rQ r� r� rR r~ r� r� r� r r r� r, r- r� r. r� r/ r r2 r1 r� r r4 r3 r� r< r r0 rA rB rB rB rG r� � sD $ � �� 4 �� :�
�r� r� r� rA c @ s. e Zd Zeeedd�dd�Zed�dd�ZdS )r0 N)r9 r� r@ rA c O s || _ || _|| _d | _d S r� )r� r@ r9 r )r} r9 r� r@ rB rB rG r~ � s zPipelineCommand.__init__r c C s d| j � d| j� d| j� d�S )N�[z] r6 �))r9 r� r@ r� rB rB rG r � s zPipelineCommand.__repr__)rO rP rQ r� r r~ r� r rB rB rB rG r0 � s r0 )Rr{ r r� r r� �typingr r r r r r r r r
r Zredis.asyncio.clientr Zredis.asyncio.connectionr
r r r Zredis.asyncio.parserr Z redis.clientr r r Z
redis.clusterr r r r r r r r r r Zredis.commandsr Z redis.crcr r! Zredis.exceptionsr" r# r$ r% r& r' r( r) r* r+ r, r- r. r/ Z redis.typingr0 r1 r2 Z redis.utilsr3 r4 r5 r� r6 rC rK rL rR r7 rz r� r� �replace�lower�setattrr0 rB rB rB rG �<module> sP 0
0 @�
( ]