File: //usr/local/lib/python3.9/site-packages/celery/bin/__pycache__/worker.cpython-39.pyc
a
X>hV2 � % @ s� d Z ddlZddlZddlZddlmZ ddlmZ ddlmZ ddl m
Z
m Z m Z m
Z
mZ ddlmZ ddlmZ dd lmZmZmZmZ dd
lmZ dd lmZm Z m Z ee �Z G d d
� d
e�Z G dd� dej!�Z"G dd� de�Z#G dd� de�Z$e � Z%e"� Z&e#� Z'e$� Z(ej)�*d�Z+dodd�Z,ej-e ddid�ej.dd e ed��e
e'd d d �ej.d d!e
ddd d"d#�ej.d$d%e
e�/� d&d'� d d(d)�ej.d*d+d,e
e d d-d �ej.d.d/d0e
e�!d1�d d2d �ej.d3e0d4d5d'� e
d d6d7�ej.d8d9e0d:d;d'� e
d<d=d7�ej.d>d?d@e&e
d<dAdB�ej.dCdDdEdde
d<dFdG�ej.dHe1e
d<dIdJ�ej.dKe1e
d<dLdJ�ej.dMe0e
d<dNdJ�ej.dOe0e
d<dPdJ�ej.dQdRde
dSdT�ej.dUdVe
e
dSdW�ej.dXdYe
e
dSdW�ej.dZd[e
e
dSdW�ej.d\de
d]dT�ej.d^de
d]dT�ej.d_de
d]dT�ej.d`e0e
d]dW�ej.dae(e
d]dW�ej.dbdce%e
dddde�ej.dfdgdhdid'� e
dddj�ej.dke
dddl�ej2edpdmdn�����������������������������Z3dS )qz/Program used to start a Celery worker instance.� N)� ParamType)�StringParamType)� concurrency)�COMMA_SEPARATED_LIST� LOG_LEVEL�CeleryDaemonCommand� CeleryOption�handle_preload_options)�BasePool)�
SecurityError)�
EX_FAILURE�EX_OK�detached�maybe_drop_privileges)�
get_logger)�default_nodename� host_format� node_formatc @ s e Zd ZdZdZdd� ZdS )�
CeleryBeatzCelery Beat flag.Zbeatc C s |j jjr|r| �d� |S )NzR-B option does not work on Windows. Please run celery beat as a separate service.)�obj�appZ
IS_WINDOWS�fail��self�value�param�ctx� r �;/usr/local/lib/python3.9/site-packages/celery/bin/worker.py�convert s
zCeleryBeat.convertN��__name__�
__module__� __qualname__�__doc__�namer r r r r r s r c s0 e Zd ZdZdZ� fdd�Z� fdd�Z� ZS )� WorkersPoolzWorkers pool option.�poolc s t � �t�� � dS )z=Initialize the workers pool option with the relevant choices.N)�super�__init__r Zget_available_pool_names)r �� __class__r r r) ( s zWorkersPool.__init__c sh t |t�rt|t�r|S t� �|||�}|jjjj }|dkrL|rLt
� |�}nt
� |�}|sdt
� |�}|S )N�prefork) �
isinstance�type�
issubclassr
r( r r r �conf� worker_poolr Zget_implementation)r r r r r1 r* r r r , s
zWorkersPool.convert)r! r" r# r$ r% r) r �
__classcell__r r r* r r& # s r& c @ s e Zd ZdZdZdd� ZdS )�HostnamezHostname option.�hostnamec C s t t|��S �N)r r r r r r r G s zHostname.convertNr r r r r r3 B s r3 c @ s e Zd ZdZdZdd� ZdS )� AutoscalezAutoscaling parameter.z <min workers>, <max workers>c C s� |� d�}t|�dkr,| �dt|�� d�� t|�dkrrzt|d �df}W n$ typ | �d|� d�� Y n0 zttttt|����W S ty� | �d|� d�� d�� Y n0 d S ) N�,� z9Expected two comma separated integers or one integer.Got z instead.� r zExpected an integer. Got z*Expected two comma separated integers.Got )
�split�lenr �int�
ValueError�tuple�reversed�sorted�map�joinr r r r r P s
�
�zAutoscale.convertNr r r r r r6 K s r6 �
C_FAKEFORKFc
C s� t rdn|}t|| �}t|||||||dd��� z2|
dur>|
} t�| | g| � tW W d � S ty� | du r�ddlm} | } | j j
d|| d� t j d d
�
| g| �d d � t Y W d � S 0 W d � n1 s�0 Y dS )
zDetach program by argv.r9 F)Z
after_forkersNr )� current_app�ERROR)r4 z
Can't exec %r� T)�exc_info)rC r r �os�execvr
� Exception�celeryrD �logZsetup_logging_subsystem�logger�criticalrB r )
�path�argv�logfile�pidfile�uid�gid�umask�workdirZfaker �
executabler4 rD r r r �detachl s*
� ��rX Zallow_extra_argsT)�clsZcontext_settingsz-nz
--hostnamezWorker Optionsz]Set custom hostname (e.g., 'w1@%%h'). Expands: %%h (hostname), %%n (name) and %%d, (domain).)�defaultrY r. �
help_group�help�-D�--detachz%Start worker as a background process.)rY �is_flagrZ r[ r\ z-Sz --statedbc C s |p| j jjjS r5 )r r r0 Zworker_state_db�r �_r r r r �<lambda>� s rb zPPath to the state database. The extension '.db' may be appended to the filename.)rY r. �callbackr[ r\ z-lz
--loglevel�WARNINGzLogging level.z-Oz--optimizationrZ )rZ ZfairzApply optimization profile.z--prefetch-multiplierz<prefetch multiplier>c C s |p| j jjjS r5 )r r r0 Zworker_prefetch_multiplierr` r r r rb � s z>Set custom prefetch multiplier value for this worker instance.)r. �metavarrc rY r[ r\ z-cz
--concurrencyz
<concurrency>c C s |p| j jjjS r5 )r r r0 Zworker_concurrencyr` r r r rb � s z Pool OptionszlNumber of child processes processing the queue. The default is the number of CPUs available on your system.z-Pz--poolr, zPool implementation.)rZ r. rY r[ r\ z-Ez
--task-eventsz--eventszdSend task-related events that can be captured by monitors like celery events, celerymon, and others.)r_ rZ rY r[ r\ z --time-limitz;Enables a hard time limit (in seconds int/float) for tasks.)r. rY r[ r\ z--soft-time-limitz;Enables a soft time limit (in seconds int/float) for tasks.z--max-tasks-per-childzfMaximum number of tasks a pool worker can execute before it's terminated and replaced by a new worker.z--max-memory-per-childa Maximum amount of resident memory, in KiB, that may be consumed by a child process before it will be replaced by a new one. If a single task causes a child process to exceed this limit, the task will be completed and the child process will be replaced afterwards.
Default: no limit.z--purgez --discardz
Queue Options)r_ rY r[ z--queuesz-Q)r. rY r[ z--exclude-queuesz-Xz --includez-Iz--without-gossipZFeaturesz--without-minglez--without-heartbeatz--heartbeat-intervalz --autoscalez-Bz--beatzEmbedded Beat Options)r. rY r_ r[ z-sz--schedule-filenamez
--schedulec C s |p| j jjjS r5 )r r r0 Zbeat_schedule_filenamer` r r r rb ! s )rc rY r[ z --scheduler)rY r[ c
K s� �z`| j j}| jrdz|j| jdd� W n< ttfyb } z tjd| � �| d��W Y d} ~ n
d} ~ 0 0 |
�dd��r
dd gt j
d
d� } d | v r�| � d � d | v r�| � d � d
| v r�| � d
� d| v r�| � d� t t j
| |||||
�dd�|
�dd�||
�dd�|d� W S t||d� |jf ||||t||�t| |�| j j| j jd�|
��}
|
�� | �|
j� W nB t�y� } z(| j �| jd � | �d
� W Y d} ~ n
d} ~ 0 0 dS )a* Start worker instance.
Examples
--------
$ celery --app=proj worker -l INFO
$ celery -A proj worker -l INFO -Q hipri,lopri
$ celery -A proj worker --concurrency=4
$ celery -A proj worker --concurrency=1000 -P eventlet
$ celery worker --autoscale=10,0
�worker)� namespacez?Unable to parse extra configuration from command line.
Reason: )r NrX Fz-mrK r9 r^ r] z--uidz--gidrU rV rW ) rQ rR rS rT rU rV r rW r4 )rS rT )r4 �pool_cls�loglevelrQ rR �statedb�no_color�quietr )r r �argsZconfig_from_cmdline�KeyErrorr= �clickZ
UsageError�get�sysrP �removerX rW r ZWorkerr rk rl �start�exit�exitcoder �error)r r4 rh r rS rT ri rQ rR rj �kwargs�erP rf r r r rf � sd 4��
� ��rf )
NNNNNNFNNN) NNNNNNNNN)4r$ rH rq ro r Z click.typesr rK r Zcelery.bin.baser r r r r Zcelery.concurrency.baser
Zcelery.exceptionsr Zcelery.platformsr r
r r Zcelery.utils.logr Zcelery.utils.nodenamesr r r r! rM r ZChoicer& r3 r6 Z CELERY_BEATZ WORKERS_POOL�HOSTNAMEZ AUTOSCALE�environrp rC rX �command�option�Pathr< �floatZ pass_contextrf r r r r �<module> s�
�
�
��� ��� � �� ����
������������ �