File: //proc/self/root/lib/python3.9/site-packages/ansible/parsing/__pycache__/dataloader.cpython-39.pyc
a
�)g�M � @ s
d dl mZmZmZ eZd dlZd dlZd dlZd dl Z d dl
Z
d dl m Z
d dlmZmZ d dlmZ d dlmZmZ d dlmZmZmZ d dlmZ d d l m Z d d
l m Z m Z m!Z!m"Z"m#Z# d d l$m%Z% d d l&m'Z' e'� Z(e �)d
ej*j+ej*j+f �Z,G dd� d�Z-dS )� )�absolute_import�division�print_functionN)� constants)�AnsibleFileNotFound�AnsibleParserError)�
is_executable)� binary_type� text_type)�to_bytes� to_native�to_text)�unquote)� from_yaml)�VaultLib�b_HEADER� is_encrypted�is_encrypted_file�parse_vaulttext_envelope)� unfrackpath)�Displayz(?:^|%s)+tasks%s?$c @ s� e Zd ZdZdd� Zdd� Zd4d d
�Zd5d d �Zd
d� Zdd� Z dd� Z
dd� Z dd� Z d6dd�Z
dd� Zd d � Zd d � Zd d!� Zd"d#� Zd7d$d%�Zd8d&d'�Zd(d)� Zd9d*d+�Zd,d-� Zd.d/� Zd:d0d1�Zd2d3� ZdS );�
DataLoadera
The DataLoader class is used to load and parse YAML or JSON content,
either from a given file name or from a string that was previously
read in through other means. A Vault password can be specified, and
any vault-encrypted files will be decrypted.
Data read from files will also be cached, so the file will never be
read from disk more than once.
Usage:
dl = DataLoader()
# optionally: dl.set_vault_password('foo')
ds = dl.load('...')
ds = dl.load_from_file('/path/to/file')
c C s2 d| _ t� | _t� | _i | _t� | _| �d � d S )N�.) �_basedir�dict� _FILE_CACHE�set�
_tempfilesZ_vaultsr �_vault�set_vault_secrets��self� r" �>/usr/lib/python3.9/site-packages/ansible/parsing/dataloader.py�__init__5 s zDataLoader.__init__c C s || j _d S �N)r �secrets)r! Z
vault_secretsr" r" r# r K s z DataLoader.set_vault_secrets�<string>TFc C s t |||| jj|d�S )zBackwards compat for now)� json_only)r r r& )r! �data� file_name� show_contentr( r" r" r# �loadN s zDataLoader.loadc C s~ | � |�}t�d| � |r2|| jv r2| j| }n6| �|�\}}t|dd�}| j||||d�}|| j|< |rp|S t�|�S dS )zA Loads data from a file, which can contain either JSON or YAML. zLoading data from %s�surrogate_or_strict��errors)r) r* r+ r( N) � path_dwim�display�debugr �_get_file_contentsr
r, �copy�deepcopy) r! r* �cacheZunsafer( Z parsed_dataZ b_file_datar+ Z file_datar" r" r# �load_from_fileR s
zDataLoader.load_from_filec C s | � |�}tj�t|dd��S �Nr- r. )r0 �os�path�existsr �r! r: r" r" r# � path_existsl s
zDataLoader.path_existsc C s( | � |�}tj�t|dd��p&|tjkS r8 )r0 r9 r: �isfiler �devnullr< r" r" r# �is_filep s
zDataLoader.is_filec C s | � |�}tj�t|dd��S r8 )r0 r9 r: �isdirr r< r" r" r# � is_directoryt s
zDataLoader.is_directoryc C s | � |�}t�|�S r% )r0 r9 �listdirr< r" r" r# �list_directoryx s
zDataLoader.list_directoryc C s | � |�}t|�S )z is the given path executable?)r0 r r< r" r" r# r | s
zDataLoader.is_executableNc C s@ t |�sd}||fS t|�\}}}}| jj||d�}d}||fS )zMDecrypt b_vault_data if encrypted and return b_data and the show_content flagT��filenameF)r r r �decrypt) r! Z b_vault_data� b_file_namer+ Z b_ciphertextZ b_versionZ cipher_nameZvault_idZb_datar" r" r# �_decrypt_if_vault_data� s z!DataLoader._decrypt_if_vault_datac
C s� |rt |ttf�s"tdt|� ��t| �|��}| �|�sFtd|d��zDt |d��&}|�
� }| � ||�W d � W S 1 s~0 Y W n@ t t
fy� } z$td|t|�f |d��W Y d}~n
d}~0 0 dS )a
Reads the file contents from the given file name
If the contents are vault-encrypted, it will decrypt them and return
the decrypted data
:arg file_name: The name of the file to read. If this is a relative
path, it will be expanded relative to the basedir
:raises AnsibleFileNotFound: if the file_name does not refer to a file
:raises AnsibleParserError: if we were unable to read the file
:return: Returns a byte string of the file contents
�Invalid filename: '%s'z Unable to retrieve file contents�r* �rbN�8an error occurred while trying to read the file '%s': %s�Zorig_exc)�
isinstancer r
r r r r0 r= r �open�readrI �IOError�OSError)r! r* rH �fr) �er" r" r# r3 � s
0z DataLoader._get_file_contentsc C s | j S )z returns the current basedir )r r r" r" r# � get_basedir� s zDataLoader.get_basedirc C s |durt |�| _dS )zK sets the base directory, used to find files when a relative path is given N)r
r )r! �basedirr" r" r# � set_basedir� s zDataLoader.set_basedirc C s^ t |�}t|dd�}|�ttjj��s0|�d�r6|}n t| jdd�}tj�||�}t|dd�S )z=
make relative paths work like folks expect.
r- r. �~F��follow) r r
�
startswithr9 r: �sepr �joinr )r! Zgivenr: rW r" r" r# r0 � s zDataLoader.path_dwimc C s, t |dd�}tj�|�}t t|dd�dd�}tj�|d�tj�|d�tj�|d�f}tj�|d�tj�|d �tj�|d
�tj�|d �tj�|d �tj�|d
�tj�|d�tj�|d �tj�|d
�tj�|d �tj�|d �tj�|d
�f }ttjj|�}ttjj|�}t� |��rt
|��s$t
|��r(dS dS )zR imperfect role detection, roles are still valid w/o tasks|meta/main.yml|yaml|etc r- r. FrZ s main.ymls main.yamls mains tasks/main.ymls tasks/main.yamls
tasks/mains
meta/main.ymls meta/main.yamls meta/mainT) r r9 r: �dirnamer r^ �mapr; �RE_TASKS�search�any) r! r: �b_pathZb_path_dirname�b_upathZuntasked_pathsZ tasked_pathsZexists_untaskedZ
exists_taskedr" r" r# �_is_role� s2 � � zDataLoader._is_rolec C s� g }t |dd�}|�t tjj��s,|�d�rB|�t|dd�� �n|�tj�|||�� t|dd�}|sr| �|�}|r�t �
|�r�ttj� |�dd�}| j }| �
|� |�ttj�|||�dd�� | �
|� |r�|�|�s�|�ttj�|d|�dd�� |�ttj�||�dd�� |�ttj�||�dd�� |�| �tj�||��� |�| �|�� |D ]"}tj�t|dd���r^ �q��q^|S )z�
find one file in either a role or playbook dir with or without
explicitly named dirname subdirs
Used in action plugins and lookups to find supplemental files that
could be in either place.
r- r. rY FrZ Ztasks)r
r\ r9 r: r] �appendr r^ rf ra rb r_ r rX �endswithr0 r; r ) r! r: r_ �source�is_rolerb rW Z cur_basedir� candidater" r" r# �path_dwim_relative� s0
z DataLoader.path_dwim_relativec C s t |dd�}t |dd�}d}g }|du r6t�d� �n�|rz|�d�sR|�tjj�rzt|dd�} tj�t | dd��rv| }�n|t� dd �
|� � |D ]�}
t|
dd�} t | dd�} tj� | �}
|s�| � |
��r
|
�
d
��r
|�tj�
tj� |
�||�� |�tj�
|
|�� q�|�d �d |k�r4|�tj�
| ||�� |�tj�
| |�� q�|�d �d |k�r�|�tj�
t | �� dd�||�� |�tj�
t | �� dd�|�� t� d
td�
|�� � |D ]8}t�d|t|�f � tj�|��r�t|�} �q��q�|du �rt|dd� |D �d��|S )au
find one file in first path in stack taking roles into account and adding play basedir as fallback
:arg paths: A list of text strings which are the paths to look for the filename in.
:arg dirname: A text string representing a directory. The directory
is prepended to the source to form the path to search for.
:arg source: A text string which is the filename to search for
:rtype: A text string
:returns: An absolute path to the filename ``source`` if found
:raises: An AnsibleFileNotFound Exception if the file is found to exist in the search paths
r- r. Nz:Invalid request to find a file that matches a "null" valuerY FrZ zevaluation_path:
%sz
s /tasks� /r zsearch_path:
%ss
zlooking for "%s" at "%s"c S s g | ] }t |��qS r" )r )�.0�pr" r" r# �
<listcomp>U � z7DataLoader.path_dwim_relative_stack.<locals>.<listcomp>)r* �paths)r r1 �warningr\ r9 r: r] r r; r2 r^ r_ rf rh rg �splitrV r
Zvvvvvr )r! rr r_ ri rj Z b_dirnameZb_source�resultrb Z test_pathr: Zupathre Z
b_pb_base_dirZ b_candidater" r" r# �path_dwim_relative_stack sB "
z#DataLoader.path_dwim_relative_stackc
C s� t jtjd�\}}t�|d�}t|�}zRz|�|� W n6 tyl } z t� |� t|��W Y d}~n
d}~0 0 W |�
� n
|�
� 0 |S )z. Create a tempfile containing defined content )�dir�wbN) �tempfileZmkstemp�CZDEFAULT_LOCAL_TMPr9 �fdopenr �write� Exception�remove�close)r! Zcontent�fdZcontent_tempfilerT �errr" r" r# �_create_content_tempfileY s
z#DataLoader._create_content_tempfilec
C s0 |rt |ttf�s"tdt|� ��t|dd�}| �|�rB| �|�sLt|d��| � |�}z�|r�t
t|�d��f}t |t t
�d�r�|�� }| jjs�tdt|� ��| jj||d�}| �|�}| j�|� W d � n1 s�0 Y |W S ttf�y* } z(td
t|�t|�f |d ��W Y d }~n
d }~0 0 d S ) z�
If the file is vault encrypted return a path to a temporary decrypted file
If the file is not encrypted then the path is returned
Temporary files are cleanup in the destructor
rJ r- r. rK rL )�countz:A vault password or secret must be specified to decrypt %srE NrM rN )rO r r
r r r r= r@ r r0 rP r �lenr rQ r r& rG r� r �addrR rS )r! � file_pathrG Z b_file_pathZ real_pathrT r) rU r" r" r# �
get_real_fileg s&
*zDataLoader.get_real_filec C s$ || j v r t�|� | j �|� dS )z�
Removes any temporary files created from a previous call to
get_real_file. file_path must be the path returned from a
previous call to get_real_file.
N)r r9 �unlinkr~ )r! r� r" r" r# �cleanup_tmp_file� s
zDataLoader.cleanup_tmp_filec C sZ t | j�D ]J}z| �|� W q
tyR } z t�dt|� � W Y d}~q
d}~0 0 q
dS )z�
Removes all temporary files that DataLoader has created
NOTE: not thread safe, forks also need special handling see __init__ for details.
z Unable to cleanup temp files: %sN)�listr r� r} r1 rs r
)r! rT rU r" r" r# �cleanup_all_tmp_files� s
z DataLoader.cleanup_all_tmp_filesc C s� t tj�||��}g }|du r*dgtj }|D ]x}d|v rH|t |� }n |r`d�|t |�g�}n|}| �|�r.| �|�r�|r.|�| � t
|�|�� q�q.n
|� |� q�q.|S )z�
Find vars files in a given path with specified name. This will find
files in a dir named <name>/ or a file called <name> ending in known
extensions.
N� r � .) r r9 r: r^ rz ZYAML_FILENAME_EXTENSIONSr= rB �extend�_get_dir_vars_filesr
rg ) r! r: �name�
extensionsZ allow_dirrd �found�ext� full_pathr" r" r# �find_vars_files� s$
zDataLoader.find_vars_filesc C s� g }t | �|��D ]|}|�d�s|�d�stj�|�d }tj�||�}| �|�rj|sj|� | �
||�� q| � |�r|r�t |�|v r|�
|� q|S )Nr rY ���)�sortedrD r\ rh r9 r: �splitextr^ rB r� r� r@ r
rg )r! r: r� r� Zspathr� Z
full_spathr" r" r# r� � s z DataLoader._get_dir_vars_files)r' TF)TFF)N)F)F)T)NT)�__name__�
__module__� __qualname__�__doc__r$ r r, r7 r= r@ rB rD r rI r3 rV rX r0 rf rl rv r� r� r� r� r� r� r" r" r" r# r " s0
"
7
;
(
"r ).Z
__future__r r r �typeZ
__metaclass__r4 r9 Zos.path�rery Zansibler rz Zansible.errorsr r Zansible.module_utils.basicr Zansible.module_utils.sixr r
Zansible.module_utils._textr r r
Zansible.parsing.quotingr Zansible.parsing.utils.yamlr Zansible.parsing.vaultr r r r r Zansible.utils.pathr Zansible.utils.displayr r1 �compiler: r] ra r r" r" r" r# �<module> s&