0x1949 Team - FAZEMRX - MANAGER
Edit File: util.cpython-310.pyc
o 3'�f`v � @ s d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl Z d dl Z d dl Z d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlmZ d dl m Z m Z d dlm Z m Z d dl!m"Z" d dl#m$Z$ d dl%m&Z& d dl'm(Z( d d l)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7 d d l8m9Z9 d dl:Z:d d l;m<Z<m=Z=m>Z>m?Z?m@Z@mAZAmBZBmCZCmDZDmEZE d d lFmGZG e+r�d d lHmIZI daJe �KeL�ZMe jNdiZOdejP ejQ ZRdZSdZTdd� ZUe$� dd� �ZVe$� dd� �ZW�dsde6eXeYf deXfdd �ZZ�dsd e6eXeYf deYfd d �Z[d eYdeYfd!d"�Z\d#d$� Z]G d%d&� d&�Z^G d'd(� d(e_�Z`G d)d*� d*e_�Zad+d,� Zb�dtd-d.�Zc�dtd/d0�Zd�dtd1d2�Ze�dud4d5�Zf�dtd6d7�Zgdd8�de/fd9d:�Zhd;d<� Zid=d>� Zjd?d@� Zk�dvdBdC�ZldDdE� ZmdFeXdenfdGdH�ZodIdJ� ZpdAdAde jqdAfdKdL�Zre$� dMdN� �Zse$� dOdP� �Zte$� dQdR� �Zue$� dSdT� �Zve$� dUdV� �Zwe$� dWdX� �Zx�dwdZd[�Zy�dtd\d]�Zz�dxd^d_�Z{�dtd`da�Z|e$� dbdc� �Z}ddde� Z~e$� dfdg� �Z�dtdhdi�Z��dtdjdk�Z�dldm� Z��dydndo�Z��dwdpe4e2 denfdqdr�Z�ej dsdt� �Z�ej dudv� �Z�dwdx� Z�dydz� Z��dzd}d~�Z��dtdd��Z�denffd�d��Z��d{d�d��Z�dd8�denfd�d��Z�dd8�denfd�d��Z��dtd�d��Z��dtd�d��Z�d�d�� Z�e d�g d���Z��dwd�d��Z��d|d�d��Z�de�fd�d��Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z� �d}d�d��Z� �d}d�d��Z� �d}d�d��Z� �d}d�d��Z� �d}d�d��Z��d~d�d��Z�d�d�� Z�ddYd��d�e6eXe j�f d�e3e-e�gdf d�e�deYfd�d��Z�ddYd��d�e6eXe j�f d�e3e-e�gdf d�e�deXfd�d��Z�e$� d�d�� �Z�d�d�� Z�de�fd�d��Z��dd�d��Z��dyd�dZ��dyd�dĄZ�d�e/eXe,f d�e3eX de1e3eX fd�dȄZ�d�e/eXe,f fd�dʄZ�e j�dAd˜d�e�ddfd�d΄Z��dtd�eXdeXfd�dфZ�d�e j�deYfd�dԄZ�d�dք Z�d�d Z�d�dڄ Z��d�d�d݄Z�enffd�d߄Z�d�d� Z��d�d�d�Z�ej d�d� �Z�d�d� Z� A�d�d�d�Z�d�d� Z�d�d� Z��dwd�d�Z�d�d� Z�d�d� Zd�d�� Z�e$� d�d�� �Z�d�d�� Z�d�d�� Z� ��d�dYd��d�e�d�e�ddfd��d �ZŐd�d� ZƐd�d� ZǐdeXde�f�d�d�ZȐdeXde�f�d �d �ZɐdeXdeXf�d �d �ZʐdeXdeXf�d �d�ZːdeXde1eX f�d�d�Z� �� Y�d�dAdd�d��d�d�Z͐d�d� Zΐd��d�d�Zϐd��d �d �ZАdy�d �d �Zѐd �d!� ZҐd"�d#� ZӐd$�d%� ZԐd&�d'� Z�e$� �d(�d)� �Zd*�d+� Zא ,�d��d-eX�d.eXde/eXeXf f�d/�d0�Zؐd1�d2� Zِd3�d4� Zڐd5�d6� Z�eMdYf�d7�d8�Zܐd9�d:� Zݐd;�d<� Zސd=�d>� Zߐd?�d@� Z�dw�dA�dB�Z�eMdYf�dC�dD�Z�dEeXde�f�dF�dG�Z�e5�dH�Z� Y�d��dIe-�dJe�f de�f�dK�dL�Z�dM�dN� Z�dde j�jNf�dO�dP�Z�d��dR�dS�Z�dT�dU� Z�dt�dV�dW�Z�dX�dY� Z�dZ�d[� Z�d\�d]� Z�d^�d_� Z�d��d`�da�Z�d��dc�dd�Z�de�df� Z�dy�dg�dh�Z�d��dk�dl�Z�dm�dndenf�do�dp�Z�e de0de,df f�dq�dr��Z�dS (� � N)� b64decode)�deque� namedtuple)�contextmanager�suppress)�ENOENT)� lru_cache)�Path)� ModuleType)�IO� TYPE_CHECKING�Any�Callable�Deque�Dict� Generator�List�Mapping�Optional�Sequence�TypeVar�Union�cast)�parse) �features�importer�mergers�net�settings�subp� temp_utils� type_utils� url_helper�version)� CFG_BUILTIN)�Paths�_z_-.())�true�1�on�yes)�off�0�no�falsec C s" t ttt�� j�d�d d� ��S )N�.� )�tuple�map�int�os�uname�release�split� r8 r8 �0/usr/lib/python3/dist-packages/cloudinit/util.py�kernel_version^ s "r: c C s t j ddgdd�} | j�� S )z�Return the sanitized string output by `dpkg --print-architecture`. N.B. This function is wrapped in functools.lru_cache, so repeated calls won't shell out every time. �dpkgz--print-architectureT��capture)r �stdout�strip)�outr8 r8 r9 �get_dpkg_architectureb s rA c s� ddddd�} i � zCt j ddgdd �}|j�� D ]}|�d �\}}}|| v r.|�� � | | < q� fd d �| �� D �}t|�rJt�d d� |�� W � S W � S t j yq } zt�d|� t dd� | �� D ��� W Y d }~� S d }~ww )N�codename� description�idr6 )�Codename� DescriptionzDistributor ID�Release� lsb_releasez--allTr< �:c s g | ]}|� vr|�qS r8 r8 )�.0�k��datar8 r9 � <listcomp>} s z lsb_release.<locals>.<listcomp>z.Missing fields in lsb_release --all output: %s�,z#Unable to get lsb_release --all: %sc s s � | ]}|d fV qdS )� UNAVAILABLENr8 �rJ �vr8 r8 r9 � <genexpr>� s � z lsb_release.<locals>.<genexpr>) r r> � splitlines� partitionr? �values�len�LOG�warning�join�ProcessExecutionError�dict)�fmapr@ �line�fnamer& �val�missing�errr8 rL r9 rH m s8 ��� � � ��rH �utf-8�blob�returnc C � t | t�r| S | j|d�S �N)�encoding)� isinstance�str�decode)rd rh r8 r8 r9 � decode_binary� � rl �textc C rf rg )ri �bytes�encode)rn rh r8 r8 r9 � encode_text� rm rq rM c C sB t | t�s tdt| � ��zt| dd�W S tjy | Y S w )z�base64 decode data If data is base64 encoded bytes, return b64decode(data). If not, return data unmodified. @param data: data as bytes. TypeError is raised if not bytes. z data is '%s', expected bytesT)�validate)ri ro � TypeError�typer �binascii�ErrorrL r8 r8 r9 �maybe_b64decode� s �rw c C sP | j dd�}| �� dkr&t|t�r&| �� }|r |jr |j}nd}|�|d�S |S )NT)rk rn rc �surrogateescape)� get_payload�get_content_maintyperi ro � get_charset� input_codecrk )�part� cte_payload�charsetrh r8 r8 r9 �fully_decoded_payload� s � r� c @ s& e Zd Zd dd�Zdd� Zdd� ZdS ) � SeLinuxGuardFc C s> | zt �d�| _W n ty d | _Y nw || _|| _d S )N�selinux)r � import_moduler� � ImportError�path� recursive)�selfr� r� r8 r8 r9 �__init__� s � zSeLinuxGuard.__init__c C s | j r | j �� r dS dS �NTF)r� �is_selinux_enabled)r� r8 r8 r9 � __enter__� s zSeLinuxGuard.__enter__c C s� | j r| j �� s d S tj�| j�sd S tj�| j�}zt�|�}| j �||tj � W n t y5 Y d S w t � d|| j � z | j j|| j d� W d S t yf } zt �d|| j |� W Y d }~d S d }~ww )Nz,Restoring selinux mode for %s (recursive=%s)�r� z,restorecon failed on %s,%s maybe badness? %s)r� r� r4 r� �lexists�realpath�lstat� matchpathcon�stat�ST_MODE�OSErrorrX �debugr� � restoreconrY )r� � excp_type� excp_value�excp_tracebackr� �stats�er8 r8 r9 �__exit__� s6 �����zSeLinuxGuard.__exit__N�F)�__name__� __module__� __qualname__r� r� r� r8 r8 r8 r9 r� � s r� c @ � e Zd ZdS )�MountFailedErrorN�r� r� r� r8 r8 r8 r9 r� � � r� c @ r� )�DecompressionErrorNr� r8 r8 r8 r9 r� � r� r� c O sx t �� }|dkr0z| |i |�� t �d� W d S ty/ ttdt�| �� t �d� Y d S w t�d|t�| �� d S )Nr z&Failed forking and calling callback %s� z(Forked child %s who will run callback %s) r4 �fork�_exit� Exception�logexcrX r! �obj_namer� )�child_cb�args�kwargs�fidr8 r8 r9 �fork_cb� s$ ���r� c C sB t | t�r | du S t}|rt|�| }t| ��� �� |v r dS dS r� )ri �bool� TRUE_STRINGS�listrj �lowerr? �r` �addons� check_setr8 r8 r9 �is_true � r� c C sB t | t�r | du S t}|rt|�| }t| ��� �� |v r dS dS )NFT)ri r� � FALSE_STRINGSr� rj r� r? r� r8 r8 r9 �is_false r� r� c C s | sdS t | t�r | S t| |�S �NF)ri r� r� )r` r� r8 r8 r9 �translate_bool s r� � c s6 t �� � �s tjtj �d�� �fdd�t| �D ��S )N� c s g | ]}� � ���qS r8 )�choice)rJ �_x��r� select_fromr8 r9 rN ) s z rand_str.<locals>.<listcomp>)�random� SystemRandom�string� ascii_letters�digitsrZ �range)�strlenr� r8 r� r9 �rand_str% s r� c C s, |sd} t dd�d | }|| vr |S q)Nr� T� )r� r& )r� )� dictionary�postfix�newkeyr8 r8 r9 � rand_dict_key, s �r� ��instance_data_filec C s� ddl m}m}m}m} zt| �}W n ty i Y S w |rrtj� |�rrz||| |�}t � d|| � W n< |yN } z t � d| |� W Y d}~n(d}~w |yV Y n |yq } zt � d||t |�� W Y d}~nd}~ww t|i d�S )z>Read a yaml config with optional template, and convert to dictr )�JinjaLoadError�JinjaSyntaxParsingException� NotJinjaError� render_jinja_payload_from_filez?Applied instance data in '%s' to configuration loaded from '%s'z4Failed to render templated yaml config file '%s'. %sNz:Could not apply Jinja template '%s' to '%s'. Exception: %s��default)�!cloudinit.handlers.jinja_templater� r� r� r� �load_text_file�FileNotFoundErrorr4 r� �existsrX r� rY �repr� load_yaml)r_ r� r� r� r� r� � config_filer� r8 r8 r9 � read_conf6 sJ ����� ��� r� c G s t t| � �S �N)�sorted� uniq_merge)�listsr8 r8 r9 �uniq_merge_sortedj � r� c G sF g }| D ]}t |t�r|�� �d�}dd� |D �}|�|� qt|�S )NrO c S � g | ]}|r|�qS r8 r8 )rJ �ar8 r8 r9 rN | � z uniq_merge.<locals>.<listcomp>)ri rj r? r7 �extend� uniq_list)r� � combined_list�a_listr8 r8 r9 r� v s r� c C s` t �� D ] \}}| �||�} qg }| D ] }|tvr |�|� q|D ]}| �|d�} q!| �� } | S )Nr� )�FN_REPLACEMENTS�items�replace� FN_ALLOWED�appendr? )�fnrK rR �removalsr8 r8 r9 �clean_filename� s �r� Tc C s� zWt �t| ���E}t�d dd|��+}|r)t|�� �W d � W d � W S |�� W d � W d � W S 1 s?w Y W d � W d S 1 sPw Y W d S tyt } z|ri| W Y d }~S tt |��|�d }~ww )N�rbr� ) �io�BytesIOrq �gzip�GzipFilerl �readr� r� rj )rM �quietrk �buf�ghr� r8 r8 r9 � decomp_gzip� s � �X���r� c C s~ | sdS | � dd�}|d �� }t|�dkr |d �� }nd }|r+|dks+|�� dkr-d }|r9|dks9|�� dkr;d }||fS )N�NNrI r� r r0 z-1�none)r7 r? rW r� )�ug_pair� ug_parted�u�gr8 r8 r9 �extract_usergroup� s r �root_dirc C sh t � }t�tj�| d��D ]$}tj�|�sq tj�|�dd� }|�� }|r1|�d�dkr1|||< q |S )Nz*.pyr ���r/ ���) r\ �globr4 r� rZ �isfile�basenamer? �find)r �entriesr_ �modnamer8 r8 r9 �get_modules_from_dir� s �r c C sB t | d��}|�|� |�� W d � d S 1 sw Y d S )N�w)�open�write�flush)�conpathrn �wfhr8 r8 r9 �write_to_console� s "�r c C s� |rt j�| � |rEd}d}tj�|�r;z t|| � d}W n ty: d}t j�|� d�� |r8|� t j |� Y nw |rE|sEt j�| � |ra| d dkrY|� || d d� � d S |� || � d S d S )Nz /dev/consoleFTz Failed to write to /dev/console� r ) �sys�stderrr r4 r� r� r r� r> �log�logging�WARNING) rn �consoler r � log_level�fallback_to_stdoutr �writing_to_console_worked� console_errorr8 r8 r9 � multi_log� s. �� �r# c C s dt �� v S )a deprecated: prefer Distro object's `is_linux` property Multiple sources of truth is bad, and already know whether we are working with Linux from the Distro class. Using Distro offers greater code reusablity, cleaner code, and easier maintenance. �Linux��platform�systemr8 r8 r8 r9 �is_Linux� s r( c C s$ dt �� v rdS t �� dkrdS dS )N�BSDT� DragonFlyFr% r8 r8 r8 r9 �is_BSD� s r+ c C � t � d dkS )N�variant�freebsd�� system_infor8 r8 r8 r9 � is_FreeBSD � r1 c C r, )Nr- � dragonflyr/ r8 r8 r8 r9 �is_DragonFlyBSD r2 r4 c C r, )Nr- �netbsdr/ r8 r8 r8 r9 � is_NetBSD r2 r6 c C r, )Nr- �openbsdr/ r8 r8 r8 r9 � is_OpenBSD r2 r8 Fc C s || vr|S t | | �S r� )r� ��yobj�keyr� r8 r8 r9 �get_cfg_option_bool s r< c C s* || vr|S | | }t |t�st|�}|S r� )ri rj )r: r; r� r` r8 r8 r9 �get_cfg_option_str s r= c C � t t| ||d��S )Nr� )r3 r= r9 r8 r8 r9 �get_cfg_option_int# s r? c C s� | sd} t j�| �s i S t| �}d}d|v rd}t�||�}|rS|�� }d|d v r0|d |d< |d �� �d�d |d< |d d krGd |d< |d |d |d d �S i S ) z�Return a dictionary of distro info fields from /etc/redhat-release. Dict keys will align with /etc/os-release keys: ID, VERSION_ID, VERSION_CODENAME z/etc/redhat-releasezA(?P<name>.+) release (?P<version>[\d\.]+) \((?P<codename>[^)]+)\)� Virtuozzoz)(?P<name>.+) release (?P<version>[\d\.]+)�namerB z linuxr zred hat enterprise�redhatr# )�ID� VERSION_ID�VERSION_CODENAME) r4 r� r� r� �re�match� groupdictr� rU )� release_file�redhat_release� redhat_regexrG �groupr8 r8 r9 �_parse_redhat_release' s, � �rM c C s� d} d}d}i }d}t j�d�rttd��}|s d}t� }|ru|�dd�} |�dd�}d| v s3d| v r8t�� }n6| d ks@| d krG|�d d�}n'| d krT|sT|�d d�}n|�d d�}|snt � d|�dd��}|rn|� � d }| dkrtd} nJt � r�t� � �� } t�� }n<d}z%zt�� }W n ty� Y nw W d }|D ]}|r�d}q�|s�t�d� |S d }|D ]}|r�d}q�|s�t�d� w w | ||fS )Nr� F�/etc/os-releaseTrC rD �sles�suse�alpine�photon� PRETTY_NAME� virtuozzorE z [^ ]+ \((?P<codename>[^)]+)\)�VERSIONrB �rhelrB )r� r� r� r� zPUnable to determine distribution, template expansion may have unexpected results)r4 r� r� �load_shell_contentr� rM �getr& �machinerF rG rH r+ r' r� r6 �distr� rX rY ) � distro_name�distro_version�flavor� os_release�os_release_rhelrG rZ �found�entryr8 r8 r9 �get_linux_distroO sz � � �������� rb c C s� | d � � }d}|dkr8| d d � � }|dv r |}|S |dv r$d}|S |d kr,d }|S |d v r4d }|S d}|S |d v r>|}|S )Nr' �unknown�linuxrZ r )� almalinuxrQ �aosc�arch� azurelinux�centos� cloudlinux�debian� eurolinux�fedora�mariner� miraclelinux� openeuler� opencloudos� openmandrivarR rV �rockyrP � tencentosrT )�ubuntu� linuxmint�mintru rB rV )�opensusez opensuse-leapzopensuse-microoszopensuse-tumbleweed�sle_hpcz sle-microrO rP )�windows�darwinr. r5 r7 r3 )r� )�infor' r- � linux_distr8 r8 r9 � _get_variant� s* ��� � �r~ c C s< t � � t �� t �� t �� tt �� �t� d�} t| �| d< | S )N)r& r' r6 �pythonr5 rZ r- )r& r' r6 �python_versionr� r5 rb r~ )r| r8 r8 r9 r0 � s � r0 c C sX || vr|S | | du rg S | | }t |t�r dd� |D �}|S t |t�s)t|�}|gS )a� Gets the C{key} config option from C{yobj} as a list of strings. If the key is present as a single string it will be returned as a list with one string arg. @param yobj: The configuration object. @param key: The configuration key to get. @param default: The default to return if key is not found. @return: The configuration option as a list of strings or default if key is not found. Nc S s g | ]}|�qS r8 r8 rQ r8 r8 r9 rN � s z'get_cfg_option_list.<locals>.<listcomp>)ri r� rj )r: r; r� r` �cvalr8 r8 r9 �get_cfg_option_list� s r� c C s> t |t�r |�d�}| }|D ]}||vr| S || }q|S )a� Return the value of the item at path C{keyp} in C{yobj}. example: get_cfg_by_path({'a': {'b': {'num': 4}}}, 'a/b/num') == 4 get_cfg_by_path({'a': {'b': {'num': 4}}}, 'c/d') == None @param yobj: A dictionary. @param keyp: A path inside yobj. it can be a '/' delimited string, or an iterable. @param default: The default to return if the path does not exist. @return: The value of the item at keyp." is not found.�/)ri rj r7 )r: �keypr� �cur�tokr8 r8 r9 �get_cfg_by_path� s r� c C s t | |�\}}t||� ||fS r� )�get_output_cfg�redirect_output)�cfg�mode�outfmt�errfmtr8 r8 r9 � fixup_output s r� c C s� t tj�d��rt�d� d S |stj}|stj}dd� }| r�t�d|| � | � dd�\}}|dks6|d krDd }|dkr>d }t ||�}n |d kr[t j |d t j |d�} ttt | j�}ntd| ��|rmt�|�� |�� � || kr�t�d|| � t�|�� |�� � d S |r�t�d||� |� dd�\}}|dks�|d kr�d }|dkr�d }t ||�}n |d kr�t j |d t j |d�} ttt | j�}ntd| ��|r�t�|�� |�� � d S d S d S )N�_CLOUD_INIT_SAVE_STDOUTz5Not redirecting output due to _CLOUD_INIT_SAVE_STDOUTc S s> t �d� zt�d�j} W n ty Y dS w t �| � dS )a� Reconfigure umask and group ID to create output files securely. This is passed to subprocess.Popen as preexec_fn, so it is executed in the context of the newly-created process. It: * sets the umask of the process so created files aren't world-readable * if an adm group exists in the system, sets that as the process' GID (so that the created file(s) are owned by root:adm) � �admN)r4 �umask�grp�getgrnam�gr_gid�KeyError�setgid)�group_idr8 r8 r9 � set_subprocess_umask_and_gid& s �z5redirect_output.<locals>.set_subprocess_umask_and_gidzRedirecting %s to %s� r� �>�>>�ab�wb�|T)�shell�stdin� preexec_fnz"Invalid type for output format: %sz!Invalid type for error format: %s)r� r4 �environrX rX r� r r> r r7 r � subprocess�Popen�PIPEr r r r� rs �dup2�fileno) r� r� �o_out�o_errr� r� �arg�owith�new_fp�procr8 r8 r9 r� sh � � �r� �sourcesc C sR |rt t| ��} i }| D ]}|r&t�|�}|st�� }t�|�}|�||�}q |S )aF Merge multiple dicts according to the dict merger rules. Dict merger rules can be found in cloud-init documentation. If no mergers have been specified, entries will be recursively added, but no values get replaced if they already exist. Functionally, this means that the highest priority keys must be specified first. Example: a = { "a": 1, "b": 2, "c": [1, 2, 3], "d": { "a": 1, "b": 2, }, } b = { "a": 10, "c": [4], "d": { "a": 3, "f": 10, }, "e": 20, } mergemanydict([a, b]) results in: { 'a': 1, 'b': 2, 'c': [1, 2, 3], 'd': { 'a': 1, 'b': 2, 'f': 10, }, 'e': 20, } )r� �reversedr �dict_extract_mergers�default_mergers� construct�merge)r� �reverse� merged_cfgr� �mergers_to_apply�mergerr8 r8 r9 � mergemanydicto s * �r� c c s8 � t �� }zt �| � | V W t �|� d S t �|� w r� )r4 �getcwd�chdir)�ndir�currr8 r8 r9 r� � s � r� c c s0 � t �| �}z |V W t �|� d S t �|� w r� )r4 r� )�n_msk�oldr8 r8 r9 r� � s � r� c C s dj | |d|d�S )Nz{0:{fill}{align}{size}}�^)�fill�align�size)�format)rn r� �max_lenr8 r8 r9 �center� s �r� c C s t �d| � t�| � d S )NzRecursively deleting %s)rX r� �shutil�rmtree�r� r8 r8 r9 �del_dir� s r� r� � c C st z t |||d�\}}}}|| d< || d< || d< || d< W dS tjy9 } z|jtjkr4W Y d}~dS � d}~ww ) z� returns boolean indicating success or failure (presense of files) if files are present, populates 'fill' dictionary with 'user-data' and 'meta-data' entries )�base�ext�timeout� user-data� vendor-data� meta-dataznetwork-configTNF)� read_seededr" �UrlError�code� NOT_FOUND) r� r� r� r� �md�ud�vd�networkr� r8 r8 r9 �read_optional_seed� s ��r� c C s� i }| s ddg}nt j�| �d�d�t j�| �d�d�g}t|�}dd� |D �}d }|D ]}t j�t j�|d��rBt j�|d�} nq,d }|D ]}t j�t j�|d��r]t j�|d�} nqG|rl|rl||d < ||d < |S |rr||d < |S ) Nz/var/lib/cloud/data/sslz /var/lib/cloud/instance/data/sslrM �sslc S s g | ] }|rt j�|�r|�qS r8 )r4 r� �isdir)rJ �dr8 r8 r9 rN � s z%fetch_ssl_details.<locals>.<listcomp>zcert.pemzkey.pem� cert_file�key_file)r4 r� rZ � get_ipath_cur� get_cpathr� r )�paths� ssl_details�ssl_cert_pathsr� r� r� r8 r8 r9 �fetch_ssl_details� s: �����r� c C s |}t | �} z/t�dt| �|� t�| �}|d u r!t�d� |}nt||�s1td|t� |�f ��|}W |S tj tt fy� } zJd}d }t |d�rUt |d�rUt |d�}nt |d�rdt |d�rdt |d�}|rw|dj|jd |jd |d �7 }n|d j|d �7 }t�|� W Y d }~|S d }~ww ) NzKAttempting to load yaml from string of length %s with allowed root types %sz-loaded blob returned None, returning default.z2Yaml load allows %s root types, but got %s insteadzFailed loading yaml blob� context_mark� problem_markz5. Invalid format at line {line} column {col}: "{err}"r� )r^ �colrb z. {err})rb )rl rX r� rW �yaml� safe_loadri rs r! r� � YAMLError� ValueError�hasattr�getattrr� r^ �columnrY )rd r� �allowed�loaded� convertedr� �msg�markr8 r8 r9 r� � sL � ��� ����r� � c C sV | � d�dkr | �dd| �}| �dd| �}| �dd| �}n*tjr5| d dkr5t�| �jdkr5| d7 } d | d|f }d | d|f }d | d|f }d }tj|||d �}d } |� � rat |j i d �} tj|||d �} d } | � � rr| j } d } z tj|||d �} W n tj y� } z t �d |� W Y d }~nd }~ww | � � r�| j } nt �d � | | | |fS )Nz%sr r� r� r� r r� r� z%s%s%s)r� �retriesr� z!Error in vendor-data response: %sz Error in vendor-data response)r r� r �%NOCLOUD_SEED_URL_APPEND_FORWARD_SLASHr �urlparse�queryr" �read_file_or_url�okr� �contentsr� rX r� )r� r� r� r� �ud_url�vd_url�md_urlr� �md_respr� �ud_respr� r� �vd_respr� r8 r8 r9 r� ! sH �� ��� r� c s� t t�� �dd�}dd� |D �}� fdd�|D �}g }|D ];}tj�� |�}z |�t||d�� W q ty@ t� d|� Y q t yX } z t� d||� W Y d }~q d }~ww t |�S ) z Read configuration directory.T�r� c S � g | ] }|� d �r|�qS )z.cfg)�endswith�rJ �fr8 r8 r9 rN S � z read_conf_d.<locals>.<listcomp>c s& g | ]}t j�t j�� |��r|�qS r8 )r4 r� r rZ r ��confdr8 r9 rN V s & r� �1REDACTED config part %s, insufficient permissions� Error accessing file %s: [%s]N) r� r4 �listdirr� rZ r� r� �PermissionErrorrX rY r� r� )r r� �confs�cfgsr� r� r� r8 r r9 � read_conf_dM s, �� ���r c C s t � }i }zt| |d�}W n' ty t�d| � Y n ty4 } z t�d| |� W Y d}~n d}~ww |�|� d}d|v r]|d }|r\t|t�sVt d| t � |�f ��t|�� � }nt j�| � d��rk| � d�}|r~t j�|�r~t||d�}|�|� t|�S ) a Read yaml file along with optional ".d" directory, return merged config Given a yaml file, load the file as a dictionary. Additionally, if there exists a same-named directory with .d extension, read all files from that directory in order and return the merged config. The template file is optional and will be applied to any applicable jinja file in the configs. For example, this function can read both /etc/cloud/cloud.cfg and all files in /etc/cloud/cloud.cfg.d and merge all configs into a single dict. r� r r Nr� �conf_dz8Config file %s contains 'conf_d' with non-string type %sz.d)r r� r rX rY r� r� ri rj rs r! r� r? r4 r� r� r � appendleftr� )�cfgfiler� r r� r� r � confd_cfgr8 r8 r9 �read_conf_with_confdm s> ��� �� � r c C s t t| d��S )N��cmdline)r� �read_cc_from_cmdliner r8 r8 r9 �read_conf_from_cmdline� r2 r c C s� | d u rt � } d| � �} d}d}t|�}t|�}t| �}g }| �|�}|dkrU| �||| �}|dk r5|}|�t�| || |� �� ��dd�� | �||| �}|dks'd�|�S )Nr� z cc:�end_ccr z\nr ) � get_cmdlinerW r r� r �unquote�lstripr� rZ ) r � tag_begin�tag_end�begin_l�end_l�clen�tokens�begin�endr8 r8 r9 r � s, ��� r c C s2 | � d�}|dks| |d dkr| S | �dd�S )Nr r r� � z )r r� )r� �posr8 r8 r9 �dos2unix� s r) �HostnameFqdnInfo)�hostname�fqdn� is_defaultc C s� d}d| v r| d }t | d|�d�d �}n6d| v r3| d �d�dkr3| d }| d d|�d�� }n|jd|d�j}d| v rD| d }n|j|d �\}}t|||�S ) a� Get hostname and fqdn from config if present and fallback to cloud. @param cfg: Dictionary of merged user-data configuration (from init.cfg). @param cloud: Cloud instance from init.cloudify(). @param metadata_only: Boolean, set True to only query cloud meta-data, returning None if not present in meta-data. @return: a namedtuple of <hostname>, <fqdn>, <is_default> (str, str, bool). Values can be none when metadata_only is True and no cfg or metadata provides hostname info. is_default is a bool and it's true only if hostname is localhost and was returned by util.get_hostname() as a default. This is used to differentiate with a user-defined localhost hostname. Fr, r+ r/ r NT)r, � metadata_only)r. )r= r7 r � get_hostnamer+ r* )r� �cloudr. r- r, r+ r8 r8 r9 �get_hostname_fqdn� s$ �� � r1 � /etc/hostsc C s� d}z=t |��� D ]3}|�d�}|dkr|d|� }|�� }|s!q |�� }t|�dk r,q | |dd� v r<|d } W |S q W |S tyI Y |S w )a� For each host a single line should be present with the following information: IP_address canonical_hostname [aliases...] Fields of the entry are separated by any number of blanks and/or tab characters. Text from a "#" character until the end of the line is a comment, and is ignored. Host names may contain only alphanumeric characters, minus signs ("-"), and periods ("."). They must begin with an alphabetic character and end with an alphanumeric character. Optional aliases provide for name changes, alternate spellings, shorter hostnames, or generic hostnames (for example, localhost). N�#r � r0 r� )r� rT r r? r7 rW �IOError)r+ �filenamer, r^ �hashpos�toksr8 r8 r9 �get_fqdn_from_hosts� s. �� ��r9 c C sP t �| �}|j}tdu r_t� }d}i }|D ]?}z0t�|dddtjtj�}g ||< |D ]\}} } } } || � d| | d f � |� | d � q*W q tj tj fyT Y qw |a|r_t �d|� z:tt�� t�|j�d��rx W d � W dS W d � n1 s�w Y t�|d�}|d d d } | tvW S tj tj fy� Y d S w ) a� determine if a url's network address is resolvable, return a boolean This also attempts to be resilent against dns redirection. Note, that normal nsswitch resolution is used here. So in order to avoid any utilization of 'search' entries in /etc/resolv.conf we have to append '.'. The top level 'invalid' domain is invalid per RFC. And example.com should also not exist. The '__cloud_init_expected_not_found__' entry will be resolved inside the search list. N)zdoes-not-exist.example.com.zexample.invalid.�!__cloud_init_expected_not_found__r z%s: %sz detected dns redirection: %sz[]T� F)r r� r+ �_DNS_REDIRECT_IP�set�socket� getaddrinfo� SOCK_STREAM� AI_CANONNAMEr� �add�gaierror�errorrX r� r r� r � is_ip_address�netlocr? )�url� parsed_urlrA �badips�badnames� badresults�iname�result�_fam�_stype�_proto�cname�sockaddr�addrr8 r8 r9 � is_resolvable% sF ��� � � �rT c C s t �� } | S r� )r> � gethostname)r+ r8 r8 r9 r/ X s r/ c C s( zt �| �d W S t jy Y d S w �Nr )r> � gethostbyaddr�herror)�ipr8 r8 r9 rW ] s �rW c C s t tjd| t| fd�S )z5determine if this url is resolvable (existing or ip).zResolving URL: )�logfuncr� �funcr� )�log_timerX r� rT )rG r8 r8 r9 �is_resolvable_urld s �r] c C sZ | du rdS t �d| � | D ] }zt|�r t �d|� |W S W q ty* Y qw dS )zc Search through a list of mirror urls for one that works This needs to return quickly. Nz%search for mirror in candidates: '%s'zfound working mirror: '%s')rX r� r] r� )� candidates�candr8 r8 r9 �search_for_mirrorn s � �r` �devicec C sz g }| st � d�t � d� S | �d�r'| �d�}dd� d| d| fD �}|S | dkr2t � d�}|S | d kr;t � d�}|S ) Nz/dev/msdosfs/*z/dev/iso9660/*�LABEL=c S � g | ] }t j�|�r|�qS r8 �r4 r� r� )rJ �pr8 r8 r9 rN � s ��z*find_devs_with_freebsd.<locals>.<listcomp>z /dev/msdosfs/z /dev/iso9660/� TYPE=vfat� TYPE=iso9660)r � startswithr )�criteria�oformat�tag�no_cacher� �devlist�labelr8 r8 r9 �find_devs_with_freebsd� s � � � ro c C s� g }d }d }d}| r | � d�r| �d�}| � d�r | �d�}tjg d�dgd�} | j�� D ]5} |s3|r@tjd| gddgd�\}} |rId | |vrIq-|d krRd |vrRq-|d kr[d |v r[q-|�d | � q-|S )Nr� rb zTYPE=��sysctl�-nz hw.disknamesr ��rcs� mscdlabelr� z label "%s"�iso9660zISO filesystem�vfat�/dev/)rh r r r> r7 r� ) ri rj rk rl r� rm rn �_type� mscdlabel_outr@ �devr& r8 r8 r9 �find_devs_with_netbsd� s* r| c C s� t j g d�dgd�}g }|j�� �d�D ](}|�d�s q|dkr!q|�|d d� d � |�d �s<|�|d d� d � qd d � |D �S ) Nrp r rs rO rI zfd0:r r� �cd�ic S � g | ]}d | �qS �rx r8 �rJ r~ r8 r8 r9 rN � r� z*find_devs_with_openbsd.<locals>.<listcomp>)r r> �rstripr7 r r� rh )ri rj rk rl r� r@ rm ra r8 r8 r9 �find_devs_with_openbsd� s �r� c C s~ t j g d�dgd�}dd� t|j�� dd�D �}| dkr$d d� |D �}n| d v r0d d� |D �}n| r8t�d | � d d� |D �S )N)rq rr z kern.disksr rs c S s$ g | ]}|� d �s|� d�s|�qS )r� �vn�rh r� r8 r8 r9 rN � s ���z/find_devs_with_dragonflybsd.<locals>.<listcomp>Tr rg c S r �)r} �acdr� r� r8 r8 r9 rN � r )zLABEL=CONFIG-2rf c S s g | ] }|� d �s|�qS r� r� r� r8 r8 r9 rN � r zUnexpected criteria: %sc S r r� r8 r� r8 r8 r9 rN � r� )r r� r> r7 rX r� )ri rj rk rl r� r@ rm r8 r8 r9 �find_devs_with_dragonflybsd� s � r� c C s@ t � r t| ||||�S t� rt| ||||�S t� r!t| ||||�S t� r,t| ||||�S dg}g }| r:|�d| � |rC|�d| � |rL|� ddg� |rU|�d| � |r\|�|� || }z t j |ddgd �\}} W n t j y� } z| j t kr~d }n� W Y d } ~ nd } ~ ww g } |�� D ] } | �� } | r�| �| � q�| S ) z� find devices matching given criteria (via blkid) criteria can be *one* of: TYPE=<filesystem> LABEL=<label> UUID=<uuid> �blkidz-t%sz-s%s�-c� /dev/nullz-o%sr r0 rs r� N)r1 ro r6 r| r8 r� r4 r� r� r� r r[ �errnor rT r? ) ri rj rk rl r� � blk_id_cmd�options�cmdr@ �_errr� r r^ r8 r8 r9 �find_devs_with� sN � ��� �r� c C s� | du rg } nt | �} g d�}|r|�ddg� |�| � tj|ddd�}i }|j�� D ]}|�d�\}}}t|�||< ||| d < q,|S ) z�Get all device tags details from blkid. @param devs: Optional list of device paths you wish to query. @param disable_cache: Bool, set True to start with clean cache. @return: Dict of key value pairs of info for the device. N)r� �-o�fullr� r� Tr� )r= rk rI �DEVNAME)r� r� r r> rT rU rW ) �devs� disable_cacher� r@ �retr^ r{ r& rM r8 r8 r9 r� s r� c C s& g }| D ] }||v r q|� |� q|S r� )r� )�in_list�out_listr~ r8 r8 r9 r� 2 s r� ��read_cbr� r_ r� r� c C s� t �d| |� t�� �7}z t| d��}t|||d� W d � n1 s$w Y W n ty6 |s4� Y nw |�� }W d � n1 sEw Y t �dt|�| � |S )NzReading from %s (quiet=%s)r� )�chunk_cbzRead %s bytes from %s) rX r� r� r� r � pipe_in_outr� �getvaluerW )r_ r� r� �ofh�ifhr� r8 r8 r9 �load_binary_file< s �� �� �r� c C r> )Nr� )rl r� )r_ r� r� r8 r8 r9 r� O s r� c C s� t � r0ztd�} | �dd�d d� }W |S ty/ } zt�d|� d}W Y d }~|S d }~ww z td��� }W |S tyE d}Y |S w )Nz/proc/1/cmdline� r� r z"failed reading /proc/1/cmdline: %sr� z /proc/cmdline)� is_containerr� r� r� rX rY r? )r� r r� r8 r8 r9 � _get_cmdlineX s$ � �� ��r� c C s dt jv r t jd S t� S )N�DEBUG_PROC_CMDLINE)r4 r� r� r8 r8 r8 r9 r k s r c C s4 d} z t | ��� }|dkW S ttfy Y dS w )Nz /proc/sys/crypto/fips_enabledr( F)r� r? r5 r� )� fips_procr� r8 r8 r9 � fips_enabledr s �r� � c C sN d} | � |�}t|�dkrn|�|� |t|�7 }|r ||� q|�� |S rV )r� rW r r )�in_fh�out_fh� chunk_sizer� � bytes_pipedrM r8 r8 r9 r� ~ s � r� c C s6 |dv r |dv r d S t �d| ||� t�| ||� d S )N)Nr z%Changing the ownership of %s to %s:%s)rX r� r4 �chown)r_ �uid�gidr8 r8 r9 � chownbyid� s r� c C sd d}d}z|r t �|�j}|rt�|�j}W n ty) } ztd| �|�d }~ww t| ||� d S )Nr zUnknown user or group: %s) �pwd�getpwnam�pw_uidr� r� r� r� r� r� )r_ �userrL r� r� r� r8 r8 r9 � chownbyname� s ���r� r� r� c C s` ddg}| r d| vr |S | d }||v r|| }n d|vr |S |d }t |t�r,||g}t |t�rIt|�dkr=|d |d< t|�dkrI|d |d< t |t�rbd|v rX|d |d< d|v rb|d |d< |d dkrn|d |d< g d�}t|�D ]7\}}|s}qv|�� }d } |D ]} |�| �r�d | |t| �d� �� f }d } nq�| s�d d |�� f }|||< qv|S ) a� Get the output configuration for a given mode. The output config is a dictionary that specifies how to deal with stdout and stderr for the cloud-init modules. It is a (frustratingly) flexible format that can take multiple forms such as: output: { all: "| tee -a /var/log/cloud-init-output.log" } or output: init: output: "> /var/log/cloud-init.out" error: "> /var/log/cloud-init.err" config: "tee -a /var/log/cloud-config.log" final: - ">> /var/log/cloud-final.out" - "/var/log/cloud-final.err" Mode can be one of the configuration stages. If you pass a non-existent mode, it will assume the "all" mode configuration if defined. Stderr can be specified as &1 to indicate that it should be the same as stdout. If a file is specified with no redirection, it will default to appending to the file. If not overridden, output is provided in '/etc/cloud/config/cloud.cfg.d/05_logging.cfg' and defaults to: {"all": "| tee -a /var/log/cloud-init-output.log"} :param cfg: The base configuration that may or may not contain the 'output' configuration dictionary :param mode: The mode to get the output configuration for. :return: A list of two strings (or Nones), the first for stdout for the specified mode and the second for stderr. N�output�allr r� rD z&1)r� r� r� Fz%s %sTr� ) ri rj r� rW r\ � enumerater rh r? ) r� r� r� �outcfg�modecfg�swlistr~ r� r` r` �sr8 r8 r9 r� � sN ' � r� c C s� g }g }| r t | t�s |S | �d�}|r|�|� t| d�D ]4}|s#q t�d|�}|s,q |�d�}|�� }t |�dkrA|�|� q ddg|dd� krR|�|d � q |D ] }t � |� d ��D ]} t j � | �rp| |krp|�| � q_qUtt|| ��S ) a= Return a list of log file paths from the configuration dictionary. Obtains the paths from the 'def_log_file' and 'output' configuration defined in the base configuration. If not provided in base configuration, 'def_log_file' is specified in 'cloudinit/settings.py' and defaults to: /var/log/cloud-init.log If not overridden, output is provided in '/etc/cloud/config/cloud.cfg.d/05_logging.cfg' and defaults to: {"all": "| tee -a /var/log/cloud-init-output.log"} @param cfg: The cloud-init merged configuration dictionary. � def_log_fileNz (?P<type>\||>+)\s*(?P<target>.*)�targetr� �teez-ar0 �*)ri r\ rX r� r� rF rG rL r7 rW r r4 r� r r� r= ) r� �logs� rotated_logs� default_log�fmtrG r� �parts�logfile�rotated_logfiler8 r8 r9 �get_config_logfiles s6 � ��r� )r �exc_infor c G s0 | j ||g|�R � | j|g|�R d|i� d S )Nr� )r r� )r r� r r� r� r8 r8 r9 r� 2 s r� �routinec C s8 t �|�}|�t| �� |�� }|d ur|d|� S |S rV )�hashlib�new�updaterq � hexdigest)rd r� �mlen�hasher�digestr8 r8 r9 � hash_blob9 s r� r c s2 t �� }t� fdd�d�D ]}|�|� q |�� S )z�Hash the content of a binary buffer using SHA1. @param f: buffered binary stream to hash. @return: digested data as bytes. c s � � tj�S r� )r� r� �DEFAULT_BUFFER_SIZEr8 �r r8 r9 �<lambda>K s z hash_buffer.<locals>.<lambda>� )r� �sha1�iterr� r� )r r� �chunkr8 r� r9 � hash_bufferD s r� c C �, z t �| �r W dS W d S ty Y dS w r� )r� r� r� �rA r8 r8 r9 �is_userP � � �r� c C r� r� )r� r� r� r� r8 r8 r9 �is_groupX r� r� c C � t �d| |� t�| |� d S )NzRenaming %s to %s)rX r� r4 �rename��src�destr8 r8 r9 r� ` s r� �� c C s | D ]}t ||� qd S r� )� ensure_dir)�dirlistr� r� r8 r8 r9 � ensure_dirsf s �r� c C sH t �t| ��}t|t|��s"d�dd� |D ��}td|t|�f ��|S )N�, c S s g | ]}t |��qS r8 )rj )rJ �tr8 r8 r9 rN n r� z load_json.<locals>.<listcomp>z((%s) root types expected, got %s instead)�json�loadsrl ri r1 rZ rs rt )rn � root_types�decoded�expected_typesr8 r8 r9 � load_jsonk s ��r� c C s8 t j�| �}|t j�|�kr| S t j�|�r| S t|�S )z�Get the last directory in a path that does not exist. Example: when path=/usr/a/b and /usr/a does not exis but /usr does, return /usr/a )r4 r� �dirnamer� �get_non_exist_parent_dir)r� �p_pathr8 r8 r9 r� v s r� c C s� t j�| �s^t| �}tt j�| �dd�� t �| � W d � n1 s$w Y t| |� |s2|rZt|||� t | � |�d dd � �}t |�}|j D ]}|� |�}t|||� qLd S d S t| |� d S )NTr� r� ) r4 r� r� r� r� r� �makedirs�chmodr� r r7 r� �joinpath)r� r� r� rL �non_existed_parent_dir�sub_relative_dir�sub_pathr} r8 r8 r9 r� � s � �r� c c sD � z| V W | rd| g}t � |� d S d S | r!d| g}t � |� w w )N�umount)r )r� � umount_cmdr8 r8 r9 � unmounter� s �� �r� c C s i } z{t j�d�rtd��� }d}n t�d�}|j�� }d}t�d�}|D ]N}|dkr?|� � }t |�dkr6q%|\}}} } } } n&|� |�} | d u sPt | � � �dk rQq%| � d�}| � d�}| � d �} | � d�} |�d d �}| || d �| |< q%t�d | |� W | S ttfy� ttd� Y | S w )Nz /proc/mountsr� �mountz*^(/dev/[\S]+) on (/.*) \((.+), .+, (.+)\)$� r; r� r0 r4 z\040r� )�fstype� mountpoint�optszFetched %s mounts from %sz Failed fetching mount points)r4 r� r� r� rT r r> rF �compiler7 rW �search�groupsrL r� rX r� r5 r� r� )�mounted� mount_locs�methodr@ �mountre�mpline�wordsr{ �mpr� r �_freq�_passno�mr8 r8 r9 �mounts� sB �� �r c C s6 t |t�r |g}n t |ttf�rt|�}n|du r d}n tdjt|�d���t� r1|du r0dg}n(t� rV|du r<g d�}t |�D ]\}}|dkrLd||< |dv rTd ||< q@nd g}t � }t � � ��} d } t j�| �|v rv|t j�| � d } n]d} |D ]M}d} z%g d �} |r�| �d|g� | �| � | �| � tj| |d� | } | } W n$ ttfy� } z|r�t�d| |d�| �|� |} W Y d}~qzd}~ww | s�td| | | f ��| �d�s�| d7 } t| �� |du r�|| �}n|| |�}|W d � W d � S 1 �sw Y W d � dS 1 �sw Y dS )a2 Mount the device, call method 'callback' passing the directory in which it was mounted, then unmount. Return whatever 'callback' returned. If data != None, also pass data to callback. mtype is a filesystem type. it may be a list, string (a single fsname) or a list of fsnames. Nz6Unsupported type provided for mtype parameter: {_type})ry �auto)�ufs�cd9660�msdosrv r )rw �msdosfsr r� Fr )r� r� �roz-t)� update_envzbFailed to mount device: '%s' with type: '%s' using mount command: '%s', which caused exception: %sr� z#Failed mounting %s to %s due to: %sr� )ri rj r� r1 rs r� rt r( r+ r� r r �tempdirr4 r� r� r� r� r r5 r� rX r� rZ r� r r� )ra �callbackrM �mtype�update_env_for_mount� log_error�mtypes�indexr �tmpdr� r �failure_reason�mountcmd�excr� r8 r8 r9 �mount_cb� s� ����� � �� �� ��'$�r" c C s t �t�S r� )�obj_copy�deepcopyr$ r8 r8 r8 r9 �get_builtin_cfg0 s r% c C s t �d| � tj�| �S )Nz Testing if a link exists for %s)rX r� r4 r� �islinkr� r8 r8 r9 �is_link5 s r' c C sh t �d|| � |r,tj�|�r,tj�tj�|�dtd� �}t�| |� t� ||� d S t�| |� d S )Nz$Creating symbolic link from %r => %r�tmpr� ) rX r� r4 r� r� rZ r� r� �symlinkr� )�source�link�force�tmp_linkr8 r8 r9 �sym_link: s r. c C s2 t �d| � zt�| � W d S ty Y d S w )NzAttempting to remove %s)rX r� r4 �unlinkr� r� r8 r8 r9 �del_fileF s �r0 c C r� )NzCopying %s to %s)rX r� r� �copyr� r8 r8 r9 r1 N s r1 c C s0 z t �dt �� �} W | S ty d} Y | S w )Nz%a, %d %b %Y %H:%M:%S %z�??)�time�strftime�gmtimer� )�tsr8 r8 r9 � time_rfc2822S s ��r7 c s� ddl � ddl� G � fdd�d� j�} � �� j�d��}� �� }� �| �|_dt � s,dndg}� j d |� }| � }|� |� � t |��� � |�� � |�dd�d krX|j|jd S td ��) a� Use sysctl(3) via ctypes to find kern.boottime kern.boottime is of type struct timeval. Here we create a private class to easier unpack it. Use sysctl(3) (or sysctl(2) on OpenBSD) because sysctlbyname(3) does not exist on OpenBSD. That complicates retrieval on NetBSD, which #defines KERN_BOOTTIME as 83 instead of 21. 21 on NetBSD is KERN_OBOOTTIME, the kern.boottime up until NetBSD 5.0 @return boottime: float to be compatible with linux r Nc s e Zd Zd� jfd� jfgZdS )zboottime.<locals>.timeval�tv_sec�tv_usecN)r� r� r� �c_int64�_fields_r8 ��ctypesr8 r9 �timevalk s r> �cr� � �S r0 r g ��.Az/Unable to retrieve kern.boottime on this system)r= � ctypes.util� Structure�CDLL�util� find_library�c_size_t�sizeof�valuer6 �c_intrq rW �byrefr8 r9 � RuntimeError)r> �libcr� � mib_values�mibr� r8 r< r9 �boottime[ s. � �� rP c C s| d} d}z(t j�d�r d}td�}|r |�� d } W | S W | S d}tt�� t� �} W | S ty= t t d| � Y | S w )Nr2 rc z /proc/uptimer r= z&Unable to read uptime using method: %s) r4 r� r� r� r7 rj r3 rP r� r� rX )� uptime_strr r� r8 r8 r9 �uptime� s$ � � ��rR c C s t | |dd d� d S )Nr� )�omoder� �� write_file)r� �contentr8 r8 r9 � append_file� s rW � )� preserve_moderY c C s t | dd||d� d S )Nr� r� )rV rS r� rY rT )r� r� rY r8 r8 r9 � ensure_file� s �rZ c C s$ zt | �W S ttfy Y d S w r� )r3 r� rs )� possible_intr8 r8 r9 �safe_int� s �r\ c C sR t |�}| r%|r't| �� t�| |� W d � d S 1 s w Y d S d S d S r� )r\ r� r4 r� )r� r� � real_moder8 r8 r9 r� � s "��r� �grp_namec C s8 d}z t �| �j}W |S ty t�d| � Y |S w )zt Returns the group id of a group name, or -1 if no group exists @param grp_name: the name of the group r z"Group %s is not a valid group name)r� r� r� r� rX r� )r^ r� r8 r8 r9 � get_group_id� s ��r_ r� c C s t �t� | �j�S )z� Returns the octal permissions of the file/folder pointed by the path, encoded as an int. @param path: The full path of the file/folder. )r� �S_IMODEr4 �st_moder� r8 r8 r9 �get_permissions� s rb c C � t �| �}t�|j�jS )zw Returns the owner of the file/folder pointed by the path. @param path: The full path of the file/folder. )r4 r� r� �getpwuid�st_uid�pw_name�r� �str8 r8 r9 � get_owner� � ri c C rc )zw Returns the group of the file/folder pointed by the path. @param path: The full path of the file/folder. )r4 r� r� �getgrgid�st_gid�gr_namerg r8 r8 r9 � get_group� rj rn �usernamec C sJ g }t �� D ] }| |jv r|�|j� qt�| �j}|�t �|�j� |S )zp Returns a list of all groups to which the user belongs @param username: the user we want to check ) r� �getgrall�gr_memr� rm r� r� �pw_gidrk )ro r rL r� r8 r8 r9 �get_user_groups� s � rs r� )�ensure_dir_existsr� rL c C s |rzt | �}W n ty Y nw |r ttj�| �||d� d|�� v r,t|�}d}nt|�}d}zd| } W n t yE d| } Y nw t � d| || t |�|� t | d��& t| |��} | �|� | �� W d � n1 sqw Y W d � n1 s�w Y t| |� d S ) a) Writes a file with the given content and sets the file mode as specified. Restores the SELinux context if possible. @param filename: The full path of the file to write. @param content: The content to write to the file. @param mode: The filesystem mode to set on the file. @param omode: The open mode used when opening the file (w, wb, a, etc.) @param preserve_mode: If True and `filename` exists, preserve `filename`s current mode instead of applying `mode`. @param ensure_dir_exists: If True (the default), ensure that the directory containing `filename` exists before writing to the file. @param user: The user to set on the file. @param group: The group to set on the file. )r� rL �bro � charactersz%oz%rz Writing to %s - %s: [%s] %s %sr� N)rb r� r� r4 r� r� r� rq rl rs rX r� rW r� r r r r� ) r6 rV r� rS rY rt r� rL � write_type�mode_r�fhr8 r8 r9 rU � sD � �� �� �rU c C s@ t �| �D ]}t j�| |�}t j�|�rt|� qt|� qdS )z� Deletes all contents of a directory without deleting the directory itself. @param dirname: The directory whose contents should be deleted. N)r4 r r� rZ r� r� r0 )r� �node� node_fullpathr8 r8 r9 �delete_dir_contents- s �r| r3 �createdc C s6 t �� }t| �}|d|�� |f 7 }|dt� 7 }|S )Nz %s by cloud-init v. %sz on %s)r# �version_stringrj �titler7 )� comment_charr� �ci_ver�headerr8 r8 r9 � make_header; s r� c C s� t | ttf�stdt�| � ��d}|r|d7 }dd }d}| D ]J}t |ttf�rKg }|D ]}|�dt|��d|� � q-d |d � |�f }|d 7 }q t |t�r[d ||f }|d 7 }q |d u r`q td t�|�|f ��t � d |� |S )Nz8Input to shellify was type '%s'. Expected list or tuple.r� z #!/bin/sh z%s%s%s%s)�'�\r� r� r z'%s'r� z%s%s r� r� zCUnable to shellify type '%s'. Expected list, string, tuple. Got: %szShellified %s commands.) ri r1 r� rs r! r� r� rj r� rZ rX r� )�cmdlist� add_headerrV �escaped� cmds_mader� �fixedr r8 r8 r9 �shellifyG s< �� �� r� c C sB |r| � |�r| t|�d � } |r | �|�r | d t|� � } | S r� )rh rW r )r^ �prefix�suffixr8 r8 r9 �strip_prefix_suffixl s r� c C s> t �| d �d u r dS zt � | � W dS t jy Y dS w )Nr FT)r �whichr[ )r� r8 r8 r9 �_cmd_exits_zerot s ��r� c C s t g d��S )N)zsystemd-detect-virtz--quietz --container�r� r8 r8 r8 r9 �_is_container_systemd~ r� r� c C s t dg�S )Nzlxc-is-containerr� r8 r8 r8 r9 �_is_container_old_lxc� � r� c C sB t � sdS g d�} t�| d �d u rdS t�| �\}}|�� dkS )NF)rq z-qnzsecurity.jail.jailedr r( )r1 r r� r? )r� r@ r& r8 r8 r9 �_is_container_freebsd� s r� c C s� t ttf} | D ]}|� r dS qztd�}d|v r W dS d|v r#W dS W n ttfy/ Y nw tj�d�r>tj�d�s>dS z%t d�� � }|D ]}|� d�r`|� � � d d�\}}|d kr` W dS qGW d S ttfyo Y d S w ) zH Checks to see if this code running in a container of some sort Tr� � container�LIBVIRT_LXC_UUIDz/proc/vzz/proc/bcz/proc/self/statuszVxID:rI r, F)r� r� r� � get_proc_envr5 r� r4 r� r� r� rT rh r? r7 )�checks�helper�pid1env�linesr^ �_keyr` r8 r8 r9 r� � sD ���� ����r� c C s t j�d�S )z2Check to see if we are running in a lxd container.z /dev/lxd/sockrd r8 r8 r8 r9 �is_lxd� s r� r� rh �errorsc C s� t j�dt| �d�}zt|�}W n ttfy i Y S w i }d\}}|�||�}|�|�D ]}|s4q/|�|d�\} } | rB| || < q/|S )z� Return the environment in a dict that a given process id was started with. @param encoding: decoding will be done with .decode(encoding, errors) and text will be returned. @param errors: passed through .decode(encoding, errors). z/procr� )r� �=r� ) r4 r� rZ rj r� r5 r� rk r7 ) �pidrh r� r� r� �env�null�equalr� rA r` r8 r8 r9 r� � s" � �r� c C sN i }| � � D ] }z |� dd�\}}W n ty |}d}Y nw |||< q|S )Nr� r� T)r7 r� )�kvstringr� r� r; r` r8 r8 r9 �keyval_str_to_dict� s � r� c C s& | � d�r | dd � } tj�d| �S )Nrx r� z /sys/class/block/%s/partition)rh r4 r� r )ra r8 r8 r9 � is_partition� s r� c C s� t |t�s|g}g }|D ]C}t |t�r|�|� q t |ttf�rLt|�dk s,t|�dkr0td��t|�dkrD|d rD|�| t|� � q |�|d � q td��|S )Nr� r0 z Invalid package & version tuple.r zInvalid package type.)ri r� rj r� r1 rW rL )� version_fmt�pkgs�pkglist�pkgr8 r8 r9 �expand_package_list� s r� c C s� dd� | � d�D �}d}d}d}d}t|�D ]�\} } | � � } t| �dk r3|�d| d t| �| � dS | d } d d� | � d�D �} t| �t|�krJqtt| �t|��}| d |� |d |� kr`q|durmt|�t| �krmqz| �d �} W n ty� |�d | d | � Y dS w z| | d }| | d }W n ty� |�d| d | � Y dS w | }| }| d }q|r�|r�|r�|r�|r�||||fS dS |r�|r�|r�|||fS dS )zRReturn the mount information for PATH given the lines from /proc/$$/mountinfo.c S r� r8 r8 �rJ r� r8 r8 r9 rN r� z$parse_mount_info.<locals>.<listcomp>r� Nr� z$Line %d has two few columns (%d): %sr� r; c S r� r8 r8 r� r8 r8 r9 rN ) r� r �-z,Did not find column named '-' in line %d: %sr0 z/Too few columns after '-' column in line %d: %sr� )r7 r� rW r� �minr r� � IndexError)r� �mountinfo_linesr � get_mnt_opts� path_elements�devpth�fs_type�match_mount_point�match_mount_point_elementsr~ r^ r� � mount_point�mount_point_elements�x� mount_optionsr8 r8 r9 �parse_mount_info sh � �� �� �� � r� c C sB t d��� D ]}|�� dd� \}}}|| kr |||f S qdS )z<On older kernels there's no /proc/$$/mountinfo, so use mtab.� /etc/mtabNr4 )r� rT r7 )r� r^ r� r� r� r8 r8 r9 � parse_mtab^ s �r� c C s� | � d�}t|�dkr|d S t|�dkr|d S |d dv rS| dd � }t�g d��\}}|� d �D ]}|� � }t|�dkrN|d |krN|d } t|�S q3t|�S t�d | � d S ) Nr� r� r r4 r0 )rn �gpt�gptidr �ufsidr� )�glabel�statusz-sr z)Unexpected input in find_freebsd_part: %s)r7 rW r rj rX rY )�fs�splitted� target_labelr} r� �labelsr� r8 r8 r9 �find_freebsd_partg s" � r� c C sJ d }|� d�D ]}|� � }t|�dkr"tj�|d | �r"|} |S q|S )Nr r0 r� )r7 rW r4 r� r� )r� �mnt_list� path_foundr^ r� r8 r8 r9 �get_path_dev_freebsdz s � r� c C sl t j dd| gddgd�\}}t|�r(t � ddg�\}}t| |�}|d u r&d S |}|�� }t|d �}d| S )Nr� z-pr r� rs rx )r rW r� r7 r� )r� rM rb r� r� r� � label_partr8 r8 r9 �get_freebsd_devpth� s r� c C s� t � dg�\}}d}dd� | �d�D �}d}d}d}d} |�� D ]�} t�|| �} | s+q | �d�}| �d�}d d� |�d�D �} t| �t|�krHq tt| �t|��} | d | � |d | � kr^q | durkt| �t| �krkq |}| } | �d �}| �d �}|dur�d �| �d �� d �� � �d��}t � d||||� t�d|�}|s�t � r�|dvr�t |�}|}|| kr� nq |r�|| vr�dS |r�|r�|r�|r�|r�||||fS dS dS dS dS |r�|r�|r�|||fS dS dS dS )z�Return the mount information for PATH given the lines ``mount(1)`` This function is compatible with ``util.parse_mount_info()``r� ze^(?P<devpth>[\S]+?) on (?P<mountpoint>[\S]+?) (\(|type )(?P<type>[^,\(\) ]+)( \()?(?P<options>.*?)\)$c S r� r8 r8 r� r8 r8 r9 rN � r� z parse_mount.<locals>.<listcomp>r� Nr� r c S r� r8 r8 r� r8 r8 r9 rN � r� r rt r� rO r� zNfound line in mount -> devpth: %s, mount_point: %s, fs_type: %s, options: '%s'z^(/dev/.+)[sp]([0-9])$)�zfs�nfs)r r7 rT rF r rL rW r� rZ r? rX r� r1 r� )r� r� � mountoutputr� �regexr� r� r� r� r� r^ r r� r� r� r� �devm� match_devpthr8 r8 r9 � parse_mount� sr � �� �� � � �r� c C sP dt �� }t j�|�rt|��� }t| |||�S t j�d�r#t| �S t| |�S )Nz/proc/%s/mountinfor� ) r4 �getpidr� r� r� rT r� r� r� )r� r r� �mountinfo_pathr� r8 r8 r9 �get_mount_info� s r� �optc C s t | dd��^ }}||�d�v S )NT�r� rO �r� r7 )r� r� r& �mnt_optsr8 r8 r9 � has_mount_opt s r� �Tr[ .c C s| |d u rg }|d u r i }t �� }d }|r%ztt� �}W n ty$ Y nw zQ||i |��}W t �� | } d } |d urMz tt� �| } W n tyL Y nw d| } |rct| t�r_| d| 7 } n| d7 } z | || � W |S tyv Y |S w t �� | } d } |d ur�z tt� �| } W n ty� Y nw d| } |r�t| t�r�| d| 7 } n| d7 } z| || � W w ty� Y w w )Nz took %0.3f secondsz (%0.2f)z (N/A))r3 � monotonic�floatrR r� ri r� ) rZ r� r[ r� r� � get_uptime�start�ustartr� �delta�udelta�tmsgr8 r8 r9 r\ sh � � �� � � �r\ c C s$ | � dd�}t|�dkr|S | d fS )Nr/ r� )�rsplitrW )�dottedr8 r8 r8 r9 �expand_dotted_devnameF s r� c C s� |d u rg }|d u r g }g }i }|| D ]"}zt | | | dd�||< W q ty6 ||v r4|�|� Y qw t|�rFtdjd�|�d���|S )NF�r� z Missing required files: {files}rO )�files)r� r� r� rW r� r� rZ )r� �required�optional�delimra r� r r8 r8 r9 �pathprefix2dictN s& ���r� � /proc/meminfoc C s� ddddd�}dddd �}i }t | ��� D ]:}z |�� \}}}W n ty1 |�� \}}d }Y nw |r?t|�|| ||< q||v rOt|�|| ||| < q|S ) Nr� � r� � @)�kB�mB�B�gB�total�free� available)z MemTotal:zMemFree:z MemAvailable:r� )r� rT r7 r� r3 ) �meminfo�raw�mpliers�kmapr� r^ r; rI �unitr8 r8 r9 � read_meminfof s& � ��r� c C s� | }| � d�r| dd� } n | � d�r| dd� } dddd d d �}| }d}|D ]}| � |�r9|}| d t|� � }q'zt|�}W n tyS } ztd | �|�d}~ww |d k r^td| ��t||| �S )a} Convert human string or integer to size in bytes In the original implementation, SI prefixes parse to IEC values (1KB=1024B). Later, support for parsing IEC prefixes was added, also parsing to IEC values (1KiB=1024B). To maintain backwards compatibility for the long-used implementation, no fix is provided for SI prefixes (to make 1KB=1000B may now violate user expectations). Future prospective callers of this function should consider implementing a new function with more standard expectations (1KB=1000B and 1KiB=1024B) Examples: 10M => 10485760 10MB => 10485760 10MiB => 10485760 �iBN���r� r r� r� r� r� l )r� �K�M�Gr� r z'%s' is not valid input.z'%s': cannot be negative)r rW r� r� r3 )r� �size_inr� �num�mplierr r� r8 r8 r9 � human2bytes~ s, � �� r c C s< | du r t �� d } | dkp| d dko| dd� dk}|S )z$Return True if platform is x86-basedNr; �x86_64r r~ r0 �86)r4 r5 )� uname_arch�x86_arch_matchr8 r8 r9 �is_x86� s �r c C s t �| �S r� )�email�message_from_string)r� r8 r8 r9 r � r� r c C st t j ddgdd�} t� }| j�� D ]&}z |�d d�\}}}W n ty' Y qw |�d�r7|�t� dd|�� q|S ) Nz dpkg-queryz--listTr< r0 )�hi�iiz:.*r� ) r r= r> rT r7 r� rh rB rF �sub)r@ � pkgs_instr^ �stater� r& r8 r8 r9 �get_installed_packages� s � �r c C s� d} zt t| dd��}|�dd��� dkrW dS W n ty2 } z t�d| |� W Y d }~nd }~ww t� }d|v r<dS td dd�}d|�� v rJdS tj � d �rRdS d S ) NrN Tr� rC r� z ubuntu-corez!Unexpected error loading '%s': %sz snap_core=z /etc/system-image/channel.iniz/etc/system-image/config.d/F) rW r� rX r� r� rX rY r r4 r� r� )�orpath�orinfor� r rV r8 r8 r9 �system_is_snappy� s& ��� r c C s� d }| � � D ]}|�d�r|dd � } nq|d u r d S |�d�r#|S |�d�r2d|td�d � S |�d�rCd|td�d � �� S |�d�rhd |td�d � �� }tj�|�r\|S t|�}|rf|d S |S d| S ) Nzroot=r� rx rb z/dev/disk/by-label/zUUID=z/dev/disk/by-uuid/z PARTUUID=z/dev/disk/by-partuuid/r )r7 rh rW r� r4 r� r� r� )r r` r� � disks_path�resultsr8 r8 r9 �rootdev_from_cmdline� s0 � � r c C sF dd� }i }|| �D ]}|� dd�\}}|s|}|s |r |||< q |S )z�Given shell like syntax (key=value\nkey2=value2\n) in content return the data in dictionary form. If 'add_empty' is True then add entries in to the returned dictionary for 'VAR=' variables. Set their value to empty_val.c S s t j| dd�S )NT)�comments)�shlexr7 )rd r8 r8 r9 � _shlex_split s z(load_shell_content.<locals>._shlex_splitr� r� )r7 )rV � add_empty� empty_valr rM r^ r; rI r8 r8 r9 rW � s �rW � �?c C s� t | �}d} |t dd� |D ��8 }t|�dkr"t�d||| � g S |dkr.t�d||| � || |kr5n t�|� ||7 }qt�d|||� |S )Nr Tc S rc r8 rd r r8 r8 r9 rN s z"wait_for_files.<locals>.<listcomp>z)%sAll files appeared after %s seconds: %sz6%sWaiting up to %s seconds for the following files: %sz*%sStill missing files after %s seconds: %s)r= rW rX r� r3 �sleep)�flist�maxwait�naplen�log_pre�need�waitedr8 r8 r9 �wait_for_files s8 �� ��r( c C s& t | dd�}|d �d�}|d dkS )z1Check whether the given mount point is mounted rwTr� r rO r �rwr� )r� rM � mount_optsr8 r8 r9 �mount_is_read_write0 s r+ c C sX t �d�sdS ddg}| r tj�| �rdS |�d| g� |r'|�d| g� t � |�S )zAInvoke udevadm settle with optional exists and timeout parameters�udevadmN�settlez--exit-if-exists=%sz --timeout=%s)r r� r4 r� r� r� )r� r� � settle_cmdr8 r8 r9 �udevadm_settle7 s r/ r� � Error: {}c C s& t |�| �tjd� |rt�|� |S )a Print error to stderr and return or exit @param msg: message to print @param rc: return code (default: 1) @param fmt: format string for putting message in (default: 'Error:\n {}') @param sys_exit: exit when called (default: false) )�file)�printr� r r �exit)r� �rcr� �sys_exitr8 r8 r9 rD I s rD r� r% c C s� dg i}zt �t| �d�dd��}W n. ty% t�d| �d�� Y |S t jy@ } zt�dt j |� W Y d }~|S d }~ww d|vrIg |d< |S )N�scopeszhotplug.enabledFr� zFile not found: %sz>Ignoring contents of %s because it is not decodable. Error: %s) r� r� r� r� r� rX r� �JSONDecodeErrorrY r �HOTPLUG_ENABLED_FILE)r� rV r� r8 r8 r9 �read_hotplug_enabled_fileX s( � ����r9 c c s � dV dS )ztContext manager that does nothing. Note: In python-3.7+, this can be substituted by contextlib.nullcontext Nr8 r8 r8 r8 r9 � nullcontextl s � r: )rc r� )r� N)TTr� )r r )r� r� r� )r� r� r� r� )r2 )Nra NFNr� )r� N)r� )NNN)NNNT)rX )rX r� F)r3 r} )T)rc r� )NNF)r� F)FN)r r� )r� r0 F)�ru � contextlibr1 r# r r r� r� r� r� r� r r4 �os.pathr& r� r� rF r r� r> r� r� r� r r3 �base64r � collectionsr r r r r� r � functoolsr �pathlibr �typesr �typingr r r r r r r r r r r r r r �urllibr r� � cloudinitr r r r r r r r! r" r# �cloudinit.settingsr$ �cloudinit.helpersr% r< � getLoggerr� rX �sepr� r� r� r� r� r� r: rA rH rj ro rl rq rw r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r\ r r �DEBUGr# r( r+ r1 r4 r6 r8 r< r= r? rM rb r~ r0 r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r) r* r1 r9 r� rT r/ rW r] r` ro r| r� r� r� r� r� �PathLiker3 r� r� r� r r� r� r� r� r� r� r r� r� �BufferedIOBaser� r� r� r� r� r� r� r� r� r r" r% r' r. r0 r7 rP rR rW rZ r\ r� r_ rb ri rn rs rU r| r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r\ r� r� r� r� r r r r r r rW r( r+ r/ rD r9 r: r8 r8 r8 r9 �<module> sJ @ 0 � / 4 �, ( =: T8 ! (, / #� +(3 � � � � � @ � ��� �� ��� � �� �b/�� � - �^ *���� � �� = % -��� � N W' � �� . + "