0x1949 Team - FAZEMRX - MANAGER
Edit File: __init__.cpython-310.pyc
o ���f� � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlmZ d dl m Z m Z d dl m Z mZmZmZmZmZ d dlmZmZmZmZmZmZ d dlmZ d dlm Z d dl m Z d d l m Z d d l!m"Z"m#Z# d d l$m%Z% d d l&m'Z' d d l(m)Z) d dl*m+Z+ dZ,dZ-dZ.dZ/e,e-e.gZ0dZ1dZ2dZ3dZ4dZ5dZ6dZ7dZ8e�9e:�Z;dd d � fd d d � fd d!d � fd"�Z<e G d#d$� d$e ��Z=G d%d&� d&e �Z>G d'd(� d(e?�Z@G d)d*� d*e?�ZAG d+d,� d,e?�ZBdYd/d0�ZCe5fd1d2�ZDed3g d4��ZEed5d6d7g�ZFG d8d� de)e jGd9�ZHd:d;� ZId<eeHeJf fd=d>�ZKd?d@� ZL AdZdBeJd<eMfdCdD�ZNdEdF� ZOd[dHdI�ZPG dJdK� dKeQ�ZRdLdM� ZSdNeHdOeJd<eMfdPdQ�ZTdOeJd<eeH fdRdS�ZUd<eJfdTdU�ZVdVeJd<eJfdWdX�ZWdS )\� N)� namedtuple)�Enum�unique)�Any�Dict�List�Optional�Tuple�Union)� atomic_helper�dmi�importer� lifecycle�net� type_utils)� user_data)�util)� write_json)�Distro)� EventScope� EventType)� launch_index)�Paths)�CloudInitPickleMixin)�events�disabled�localr �pass� FILESYSTEM�NETWORK� DataSourcez|EXPERIMENTAL: The structure and format of content scoped under the 'ds' key may change in subsequent releases of cloud-init.zredacted for non-root user� cloud-name�_unset�unknownz aws-chinac C � | dkS �N�aws� ��cr' r' �</usr/lib/python3/dist-packages/cloudinit/sources/__init__.py�<lambda>? � r+ zaws-govc C r$ r% r' r( r' r' r* r+ @ r, z azure-chinac C r$ )N�azurer' r( r' r' r* r+ A r, )zcn-zus-gov-�chinac @ s2 e Zd ZdZdZdZdZdZdZde fdd �Z d S ) �NetworkConfigSourcezb Represents the canonical list of network config sources that cloud-init knows about. �cmdline�ds� system_cfg�fallback� initramfs�returnc C � | j S �N��value��selfr' r' r* �__str__R � zNetworkConfigSource.__str__N) �__name__� __module__� __qualname__�__doc__�CMD_LINE�DS� SYSTEM_CFG�FALLBACK� INITRAMFS�strr< r' r' r' r* r/ E s r/ c @ s& e Zd ZdZdZdZdefdd�ZdS )�NicOrderz Represents ways to sort NICs�mac�nic_namer5 c C r6 r7 r8 r: r' r' r* r< \ r= zNicOrder.__str__N)r> r? r@ rA �MAC�NIC_NAMErG r< r' r' r' r* rH V s rH c @ � e Zd ZdZdS )� DatasourceUnpickleUserDataErrorzERaised when userdata is unable to be unpickled due to python upgradesN�r> r? r@ rA r' r' r' r* rN ` � rN c @ � e Zd ZdS )�DataSourceNotFoundExceptionN�r> r? r@ r' r' r' r* rR d � rR c @ rM )�InvalidMetaDataExceptionz8Raised when metadata is broken, unavailable or disabled.NrO r' r' r' r* rU h rP rU � r' c C s� t �| �}g }g }| �� D ]V\}}|r|d | }n|}|�� |v s(|�� |v r-|�|� t|t�rD|�d�rD|�|� |�dd�||< t|t �rct |||�} |� | � d�� |� | � d�� | ||< q t |�|d< t |�|d< |S )z�Process all instance metadata cleaning it up for persisting as json. Strip ci-b64 prefix and catalog any 'base64_encoded_keys' as a list @return Dict copy of processed metadata. �/zci-b64:rV �base64_encoded_keys�sensitive_keys)�copy�deepcopy�items�lower�append� isinstancerG � startswith�replace�dict�process_instance_metadata�extend�pop�sorted) �metadata�key_pathrY �md_copyrX � sens_keys�key�val� sub_key_path� return_valr' r' r* rc l s0 �� rc c C s� | � dg �s| S t�| �}| � d�D ]+}|�d�}|}|D ]}||v r4t|| t�r4||d kr4|| }q ||v r=|||< q|S )z�Redact any sensitive keys from to provided metadata dictionary. Replace any keys values listed in 'sensitive_keys' with redact_value. rY rW ���)�getrZ r[ �splitr_ rb )rg � redact_valueri rh � path_parts�obj�pathr' r' r* �redact_sensitive_keys� s" � ��rv � URLParams)�max_wait_seconds�timeout_seconds� num_retries�sec_between_retries�DataSourceHostname�hostname� is_defaultc @ s� e Zd ZU eZdZdZdZdZdZ dZ e e e ef ed< ejejejejfZeedf ed< dZdZd Zd Zej e j e j e j e j!hiZ"ej e j hiZ#d e$fd e$fd i fddddddf Z%eeee&f df ed< dZ'dZ(eedf ed< dZ)dZ*e e ed< d Z+dxde,de-fdd �Z.d e/d dfd d �Z0d!d"� Z1d e2fd#d$�Z3d e2fd%d&�Z4d'd(� Z5d)d*� Z6dyd,d-�Z7d e2fd.d/�Z8dzd1d2�Z9d e2fd3d4�Z:d5d6� Z;d{d7d8�Z<d9d:� Z=d;d<� Z>e?d=d>� �Z@e?d?d@� �ZAdAdB� ZBe?dCdD� �ZCdEdF� ZDe?dGdH� �ZEdIdJ� ZFdKdL� ZGdMdN� ZHdOdP� ZIdQdR� ZJdSdT� ZKdUdV� ZLdWdX� ZMdYdZ� ZNd[d\� ZOe?d]d^� �ZPe?d_d`� �ZQdadb� ZRd|dcdd�ZSdedf� ZTdgeUe fdhdi�ZVdgeUe d e2fdjdk�ZWdldm� ZXdndo� ZYeZd}dpdq��Z[e?drds� �Z\dtdu� Z]dvdw� Z^dS )~r z en_US.UTF-8�_undefN�_crawled_metadata.�network_config_sourcesro � � � � ec2_metadata� network_jsonrg )�userdataN)� userdata_rawN)� vendordataN)�vendordata_rawN)� vendordata2N)�vendordata2_rawN�cached_attr_defaultsF) �combined_cloud_config� merged_cfg�merged_system_cfgzsecurity-credentialsr� � user-datar r� � vendor-datazds/vendor_data�sensitive_metadata_keys�extra_hotplug_udev_rules�distro�pathsc C s� || _ || _|| _d | _i | _d | _d | _d | _d | _d | _ d | _ t | _ t | _ t�| j d| jfi �| _| js9i | _|sDt�| j�| _d S || _d S )N� datasource)�sys_cfgr� r� r� rg r� r� r� r� r� �metadata_address�UNSETr� r� r �get_cfg_by_path�dsname�ds_cfg�ud�UserDataProcessor�ud_proc)r; r� r� r� r� r' r' r* �__init__< s* � zDataSource.__init__�ci_pkl_versionr5 c C s� dddt ddt dddd� }|�� D ]\}}t| |�s t| ||� qt| d�s.t| ddd� � t| d�rW| jdurYzt| j� W dS tyV } z t�d|� t � |�d}~ww dS dS ) z(Perform deserialization fixes for Paths.NF) r� �_platform_type� _subplatformr� r� r� r� �skip_hotplug_detectr� r� � check_if_fallback_is_allowedc S � dS �NFr' r' r' r' r* r+ i � z&DataSource._unpickle.<locals>.<lambda>r� z:Unable to unpickle datasource: %s. Ignoring current cache.) r� r\ �hasattr�setattrr� rG �AttributeError�LOG�debugrN )r; r� �expected_attrsrk r9 �er' r' r* � _unpickleV s: � � ����zDataSource._unpicklec C s t �| �S r7 �r �obj_namer: r' r' r* r< z s zDataSource.__str__c C r� )z#Check if running on this datasourceTr' r: r' r' r* � ds_detect} � zDataSource.ds_detectc C sN | j �� t� �� krt�d| � dS | j�dg �| j gkr%t�d| � dS dS )aJ Override if either: - only a single datasource defined (nothing to fall back to) - command line argument is used (ci.ds=OpenStack) Note: get_cmdline() is required for the general case - when ds-identify does not run, _something_ needs to detect the kernel command line definition. z6Kernel command line set to use a single datasource %s.T�datasource_listz2Datasource list set to use a single datasource %s.F)r� r] � parse_cmdliner� r� r� rp r: r' r' r* �override_ds_detect� s ��z DataSource.override_ds_detectc C s< | � � r| �� S | �� rt�d| � | �� S t�d| � dS )z&Overrides runtime datasource detectionz Detected %szDid not detect %sF)r� � _get_datar� r� r� r: r' r' r* �_check_and_get_data� s � z DataSource._check_and_get_datac C s� | � � j}| �� }| j}|d }di ddg�d|�d|�dt| j| j| j��d| j�d | j�d |d d �d |d d �d|d d �d| j�d| �� �d|d �d|�d|�d|d d �d|�d|�|d d | j| j |d |d d ��iS ) z2Return a dictionary of standardized metadata keys.�sys_info�v1� _beta_keys� subplatform�availability-zone�availability_zone�cloud_idr! � cloud_namer� �distr �distro_versionr� �distro_release� �platform�public_ssh_keys�python_version�python� instance-id� instance_id�kernel_release�uname�local-hostname�local_hostname� �variant)�machine�regionr� �system_platformr� ) � get_hostnamer} �get_instance_idr� �canonical_cloud_idr� r� � platform_type�get_public_ssh_keysr� )r; � instance_datar� r� r� �sysinfor' r' r* �_get_standardized_metadata� s` ��� ���� � � � � ���� ��� ��z%DataSource._get_standardized_metadatar' c C sP | j sdS |r |}n| j}|D ]\}}t| |�r t| ||� q|s&d| _ dS dS )z�Reset any cached metadata attributes to datasource defaults. @param attr_defaults: Optional tuple of (attr, value) pairs to set instead of cached_attr_defaults. NF)� _dirty_cacher� r� r� )r; � attr_defaults� attr_values� attributer9 r' r' r* �clear_cached_attrs� s � �z DataSource.clear_cached_attrsc C s" d| _ | �� }|s |S | �� |S )z�Datasources implement _get_data to setup metadata and userdata_raw. Minimally, the datasource should return a boolean True on success. T)r� r� �persist_instance_data)r; � return_valuer' r' r* �get_data� s zDataSource.get_dataTc C sX |rt j�| jj�rt| | j�d�� | jdur/t� | j�}|� dd� |� dd� d|i}n dd| j ii}| j t krB| j |d d< | jt krN| j|d d< t|d d < t� | j�|d < d |d d < t� |d �|d < d |d d < t�� |d< |�| �|�� zt�|�}tt�|�| jd�}W n5 ty� } zt � dt |�� W Y d}~dS d}~w t y� } zt � dt |�� W Y d}~dS d}~ww | j� d�}|d �!dd�}t j�"| jj#d�} t�$| � d|� �|� d�� d} | � d|� �} t j�%| ��rt j�&| �} tj'| | dd� | �r| | k�rt�(| � t)||dd � | j� d �} t)| t*|�� dS ) aP Process and write INSTANCE_JSON_FILE with all instance metadata. Replace any hyphens with underscores in key names for use in template processing. :param write_cache: boolean set True to persist obj.pkl when instance_link exists. @return True on successful write, False otherwise. �obj_pklNr� r� r1 � meta_datar� r� �_docr� z<DEPRECATED: Use merged_system_cfg. Will be dropped from 24.1r� zUMerged cloud-init system config from /etc/cloud/cloud.cfg and /etc/cloud/cloud.cfg.d/r� )rY z'Error persisting instance-data.json: %sF�instance_data_sensitiver� r� �nonezcloud-id�-� T)�forcei� )�moder� )+�osru �lexistsr� � instance_link� pkl_store� get_ipath_curr� rZ r[ re rg r� r� r� �EXPERIMENTAL_TEXTr� r � system_info�updater� r � json_dumpsrc �json�loadsr� � TypeErrorr� �warningrG �UnicodeDecodeError� get_runpathrp �join�run_dir� write_file�exists�realpath�sym_link�del_filer rv ) r; � write_cache�crawled_metadatar� �content�processed_datar� �json_sensitive_filer� � cloud_id_file�prev_cloud_id_file�new_cloud_id_file� json_filer' r' r* r� � sn ��� � ���� z DataSource.persist_instance_datac C s t d��)z@Walk metadata sources, process crawled data and save attributes.zlSubclasses of DataSource must implement _get_data which sets self.metadata, vendordata_raw and userdata_raw.)�NotImplementedErrorr: r' r' r* r� < s �zDataSource._get_datac C sB | j }z t| j�d| j ��}W n ty$ t�td| j�d�|� Y nw | j}zt dt| j�d| j���}W n tyO | j}t�td| j�d�|� Y nw | j }z t| j�d| j ��}W n t yt t�td| j�d�|� Y nw | j }z t| j�d| j ��}W n t y� t�td | j�d�|� Y nw t ||||�S ) z�Return the Datasource's preferred url_read parameters. Subclasses may override url_max_wait, url_timeout, url_retries. @return: A URLParams object with max_wait_seconds, timeout_seconds, num_retries. �max_waitz6Config max_wait '%s' is not an int, using default '%s'r �timeoutz5Config timeout '%s' is not an int, using default '%s'�retriesz5Config retries '%s' is not an int, using default '%s'r{ zAConfig sec_between_retries '%s' is not an int, using default '%s')� url_max_wait�intr� rp � ValueErrorr �logexcr� � url_timeout�max� url_retries� Exception�url_sec_between_retriesrw )r; r r r r{ r' r' r* �get_url_paramsC sd �� �� ���� �� zDataSource.get_url_paramsc C s2 | j d u r| j�| �� �| _ |r| �| j �S | j S r7 )r� r� �process�get_userdata_raw� _filter_xdata)r; � apply_filterr' r' r* � get_userdata s zDataSource.get_userdatac C �" | j d u r| j�| �� �| _ | j S r7 )r� r� r �get_vendordata_rawr: r' r' r* �get_vendordata� � zDataSource.get_vendordatac C r! r7 )r� r� r �get_vendordata2_rawr: r' r' r* �get_vendordata2� r$ zDataSource.get_vendordata2c C s | j s | j�� | _ | j S r7 )r� r� r] r: r' r' r* r� � s zDataSource.platform_typec C s | j s| �� | _ | j S )a� Return a string representing subplatform details for the datasource. This should be guidance for where the metadata is sourced. Examples of this on different clouds: ec2: metadata (http://169.254.169.254) openstack: configdrive (/dev/path) openstack: metadata (http://169.254.169.254) nocloud: seed-dir (/seed/dir/path) lxd: nocloud (/seed/dir/path) )r� �_get_subplatformr: r' r' r* r� � s zDataSource.subplatformc C s | j r d| j � d�S tS )z?Subclasses should implement to return a "slug (detail)" string.z metadata (�))r� �METADATA_UNKNOWNr: r' r' r* r' � s zDataSource._get_subplatformc C s~ | j r| j S | jr5| j�t�r5| j�t�}t|t�r"|�� | _ | j S | �� �� | _ t� dtt |�� | j S | �� �� | _ | j S )z�Return lowercase cloud name as determined by the datasource. Datasource can determine or define its own cloud product name in metadata. z5Ignoring metadata provided key %s: non-string type %s) � _cloud_namerg rp �METADATA_CLOUD_NAME_KEYr_ rG r] �_get_cloud_namer� r� �type)r; r� r' r' r* r� � s ���zDataSource.cloud_namec C r6 )z�Return the datasource name as it frequently matches cloud name. Should be overridden in subclasses which can run on multiple cloud names, such as DatasourceEc2. )r� r: r' r' r* r, � s zDataSource._get_cloud_namec C s" | j sd S d| j v r| j d S d S )Nz launch-index)rg r: r' r' r* r � s zDataSource.launch_indexc C s0 t �t�| j ��g}|}|D ]}|�|�}q|S r7 )r �Filterr �safe_int�apply)r; � processed_ud�filters�new_ud�fr' r' r* r � s � zDataSource._filter_xdatac C r6 r7 )r� r: r' r' r* r � r= zDataSource.get_userdata_rawc C r6 r7 )r� r: r' r' r* r" � r= z DataSource.get_vendordata_rawc C r6 r7 )r� r: r' r' r* r% � r= z DataSource.get_vendordata2_rawc C s i S r7 r' r: r' r' r* �get_config_obj� s zDataSource.get_config_objc C s t | j�d��S )Nz public-keys)�normalize_pubkey_datarg rp r: r' r' r* r� � s z DataSource.get_public_ssh_keysc C r� )a5 Publish the public SSH host keys (found in /etc/ssh/*.pub). @param hostkeys: List of host key tuples (key_type, key_value), where key_type is the first field in the public key file (e.g. 'ssh-rsa') and key_value is the key itself (e.g. 'AAAAB3NzaC1y...'). Nr' )r; �hostkeysr' r' r* �publish_host_keys� r� z DataSource.publish_host_keysc C sd ddi}|� � D ]'\}}|�|�sq|D ]}d||t|�d � f }tj�|�r.| S qqd S )N�sd)�vd�xvd�vtbz /dev/%s%s)r\ r` �lenr� ru r )r; � short_name�mappings�nfrom�tlist�nto�candr' r' r* � _remap_device� s ��zDataSource._remap_devicec C � d S r7 r' )r; �_namer' r' r* �device_name_to_device s z DataSource.device_name_to_devicec C s, | j }z| j�� }W |S ty Y |S w )z<Default locale is en_US.UTF-8, but allow distros to override)�default_localer� � get_localer )r; �localer' r' r* rI s ��zDataSource.get_localec C s2 | j �d| j �d��}|r|S | j �di ��d�S )Nr� r� � placement�rg rp )r; � top_level_azr' r' r* r� s �z DataSource.availability_zonec C s | j �d�S )Nr� rL r: r' r' r* r� " s zDataSource.regionc C s" | j rd| j vr dS t| j d �S )Nr� ziid-datasource)rg rG r: r' r' r* r� & s zDataSource.get_instance_idc C sX d}d}|}d}| j r| j �d�sW|rtd|�S g }t�� } | dkr$d}t�| �} | r:| �d�dkr:t| ��d�}nI| rK| �d�dkrKt| ��d�}n8| rR| |g}n1||g}n,| j d } t � | �r~g }|rjt� | �}|rtt|��d�}nd | � dd � g}n| �d�}t |�d kr�|d } d�|d d� �}n|d } |r�||kr�d | |f } t| |�S ) a� Get hostname or fqdn from the datasource. Look it up if desired. @param fqdn: Boolean, set True to return hostname with domain. @param resolve_ip: Boolean, set True to attempt to resolve an ipv4 address provided in local-hostname meta-data. @param metadata_only: Boolean, set True to avoid looking up hostname if meta-data doesn't have local-hostname present. @return: a DataSourceHostname namedtuple <hostname or qualified hostname>, <is_default> (str, bool). is_default is a bool and it's true only if hostname is localhost and was returned by util.get_hostname() as a default. This is used to differentiate with a user-defined localhost hostname. Optionally return (None, False) when metadata_only is True and local-hostname data is not available. � localdomain� localhostFr� NT�.r zip-%sr� r� z%s.%s)rg rp r| r r� �get_fqdn_from_hosts�findrG rq r �is_ipv4_address� gethostbyaddrra r= r� ) r; �fqdn� resolve_ip� metadata_only� defdomain�defhost�domainr~ �toksr} � hosts_fqdn�lhostr' r' r* r� , sF zDataSource.get_hostnamec C s | j j| d�S )N)� data_source)r� �get_package_mirror_infor: r' r' r* r_ t s z"DataSource.get_package_mirror_info�source_event_typesc C sP i }|D ]!}| j �� D ]\}}||v r$|�|�s t� ||< || �|� q q|S r7 )�supported_update_eventsr\ rp �set�add)r; r` �supported_events�event� update_scope� update_eventsr' r' r* �get_supported_eventsw s � ��z DataSource.get_supported_eventsc C s� | � |�}|�� D ] \}}t�d|jd�dd� |D ��� | �d| tff� q |r6| �� | �� }|r6dS t�d| d�dd� |D ��� d S ) a� Refresh cached metadata if the datasource supports this event. The datasource has a list of supported_update_events which trigger refreshing all cached metadata as well as refreshing the network configuration. @param source_event_types: List of EventTypes which may trigger a metadata update. @return True if the datasource did successfully update cached metadata due to source_event_type. z:Update datasource metadata and %s config due to events: %s�, c S � g | ]}|j �qS r' r8 ��.0re r' r' r* � <listcomp>� � z;DataSource.update_metadata_if_supported.<locals>.<listcomp>z _%s_configTz(Datasource %s not updated for events: %sc S rj r' r8 rk r' r' r* rm � rn F) rh r\ r� r� r9 r� r� r� r� )r; r` rd �scope�matched_events�resultr' r' r* � update_metadata_if_supported� s& ��z'DataSource.update_metadata_if_supportedc C r� r� r' )r; r� r' r' r* �check_instance_id� r� z DataSource.check_instance_idc C r� )a check_if_fallback_is_allowed() Checks if a cached ds is allowed to be restored when no valid ds is found in local mode by checking instance-id and searching valid data through ds list. @return True if a ds allows fallback, False otherwise. Fr' r: r' r' r* r� � s z'DataSource.check_if_fallback_is_allowedc C sT |d u rt }|d u r t}| D ]}|d u rq||v r | S t�d||� | S |S )Nz%invalid dsmode '%s', using default=%s)�DSMODE_NETWORK� VALID_DSMODESr� r� )� candidates�default�valid� candidater' r' r* �_determine_dsmode� s �z DataSource._determine_dsmodec C rE r7 r' r: r' r' r* �network_config� r� zDataSource.network_configc C r� )a( setup(is_new_instance) This is called before user-data and vendor-data have been processed. Unless the datasource has set mode to 'local', then networking per 'fallback' or per 'network_config' will have been written and brought up the OS at this point. Nr' )r; �is_new_instancer' r' r* �setup� s zDataSource.setupc C r� )a� activate(cfg, is_new_instance) This is called before the init_modules will be called but after the user-data and vendor-data have been fully processed. The cfg is fully up to date config, it contains a merged view of system config, datasource config, user config, vendor config. It should be used rather than the sys_cfg passed to __init__. is_new_instance is a boolean indicating if this is a new instance. Nr' )r; �cfgr| r' r' r* �activate� s zDataSource.activater7 )r' �T)F)FFF)NN)_r> r? r@ rt �dsmoderH r� r* r� r� r� r r r rG �__annotations__r/ rB rF rD rC r� r r r r r r r r �BOOT_NEW_INSTANCE�BOOT� BOOT_LEGACY�HOTPLUGra �default_update_eventsr� r� r r� r� r� r� �_ci_pkl_versionr r r� r r� r< �boolr� r� r� r� r� r� r� r� r r r# r& �propertyr� r� r' r� r, r r r r" r% r5 r� r8 rD rG rI r� r� r� r� r_ r rh rr rs r� � staticmethodrz r{ r} r r' r' r' r* r � s� � �� �� � $ & L < H � �& )� metaclassc C s� g }| s|S t | t�r| �� S t | ttf�rt| �S t | t�rC| �� D ] \}}t |t�r/|g}t |ttf�rB|D ] }|rA|�|� q8q#|S r7 )r_ rG � splitlines�listrb rb r\ r^ )� pubkey_data�keys�_keyname�klist�pkeyr' r' r* r6 � s" �r6 r5 c C s. t |||�}dd� |D �}t|v rdnd} t�d| |� t||�D ]j\} } tjd| �dd� d | | f d | | f |d �} z?| �3 t�d | � | | ||�} | �t j g�rkd | | f | _ | t � | �fW d � W S W d � n1 suw Y W q! ty� t�td| � Y q!w dd�|� }t|��)Nc S s g | ]}t �|��qS r' r� )rl r4 r' r' r* rm s z find_source.<locals>.<listcomp>�networkr z#Searching for %s data source in: %sz search-%sr rV z searching for %s data from %szno %s data found from %s)�name� description�message�parentz%Seeing if we can get any data from %szfound %s data from %szGetting data from %s failedz4Did not find any data source, searched classes: (%s)ri )� list_sources� DEP_NETWORKr� r� �zipr �ReportEventStackra rr r r� r� r r� r r r r� rR )r� r� r� �ds_deps�cfg_list�pkg_list�reporter�ds_list�ds_namesr� r� �cls�myrep�s�msgr' r' r* � find_source s> � � � �� ��r� c C s� g }t �d| ||� | D ]5}t�|�}t�||dg�\}}|s%t �d|� |D ]}t�|�} t| d�} | |�} | r@|�| � nq'q |S )z�Return a list of classes that have the same depends as 'depends' iterate through cfg_list, loading "DataSource*" modules and calling their "get_datasource_list". Return an ordered list of classes that match (if any) zLLooking for data source in: %s, via packages %s that matches dependencies %s�get_datasource_listzDCould not import %s. Does the DataSource exist and is it importable?) r� r� r �"match_case_insensitive_module_name� find_module�error� import_module�getattrrd ) r� �dependsr� �src_listr1 �ds_name�m_locs� _looked_locs�m_loc�mod�lister�matchesr' r' r* r� * s6 � �� ��r� � system-uuid�fieldc C s* | sdS t �|�}|s dS | �� |�� kS r� )r � read_dmi_datar] )r� r� � dmi_valuer' r' r* � instance_id_matches_system_uuidN s r� c C sl | st } |st }|t kr| t kr| S |S t�� D ]\}}|\}}|�|�r-|| �r-| S q| t kr4| S |S )z@Lookup the canonical cloud-id for a given cloud_name and region.)r) �CLOUD_ID_REGION_PREFIX_MAPr\ r` )r� r� r� �prefix� cloud_id_testr� � valid_cloudr' r' r* r� \ s �r� Tc C sf | sdS t | t�r | S t | t�rt�| �S t | t�r+|du r't| �d�dd�S td��tdt | � ��)aL data: a loaded object (strings, arrays, dicts). return something suitable for cloudinit vendordata_raw. if data is: None: return None string: return string list: return data the list is then processed in UserDataProcessor dict: return convert_vendordata(data.get('cloud-init')) NTz cloud-initF)�recursez'vendordata['cloud-init'] cannot be dictz$Unknown data type for vendordata: %s) r_ rG r� rZ r[ rb �convert_vendordatarp r r- )�datar� r' r' r* r� o s r� c @ rQ )�BrokenMetadataNrS r' r' r' r* r� � rT r� c C s4 g }t | �}|D ]\}}|t |�kr|�|� q|S r7 )rb r^ )r� r� �ret_list�depsetr� �depsr' r' r* �list_from_depends� s �r� rt �fnamec C sn zt �| �}W n ty t�td| � Y dS w z tj||ddd� W dS ty6 t�td|� Y dS w )z[Use pickle to serialize Datasource to a file as a cache. :return: True on success z Failed pickling datasource %sF�wb� )�omoder� z Failed pickling datasource to %sT)�pickle�dumpsr r r r� r )rt r� � pk_contentsr' r' r* r� � s � ��r� c C s� d}zt �| �}W n ty( } ztj�| �r t�d| |� W Y d}~nd}~ww |s-dS zt� |�W S t y= Y dS tyM t � td| � Y dS w )zBUse pickle to deserialize a instance Datasource from a cache file.Nz failed loading pickle in %s: %sz#Failed loading pickled blob from %s) r �load_binary_filer r� ru �isfiler� r� r� r� rN r )r� �pickle_contentsr� r' r' r* �pkl_load� s$ �� �r� c C s t t�� �S )z�Check if command line argument for this datasource was passed Passing by command line overrides runtime datasource detection )�parse_cmdline_or_dmir � get_cmdliner' r' r' r* r� � s r� �inputc C s� t �d| �}t �d| �}t �d| �}|p|p|}|p|}|r7|�d��� }tjd|� d|� �dd|� d �d � |rC|�d�rC|�d�S d S ) Nz(?:^|\s)ds=([^\s;]+)z(?:^|\s)ci\.ds=([^\s;]+)z (?:^|\s)ci\.datasource=([^\s;]+)r� z8Defining the datasource on the command line using ci.ds=z or ci.datasource=z23.2zUse ds=z instead)� deprecated�deprecated_version� extra_messagerV )�re�search�group�stripr � deprecate)r� � ds_parse_0� ds_parse_1� ds_parse_2r1 r� r� r' r' r* r� � s& �� � r� )rV r' )r� r� )X�abcrZ r� �loggingr� r� r� � collectionsr �enumr r �typingr r r r r r � cloudinitr r r r r r r r� r �cloudinit.atomic_helperr �cloudinit.distrosr �cloudinit.eventr r �cloudinit.filtersr �cloudinit.helpersr �cloudinit.persistencer �cloudinit.reportingr �DSMODE_DISABLED� DSMODE_LOCALrt � DSMODE_PASSru �DEP_FILESYSTEMr� � DS_PREFIXr� �REDACT_SENSITIVE_VALUEr+ r� r) � getLoggerr> r� r� r/ rH r rN rR rU rc rv rw r| �ABCMetar r6 rG r� r� r� r� r� r� �IOErrorr� r� r� r� r� r� r' r' r' r* �<module> s� � � # � � 6 �!%�� �