shell bypass 403
a
�1j�n �
@ s� d dl Z d dlZd dlZd dlZd dlmZmZmZ d dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z
d dlZd dlZd dlZd dlZd dlmZ d dlmZ zd dlmZ W n ey� d dlmZ Y n0 e�d�Z dZ zd dl Z e � e � d Z W nD ee!f�y8 d d
l"m#Z# d Z$e �%d e#e$d
dd�� d �� Y n0 dZ&g d�Z'dd� Z(dVdd�Z)dd� Z*dWdd�Z+dd� Z,d d � Z-d d � Z.dXd d!�Z/d"d#� Z0dYd$d%�Z1e2d&�d'd(�Z3e&ddddddddddddf
d)d*�Z4dZd+d,�Z5d[d-d.�Z6d\d0d1�Z7d]d3d4�Z8e j9fd5d6�Z:d7d8� Z;d9d:� Z<d;d<� Z=d=d>� Z>d?d@� Z?e j@dA�dBdC�ZAdDdE� ZBg fdFdG�ZCG dHdI� dIejD�ZEG dJdK� dK�ZFG dLdM� dMejD�ZGG dNdO� dOejD�ZHG dPdQ� dQ�ZIG dRdS� dS�ZJG dTdU� dUeK�ZLdS )^� N)�Popen�PIPE�STDOUT)�closing)�deque)�parse)�
parse_versionZsosFT)�fillz�WARNING: Failed to load 'magic' module version >= 0.4.20 which sos aims to use for detecting binary files. A less effective method will be used. It is recommended to install proper python3-magic package with the module.
�
�H )Zreplace_whitespacei, )�TIMEOUT_DEFAULT�ImporterHelper�SoSTimeoutError� TempFileUtil�bold�file_is_binary�fileobj�find�get_human_readable�grep�
import_module�
is_executable�listdirr � path_exists�
path_isdir� path_isfile� path_islink� path_join� recursive_dict_values_by_key� shell_out�sos_get_command_output�tac_logs�tailc
C s� t �d�}zF|j| dd�\}}}|s*| W S t �dd|��d�}|� d|� �}|W S ty� } z&t�d| � d |� �� | W Y d
}~S d
}~0 0 d
S ) z< Convert the version into a PEP440 compliant version scheme.z2^([0-9][0-9.]*(?:(?:a|b|rc|.post|.dev)[0-9]+)*)\+?� )�maxsplitz[+~]+�.�-�+zUnable to format z to pep440 format: N)�re�compile�split�sub�strip� Exception�log�debug)�verZpublic_version_re�_Zpublic�localZsanitized_localZpep440_version�err� r4 �1/usr/lib/python3.9/site-packages/sos/utilities.py�format_version_to_pep440P s �r6 c C s |rt | �}t|�S t| �S )z6 Converts the version to PEP440 format before parsing )r6 r )r0 Zpep440Z
ver_pep440r4 r4 r5 �sos_parse_versiona s r7 c C sT t | d��6}t�| �j|kr*|�| d� |�� W d � S 1 sF0 Y dS )z,Returns the last number_of_bytes of filename�rb� N)�open�os�stat�st_size�seek�read)�filenameZnumber_of_bytes�fr4 r4 r5 r" j s r" �rc C sZ t | t�rNzt| |dd�W S tyJ t�d| � d�� tt�� � Y S 0 nt| �S dS )z@Returns a file-like object that can be used as a context manager�utf-8��encodingz fileobj: z could not be openedN) �
isinstance�strr: �IOErrorr. r/ r �io�StringIO)Z path_or_file�moder4 r4 r5 r r s
r c C sH ddddd�}|� � D ]*\}}| |krt| �| d�|� � S q| � S )zCConverts a number of bytes to a shorter, more human friendly formatl i @� � )�T�G�M�Kz.1f)�items�float)Z num_bytesZsizes�symbol�sizer4 r4 r5 �
convert_bytes~ s
rV c C s� | dd� dv r�t | ddd��P}|�� }t�d|�rDW d � dS t�d |�r`W d � d
S W d � n1 st0 Y dS dS ) a� Helper to determine if a given file is a certificate or not.
This is especially helpful for `sos clean`, which cannot obfuscate
certificate files content and instead, by default, will keep them as is.
:param fname: The full path of the file to check
:type fname: ``str``
:returns: The type of the certificate or ``None``
:rtype: ``string`` or ``None``
���N)z.csrz.crtz.pemrB rC rD z-----BEGIN CERTIFICATE-----Z certificatez"-----BEGIN [A-Z]+ PRIVATE KEY-----Zcertificatekey)r: r? r( �search)�fnamerA Zcontentr4 r4 r5 �file_is_certificate� s .rZ c s� t r`zHt�| �� ddg}� jdkoJt� fdd�|D �� oJtt�d| �� W S ty^ Y n0 t | ddd ��N}z |�
d
� W W d � d S t y� Y W d � d
S 0 W d � n1 s�0 Y d S )az Helper to determine if a given file contains binary content or not.
This is especially helpful for `sos clean`, which cannot obfuscate binary
data and instead, by default, will remove binary files.
:param fname: The full path of the file to check binaryness of
:type fname: ``str``
:returns: True if binary, else False
:rtype: ``bool``
ztext/zinode/�binaryc 3 s | ]}� j �|�V qd S �N)Z mime_type�
startswith)�.0Z_mt�Z_ftupr4 r5 � <genexpr>� � z!file_is_binary.<locals>.<genexpr>zaudit\.log(?:\.[1-9]\d*)?$�trrC rD r# NFT) � magic_mod�magic�detect_from_filenamerE �any�boolr( rX r- r: r? �UnicodeDecodeError)rY Z_mimesZtfiler4 r_ r5 r � s$
���
r c c s� |r"t j�|��t jj�}||7 }t �|�D ]^\}}}|rV|�t jj�|krV|dd�= |rht�||�shq,t�|| �D ]}t j�||�V qtq,dS )z�Generator function to find files recursively.
Usage::
for filename in find("*.properties", "/var/log/foobar"):
print filename
N) r; �path�dirname�count�sep�walk�fnmatch�filter�join) Z file_patternZtop_dirZ max_depth� path_patternZ
base_depthri �dirlistZfilelist�namer4 r4 r5 r � s
r c sR g }|D ]D}t |��(}|�� fdd�|D �� W d � q1 sB0 Y q|S )z�Returns lines matched in fnames, where fnames can either be pathnames to
files to grep through or open file objects to grep through line by linec 3 s | ]}t �� |�r|V qd S r\ )r( �match)r^ �line��patternr4 r5 r` � ra zgrep.<locals>.<genexpr>N)r �extend)rw Zfiles_or_paths�matchesZfop�for4 rv r5 r � s
8r c s\ t j�dd��t jj�}� g� fdd�|D � }�rJ|�fdd�|D �7 }tdd� |D ��S )z6Returns if a command matches an executable on the PATH�PATH� c s g | ]}t j�|� ��qS r4 )r; ri rp )r^ �p)�commandr4 r5 �
<listcomp>� ra z!is_executable.<locals>.<listcomp>c s g | ]}t j�� |�d ���qS )�/)r; ri rp �lstrip)r^ �c��sysrootr4 r5 r � s c s s | ]}t �|t j�V qd S r\ )r; �access�X_OK)r^ ri r4 r4 r5 r` � ra z is_executable.<locals>.<genexpr>)r; �environ�getr* ri �pathseprf )r~ r� �pathsZ
candidatesr4 )r~ r� r5 r � s �r )�urlc C s� ddl m}m} zd|| �}|js&|jrpd}|jr:||j7 }|jrP|d|j� �7 }||j||j|j |j
|j f�W S | W S t y� | Y S 0 dS )zK
Replace username:password@ with ********@ in proxy URL if present
r )�urlparse�
urlunparsez ********@�:N)
� urllib.parser� r� �username�password�hostname�port�schemeri �params�query�fragmentr- )r� r� r� Z
parsed_url�netlocr4 r4 r5 �scrub_url_credential� s
� r� c
s � ��fdd�}�fdd�}�rfzt ���}W n tyL dddd� Y S 0 |�|j�|j�d�� tj�� }d |d
< |r�|�� D ]"\}}|r�|||< q�|� |d � q�|r�t
d �r�d
|r�dnd� d|� d| � �} t � | �}g }|D ]L}|�
d��r&d|v �r&t�|�}|�r|�|� n
|�|� q�|�|� q�|
�rl|�rDt}n&| �r`tjtj�|
�d�}n
t|
d�}nt}|
d u�r~tnd }�zp�z�t|d|||�r�tntd|d|d� ���}d }�zf|
�r
|�r�| �r�tjtj�|
�d�}n
t|
d�}t|j|||�} n
t||�} nt |j||�} |
d u�r.t |j |
�}��rJ| j �r6||� �q4n�z|� |�rZ|nd � W n� t!�y4 |�"� |
�r�| �r�t|
d�� } t#|| d� W d � n1 �s�0 Y d| _ d| �$� | j%d� Y W |d u�r |�&� |j'�r t(�)d| � d|j'� �� W d � W W t*|d ��r2|�+� S 0 |�,� d u �rH�q6|
�r�| �r�t|
d��*} t#|| | j%�pv|j-d k� W d � n1 �s�0 Y |j-d v �r�d } n| �$� } |j-| | j%d�W |d u�r�|�&� |j'�r�t(�)d| � d|j'� �� W d � W W t*|d ��r |�+� S n4|d u�rR|�&� |j'�rRt(�)d| � d|j'� �� 0 W d � n1 �sj0 Y W nf t.�y� } zL| j/t/j0k�r�dddd�W Y d } ~ W t*|d ��r�|�+� S | �W Y d } ~ n
d } ~ 0 0 W t*|d ��r |�+� nt*|d ��r
|�+� 0 d S ) ar Execute a command and return a dictionary of status and output,
optionally changing root or current working directory before
executing command.
:param stdin: If not ``None``, open a pipe to the child's stdin and
write this value (``str`` is encoded as UTF-8, ``bytes`` is sent
as-is). If ``None``, the child inherits the parent's stdin.
c sb �r�dkrt ��� �rPt �t���j� t �t���j� t �t���j � � r^t �� � d S �Nr� )
r; �chroot�setgid�pwd�getpwnam�pw_gid�setuid�pw_uid�chdir�pw_dirr4 )r� r� �runasr4 r5 �_child_prep_fn s
z.sos_get_command_output.<locals>._child_prep_fnc s, � � s| � � dkr | �� t�t�d� d S )N�| �{�G�z�?)�poll� terminater �time�sleep)�proc)�pollerr4 r5 �
_check_poller" s z-sos_get_command_output.<locals>._check_poller� r| )�status�outputZ truncated)�HOMEZLOGNAMEZPWDZUSERzC.UTF-8�LC_ALLN�timeoutztimeout z --foreground� zs r� �*��dir�wbF���T)�shell�stdin�stdout�stderr�bufsize�envZ close_fdsZ
preexec_fnr� zPassing stdin to command z raised an error: �closer )�~ r� ra )1r� r� �KeyError�updater� r; r� �copyrR �popr �shlexr* r] �globrx �appendr �tempfileZ
TemporaryFileri rj r: r r �
HeadReaderr� �
FakeReader�
TailReader� StdinWriterr� �running�waitr- r� r! � get_contents�is_fullrp �errorr. �warning�hasattrr� r� �
returncode�OSError�errno�ENOENT) r~ r� r� r� r� r� Z
foregroundr[ � sizelimitr� Zto_fileZtacr� r� r� r� Zpwd_userZcmd_env�key�value�argsZ
expanded_args�argZ expanded_argZ_output�_stdinr} Z stdin_writer�reader�f_dstr� �er4 )r� r� r� r� r5 r s
�
�
�
�
�
,�
��" � �$ �
�� � ��
�. �
� r c C s� d}d}d}| � � t�| �� �jdkr,dS tj| �� dtjd���}|�� d }}|| |krdd}|dkr�|�|d|�}||d |kr�|d krdq�qd|r�d
}n|� ||d |d � � |}qdW d � n1 s�0 Y dS ) z�Python implementation of the tac utility with support
for multiline logs (starting with space). It is intended
to reverse the output of 'journalctl --reverse'.
�
�
� r N)r� r# Tr� F)
�flushr; �fstat�filenor= �mmapZ ACCESS_READrU �rfind�write) �f_srcr� Z
drop_last_logZ NEWLINE_BZ NEWLINE_IZSPACE_IZmmZsep1Zsep2r4 r4 r5 r! � s( r! c
s� � � d�d }zt� t� t� |g�}W n@ tyf } z(td� � d|jj� �� |�W Y d}~n
d}~0 0 � fdd�t� |tj
�D �}�r��fdd�|D �}|S ) a Imports the module module_fqname and returns a list of defined classes
from that module. If superclasses is defined then the classes returned will
be subclasses of the specified superclass or superclasses. If superclasses
is plural it must be a tuple of classes.r% r� z"Error while trying to load module z: Nc s g | ]\}}|j � kr|�qS r4 )�
__module__)r^ Zcname�class_)�
module_fqnamer4 r5 r � s
�z!import_module.<locals>.<listcomp>c s g | ]}t |� �r|�qS r4 )�
issubclass)r^ �m)� superclassesr4 r5 r � ra ) �
rpartition�
__import__�globals�locals� ImportError�print� __class__�__name__�inspectZ
getmembersZisclass)r� r� Z module_name�moduler� �modulesr4 )r� r� r5 r � s
�
�r � c C s t | |||d�d S )zeShell out to an external command and return the output or the empty
string in case of error.
)r� r� r� r� )r )�cmdr� r� Zrunatr4 r4 r5 r � s
��r r9 c C sH g d�}d}| dkr.|dk r.|d7 }| d } q | d|� d��|| � �S ) N)�BZKiBZMiBZGiBZTiBr rM � r# g �@r% rA r4 )rU Z precision�suffixesZ suffixindexr4 r4 r5 r � s
r c C s> |r,|t jkr,| �|�s,t j�|| �d��} t||�}|| �S r� )r; rl r] ri rp r� �getattr)ri r� �methodr� Z_methr4 r4 r5 � _os_wrapper� s
r c C s$ d| v rt | |dtd�S t | |d�S )Nr� r� )r� �exists)r r� �ri r� r4 r4 r5 r s r c C s t | |d�S )N�isdir�r r r4 r4 r5 r s r c C s t | |d�S )N�isfiler r r4 r4 r5 r s r c C s t | |d�S )N�islinkr r r4 r4 r5 r s r c C s t | |dt�S )Nr )r r; r r4 r4 r5 r s r r� c G s8 |r$| � |�s$tj�|| �tj��} tjj| g|�R � S r\ )r] r; ri rp r� rl )ri r� r} r4 r4 r5 r s r c C s d| d S )a" Helper to make text bold in console output, without pulling in
dependencies to the project unneccessarily.
:param text: The text to make bold
:type text: ``str``
:returns: The text wrapped in the ASCII codes to display as bold
:rtype: ``str``
z[1mz[0mr4 )�textr4 r4 r5 r " s
r c s� g }g � |� |� t| t�r�| �� D ]~\}�� �|� |rB||v rR|� t��� q$t�t�r$z$|� t�fdd�|D ��d � W n ty� Y n0 � � ��� � q$n
|� | � � fdd�|D �S )a Recursively compile all elements of a potentially nested dict by a set
of keys. If a given key is a dict within ``dobj``, then _all_ elements
within that dict, regardless of child keys, will be returned.
For example, if a Plugin searches the devices dict for the 'storage' key,
then all storage devices under the that dict (e.g. block, fibre, etc...)
will be returned. However, if the Plugin specifies 'block' via ``keys``,
then only the block devices within the devices['storage'] dict will be
returned.
Any elements passed here that are _not_ keys within the dict or any nested
dicts will also be returned.
:param dobj: The 'top-level' dict to intially search by
:type dobj: ``dict``
:param keys: Which keys to compile elements from within ``dobj``. If no
keys are given, all nested elements are returned
:param keys: ``list`` of ``str``
:returns: All elements within the dict and any nested dicts
:rtype: ``list``
c 3 s | ]}|� v r� | V qd S r\ r4 )r^ r� )�vr4 r5 r` V s z/recursive_dict_values_by_key.<locals>.<genexpr>r c s g | ]}|� vr|�qS r4 r4 )r^ �d)�_filtr4 r5 r b ra z0recursive_dict_values_by_key.<locals>.<listcomp>)rx rF �dictrR r� r �
IndexError�keys)Zdobjr Z_items�kr4 )r r
r5 r / s,
���
r c s, e Zd ZdZdZ� fdd�Zdd� Z� ZS )r� zEWrite bytes to a Popen child's stdin without blocking the main threadi c sL t � jdd� t|t�r"|�d�}|| _|r4t|�nd | _d| _| � � d S )NF)�daemonrC r| )
�super�__init__rF rG �encoder� �
memoryview�_datar� �start)�selfZ
stdin_pipe�data�r� r4 r5 r j s
zStdinWriter.__init__c C s6 | j d u rd S z�z^| jrld}t| j�}||k rb| j||| j � }| j �|�}|d u rXq&||7 }q&| j �� W n. ttfy� } z|| _W Y d }~n
d }~0 0 W z| j � � W n6 ttfy� } z| j|7 _W Y d }~n
d }~0 0 nJz| j � � W n8 ttf�y. } z| j|7 _W Y d }~n
d }~0 0 0 d S �Nr )
r� r �len�CHUNKr� r� �BrokenPipeError�
ValueErrorr� r� )r �offset�total�chunk�n�excr4 r4 r5 �runs s.
&�zStdinWriter.run)r� r� � __qualname__�__doc__r r r( �
__classcell__r4 r4 r r5 r� e s r� c @ s8 e Zd ZdZdd� Zedd� �Zdd� Zedd � �Zd
S ) r� z�Used when we are writing directly to disk without sizelimits,
this allows us to keep more simplified flows for executing,
monitoring, and collecting command output.
c C s || _ || _d S r\ )�processr[ )r r, r[ r4 r4 r5 r � s zFakeReader.__init__c C s dS )NFr4 �r r4 r4 r5 r� � s zFakeReader.is_fullc C s | j s
dS dS �Nr| ra �r[ r- r4 r4 r5 r� � s zFakeReader.get_contentsc C s | j �� d u S r\ )r, r� r- r4 r4 r5 r� � s zFakeReader.runningN) r� r� r) r* r �propertyr� r� r� r4 r4 r4 r5 r� � s
r� c s@ e Zd ZdZdZ� fdd�Zdd� Zdd� Zed d
� �Z � Z
S ) r� zzUsed to 'head' the command output (f_src) to a given size
without deadlocking sos. Takes a sizelimit value in MB.
rL c s8 t � �� || _|| _|d | _|| _d| _| �� d S )NrL T)r r r� r� � remainingr[ r� r )r r� r� r� r[ r r4 r5 r � s
zHeadReader.__init__c C sZ | j dkrF| j�t| j | j��}|s&qF| j�|� | j t|�8 _ q | j�� d| _ dS )z�Reads from the f_src (Popen stdout pipe) until we reach sizelimit.
once done, close f_src to signal the program that we are done.
r FN)
r1 r� r? �min� COPY_BUFSIZEr� r� r r� r� )r �bufr4 r4 r5 r( � s
zHeadReader.runc C s | j s
dS dS r. r/ r- r4 r4 r5 r� � s zHeadReader.get_contentsc C s
| j dkS r )r1 r- r4 r4 r5 r� � s zHeadReader.is_full) r� r� r) r* r3 r r( r� r0 r� r+ r4 r4 r r5 r� � s
r� c s< e Zd ZdZ� fdd�Zdd� Zdd� Zedd � �Z� Z S )
r� z�Used to tail the command output to a given size without deadlocking
sos.
Takes a sizelimit value in MB, and will compile stdout from Popen into a
string that is limited to the given sizelimit.
c s^ t � �� || _|| _d| _d | _|r>|d }t|| j �| _t| jd�| _d| _| � � d S )Ni rL )�maxlenT)
r r �chanr[ � chunksize�slots�intr r� r )r Zchannelr� r[ r r4 r5 r � s
zTailReader.__init__c C sH z&| j �| j�}|sq$| j�|� qW n ttfy< Y n0 d| _dS )al Reads from the channel (pipe) that is the output pipe for a
called Popen. As we are reading from the pipe, the output is added
to a deque. After the size of the deque exceeds the sizelimit
earlier (older) entries are removed.
This means the returned output is chunksize-sensitive, but is not
really byte-sensitive.
FN)r6 r? r7 r r� r" rH r� )r ru r4 r4 r5 r( � s zTailReader.runc C sD | j rt�d� q | js.d�dd� | jD ��S d�dd� | jD ��S )z-Returns the contents of the deque as a stringr� r| c s s | ]}|� d d�V qdS )rC �ignoreN)�decode�r^ Zlnr4 r4 r5 r` � ra z*TailReader.get_contents.<locals>.<genexpr>ra c s s | ]
}|V qd S r\ r4 r< r4 r4 r5 r` � ra )r� r� r� r[ rp r r- r4 r4 r5 r� � s
zTailReader.get_contentsc C s | j s
dS t| j�| j kS )z?Checks if the deque is full, implying that output was truncatedF)r8 r r r- r4 r4 r5 r� � s zTailReader.is_full)
r� r� r) r* r r( r� r0 r� r+ r4 r4 r r5 r� � s
r� c @ s8 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd S )
r
z�Provides a list of modules that can be imported in a package.
Importable modules are located along the module __path__ list and modules
are files that end in .py.
c C s
|| _ dS )zopackage is a package module
import my.package.module
helper = ImporterHelper(my.package.module)N)�package)r r= r4 r4 r5 r s zImporterHelper.__init__c C s t j�|�}t j�|�\}}|S )z-Returns the plugin module name given the path)r; ri �basename�splitext)r ri �basers r1 r4 r4 r5 � _plugin_name s zImporterHelper._plugin_namec s � fdd�|D �}|� � |S )Nc s( g | ] }d |vr|� d�r� �|��qS )r z.py)�endswithrA )r^ Zpluginr- r4 r5 r s �z9ImporterHelper._get_plugins_from_list.<locals>.<listcomp>)�sort)r Zlist_�pluginsr4 r- r5 �_get_plugins_from_list s
�z%ImporterHelper._get_plugins_from_listc C s0 t j�|�r,ttd|��}| �|�}|r,|S g S )Nz*.py)r; ri r �listr rE )r ri Zpy_filesZpnamesr4 r4 r5 �_find_plugins_in_dir s
z#ImporterHelper._find_plugins_in_dirc C s2 g }| j jD ] }tj�|�r |�| �|�� q |S )zQReturns the list of importable modules in the configured python
package. )r= �__path__r; ri r rx rG )r rD ri r4 r4 r5 � get_modules$ s
zImporterHelper.get_modulesN) r� r� r) r* r rA rE rG rI r4 r4 r4 r5 r
s r
c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )r c C s || _ g | _d S r\ )�tmp_dir�files)r rJ r4 r4 r5 r 1 s zTempFileUtil.__init__c C s2 t j| jd�\}}t�|d�}| j�||f� |S )Nr� zw+)r� ZmkstemprJ r; �fdopenrK r� )r �fdrY Zfobjr4 r4 r5 �new5 s zTempFileUtil.newc C sd | j D ]R\}}z|�� |�� W n ty4 Y n0 zt�|� W q tyV Y q0 qg | _ d S r\ )rK r� r� r- r; �unlink)r rY rA r4 r4 r5 �clean< s zTempFileUtil.cleanN)r� r� r) r rN rP r4 r4 r4 r5 r / s r c @ s e Zd ZdS )r N)r� r� r) r4 r4 r4 r5 r L s r )T)rB )NN)N)F)N)r� NN)r9 )Mr; r� r( r� �
subprocessr r r Zloggingrn r� r� r� r� � threadingr� rI r� �
contextlibr � collectionsr Zpackaging.versionr r r� Z
pkg_resourcesZ getLoggerr. rc rd re �__file__�AttributeError�textwrapr �msgr� r �__all__r6 r7 r" r rV rZ r r r r rG r� r r! r r r ri r r r r r r rl r r r �Threadr� r� r� r� r
r r� r r4 r4 r4 r5 �<module> s�
"
&
�
&
*
6'%<,