OwlCyberSecurity - MANAGER
Edit File: _headersutil.cpython-39.pyc
a �4�]�" � @ s� d Z ddlmZ ddlZddlZddlmZ ddlmZ ddl m Z dd � Z d#d d �Z d d� Z e�d�Ze�d�Ze�d�Ze�d�Zdd� Ze�d�Zdd� Zdd� Zdd� Zd d hZd d � Zd d!� Zed"kr�e� dS )$a0 Utility functions for HTTP header value parsing and construction. Copyright 1997-1998, Gisle Aas Copyright 2002-2006, John J. Lee This code is free software; you can redistribute it and/or modify it under the terms of the BSD or ZPL 2.1 licenses (see the file LICENSE included with the distribution). � )�absolute_importN� )�_rfc3986)� http2time)� is_stringc C sD | d u r dS t j�t�| �d �d }ddg}|r<|dg7 }||v S )NF� r z.htmz.htmlz.xhtml)�os�path�splitextr Zurlsplit)�url� allow_xhtmlZextZ html_exts� r �8/usr/lib/python3/dist-packages/mechanize/_headersutil.py�is_html_file_extension s r Fc C sb | st ||�S t| �}t|�dk r,t ||�S |d }|d }|d }dg}|rZ|g d�7 }||v S )zM ct_headers: Sequence of Content-Type headers url: Response URL r r z text/html)z text/xhtmlztext/xmlzapplication/xmlzapplication/xhtml+xml)r �split_header_words�len)Z ct_headersr r �headersZ first_headerZfirst_parameterZctZ html_typesr r r �is_html s r c C s* | � d�\}}| jd|� | j|d� S )z)Return unmatched part of re.Match object.r N)�span�string)�match�start�endr r r � unmatched9 s r z^\s*([^=\s;,]+)z&^\s*=\s*\"([^\"\\]*(?:\\.[^\"\\]*)*)\"z^\s*=\s*([^\s;,]*)z\\(.)c C s. t | �r J �g }| D �]}|}g }|�rt�|�}|r�t|�}|�d�}t�|�}|rvt|�}|�d�}t�d|�}n.t�|�}|r�t|�}|�d�}|� � }nd}|� ||f� q"|� � � d�r�|� � dd� }|r�|� |� g }q"t �dd|�\}} | dk�sJ d|||f ��|}q"|r|� |� q|S ) am Parse header values into a list of lists containing key,value pairs. The function knows how to deal with ",", ";" and "=" as well as quoted values after "=". A list of space separated tokens are parsed as if they were separated by ";". If the header_values passed as argument contains multiple values, then they are treated as if they were a single value separated by comma ",". This means that this function is useful for parsing header fields that follow this syntax (BNF as from the HTTP/1.1 specification, but we relax the requirement for tokens). headers = #header header = (token | parameter) *( [";"] (token | parameter)) token = 1*<any CHAR except CTLs or separators> separators = "(" | ")" | "<" | ">" | "@" | "," | ";" | ":" | "\" | <"> | "/" | "[" | "]" | "?" | "=" | "{" | "}" | SP | HT quoted-string = ( <"> *(qdtext | quoted-pair ) <"> ) qdtext = <any TEXT except <">> quoted-pair = "\" CHAR parameter = attribute "=" value attribute = token value = token | quoted-string Each header is represented by a list of key/value pairs. The value for a simple token (not part of a parameter) is None. Syntactically incorrect headers will not necessarily be parsed as you would want. This is easier to describe with some examples: >>> split_header_words(['foo="bar"; port="80,81"; discard, bar=baz']) [[('foo', 'bar'), ('port', '80,81'), ('discard', None)], [('bar', 'baz')]] >>> split_header_words(['text/html; charset="iso-8859-1"']) [[('text/html', None), ('charset', 'iso-8859-1')]] >>> split_header_words([r'Basic realm="\"foo\bar\""']) [[('Basic', None), ('realm', '"foobar"')]] r z\1N�,z^[=\s;]*� r z&split_header_words bug: '%s', '%s', %s)r �token_re�searchr �group�quoted_value_re� escape_re�sub�value_re�rstrip�append�lstrip� startswith�re�subn) Z header_values�result�textZ orig_text�pairs�m�name�valueZnon_junkZ nr_junk_charsr r r r E sJ - �� r z([\"\\])c C s� g }| D ]v}g }|D ]T\}}|dur^t �d|�sDt�d|�}d| }|du rR|}n d||f }|�|� q|r|�d�|�� qd�|�S )a� Do the inverse of the conversion done by split_header_words. Takes a list of lists of (key, value) pairs and produces a single header value. Attribute values are quoted if needed. >>> join_header_words([[("text/plain", None), ("charset", "iso-8859/1")]]) 'text/plain; charset="iso-8859/1"' >>> join_header_words([[( "text/plain", None)], [("charset", "iso-8859/1")]]) 'text/plain, charset="iso-8859/1"' Nz^\w+$z\\\1z"%s"z%s=%sz; z, )r' r �join_escape_rer! r$ �join)Zlistsr r+ �attr�k�vr r r �join_header_words� s r4 c C s0 | � d�r| dd � } | �d�r,| d d� } | S )N�"r ���)r& �endswith)r* r r r � strip_quotes� s r8 c C s� d}g }| D ]�}g }d}t �d|�}tt|��D ]�}|| }|�� }|dkrNq0d|vrb|d } } nt �d|d�\} } | �� } |d kr�| �� } | |v r�| } | d kr�t| �} d }| d kr�tt| ��} |� | | f� q0|r |s�|� d � |� |� q |S )a5 Ad-hoc parser for Netscape protocol cookie-attributes. The old Netscape cookie format for Set-Cookie can for instance contain an unquoted "," in the expires field, so we have to use this ad-hoc parser instead of split_header_words. XXX This may not make the best possible effort to parse all the crap that Netscape Cookie headers contain. Ronald Tschalar's HTTPClient parser is probably better, so could do worse than following that if this ever gives any trouble. Currently, this is also used for parsing RFC 2109 cookies. )�expiresZdomainr Zsecure�versionZportzmax-ageFz;\s*r �=Nz\s*=\s*r r r: Tr9 )r: �0) r' �split�ranger r# r% �lowerr8 r r$ ) Z ns_headersZ known_attrsr) Z ns_headerr+ Z version_set�paramsZiiZparamr2 r3 Zlcr r r �parse_ns_headers� s< rA ZWWWZTEc C sZ dd� | � d�D �}|d �� }|tv r0||d< t|�dkrP|d dkrPd|d< d�|�S ) Nc S s g | ] }|� � �qS r )� capitalize)�.0�xr r r � <listcomp> � z)normalize_header_name.<locals>.<listcomp>�-r � r Z WebsocketZ WebSocket)r= �upper�uppercase_headersr r0 )r- �parts�qr r r �normalize_header_name s rM c C s dd l } ddlm} | �|�S )Nr r )� _headersutil)�doctestr rN Ztestmod)rO rN r r r �_test s rP �__main__)NF) �__doc__Z __future__r r r' r r Z_utilr Zpolyglotr r r r �compiler r r" r r r/ r4 r8 rA rJ rM rP �__name__r r r r �<module> s. X =