U e9@sddlZddlZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z m Z mZddlmZddlmZdd lmZmZe d d Zed ejZed ejZedejZedZedZe ddZGddde Ze ddZe edfddZ e ddZ!e ddZ"ddZ#dd d!d"Z$Gd#d$d$eZ%dd d%d&Z&ed'ej'Z(d(d)Z)e d*d+Z*e d3d-d.Z+d/d0Z,d1d2Z-ee-e.Z/dS)4N)GzipFile)compress)BytesIO)SuspiciousFileOperation)SimpleLazyObjectkeep_lazy_textlazy)_lazy_re_compile)gettext) gettext_lazypgettextcCs2|s|St|tst|}|d|ddS)z(Capitalize the first letter of a string.rN) isinstancestrupper)xr5/tmp/pip-unpacked-wheel-lctamlir/django/utils/text.pycapfirsts  rz<[^>]+?>|([^<>\s]+)z <[^>]+?>|(.)z<(/)?(\S+?)(?:(\s*/)|\s.*?)?>z\r\n|\rz&(((?<=[a-z])[A-Z])|([A-Z](?![A-Z]|$)))csfdd}d|S)aC A word-wrap function that preserves existing line breaks. Expects that existing line breaks are posix newlines. Preserve all white space except added line breaks consume the space on which they break the line. Don't wrap long words, thus the output text may have lines longer than ``width``. c3sdD]}t|dr"dp$}t||kr|d|ddd}|dkrz|dd}|dkrz|Vd}qd|d|dV||d}t|drdp}q*|r |Vq dS)NT r  rz%s ) splitlinesminendswithlenrfindfind)line max_widthspacetextwidthrr _generator/s  zwrap.._generatorr)join)r"r#r$rr!rwrap"s r&csZeZdZdZdZfddZdddZdd d Zd d Zdd dZ ddZ ddZ Z S) Truncatorz An object used to truncate text, either by characters or words. When truncating HTML text (either chars or words), input will be limited to at most `MAX_LENGTH_HTML` characters. i@KLcstfdddS)NcstSNrrr"rrOz$Truncator.__init__..)super__init__)selfr" __class__r*rr.NszTruncator.__init__NcCs@|dkrtdd}d|kr&|d|iS||r4|Sd||fS)Nz%String to return when truncating textu%(truncated_text)s…z%(truncated_text)sZtruncated_textz%s%s)r r)r/r"truncaterrradd_truncation_textQs  zTruncator.add_truncation_textFcCsx|t|}td|j}|}|d|D]"}t|s.|d8}|dkr.qRq.|rh|||||dS|||||S)a Return the text truncated to be no longer than the specified number of characters. `truncate` specifies what should be used to notify that the string has been truncated, defaulting to a translatable string of an ellipsis. NFCrr rF) _setupint unicodedata normalize_wrappedr3 combining_truncate_html _text_chars)r/numr2htmllengthr" truncate_lencharrrrchars`s zTruncator.charsc Csjd}d}t|D]T\}}t|r$q|d7}|dkr@||kr@|}||kr||d|pVd|Sq|S)z2Truncate a string after a certain number of chars.rNr ) enumerater7r:r3) r/r?r2r"r@Zs_lenZ end_indexirArrrr<ws zTruncator._text_charscCs4|t|}|r(||||j|dS|||S)z Truncate a string after a certain number of words. `truncate` specifies what should be used to notify that the string has been truncated, defaulting to ellipsis. T)r5r6r;r9 _text_words)r/r=r2r>r?rrrwordss zTruncator.wordscCs>|j}t||kr4|d|}|d||Sd|S)zk Truncate a string after a certain number of words. Strip newlines in the string. Nr)r9splitrr3r%)r/r?r2rFrrrrEs    zTruncator._text_wordscCs|r|dkrdSd}t||jkr4|d|j}d}d}d}d} d} g} |rPtnt} | |kr&| ||} | srq&| d}| dr| d7} | |krT|} qTt| d}|rT| |krqT|\}}}| }|s||krqT|rz| |}Wnt k rYnX| |dd} qT| d|qT| d|}| |krT|rP|rP||7}|S|d| }|rn||7}| D]}|d|7}qr|S) a Truncate HTML to a certain number of chars (not counting tags and comments), or, if words is True, then to a certain number of words. Close opened tags if they were correctly closed in the given HTML. Preserve newlines in the HTML. rrFNT) brcollinkbaseimgparamareahrinputr z)rMAX_LENGTH_HTMLre_wordsre_charssearchendre_tagmatchgroupslowerindex ValueErrorinsertr3)r/r?r2r"r@rFZ size_limitedZhtml4_singletsposZ end_text_posZ current_lenZ open_tagsregexmtagZ closing_tagtagnameZ self_closingrDZ truncate_textoutrrrr;s^            zTruncator._truncate_html)N)NF)NF) __name__ __module__ __qualname____doc__rQr.r3rBr<rFrEr; __classcell__rrr0rr'Cs     r'cCs:t|dd}tdd|}|dkr6td||S)aY Return the given string converted to a string that can be used for a clean filename. Remove leading and trailing spaces; convert other spaces to underscores; and remove anything that is not an alphanumeric, dash, underscore, or dot. >>> get_valid_filename("john's portrait in 2004.jpg") 'johns_portrait_in_2004.jpg' r_z (?u)[^-\w.]r>r...z$Could not derive file name from '%s')rstripreplaceresubr)namesrrrget_valid_filenames  rqorcCsV|sdSt|dkr t|dSdtddd|dd Dt|t|d fS) a >>> get_text_list(['a', 'b', 'c', 'd']) 'a, b, c or d' >>> get_text_list(['a', 'b', 'c'], 'and') 'a, b and c' >>> get_text_list(['a', 'b'], 'and') 'a and b' >>> get_text_list(['a']) 'a' >>> get_text_list([]) '' rr rz%s %s %sz, css|]}t|VqdSr(r)).0rDrrr sz get_text_list..N)rrrhr%)list_ last_wordrrr get_text_list s   rxcCstdt|S)z*Normalize CRLF and CR newlines to just LF.r) re_newlinesrnrr*rrrnormalize_newlines&srzcsVddddddddddddddddddddddddddd d fd d |DS) z@Convert a phone number with letters into its numeric equivalent.23456789)abcdefghrDjklr_nopqrrptuvwryzrc3s|]}||VqdSr()get)rsrZ char2numberrrrtKsz phone2numeric..)r%rY)Zphonerrr phone2numeric,s8rcCsdt|S)Na)secrets randbelowmax_random_bytesrrr_get_random_filenameNsrrcCs\t|ddd}|s|St|}t|dd}tj|d<t|d}t|||ddS)Nr) compresslevelmtime ) gzip_compress memoryview bytearraygzipFNAMErbytes)rprZcompressed_dataZcompressed_viewheaderfilenamerrrcompress_stringRs  rc@seZdZddZdS)StreamingBuffercCs|}|d||S)Nr)getvalueseekr2)r/retrrrreadbs zStreamingBuffer.readN)rcrdrerrrrrrasrc csrt}|rt|nd}t|dd|dd6}|V|D] }|||}|r8|Vq8W5QRX|VdS)Nwbrr)rmoderfileobjr)rrrrwrite)sequencerbufrzfileitemdatarrrcompress_sequencejs"  rz ((?: [^\s'"]* (?: (?:"(?:[^"\\]|\\.)*" | '(?:[^'\\]|\\.)*') [^\s'"]* )+ ) | \S+) ccs"tt|D]}|dVqdS)a Generator that splits a string by spaces, leaving quoted phrases together. Supports both single and double quotes, and supports escaping quotes with backslashes. In the output, strings will keep their initial and trailing quote marks and escaped quotes will remain escaped (the results can then be further processed with unescape_string_literal()). >>> list(smart_split(r'This is "a person\'s" test.')) ['This', 'is', '"a person\\\'s"', 'test.'] >>> list(smart_split(r"Another 'person\'s' test.")) ['Another', "'person\\'s'", 'test.'] >>> list(smart_split(r'A "\"funky\" style" test.')) ['A', '"\\"funky\\" style"', 'test.'] rN)smart_split_refinditerr)r"bitrrr smart_splitsrcCsT|r |ddks |d|dkr,td||d}|ddd||ddS) al Convert quoted string literals to unquoted strings with escaped quotes and backslashes unquoted:: >>> unescape_string_literal('"abc"') 'abc' >>> unescape_string_literal("'abc'") 'abc' >>> unescape_string_literal('"a \"bc\""') 'a "bc"' >>> unescape_string_literal("'\'ab\' c'") "'ab' c" rz"'ruzNot a string literal: %rr z\%sz\\\)r[rl)rpquoterrrunescape_string_literals  rFcCsZt|}|rtd|}ntd|ddd}tdd|}tdd|d S) a Convert to ASCII if 'allow_unicode' is False. Convert spaces or repeated dashes to single dashes. Remove characters that aren't alphanumerics, underscores, or hyphens. Convert to lowercase. Also strip leading and trailing whitespace, dashes, and underscores. NFKCZNFKDasciiignorez[^\w\s-]rz[-\s]+-z-_) rr7r8encodedecodermrnrYrk)valueZ allow_unicoderrrslugifys rcCstd|S)zQ Split CamelCase and convert to lowercase. Strip surrounding whitespace. z \1) re_camel_casernrkrY)rrrrcamel_case_to_spacessrcOs |j||S)zk Apply str.format() on 'format_string' where format_string, args, and/or kwargs might be lazy. )format) format_stringargskwargsrrr _format_lazysr)F)0rrmrr7rrriorZdjango.core.exceptionsrZdjango.utils.functionalrrrZdjango.utils.regex_helperr Zdjango.utils.translationr rhr r rSrRrSrVryrr&r'rqrxrzrrrrrVERBOSErrrrrrrZ format_lazyrrrrs\          9   !