U h@sdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z m ZddlmZmZddlmZmZmZmZmZmZmZddlmZmZddlmZmZddl m!Z!dd l"m#Z#dd l$m%Z%dd l&m'Z'dd l(m)Z)m*Z*dd l+m,Z,ddl-m.Z.ddl/m0Z0m1Z1ddl2m3Z3ddl4m Z ddl5m6Z6ddl7m8Z8ddl9m:Z:ddl;mm?Z?ddl@mAZAddlBmCZCmDZDddlEmFZFmGZGddlHZHe IeJZKeLeMdddZNeLeeLefdddZOdeLeeLeLd d!d"ZPeeLeMd#d$d%ZQdeLeLeLd'd(d)ZRdeLeSeLeLd,d-d.ZTdeLeSeSeeLd1d2d3ZUdeeSeVefeLeLd5d6d7ZWdeLeeLee d8d9d:ZXdeLe ee e fd;dd?d@ZZdeLeLeLdBdCdDZ[deLeLeLdFdGdHZ\eeLeLeLdIdJdKZ]eSeLdLdMdNZ^deSeLdPdQdRZ_deLeLeeLeLfdSdTdUZ`eLeLeLeMdVdWdXZadeLeLeLdYdZd[ZbdeLeLeLd\d]d^ZceLd_d`daZddeSeLdcdddeZeeLdfdgdhZfdeLeeeLeLeLeMdidjdkZgeeLeeeLeeLfdldmdnZhdeeLeLeSeeFdqdrdsZideDeSeSedvdwdxZjdeeeeLeSedzd{d|ZkdeDeeLeeLeDd}d~dZleedddZmeedddZndeDeLeeLeLdddZodeLeeLeLfedddZpddZqddZrddZsdS)a Enterprise-Ready Utility Functions Module This module provides a comprehensive collection of utility functions and helpers that are commonly used across the application. It includes data processing, validation, formatting, security, and performance optimization utilities. Features: - Data validation and sanitization utilities - File processing and manipulation functions - Security and encryption helpers - Performance optimization utilities - Date and time manipulation functions - String processing and formatting utilities - Email and communication helpers - API and web service utilities - Database optimization functions - Caching and memoization decorators Author: Focus Development Team Version: 2.0.0 License: Proprietary N)datetime timedeltatimezone)DecimalInvalidOperation)AnyDictListOptionalUnionTupleCallable)wraps lru_cache)urlparseurljoin)Path)settings)cache)ValidationError)validate_email URLValidator)default_storage) ContentFile) send_mailEmailMultiAlternatives)render_to_string)r)slugify) strip_tags) force_str)gettext)get_user_model) transaction)QQuerySet) JsonResponse HttpResponse)phonereturncCsRtdd|}t|dks&t|dkr*dSddg}|D]}t||r6dSq6dS) z Validate phone number format. Args: phone: Phone number string to validate Returns: Boolean indicating if phone number is valid z\DFz ^\+?1?[2-9]\d{2}[2-9]\d{2}\d{4}$z^\+?[1-9]\d{1,14}$T)resublenmatch)r'Z digits_onlypatternspatternr2,/var/www/html/Focus/src/apps/common/utils.pyvalidate_phone_numberEs  r4)passwordr(c Csddgddddddd}t|dkrDd|dd<|d d 7<n|d td d|d <td|rd|dd<|d d 7<n|d tdd|d <td|rd|dd<|d d 7<n|d tdd|d <td|rd|dd<|d d 7<n|d tdd|d <td|rXd|dd<|d d 7<n|d tdd|d <ddddg}|D]@}t||r|d td|d d 8<qĐq|S)z Validate password strength and return detailed feedback. Args: password: Password string to validate Returns: Dictionary with validation results and feedback TrF)length uppercase lowercasedigitspecial)is_validscorefeedbackrequirements_metr>r6r<r=z+Password must be at least 8 characters longr;z[A-Z]r7z3Password must contain at least one uppercase letterz[a-z]r8z3Password must contain at least one lowercase letterz\dr9z(Password must contain at least one digitz[!@#$%^&*(),.?":{}|<>]r:z4Password must contain at least one special characterZ123456r5ZqwertyZabc123z!Password contains common patterns)r.append_r,searchlower)r5resultZcommon_patternsr1r2r2r3validate_password_strengthcs\          rF) html_content allowed_tagsr(cCsV|dkr.dddddddd d d d d dddddg}ddgddddgd}tj|||ddS)z Sanitize HTML content to prevent XSS attacks. Args: html_content: HTML content to sanitize allowed_tags: List of allowed HTML tags Returns: Sanitized HTML content NpbrZstrongZemuZolulZliZh1h2Zh3Zh4Zh5Zh6 blockquoteaimghreftitlesrcaltwidthheight)rOrPT)tags attributesstrip)bleachclean)rGrHZallowed_attributesr2r2r3 sanitize_htmls8  r\) allowed_typesr(cCs\|sdSt|j\}}||kr$dStj|jd}ddddddd d }|||kS) z Validate file type based on MIME type. Args: file: File object to validate allowed_types: List of allowed MIME types Returns: Boolean indicating if file type is allowed FTr@z image/jpegz image/pngz image/gifzapplication/pdfzapplication/mswordzGapplication/vnd.openxmlformats-officedocument.wordprocessingml.document)z.jpgz.jpegz.pngz.gifz.pdfz.docz.docx) mimetypes guess_typenameospathsplitextrDget)filer] mime_typerBZfile_extensionZextension_mappingr2r2r3validate_file_types  rgslug)text field_namer(cCsJt|}|sd}|}d}|jjf||irF|d|}|d7}q|S)a Generate a unique slug for a model instance. Args: text: Text to create slug from model_class: Model class to check uniqueness against field_name: Field name for the slug Returns: Unique slug string itemr@-)robjectsfilterexists)ri model_classrjZ base_slugrhcounterr2r2r3generate_unique_slugs  rrd...)ri max_lengthsuffixr(cCs(t||kr|S|d|t||S)z Truncate text to specified length with suffix. Args: text: Text to truncate max_length: Maximum length of text suffix: Suffix to add when truncating Returns: Truncated text Nr.)rirurvr2r2r3 truncate_texts rx )ri min_length max_keywordsr(c2st|}tdt|d|}ddddddd d d d d ddddddddddddddddddd d!d"d#d$d%d&d'd(d)d*d+d,d-d.d/d0d1d2d3d4h2fd5d6|D}d7d8lm}||}d9d6||DS):z Extract keywords from text. Args: text: Text to extract keywords from min_length: Minimum keyword length max_keywords: Maximum number of keywords to return Returns: List of extracted keywords z \b[a-zA-Z]{z,}ZtheandorZbutinonattoforofwithbyfromupZaboutZintothroughduringbeforeafterZaboveZbelowZbetweenZamongthisthatZtheseZthoseisarewaswerebeZbeenZbeinghaveZhasZhaddoZdoesZdidZwillZwouldZcouldZshouldmayZmightZmustZcanZshallcsg|]}|kr|qSr2r2).0wordZ stop_wordsr2r3 Asz$extract_keywords..r)CountercSsg|] \}}|qSr2r2)rrcountr2r2r3rGs)rrDr,findallstr collectionsr most_common)rir{r|Z clean_textwordskeywordsrZ word_countsr2rr3extract_keywords%sr   rUSD)amountcurrencyr(c Csnztt|}Wnttfk r*YdSXddddd}|||}|dkr\||dS||d Sd S) z Format currency amount with proper symbols and formatting. Args: amount: Amount to format currency: Currency code Returns: Formatted currency string z0.00$u€£¥)rZEURZGBPJPYrz,.0fz,.2fN)rrr ValueErrorrd)rrZcurrency_symbolssymbolr2r2r3format_currencyJs  r) date_stringformatsr(c CsX|dkrdddddddd d g }|D]0}zt||WStk rPYq"Yq"Xq"dS) z Parse date string with multiple format attempts. Args: date_string: Date string to parse formats: List of date formats to try Returns: Parsed datetime object or None Nz%Y-%m-%dz%Y-%m-%d %H:%M:%Sz%Y-%m-%d %H:%Mz%m/%d/%Yz%m/%d/%Y %H:%M:%Sz%d/%m/%Yz%d/%m/%Y %H:%M:%Sz%Y-%m-%dT%H:%M:%Sz%Y-%m-%dT%H:%M:%SZ)rstrptimer)rrfmtr2r2r3parse_date_stringms"   r)period start_dater(c CsR|dkrtjddddd}|dkr@|jddddd}||fS|dkrp|td d }|jddddd}||fS|d kr|}|t|d }|td ddddd }||fS|dkr |jd d}|jdkr|j|jd d d}n|j|jd d}|td d} || fS|dkr@|jd d d} |jddddddd} | | fStd|dS)z Get date range for common periods. Args: period: Period type ('today', 'yesterday', 'week', 'month', 'year') start_date: Starting date (defaults to today) Returns: Tuple of (start_date, end_date) Nr)hourminutesecond microsecondtoday;i?B yesterdayr@)daysweek)rhoursminutesseconds microsecondsmonth)day )yearr)r)rr)rr)rrrrrrzUnknown period: )rnowreplacerweekdayrrr) rrend_daterZdays_since_monday week_startZweek_endZ month_start next_monthZ month_endZ year_startZyear_endr2r2r3get_date_ranges4     r) date_timer(cCst}||}|jdkr@|jd}|d|dkr6dnddS|jdkrp|jd}|d|dkrfdnddS|jd kr|jd |jdkrdnddS|jd kr|jd }|d |dkrdnddS|jd kr|jd }|d|dkrdnddSdSdS)z Format datetime as 'time ago' string. Args: date_time: Datetime to format Returns: Formatted time ago string imz yearr@sr)z agoz monthrz dayiz hour<z minutezJust nowN)rrrr)rrdiffyearsmonthsrrr2r2r3format_time_agos"           rr))filename subfolderr(cCs`|dd}tjd|}td}|rL|d|d|Sd|d|SdS)z Generate file upload path with organization. Args: instance: Model instance filename: Original filename subfolder: Optional subfolder Returns: Generated file path .z%Y/%m/%d/zuploads/N)splitrDuuiduuid4hexrrstrftime)instancerrextZunique_filenameZ date_pathr2r2r3generate_file_paths rmd5) file_path algorithmr(c sJt|}t|d(tfdddD]}||q(W5QRX|S)z Calculate hash of a file. Args: file_path: Path to the file algorithm: Hash algorithm ('md5', 'sha1', 'sha256') Returns: File hash as hexadecimal string rbcs dS)Ni)readr2fr2r3 z%calculate_file_hash..r)hashlibnewopeniterupdate hexdigest)rrZhash_objchunkr2rr3calculate_file_hashs  r) file_paths output_pathr(c CsNt|dtj4}|D](}tj|rtj|}|||qW5QRX|S)z Compress multiple files into a ZIP archive. Args: file_paths: List of file paths to compress output_path: Path for the output ZIP file Returns: Path to the created ZIP file w)zipfileZipFile ZIP_DEFLATEDrarbrobasenamewrite)rrzipfrarcnamer2r2r3compress_filess   r) size_bytesr(cCs\|dkr dSdddddg}d}|dkrH|t|d krH|d }|d 7}q|d d ||S) z Convert file size in bytes to human-readable format. Args: size_bytes: File size in bytes Returns: Human-readable file size string rz0 BBKBMBGBTBr@g@z.1f rw)rZ size_namesir2r2r3get_file_size_human%s  r  )r6r(cCsddl}||S)z Generate a cryptographically secure random token. Args: length: Length of the token Returns: Secure random token rN)secrets token_urlsafe)r6r r2r2r3generate_secure_token@s r)r5saltr(cCs4|dkrtd}td||d}||fS)z Hash password with salt using PBKDF2. Args: password: Password to hash salt: Optional salt (generated if not provided) Returns: Tuple of (hashed_password, salt) Nsha256順)rr pbkdf2_hmacencoder)r5rZhashedr2r2r3 hash_passwordNs r)r5hashed_passwordrr(cCst||\}}||kS)z Verify password against hash. Args: password: Password to verify hashed_password: Stored hash salt: Salt used for hashing Returns: Boolean indicating if password is correct )r)r5rrZ test_hashrBr2r2r3verify_passwordas r)datakeyr(c Csddlm}ddlm}ddlm}ddl}|dkr:tj}|| dddd }| | | }||}| | }| |S) z Encrypt data using Fernet symmetric encryption. Args: data: Data to encrypt key: Encryption key (uses Django SECRET_KEY if not provided) Returns: Encrypted data as base64 string rFernethashes PBKDF2HMACNr salt_rrr6r iterations)cryptography.fernetrcryptography.hazmat.primitivesr)cryptography.hazmat.primitives.kdf.pbkdf2rbase64r SECRET_KEYSHA256urlsafe_b64encodederiverZencryptdecode) rrrrrr&kdfrencrypted_datar2r2r3 encrypt_dataqs   r.)r-rr(c Csddlm}ddlm}ddlm}ddl}|dkr:tj}|| dddd }| | | }||}| | }||} | S) z Decrypt data using Fernet symmetric encryption. Args: encrypted_data: Encrypted data as base64 string key: Decryption key (uses Django SECRET_KEY if not provided) Returns: Decrypted data rrrrNr r rr!)r#rr$rr%rr&rr'r(r)r*rurlsafe_b64decodedecryptr+) r-rrrrr&r,rZencrypted_bytesdecrypted_datar2r2r3 decrypt_datas"    r2)r(cOsvg}|D]8}t|dr2||jjd|jq|t|qt|D]\}}||d|qNd|S)z Generate cache key from arguments. Args: *args: Positional arguments **kwargs: Keyword arguments Returns: Generated cache key pkrB) hasattrrA __class____name__r3rsorteditemsjoin)argskwargsZ key_partsargrvaluer2r2r3cache_key_generators  r>,)timeout key_prefixcsttdfdd }|S)z Decorator to cache function results. Args: timeout: Cache timeout in seconds key_prefix: Prefix for cache key Returns: Decorated function funcr(cstfdd}|S)NcsNdjdt||}t|}|dk r2|S||}t|||S)NrB)r6r>rrdset)r:r; cache_keyrE)rCrAr@r2r3wrappers  z3cached_function..decorator..wrapperrrCrFrAr@rCr3 decoratorsz"cached_function..decorator)r )r@rArKr2rIr3cached_functions rL)r1cCsZz6ddlm}tt|r4tjjtj|Wntk rTt dYnXdS)zo Invalidate cache keys matching a pattern. Args: pattern: Pattern to match cache keys r) RedisCachezBPattern cache invalidation not supported for current cache backendN) Z django.core.cache.backends.redisrM isinstancer_cacheZ get_clientdeletekeys ImportErrorloggerwarning)r1rMr2r2r3invalidate_cache_patterns    rU) template_namecontext to_emailssubject from_emailr(c Csz\|dkrtj}td|d|}td|d|}t||||d}||d|WdStk r}ztd|WYd Sd}~XYnXdS) a] Send email using template. Args: template_name: Template name (without extension) context: Template context to_emails: List of recipient emails subject: Email subject from_email: Sender email (uses DEFAULT_FROM_EMAIL if not provided) Returns: Boolean indicating success Nzemails/z.htmlz.txt)rYbodyrZrz text/htmlTzError sending email: F) rDEFAULT_FROM_EMAILrrattach_alternativesend ExceptionrSerror) rVrWrXrYrZrG text_contentmsger2r2r3send_template_emails" rd)emailsr(c CsPg}g}|D]:}zt|||Wq tk rD||Yq Xq ||fS)z Validate list of email addresses. Args: emails: List of email addresses to validate Returns: Tuple of (valid_emails, invalid_emails) )rrAr)reZ valid_emailsZinvalid_emailsemailr2r2r3validate_email_list/s rgsuccess)rmessagestatus status_codeerrorsr(cCs.|||td}|r"||d<t||dS)a. Create standardized API response. Args: data: Response data message: Response message status: Response status ('success', 'error', 'warning') status_code: HTTP status code errors: Error details Returns: JsonResponse object )rkrjr timestamprm)rk)rr isoformatr%)rrjrkrlrm response_datar2r2r3create_api_responseJs rqr@)querysetpageper_pager(c Csddlm}m}m}|||}z||}Wn<|k rJ|d}Yn |k rh||j}YnXt||j|j|j|| | | r| nd| r| ndddS)z Paginate queryset and return pagination info. Args: queryset: QuerySet to paginate page: Page number per_page: Items per page Returns: Dictionary with pagination info r) Paginator EmptyPagePageNotAnIntegerr@N)Z current_pageZ total_pagesZ total_itemsruhas_next has_previous next_pageZ previous_page)rm pagination) django.core.paginatorrvrwrxrt num_pageslistnumberrryrznext_page_numberprevious_page_number)rsrtrurvrwrx paginatorpage_objr2r2r3paginate_querysetfs&  r) data_list unique_fields batch_sizer(c s$d}d}d}ttdt||D]}||||}|D]Ɖzfdd|D} z@|jjf| } D]\} } t| | | qn| |d7}Wn,|j k r|jj f} |d7}YnXWq>t k r} zt d| |d7}W5d} ~ XYq>Xq>q&W5QRX|||t|dS)a8 Bulk update or create model instances. Args: model_class: Model class data_list: List of data dictionaries unique_fields: Fields to use for uniqueness check batch_size: Batch size for processing Returns: Dictionary with operation statistics rcsi|]}|kr||qSr2r2rfieldrr2r3 sz)bulk_update_or_create..r@z Error in bulk_update_or_create: N)createdupdatedrmZtotal_processed)r"atomicranger.rmrdr8setattrsave DoesNotExistcreater_rSr`)rprrrZ created_countZ updated_count error_countr batch lookup_kwargsobjrr=rcr2rr3bulk_update_or_creates4  (r)rsselect_relatedprefetch_relatedr(cCs |r|j|}|r|j|}|S)a Optimize queryset with select_related and prefetch_related. Args: queryset: QuerySet to optimize select_related: Fields for select_related prefetch_related: Fields for prefetch_related Returns: Optimized QuerySet )rr)rsrrr2r2r3optimize_querysets   rrBcstfdd}|S)z Decorator to measure function execution time. Args: func: Function to measure Returns: Decorated function csFt}||}t}||}tdjd|dd|S)N Function z executed in z.4fz seconds)rr total_secondsrSinfor6)r:r; start_timerEend_timeZexecution_timerJr2r3rFs   z'measure_execution_time..wrapperrGrHr2rJr3measure_execution_times  rcstfdd}|S)z Decorator to monitor memory usage of a function. Args: func: Function to monitor Returns: Decorated function c szvddl}ddl}||}|jdd}||}|jdd}||}tdjd|dd|WSt k rt d||YSXdS)Nrrrz memory usage: z.2fz MBz*psutil not available for memory monitoring) psutilraProcessgetpidZ memory_inforssrSrr6rRrT) r:r;rraprocessZ memory_beforerEZ memory_afterZ memory_diffrJr2r3rFs  z%memory_usage_monitor..wrapperrGrHr2rJr3memory_usage_monitors r)rsrfieldsr(c Cs|dkrdd|jjjD}tjt|}t|ddddb}t |}| ||D]B}g}|D]*}t ||d} | dkrd} | t| qd| |qXW5QRX|S)z Export queryset to CSV file. Args: queryset: QuerySet to export filename: Output filename fields: Fields to include (all fields if None) Returns: Path to created CSV file NcSsg|] }|jqSr2)r`rr2r2r3r*sz*export_queryset_to_csv..rr)utf-8)newlineencoding)model_metarrarbr9tempfile gettempdirrcsvwriterwriterowgetattrrAr) rsrrrcsvfilerrrowrr=r2r2r3export_queryset_to_csvs    r) csv_file_path field_mappingr(c Csd}d}g}t|ddd}t|}t|ddD]\}} zbi} | D].\} } |r`|| | n| } t|| rH| | | <qH|f| }|||d7}Wq2t k r}z<|d7}| d|d t |t d |d |W5d }~XYq2Xq2W5QRX|||d S) a Import CSV data to model. Args: model_class: Model class to import to csv_file_path: Path to CSV file field_mapping: Mapping of CSV columns to model fields Returns: Dictionary with import statistics rrr)r)startr@zRow z: zError importing row N) success_countrrm)rr DictReader enumerater8rdr4 full_cleanrr_rArrSr`)rprrrrrmrreaderZrow_numrZ model_dataZ csv_fieldr= model_fieldrrcr2r2r3import_csv_to_modelAs0      4rcCs|jddkS)z Check if the request is an AJAX request. Args: request: Django request object Returns: bool: True if it's an AJAX request zX-Requested-WithXMLHttpRequest)headersrdrequestr2r2r3is_ajax_requestos rcCs0|jd}|r |dd}n |jd}|S)z Get the client's IP address from the request. Args: request: Django request object Returns: str: Client IP address HTTP_X_FORWARDED_FOR,r REMOTE_ADDR)METArdr)rx_forwarded_foripr2r2r3 get_client_ip|s  rcCst||jdddS)zGet client IP and user agent.HTTP_USER_AGENTr)) ip_address user_agent)rrrdrr2r2r3get_client_infos r)N)rh)rsrt)ryrz)r)N)N)r))r)r )N)N)N)r?r))N)Nr)rhriN)r@rr)r)NN)N)N)t__doc__r,rajsonrrr^rrrloggingrrrZ dt_timezonedecimalrrtypingrrr r r r r functoolsrr urllib.parserrpathlibr django.confrdjango.core.cacherdjango.core.exceptionsrZdjango.core.validatorsrrdjango.core.files.storagerdjango.core.files.baserdjango.core.mailrrdjango.template.loaderr django.utilsdjango.utils.textrdjango.utils.htmlrdjango.utils.encodingrdjango.utils.translationr rBdjango.contrib.authr! django.dbr"django.db.modelsr#r$ django.httpr%r&rZ getLoggerr6rSrboolr4rFr\rgrrintrxrfloatrrrrrrrr rrrr.r2r>rLrUrdrgrqrrrrrrrrrrr2r2r2r3s$               P'%#!0#!&  )$ + 4  ( &  .