U dY@sddlZddlZddlmZddlmZddlmZmZddlm Z m Z m Z m Z ddl mZddlmZddlmZdd lmZmZdd lmZdd lmZdd lmZmZdd lmZddlm Z ddl!m"Z#ddl$m%Z%ddl&m'Z'ddlm(Z(m)Z)m*Z*m+Z+m,Z,ddl-m.Z.m/Z/ddl0m1Z1ddl2m3Z3m4Z4ddl5m6Z6m7Z7ddl8m9Z9GdddZ:Gddde/e:Z;Gddde.e:ZZ?Gd#d$d$e<Z@Gd%d&d&e@ej>ZAGd'd(d(e;eAZBdS))N)forms)settings)adminmessages)ADDITIONCHANGEDELETIONLogEntry)get_permission_codename) ContentType)PermissionDenied) HttpResponseHttpResponseRedirect)escape)TemplateResponse)pathreverse)method_decorator) import_string) gettext_lazy) require_POST)DEFAULT_FORMATS)ConfirmImportForm ExportFormImportExportFormBase ImportFormexport_action_form_factory)BaseExportMixinBaseImportMixin) RowResult) post_export post_import) MediaStorageTempFolderStorage)originalcs2eZdZfddZddZdfdd ZZS) ImportExportMixinBasecsNtj||t|ddr$|j|_nd|_t|dd|_|jdkrJ|j|_dS)Nchange_list_templatezadmin/change_list.html"import_export_change_list_template)super__init__getattrr'base_change_list_template)selfargskwargs __class__7/tmp/pip-unpacked-wheel-gh2cwdms/import_export/admin.pyr*$s   zImportExportMixinBase.__init__cCs|jjj}||jjjfSN)model_meta app_labelZ model_name)r-r7r2r2r3get_model_info7s z$ImportExportMixinBase.get_model_infoNcs |pi}|j|d<t||S)Nr,)r,r)changelist_viewr-requestZ extra_contextr0r2r3r9;s z%ImportExportMixinBase.changelist_view)N)__name__ __module__ __qualname__r*r8r9 __classcell__r2r2r0r3r&#s r&cs&eZdZdZdZdZeZeZ e Z dZ dZ dZddZdd Zd d Zfd d ZeeddZddZddZddZddZddZddZeddZeddZed d!Zd"d#Z d$d%Z!d&d'Z"d(d)Z#d:d*d+Z$d,d-Z%d;d.d/Z&d0d1Z'd2d3Z(d4d5Z)d6d7Z*d<fd8d9 Z+Z,S)= ImportMixinz Import mixin. This is intended to be mixed with django.contrib.admin.ModelAdmin https://docs.djangoproject.com/en/dev/ref/contrib/admin/ z+admin/import_export/change_list_import.htmlzadmin/import_export/import.htmlz utf-8-sigNcCs |jdkrttddS|jSdS)NZIMPORT_EXPORT_SKIP_ADMIN_LOGF)skip_admin_logr+rr-r2r2r3get_skip_admin_logYs  zImportMixin.get_skip_admin_logcCs4|jdkrttdt}n|j}t|tr0t|}|S)NZIMPORT_EXPORT_TMP_STORAGE_CLASS)tmp_storage_classr+rr$ isinstancestrr)r-rDr2r2r3get_tmp_storage_class_s  z!ImportMixin.get_tmp_storage_classcCs>ttdd}|dkrdS|j}t||}|jd|j|fS)zB Returns whether a request has import permission. Z$IMPORT_EXPORT_IMPORT_PERMISSION_CODENT%s.%sr+roptsr userZhas_permr7)r-r;ZIMPORT_PERMISSION_CODErJcodenamer2r2r3has_import_permissionks   z!ImportMixin.has_import_permissioncsRt}|}td|j|jd|dtd|j|jd|dg}||S)Nzprocess_import/z%s_%s_process_importnamezimport/z %s_%s_import)r)get_urlsr8r admin_site admin_viewprocess_import import_action)r-urlsinfomy_urlsr0r2r3rPws   zImportMixin.get_urlscOs||stt|jddr(||}n|}||j}|r|}|t|j d|j d}| rpdn|j }| } | |j d|| d} | } || } |j| ||f||} | || |SdS)z\ Perform the actual import action (after the user has confirmed the import) is_originalF input_format)encodingNimport_file_name)rOrZ read_mode)rMr r+get_confirm_import_formcreate_confirm_formPOSTis_validget_import_formatsint cleaned_data from_encoding is_binaryrG get_read_modereadcreate_datasetprocess_datasetremoveprocess_result)r-r;r.r/ confirm_form form_typeimport_formatsrYrZtmp_storage_cls tmp_storagedatadatasetresultr2r2r3rSs2     zImportMixin.process_importc Osh|j|f|d|i|}||f|}|j|f|d|i|}|j|fdd|jd|jd|S)NformFToriginal_file_namedry_run raise_errors file_namerK)get_import_resource_kwargschoose_import_resource_classget_import_data_kwargs import_datarcrK) r-rrrlr;r.r/ res_kwargsresource imp_kwargsr2r2r3riszImportMixin.process_datasetcCsH||||||tjd|jdtd||jjd}t |S)NZsenderr5zadmin:%s_%s_changelist) current_app) generate_log_entriesadd_success_messager"sendr5rr8rQrOr)r-rsr;urlr2r2r3rks   zImportMixin.process_resultc Cs|stjttjttjti}tj |j j }|D]L}|j |jkr2|j |jkr2tj j|jj ||j|j||j td|j dq2dS)Nz%s through import_export)Zuser_idcontent_type_id object_id object_reprZ action_flagZchange_message)rCr IMPORT_TYPE_NEWrIMPORT_TYPE_UPDATErZIMPORT_TYPE_DELETErr ZobjectsZ get_for_modelr5pkZ import_typeZIMPORT_TYPE_ERRORZIMPORT_TYPE_SKIPr Z log_actionrKrr_)r-rsr;Z logentry_maprrowr2r2r3rs& z ImportMixin.generate_log_entriescCs<|jj}td|jtj|jtj|j}t ||dS)Nz/Import finished, with {} new and {} updated {}.) r5r6rformatZtotalsr rrZverbose_name_pluralrsuccess)r-rsr;rJZsuccess_messager2r2r3rs  zImportMixin.add_success_messagecKs |jf|Sr4get_context_datar-r/r2r2r3get_import_context_datasz#ImportMixin.get_import_context_datacKsiSr4r2rr2r2r3rszImportMixin.get_context_datacCstjdtd|jS)z .. deprecated:: 3.0 Use :meth:`~import_export.admin.ImportMixin.get_import_form_class` or set the new :attr:`~import_export.admin.ImportMixin.import_form_class` attribute. zImportMixin.get_import_form() is deprecated and will be removed in a future release. Please use get_import_form_class() instead.category)warningswarnDeprecationWarningimport_form_classrBr2r2r3get_import_forms zImportMixin.get_import_formcCstjdtd|jS)z .. deprecated:: 3.0 Use :func:`~import_export.admin.ImportMixin.get_confirm_form_class` or set the new :attr:`~import_export.admin.ImportMixin.confirm_form_class` attribute. zImportMixin.get_confirm_import_form() is deprecated and will be removed in a future release. Please use get_confirm_form_class() instead.r)rrrconfirm_form_classrBr2r2r3r]s z#ImportMixin.get_confirm_import_formcOstjdtd|S)a  .. deprecated:: 3.0 Use :meth:`~import_export.admin.ImportMixin.get_import_form_kwargs` or :meth:`~import_export.admin.ImportMixin.get_confirm_form_kwargs` instead, depending on which form you wish to customise. zImportMixin.get_form_kwargs() is deprecated and will be removed in a future release. Please use get_import_form_kwargs() or get_confirm_form_kwargs() instead.r)rrr)r-rtr.r/r2r2r3get_form_kwargss zImportMixin.get_form_kwargscCsR|}||}||}t|ts@tjdtd||f|S|||f|S)aL .. versionadded:: 3.0 Return a form instance to use for the 'initial' import step. This method can be extended to make dynamic form updates to the form after it has been instantiated. You might also look to override the following: * :meth:`~import_export.admin.ImportMixin.get_import_form_class` * :meth:`~import_export.admin.ImportMixin.get_import_form_kwargs` * :meth:`~import_export.admin.ImportMixin.get_import_form_initial` * :meth:`~import_export.mixins.BaseImportMixin.get_import_resource_classes` |The ImportForm class must inherit from ImportExportFormBase, this is needed for multiple resource classes to work properly. r) raget_import_form_classget_import_form_kwargs issubclassrrrrget_import_resource_classes)r-r;formats form_classr/r2r2r3create_import_form s    zImportMixin.create_import_formcCs*t|jdds$tjdtd|S|jS)z .. versionadded:: 3.0 Return the form class to use for the 'import' step. If you only have a single custom form class, you can set the ``import_form_class`` attribute to change this for your subclass. rXFzImportMixin.get_import_form() is deprecated and will be removed in a future release. Please use the new 'import_form_class' attribute to specify a custom form class, or override the get_import_form_class() method if your requirements are more complex.r)r+rrrrrr-r;r2r2r3r(s z!ImportMixin.get_import_form_classcCs|jpd|jpd||dS)z .. versionadded:: 3.0 Return a dictionary of values with which to initialize the 'import' form (including the initial values returned by :meth:`~import_export.admin.ImportMixin.get_import_form_initial`). Nrqfilesinitial)r_FILESget_import_form_initialrr2r2r3r>s z"ImportMixin.get_import_form_kwargscCsiS)z .. versionadded:: 3.0 Return a dictionary of initial field values to be provided to the 'import' form. r2rr2r2r3rLsz#ImportMixin.get_import_form_initialcCs ||}|||}|f|S)a .. versionadded:: 3.0 Return a form instance to use for the 'confirm' import step. This method can be extended to make dynamic form updates to the form after it has been instantiated. You might also look to override the following: * :meth:`~import_export.admin.ImportMixin.get_confirm_form_class` * :meth:`~import_export.admin.ImportMixin.get_confirm_form_kwargs` * :meth:`~import_export.admin.ImportMixin.get_confirm_form_initial` )get_confirm_form_classget_confirm_form_kwargs)r-r; import_formrr/r2r2r3r^Us  zImportMixin.create_confirm_formcCs*t|jdds$tjdtd|S|jS)z .. versionadded:: 3.0 Return the form class to use for the 'confirm' import step. If you only have a single custom form class, you can set the ``confirm_form_class`` attribute to change this for your subclass. rXFaImportMixin.get_confirm_import_form() is deprecated and will be removed in a future release. Please use the new 'confirm_form_class' attribute to specify a custom form class, or override the get_confirm_form_class() method if your requirements are more complex.r)r+r]rrrrrr2r2r3rfs z"ImportMixin.get_confirm_form_classcCs6|rd}d}n|jpd}|jp d}|||||dS)z .. versionadded:: 3.0 Return a dictionary of values with which to initialize the 'confirm' form (including the initial values returned by :meth:`~import_export.admin.ImportMixin.get_confirm_form_initial`). Nr)r_rget_confirm_form_initial)r-r;rrqrr2r2r3r|s   z#ImportMixin.get_confirm_form_kwargscCs:|dkr iS|jdj|jdj|jd|jdddS)z .. versionadded:: 3.0 Return a dictionary of initial field values to be provided to the 'confirm' form. N import_filerYr)r[rurYr)rctmp_storage_namerOget)r-r;rr2r2r3rs   z$ImportMixin.get_confirm_form_initialcOs |d}|r|d|SiS)z1 Prepare kwargs for import_data. rt)rpop)r-r;r.r/rtr2r2r3r|s   z"ImportMixin.get_import_data_kwargscCspd}|s|j}|}|||d}t}|D] }||7}q8|tkrb|sb||j}|||S)N)rZr\) rerdrGrfbyteschunksr#decodesave)r-rrYrZrorprqchunkr2r2r3write_to_tmp_storages    z ImportMixin.write_to_tmp_storagec s||st|}|}t|jddr8||}nt||}|j|f||}t|t r||| |j ppd|j pxdf|}n*t jdtd|||j pd|j pdf|}t} |j rP|rP|t|jd} | s|j| _|jd} || | } | j| _z| } | | }WnJtk rf}z*|dtdt|j d t!|W5d}~XYnX|j"s|j#|f|d |i||$|f}|g} |j%|f|d |i|}|j&|fd d| j|j'd |}||d <|(s|)st|jddr|j*||d|d<n4|+|}|,||}||jfd |i|d|d<n4|j#|f|d |i|| }fdd|D} |-|j./|td|d<||d <|j0j1|d<|j2|j2|d<dd| D|d<|j.j|_3t4||j5g|S)a Perform a dry_run of the import to make sure the import will not result in errors. If there are no errors, save the user uploaded file to a local temp file that will be used by 'process_import' for the actual import. rXFNrrrYr'za' encountered while trying to read file. Ensure you have chosen the correct format for the file. rtTrvrs)rrl)rcsg|]}|fqSr2r2).0Zresource_classr~r2r3 sz-ImportMixin.import_action..ZImporttitlerJmediacSs&g|]}|dd|DfqS)cSsg|] }|jqSr2)Z column_name)rfr2r2r3r'sz8ImportMixin.import_action...)Zget_display_nameZget_user_visible_fields)rrr2r2r3r&sZ fields_list)6rMr rrar+rrrrrrr_rrrrlistr`rbrcrerdrZrrOrrgrh ExceptionZ add_errorrtyper<rFerrorsrzr{r|r}rKZ has_errorsZhas_validation_errorsr^rrupdaterQ each_contextr5r6rrrimport_template_name)r-r;r.r/contextrnrrZ form_kwargs resourcesrYrrprqrrerrrsrrZresource_classesr2rr3rTs                zImportMixin.import_actioncs(|dkr i}|||d<t||S)NrM)rMr)r9r:r0r2r3r9/szImportMixin.changelist_view)N)N)N)-r<r=r>__doc__r(rrrrrrrrdrArDrCrGrMrPrrrSrirkrrrrr%rr]rrrrrr^rrrr|rrTr9r?r2r2r0r3r@AsN   "         qr@cseZdZdZdZdZdZeZfddZ ddZ d d Z d d Z d dZ ddZeddZddZddZdfdd ZfddZZS) ExportMixinz Export mixin. This is intended to be mixed with django.contrib.admin.ModelAdmin https://docs.djangoproject.com/en/dev/ref/contrib/admin/ z+admin/import_export/change_list_export.htmlzadmin/import_export/export.htmlNcs4t}td|j|jd|dg}||S)Nzexport/z %s_%s_exportrN)r)rPrrQrR export_actionr8)r-rUrWr0r2r3rPFs   zExportMixin.get_urlscCs>ttdd}|dkrdS|j}t||}|jd|j|fS)zB Returns whether a request has export permission. Z$IMPORT_EXPORT_EXPORT_PERMISSION_CODENTrHrI)r-r;ZEXPORT_PERMISSION_CODErJrLr2r2r3has_export_permissionOs   z!ExportMixin.has_export_permissionc Cs||}|||}||}||}||rBdgt|}||}||j||||j||j |j |j |j |d }|j |d<tjdkr|j|d<|f|}||S)zo Returns export queryset. Default implementation respects applied search and filters. Zaction_checkbox) r;r5 list_displaylist_display_links list_filterdate_hierarchy search_fieldslist_select_related list_per_pagelist_max_show_all list_editableZ model_admin sortable_by)rsearch_help_text)Zget_list_displayZget_list_display_linksZget_list_filterZget_search_fields get_actionsrZget_changelistr5rrrrrrdjangoVERSIONrZ get_queryset) r-r;rrrrZ ChangeListZchangelist_kwargsZclr2r2r3get_export_queryset[s2          zExportMixin.get_export_querysetc OsZ|d}||st|j||f||}||}|d}|sV|rV||}|S)zH Returns file_format representation for given queryset. r;rZ)rrr Zget_data_for_export export_datarreencode) r- file_formatquerysetr.r/r;rqrrZr2r2r3get_export_data~s      zExportMixin.get_export_datacKs |jf|Sr4rrr2r2r3get_export_context_datasz#ExportMixin.get_export_context_datacKsiSr4r2rr2r2r3rszExportMixin.get_context_datacCstjdtd|jS)z .. deprecated:: 3.0 Use :meth:`~import_export.admin.ExportMixin.get_export_form_class` or set the new :attr:`~import_export.admin.ExportMixin.export_form_class` attribute. zExportMixin.get_export_form() is deprecated and will be removed in a future release. Please use the new 'export_form_class' attribute to specify a custom form class, or override the get_export_form_class() method if your requirements are more complex.r)rrrexport_form_classrBr2r2r3get_export_forms zExportMixin.get_export_formcCs|jS)zD Get the form class used to read the export format. )rrBr2r2r3get_export_form_classsz!ExportMixin.get_export_form_classc Os||stt|jddr&|}n|}|}||||jpHd}|r|t |j d}| |}|j ||||j |d} |} t| | d} d||||f| d<tjd|jd| S|} | |j|td | d <|| d <|jj| d <|jj|_t||jg| S) NrXFr)r;rZZ export_form content_typeattachment; filename="%s"Content-DispositionrZExportrrtrJ)rr r+rrget_export_formatsZget_export_resource_classesr_r`rbrcrr to_encodingget_content_typer get_export_filenamer!rr5rrrQrrr6rOrrexport_template_name) r-r;r.r/rmrrtrrrrresponserr2r2r3rsF          zExportMixin.export_actioncs(|dkr i}|||d<t||S)Nr)rr)r9r:r0r2r3r9szExportMixin.changelist_viewcs t|Sr4)r)r)r-r;rrr0r2r3rszExportMixin.get_export_filename)N)r<r=r>rr(rrrrrPrrrrrr%rrrr9rr?r2r2r0r3r6s"  # 'rc@seZdZdZdZdS)ImportExportMixinz" Import and export mixin. z2admin/import_export/change_list_import_export.htmlN)r<r=r>rr(r2r2r2r3rsrc@seZdZdZdS)ImportExportModelAdminzB Subclass of ModelAdmin with import/export functionality. Nr<r=r>rr2r2r2r3rsrcsHeZdZdZdZfddZddZfddZefd d Z Z S) ExportActionMixinzI Mixin with export functionality implemented as an admin action. Ncsng}|}|r:t|D] \}}|t||fqt|dkrR|ddt||_t j ||dS)zb Adds a custom action form initialized with the available export formats. rr)rz---N) r enumerateappendrFZ get_titleleninsertrZ action_formr)r*)r-r.r/choicesrirr0r2r3r*s   zExportActionMixin.__init__c Cs|jd}|s"t|tdnZ|}|t|}|j||||jd}| }t ||d}d| |||f|d<|SdS)z> Exports the selected rows using file_format. rz!You must select an export format.)r;rZrrrN) r_rrwarningrrrbrrrr r) r-r;rZ export_formatrrrrrr2r2r3export_admin_actions   z%ExportActionMixin.export_admin_actioncs(t|}|jtjdtdfd|S)zJ Adds the export action to the list of available actions. rz'Export selected %(verbose_name_plural)s)r)r)rrrrr)r-r;actionsr0r2r3rs zExportActionMixin.get_actionscs tj}tj|jdg|jdS)Nzimport_export/action_formats.js)Zjscss)r)rrZMediaZ_jsZ_css)r-Z super_mediar0r2r3r%szExportActionMixin.media) r<r=r>rr(r*rrpropertyrr?r2r2r0r3rs  rc@seZdZdZdS)ExportActionModelAdminz^ Subclass of ModelAdmin with export functionality implemented as an admin action. Nrr2r2r2r3r+src@seZdZdZdS)ImportExportActionModelAdminz Subclass of ExportActionModelAdmin with import/export functionality. Export functionality is implemented as an admin action. Nrr2r2r2r3r2sr)CrrrZ django.confrZdjango.contribrrZdjango.contrib.admin.modelsrrrr Zdjango.contrib.authr Z"django.contrib.contenttypes.modelsr Zdjango.core.exceptionsr Z django.httpr rZdjango.template.defaultfiltersrZdjango.template.responserZ django.urlsrrZdjango.utils.decoratorsrZdjango.utils.module_loadingrZdjango.utils.translationrrZdjango.views.decorators.httprZformats.base_formatsrrrrrrZmixinsrrresultsr Zsignalsr!r"Z tmp_storagesr#r$utilsr%r&r@rrZ ModelAdminrrrrr2r2r2r3sF              x&B