U 3dS@sddlmZmZddlZddlmZddlZddlm Z ddl m Z ddl m Z ddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm!Z!ddlm"Z"ddlm#Z#ddlm$Z$e#egegegegdddddd Z%Gd!d"d"Z&Gd#d$d$e Z'ej()d%eegd&d'Z*d(d)Z+ej()d*eedd+d,d-eeddd.d-gd/d0Z,ej()d1ed2d3d.d4e-d5fed+d6d7d4e-d8feddd,d4e.d9feddd:d4e.d;fed+dd?Z/d@dAZ0dBdCZ1ej()dDe2dEfedEfedFfej3dGfgdHdIZ4dJdKZ5ej()dLeeddd,d-eeddd,d-eeddd7d-edMdNdOheeedPeeg dQdRZ6ej()dSeeddTd:d-eedUdVd.d-feeddTd:d-eedUdVd7d-feeddTd:d-eedWdVd.d-feeddTd:d-eedVdd,d-feeddTd:d-eedWdd7d-feedTdd,d-eedUdVd.d-feedTdd,d-eedUdVd7d-feedTdd,d-eed+d3d.d-feedTdd,d-eeddUd,d-feedTdd,d-eeddXd7d-feedUdVd.d-eedd+d:d-feedUdVd.d-eed+dd,d-feedUdVd.d-eedYdXd7d-feedUdVd.d-eedYdXd:d-feedUdVd7d-eedZd[d7d-feedUdVd7d-eedZd[d,d-feed3dd,d-eedd+d.d-feed+dd,d-eedd+d.d-fgd\d]Z7ej()d^egee8gegegegegegeeddd.d-geeddd,d-eeddd7d-gg d_d`Z9ej()dLeeee8eeeeeeedMdNdOheed+d3dTheeddd7d-eedd[d7d-eeddd7d-eeddd7d-eedd+d7d-eeddd.d-eeddd:d-edPeegdadbZ:ej()dceedd+d.d-ddfeeddd7d-defedMdNdOhdNfee;ejdfdgfdhdid+d3gdTdWggfdie?d+d3gdTdWggfdjed+d3gdTdWggfdkdlej@Adfdme&e&fe2d+fednfdodpdqdrdsdteBdufdtejCfdvedPe'ddwfdxgdydzZDej()d{eedd+d.d-efed|d}hefeeddd~hefdiefdjefdlefdefe>efe2efdefdefdtefedPefdefgddZEddZFddZGddZHddZIddZJddZKddZLddZMddZNddZOddZPddZQddZRddZSddZTddZUdS))IntegralRealN) csr_matrix) BaseEstimator) LeaveOneOut deprecated)Hidden)Interval)Options) StrOptions) _ArrayLikes) _Booleans) _Callables) _CVObjects) _InstancesOf)_MissingValues)_PandasNAConstraint)_IterablesNotString)_NoneConstraint) _RandomStates)_SparseMatrices)_VerboseHelper) HasMethods)make_constraint)generate_invalid_param_val)generate_valid_param)validate_params)InvalidParameterError)abcd)r"cOsdS)z/A function to test the validation of functions.N)rr r!r"argskwargsr#r#M/tmp/pip-unpacked-wheel-zrfo1fqw/sklearn/utils/tests/test_param_validation.py_func#sr'c@sBeZdZdZedegiddZeedegiddZdS)_ClasszJA class to test the _InstancesOf constraint and the validation of methods.rcCsdS)zA validated methodNr#selfrr#r#r&_method+sz_Class._methodcCsdS)zA deprecated validated methodNr#r)r#r#r&_deprecated_method/sz_Class._deprecated_methodN) __name__ __module__ __qualname____doc__rrr+rr,r#r#r#r&r((s    r(c@s6eZdZUdZdegiZeed<ddZd ddZ dS) _Estimatorztttdddd}tj|ks\ttj |ksltdS)zjCheck that inf is included iff a bound is closed and set to None. Only valid for real intervals. rNrBr@r?rD)r rnpinfrErFr#r#r&test_interval_inf_in_boundsQsrKrFr?r@rCcCstj|kstdS)z)Check that np.nan is not in any interval.N)rHnanrErJr#r#r&test_nan_not_in_intervalasrNzparams, error, matchg?r>)typer?rBrAz=Expecting left to be an int for an interval over the integersg@rDz>Expecting right to be an int for an interval over the integersz&left can't be None when closed == leftrBz(right can't be None when closed == rightzright can't be less than leftc Cs(tj||dtf|W5QRXdS)zNCheck that informative errors are raised for invalid combination of parametersmatchN)pytestraisesr )paramserrorrRr#r#r&test_interval_errorsjs rWcCsRtdddhdhd}|ds"t|ds0t|dr>tdt|ksNtdS)z*Sanity check for the StrOptions constraintrr r!rr"z'c' (deprecated)N)r is_satisfied_byrEstroptionsr#r#r&test_stroptionss r\cCsXttddtjhdhd}|ds&t|tjs6t|drDtdt|ksTtdS)z'Sanity check for the Options constraintg?rGz?z-0.5 (deprecated)N)r rrHrIrXrErYrZr#r#r& test_optionss r_ztype, expected_type_nameintfloatz numpy.ndarraycCs$t|}t|d|dks tdS)z?Check the string representation of the _InstancesOf constraint.zan instance of ''N)rrYrE)rOZexpected_type_name constraintr#r#r&%test_instances_of_type_human_readables rdcCs\tddg}Gddd}Gddd}||s8t||rHtt|dksXtdS) z Check the HasMethods constraint.rr c@seZdZddZddZdS)ztest_hasmethods.._GoodcSsdSr3r#r*r#r#r&rsz test_hasmethods.._Good.acSsdSr3r#rer#r#r&r sz test_hasmethods.._Good.bN)r-r.r/rr r#r#r#r&_Goodsrfc@seZdZddZdS)ztest_hasmethods.._BadcSsdSr3r#rer#r#r&rsztest_hasmethods.._Bad.aN)r-r.r/rr#r#r#r&_Badsrgz"an object implementing 'a' and 'b'N)rrXrErY)rcrfrgr#r#r&test_hasmethodss  rhrcrr r!r9cCst|}||rtdS)z>Check that the value generated does not satisfy the constraintNrrXrE)rc bad_valuer#r#r&test_generate_invalid_param_valsrkzinteger_interval, real_intervali cCs\t|||gd}||rt||r,tt|||gd}||rJt||rXtdS)ztCheck that the value generated for an interval constraint does not satisfy any of the interval constraints.  constraintsNri)Zinteger_intervalZ real_intervalrjr#r#r&+test_generate_invalid_param_val_2_intervalssQrurtc Cs*ttt|d|dW5QRXdS)zmCheck that the function raises NotImplementedError when there's no invalid value for the constraint. rrsN)rSrTNotImplementedErrorrrsr#r#r&)test_generate_invalid_param_val_all_valid7s rwcCst|}||stdS)z;Check that the value generated does satisfy the constraint.N)rrXrE)rcvaluer#r#r&test_generate_valid_paramPsryzconstraint_declaration, valuegzG?*cCs|dS)NrLr#)xr#r#r&wr|)NNz array-likez sparse matrix) random_staterr~)r~Nr])booleanF)verboserL)missing_valuesrP)rg)rNrrM)rmissingr4) cv_objectrncCst|}||stdS)z+Sanity check for the is_satisfied_by methodN)rrXrE)constraint_declarationrxrcr#r#r&test_is_satisfied_byps rz1constraint_declaration, expected_constraint_classZoption1Zoption2r^rrrcCst|}|j|kstdS)zHCheck that make_constraint dispaches to the appropriate constraint classN)r __class__rE)rZexpected_constraint_classrcr#r#r&test_make_constraintsrc Cs&tjtddtdW5QRXdS)zNCheck that an informative error is raised when an unknown constraint is passedzUnknown constraintrQznot a valid constraintN)rSrT ValueErrorrr#r#r#r&test_make_constraint_unknownsrc CstjtddtdddW5QRXtjtddtddgddiW5QRXtjtddtdddiW5QRXtjtd dtdddd W5QRXtjtdd&tddd d gddiddiW5QRXtjtdd&tddd d gddiddiW5QRXdS)zGCheck that validate_params works no matter how the arguments are passedz"The 'a' parameter of _func must berQwrongrLr!z"The 'b' parameter of _func must ber!"The 'c' parameter of _func must bez"The 'd' parameter of _func must be)r!r"rr>rlroernZfourN)rL)r)r)rSrTrr'r#r#r#r&test_validate_paramss<*rcCs$tdtgidd}|dddS)zTCheck that no error is raised when there are parameters without constraints rcSsdSr3r#)rr r#r#r&funcsz1test_validate_params_missing_params..funcrLr>N)rr`)rr#r#r&#test_validate_params_missing_paramss  rc Csxtt}tjtdd|ddddW5QRXtjtdd.tjtdd|ddddW5QRXW5QRXd S) z5Check that validate_params functions can be decoratedzFunction _func is deprecatedrQrLr>rlrrrN)rr'rSwarns FutureWarningrTr)Zdecorated_functionr#r#r& test_decorate_validated_functions rc CsjtjtddtdW5QRXtjtdd,tjtddtdW5QRXW5QRXdS)z-Check that validate_params works with methodsz+The 'a' parameter of _Class._method must berQrz)Function _deprecated_method is deprecatedz6The 'a' parameter of _Class._deprecated_method must beN)rSrTrr(r+rrr,r#r#r#r&test_validate_params_methodsrc Cs.td}tjtdd|W5QRXdS)z9Check that validate_params works with Estimator instancesrz'The 'a' parameter of _Estimator must berQN)r1rSrTrr9)Zestr#r#r&test_validate_params_estimators rc Cs4tjtddtdddhddhdW5QRXdS) z@Check that the deprecated parameter must be a subset of options.z#deprecated options must be a subsetrQrr r!r"rN)rSrTrr r#r#r#r&!test_stroptions_deprecated_subset src Cstdtttgidd}|dddd|dddgtjtdd }|d d W5QRXt|j}d |kstt d |kst dS)zECheck that internal constraints are not exposed in the error message.paramcSsdSr3r#rr#r#r&fsz!test_hidden_constraint..frLr>rl)rr r!The 'param' parameterrQbadrzan instance of 'dict'zan instance of 'list'N) rr listr:rSrTrrYrxrErexc_infoerr_msgr#r#r&test_hidden_constraints   rc Cstdtdhttdhgidd}|d|dtjtdd}|dd W5QRXt|j}d|ksrtd|ks~td S) zBCheck that we can have 2 StrOptions constraints, one being hidden.rautowarncSsdSr3r#rr#r#r&r*sz!test_hidden_stroptions..frrQrrN) rr r rSrTrrYrxrErr#r#r&test_hidden_stroptions's   rcCs$ttdstttjds tdS)zCheck that the validate_params decorator properly sets the parameter constraints as attribute of the decorated function/method. Z_skl_parameter_constraintsN)hasattrr'rEr(r+r#r#r#r&4test_validate_params_set_param_constraints_attribute=src CsRtddgidd}|d|tdtjtdd|d W5QRXd S) zCheck that validate_params raise a deprecation message but still passes validation when using an int for a parameter accepting a boolean. rrcSsdSr3r#rr#r#r&rJsz1test_boolean_constraint_deprecated_int..fTFz4Passing an int for a boolean parameter is deprecatedrQrLN)rrHZbool_rSrr)rr#r#r&&test_boolean_constraint_deprecated_intEs  rc Cshttdgddd dd}tjtdd|dd W5QRXGd d d }||d ||d dS)z5Check that validation can be skipped for a parameter.NZ no_validationparam1param2cSsdSr3r#rr#r#r&r\sztest_no_validation..fzThe 'param1' parameterrQr)rc@s eZdZdS)z$test_no_validation..SomeTypeN)r-r.r/r#r#r#r&SomeTypeesr)r)NN)rr`rSrTr)rrr#r#r&test_no_validationYs  rcCs>td}t}||js t|tdddgr:tdS)z9Add a specific test for checking support for `pandas.NA`.ZpandasrLr>rlN)rSZ importorskiprrXZNArErHarray)pdZ na_constraintr#r#r&$test_pandas_na_constraint_with_pd_nals rcCs>t}|dddgst|tds,t|dr:tdS)zGCheck that a string does not satisfy the _IterableNotString constraint.rLr>rlrrz some stringN)rrXrErangercr#r#r&test_iterable_not_stringusrcCsnt}|dst|ts$t|ddgddgfddgddgfgsNt|ds\t|drjtdS)zUCheck that the _CVObjects constraint accepts all current ways to pass cv objects.rnrLr>rlroNznot a CV object)rrXrErrr#r#r&test_cv_objects}s *rcCs"Gdddt}|dddS)zCheck that the validation from a scikit-learn estimator inherited by a third party estimator does not impose a match between the dict of constraints and the parameters of the estimator. cs*eZdZfddZdfdd ZZS)z7test_third_party_estimator..ThirdPartyEstimatorcs||_tjdddS)Nrr4)r superr5)r*r rr#r&r5sz@test_third_party_estimator..ThirdPartyEstimator.__init__Ncst||dSr3)rr9r6rr#r&r9sz;test_third_party_estimator..ThirdPartyEstimator.fit)NN)r-r.r/r5r9 __classcell__r#r#rr&ThirdPartyEstimators rr)r N)r1r9)rr#r#r&test_third_party_estimators r)r)VZnumbersrrZnumpyrHZ scipy.sparserrSZ sklearn.baserZsklearn.model_selectionrZ sklearn.utilsrZsklearn.utils._param_validationr r r r r rrrrrrrrrrrrrrrrrr'r(r1markZ parametrizerGrKrN TypeErrorrrWr\r_r`ZndarrayrdrhrkrurrwryrOZfloat32Zfloat64callablerrandomZ RandomStaterarMrrrrrrrrrrrrrrrrrrr#r#r#r&s                                         M         "