U d@sddlmZddlmZddlZddlmmZddl m Z m Z ddl m Z dZddZd d Zd d ZdddZddZdddZGdddZGdddeeZdddZdddZdS) )update_wrapper)NumberN)DictAnyis_tensor_likegox?cstdd|Dstdtdd|Dsttd|D]$}t|tjr>t|j|jdqdq>fdd|D}tj |Stj |S) a Given a list of values (possibly containing numbers), returns a list where each value is broadcasted based on the following rules: - `torch.*Tensor` instances are broadcasted as per :ref:`_broadcasting-semantics`. - numbers.Number instances (scalars) are upcast to tensors having the same size and type as the first tensor passed to `values`. If all the values are scalars, then they are upcasted to scalar Tensors. Args: values (list of `numbers.Number`, `torch.*Tensor` or objects implementing __torch_function__) Raises: ValueError: if any of the values is not a `numbers.Number` instance, a `torch.*Tensor` instance, or an instance implementing __torch_function__ css |]}t|pt|tVqdSN)r isinstancer.0vr =/tmp/pip-unpacked-wheel-ua33x9lu/torch/distributions/utils.py sz broadcast_all..zqInput arguments must all be instances of numbers.Number, torch.Tensor or objects implementing __torch_function__.css|]}t|VqdSrrr r r rrs)dtyperdevicecs&g|]}t|r|n tj|fqSr )rtorchZtensorr optionsr r %sz!broadcast_all..) all ValueErrordictrZget_default_dtyper TensorrrZbroadcast_tensors)valuesvalueZ new_valuesr rr broadcast_all s   rcCsBtjr.ttj|||dtj|||dStj|||dS)Nr)r_C_get_tracing_statenormalzerosZonesemptyZnormal_)shaperrr r r_standard_normal+s  r$cCs0|dkr |S|jd| d}||dS)z Sum out ``dim`` many rightmost dimensions of a given tensor. Args: value (Tensor): A tensor of ``.dim()`` at least ``dim``. dim (int): The number of rightmost dims to sum out. rN)r%)r#Zreshapesum)rdimZrequired_shaper r r_sum_rightmost3sr(FcCs|rt|Stj|ddS)a Converts a tensor of logits into probabilities. Note that for the binary case, each value denotes log odds, whereas for the multi-dimensional case, the values along the last dimension denote the log probabilities (possibly unnormalized) of the events. r%)r')rZsigmoidFZsoftmax)Zlogits is_binaryr r rlogits_to_probsAs r+cCs t|jj}|j|d|dS)N)minmax)rfinforepsclamp)probsr0r r r clamp_probsMsr3cCs,t|}|r"t|t| St|S)a$ Converts a tensor of probabilities into logits. For the binary case, this denotes the probability of occurrence of the event indexed by `1`. For the multi-dimensional case, the values along the last dimension denote the probabilities of occurrence of each of the events. )r3rloglog1p)r2r*Z ps_clampedr r rprobs_to_logitsRsr6c@s"eZdZdZddZdddZdS) lazy_propertyz Used as a decorator for lazy loading of class attributes. This uses a non-data descriptor that calls the wrapped method to compute the property on first call; thereafter replacing the wrapped method into an instance attribute. cCs||_t||dSr)wrappedrselfr8r r r__init__fszlazy_property.__init__Nc CsD|dkrt|jSt||}W5QRXt||jj||Sr)_lazy_property_and_propertyr8rZ enable_gradsetattr__name__)r:instanceZobj_typerr r r__get__js   zlazy_property.__get__)N)r> __module__ __qualname____doc__r;r@r r r rr7_sr7c@seZdZdZddZdS)r<zWe want lazy properties to look like multiple things. * property when Sphinx autodoc looks * lazy_property when Distribution validate_args looks cCs t||Sr)propertyr;r9r r rr;ysz$_lazy_property_and_property.__init__N)r>rArBrCr;r r r rr<ssr<cCs|jd}tjsH|| ks&||krHtd|d| d|ddtj||jd}||dd|dk}|d|f}|S) z Convert a `D x D` matrix or a batch of matrices into a (batched) vector which comprises of lower triangular elements from the matrix in row order. r%zdiag (z) provided is outside [z, r,z].r.)r#rrrrarangerview)matdiagnrF tril_maskvecr r rtril_matrix_to_vec}s " rMcCsdd| dd|dd|jddt||ddd}t|jj}tjst|||krt d|jddd t |tj rt| nt|}| |jd dt||f}tj||jd }||dd|dk}||d |f<|S) z Convert a vector or a batch of vectors into a batched `D x D` lower triangular matrix containing elements from the vector in row order. r,r%g?zThe size of last dimension is z which cannot be expressed as z3the lower triangular part of a square D x D matrix.NrE.)r#absrr/rr0rrroundrr rlongZ new_zerosSizerFrrG)rLrIrJr0rHrFrKr r rvec_to_tril_matrixsH"" rU)F)F)r)r) functoolsrZnumbersrrZtorch.nn.functionalnnZ functionalr)typingrrZtorch.overridesrZeuler_constantrr$r(r+r3r6r7rDr<rMrUr r r rs