o ?eU)@sdZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd lm Z dd lm Z dd lm Z d d ddZ dd d ddZ dd d ddZ  dd d ddZdS)aStandard functions for creating slots. A slot is a `Variable` created with the same first m-dimension as a primary variable or `Tensor`. A slot is always scoped in the namespace of the primary object and typically has the same device and type. Slots are typically used as accumulators to track values associated with the primary object: ```python # Optimizers can create a slot for each variable to track accumulators accumulators = {var : create_zeros_slot(var, "momentum") for var in vs} for var in vs: apply_momentum(var, accumulators[var], lr, grad, momentum_tensor) # Slots can also be used for moving averages mavg = create_slot(var, var.initialized_value(), "exponential_moving_avg") update_mavg = mavg.assign_sub((mavg - var) * (1 - decay)) ``` ) xla_sharding)distribute_lib) array_ops)cond)init_ops) ref_variable)resource_variable_ops)variable_scope) variable_v1) variablesFcopy_xla_shardingc Cs,tj}tdt|r|nd}t|rd}n t|tj r%d}nd}tj ||d||||d} t|t|t j r|j r| jt|jjdd} |j } | jj} | dus_| dkr| t j | jd| | jd| | jd| | jd| dd } |r| |j| jrtj|| dd } | S) z-Helper function for creating a slot variable.NTF) initializerZ trainable use_resourceshapedtypevalidate_shape/rcSs |jduo|jduo|j|jkSN)Zrank)Z primary_shape slot_shaperh/home/www/facesmatcher.com/pyenv/lib/python3.10/site-packages/tensorflow/python/training/slot_creator.py_has_same_rankos z(_create_slot_var.._has_same_rank)Zuse_sharding_op)r Zget_variable_scopeZ partitionerZset_partitionercallablerZis_resource_variable isinstancerZ RefVariableZ get_variabler VariableZ_save_slice_infonamelenoprZndimsZ_set_save_slice_infoZ SaveSliceInfoZ full_nameZ full_shapeZ var_offsetZ var_shaperZ copy_sharding)primaryvalscoperrrr Zcurrent_partitionerrZslotZreal_slot_nameZ slice_infonrrrr_create_slot_var2sD      r$Tc Cs|}t|tjr|j}n|jj}td|d|J|rNt }|j |t ||d|dd|dWdWdS1sHwYnt ||d|dd|dWdSWddS1skwYdS)aCreate a slot initialized to the given value. The type of the slot is determined by the given value. Args: primary: The primary `Variable` or `Tensor`. val: A `Tensor` specifying the initial value of the slot. name: Name to use for the slot variable. colocate_with_primary: Boolean. If True the slot is located on the same device as `primary`. copy_xla_sharding: Boolean. If True also copies XLA sharding from primary. Returns: A `Variable` object. Nrr ) get_shapeis_fully_definedrr r _shared_namerrr r get_strategyextendedcolocate_vars_withr$)r r!rcolocate_with_primaryr rprefixdistribution_strategyrrr create_slotxs@   "r/c Cs|}t|tjr|j}n|jj}td|d|J|rLt } | j |t ||d||||dWdWdS1sFwYnt ||d||||dWdSWddS1siwYdS)aXCreates a slot initialized using an `Initializer`. The type of the slot is determined by the given value. Args: primary: The primary `Variable` or `Tensor`. initializer: An `Initializer`. The initial value of the slot. shape: Shape of the initial value of the slot. dtype: Type of the value of the slot. name: Name to use for the slot variable. colocate_with_primary: Boolean. If True the slot is located on the same device as `primary`. copy_xla_sharding: Boolean. If True also copies XLA sharding from primary. Returns: A `Variable` object. Nrr%r ) r'rr rr(rrr rr)r*r+r$) r rrrrr,r rr-r.rrrcreate_slot_with_initializers@  "r0Nc s|durj}}|rt}t||||||dSttjr7t t t jfdd}nt }t j||d}t||||dS)aCreate a slot initialized to 0 with same shape as the primary object. Args: primary: The primary `Variable` or `Tensor`. name: Name to use for the slot variable. dtype: Type of the slot variable. Defaults to the type of `primary`. colocate_with_primary: Boolean. If True the slot is located on the same device as `primary`. copy_xla_sharding: Boolean. If True also copies XLA sharding from primary. Returns: A `Variable` object. N)r,r csjSr) initial_valuerr rrsz#create_zeros_slot..)r)rr&r'rZzeros_initializerr0rr rrrrr Zis_variable_initializedZ read_valueZzerosr/)r rrr,r rrr!rr2rcreate_zeros_slots<    r4)T)NT)__doc__Z+tensorflow.python.compiler.xla.experimentalrZtensorflow.python.distributerZtensorflow.python.opsrrrrrr r r r$r/r0r4rrrrs4           I < =