o ?e+@s,dZddlmZdZdZGdddeZdS)z3Helper library for sharding during TPU compilation.) tensor_shapec@seZdZdZddZddZddZdd Zed d Z d d Z eddZ ddZ eddZ ddZddZddZd!ddZddZdd ZdS)"ShardingPolicyz7An object use to hold the sharding policy for a Tensor.cCsd|_d|_d|_d|_dS)NrF)_number_of_shards_number_of_partitions_shard_dimension_frozenselfr c/home/www/facesmatcher.com/pyenv/lib/python3.10/site-packages/tensorflow/python/tpu/tpu_sharding.py__init__s zShardingPolicy.__init__cCs(|jdus |jdur dSd|j|jfS)NzShardingPolicy(unset)z&ShardingPolicy(%d shards dimension %d))number_of_shardsshard_dimensionr r r r __str__"s  zShardingPolicy.__str__cCs.|jdurt|_|jdurtt|_dSdSN)r_DEFAULT_NUMBER_OF_SHARDSrr as_dimension_DEFAULT_SHARD_DIMENSIONr r r r _fill_default_values)s   z#ShardingPolicy._fill_default_valuescCs|js |d|_dSdS)zPrevents further modification to the sharding policy. Any values that have not been set when freeze is called are set to defaults. If the ShardingPolicy is already frozen, this is a NoOp. TN)rrr r r r freeze0s zShardingPolicy.freezecC|jS)zBReturns the number of shards in the policy or None if unspecified.)rr r r r r:zShardingPolicy.number_of_shardscCsL|jr|j|krtd|d|jdS|dkr||_dStd|d)auSets the number of shards for the current policy. If the policy has been frozen then number_of_shards must match the existing setting. Args: number_of_shards: The number of shards to use in the policy. Raises: ValueError: If the policy has been frozen and number_of_shards differs from the frozen value; or number_of_shards <= 0. z!Can't set sharding policy to use z( shards since it has been frozen to use rz shards; value must be > 0N)rr ValueError)r rr r r set_number_of_shards?s   z#ShardingPolicy.set_number_of_shardscCr)zFReturns the number of partitions of the policy or None if unspecified.)rr r r r number_of_partitionsYrz#ShardingPolicy.number_of_partitionscCs6|jr|j|krtd|d|jddS||_dS)aeSets the number of partitions for the current policy. If the policy has been frozen then shard_dimension must match the existing setting. Args: number_of_partitions: The number of partitions to use in the policy. Raises: ValueError: If the policy has been frozen and shard_dimension differs from the frozen value. z"Can't set number_of_partitions to z! since it has been frozen to use .N)rrr)r rr r r set_number_of_partitions^s  z'ShardingPolicy.set_number_of_partitionscCr)zAReturns the shard dimension of the policy or None if unspecified.)rr r r r rsrzShardingPolicy.shard_dimensioncCs6|jr|j|krtd||jfdSt||_dS)aSets the shard dimension for the current policy. If the policy has been frozen then shard_dimension must match the existing setting. Args: shard_dimension: The shard dimension to use in the policy. Raises: ValueError: If the policy has been frozen and shard_dimension differs from the frozen value, or shard_dimension can't be interpreted as a Dimension. zCCan't set shard dimension to %d since it has been frozen to use %d.N)rrrrr)r rr r r set_shard_dimensionxs z"ShardingPolicy.set_shard_dimensioncCs4|jdur ||j|jdur||jdSdS)zMerges the policy of another policy into the current policy. Args: other: The policy to merge into this one. Raises: ValueError: If this policy has been frozen and the merge conflicts with the frozen policy. N)rrrr)r otherr r r merges  zShardingPolicy.mergecCst|}|}|jdus|jdus|sdS||jdur,td|d|jd|jdkr;||j|j9<t|S)avReturns the shape of an unpartitioned Tensor. When given the shape of a 'sharded-size' Tensor, returns the shape of the full shape of its unpartitioned Tensor. Args: shape: The shape of the sharded Tensor. Returns: The shape of the unpartitioned version of the Tensor. Raises: ValueError: if shape has unknown sharded dimension NShape & must have a fixed size for dimension z that is known. r)ras_shapeas_listrrr)r shapedimsr r r get_unpartitioned_shapes   z&ShardingPolicy.get_unpartitioned_shapeNcCs*|jdus |jdur dS|dur%|dks||jkr%td|d|jdt|}|jdkr1|S|j}|dur@td|d||jkrRtd|d |j|}||jdurktd|d |jd ||j|jdkrtd|d |jd |j||j|j<t|S)ayReturns the shape of a shard of a full Tensor. When given the shape of a 'full-size' Tensor, returns the shape of the sub-Tensor after it has been sharded. Freezes the policy if it has not yet been frozen. Args: shape: The shape of the full-size Tensor to be sharded. shard_index: The index of the shard whose shape should be returned. shard_index can be None for sharding policies that use the same shape for every shard. Returns: The shape of the sharded version of the Tensor. Raises: ValueError: If shard_index is None when shards are of different shapes; or shard_index is not None and !(0<=shard_index&sz6ShardingPolicy.get_unsharded_shape..rzSharded shapes z3 are not consistent shards of a full shape sharded r)rr)rlenrrrangeZis_compatible_withr)r ZshapesZunsharded_shapesir r r get_unsharded_shape s* z"ShardingPolicy.get_unsharded_shaper)__name__ __module__ __qualname____doc__r rrrpropertyrrrrrrr r'r,r-r4r r r r rs(    7 rN)r8Ztensorflow.python.frameworkrrrobjectrr r r r s