o ?e@#@sdZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddZ d d Z d d Zd#d dZd#ddZddZddZddZddZddZddZddZGdd d eZd!d"ZdS)$z3Exposes the Python wrapper conversion to trt_graph.N)version)_pywrap_py_utils)rewriter_config_pb2)dtypescCs~tjj}||_||_d|j_||_||_||_ d|_ d|_ ||_ ||_ ||_||_tjj|_d|_||_||_||_||_dS)z>Modifies rewriter_config to disable all non-TRT optimizations.FTN)rZRewriterConfigZOFFZarithmetic_optimizationZauto_mixed_precisionZ auto_parallelenableZconstant_foldingZdebug_stripperZdependency_optimizationZdisable_meta_optimizerZdisable_model_pruningZfunction_optimizationZimplementation_selectorZlayout_optimizerZloop_optimizationZ NO_MEM_OPTZmemory_optimizationZmin_graph_nodesZpin_to_host_optimizationZ remappingZscoped_allocator_optimizationZshape_optimization)Zrewriter_configoffr j/home/www/facesmatcher.com/pyenv/lib/python3.10/site-packages/tensorflow/python/compiler/tensorrt/utils.py-disable_non_trt_optimizers_in_rewriter_configs( r cCs6t|tsJt|dksJdd|D}d|S)NcSsg|]}t|qSr )str).0xr r r :sz+version_tuple_to_string...) isinstancetuplelenjoin)Z ver_tupler r r version_tuple_to_string6s rcCs$tt|}tt|}||kSN)rVersionr)Ztrt_verZ target_verr r r "_is_tensorrt_version_greater_equal>srcCt}t||||fSr)rZget_linked_tensorrt_versionrmajorminorpatchverr r r (is_linked_tensorrt_version_greater_equalEr cCrr)rZget_loaded_tensorrt_versionrrr r r (is_loaded_tensorrt_version_greater_equalJr!r"cCs|tjjddddvS)a!Determines if a TF-TRT experimental feature is enabled. This helper function checks if an experimental feature was enabled using the environment variable `TF_TRT_EXPERIMENTAL_FEATURES=feature_1,feature_2`. Args: feature_name: Name of the feature being tested for activation. ZTF_TRT_EXPERIMENTAL_FEATURES)default,)osenvirongetsplit)Z feature_namer r r !is_experimental_feature_activatedOs  r*cCs"t|tr tj|Sdd|DS)zEHelper function to convert a dtype id to a corresponding string name.cSsg|]}tj|qSr )r_TYPE_TO_STRING)rdr r r rcsz,_convert_dtype_id_to_str..)rintrr+)dtyper r r _convert_dtype_id_to_str^s  r/c CsdD]M}z9|j|}|dkr6|jd}|dkrWq|dkr"WdS|dkr*WdS|d kr2Wd SWd St|jWStyO}zWYd }~qd }~wwd S) z-Returns the compute DType of a GraphDef Node.)precision_modeZDstTr.Tr0zutf-8r#ZFP32Zfloat32ZFP16Zfloat16ZINT8Zint8unknownN)attrsdecoder/type Exception)nodeZtype_keyZ precision_valer r r get_node_compute_dtypefs(   r:cCs2g}|j|jjD] }|dd|jDq |S)z3Returns the input/output shapes of a GraphDef Node.cSsg|]}|jqSr )size)rdimr r r rsz&get_node_io_shapes..)r3listshapeappendr<)r8keyZ out_shaper>r r r get_node_io_shapessrAcCt|j|jjS)z1Returns the input/output dtypes of a TRTEngineOp.)r/r3r=r6r8r@r r r get_trtengineop_io_dtypesrDcCrB)z:Returns the number of input/output nodes of a TRTEngineOp.)rr3r=r6rCr r r get_trtengineop_io_nodes_countrErFcCsdtt}|jjD]$}|d|jjkr-t|j}|jD] }||j d7<q||fSq ||fS)z?Counts the number of nodes and OP types of a given TRTEngineOp.Z_native_segment) collections defaultdictr-Zlibraryfunction signaturenamerZnode_defop)graphdef node_nameZ ops_in_enginefunc node_countr8r r r get_trtengineop_node_op_counts    rRc@seZdZdZddZdS) DTypeIndexzBHelper class to create an index of dtypes with incremental values.cCs ||vr t|d||<||S)NrG)r)selfr.r r r get_dtype_indexszDTypeIndex.get_dtype_indexN)__name__ __module__ __qualname____doc__rUr r r r rSs rSc Cstt}t|d}td|dtd|dtd|dtd|dtd|dg}|jD]x}|j}t|}||}|jdd } | sGd } |j d kr\t ||\} } |d | d } n|j } d| d| d} td|d| d|d|dt |j r|j D]} | d}t dd|d}td|d|d|dqq-||q-td|dtd|dtd|dtd|dtd |d|D]\}}td!|d"|d#|d$|dqtd|dtd%|d|D]}|D]}td|d|d&|dqqtd'|dWd(n 1swYtd)td*|d+td,td-td.td/td0d(S)1a9Exports a GraphDef to GraphViz format. - Step 1: Drawing Each Node of the compute GraphDef. - Step 2: Create nodes for each collected dtype in the graph. - Step 3: Creating invisible links to align properly the legend. Each node consequently mentions: - Op Type - Compute Dtype - Compute Device wzdigraph tftrt_converted_graph {)filez) graph [fontsize=10 fontname="Verdana"];z? node [style=filled height=0.55 colorscheme=set312 shape=box];z subgraph tensorflow_graph {z node [width=1.35];/rzdevice:UnspecifiedZ TRTEngineOpz []zz
zz "z " [label= fillcolor=z];:z^\^r#rz "z" -> "z";z }z subgraph cluster_legend {z! label="Compute Dtype Legend";z margin="30";z node [width=2];z z [fillcolor=z label=<z>];z' edge[style="invisible", dir="none"];"}NzD ===================================================================z"Graph Visualization Exported to: `z`.zBWe recommend using https://edotor.net/ to visualize the .dot file.zBYou can also use `graphviz` utility to convert them to PNG format:z" - `sudo apt install -y graphviz`z= - `dot -Tpng .dot -o .png`zD=================================================================== )rSopenprintr8rLr:rUZdevicer)rMrRrinputresubr?itemskeys)rNZdot_output_filenameZ dtype_indexfZnodes_with_no_inputsr8Z output_nameZnode_precisionZ color_idxZ device_keyrQ_Z node_labelZinput_full_namepartsZ input_namer.rOr r r draw_graphdef_as_graphvizsz                    C rk)rr)rYrHr&rd packagingrZtensorflow.compiler.tf2tensorrtrZtensorflow.core.protobufrZtensorflow.python.frameworkrr rrr r"r*r/r:rArDrFrRdictrSrkr r r r s,