o ?eI@sLdZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddZ ddddde j!j"fddZ#ddZ$ddZ%ddZ&ddddej'e j!j"fddZ(dd Z)d!d"Z*e+d#kre*dSdS)$ayConverts checkpoint variables into Const ops in a standalone GraphDef file. This script is designed to take a GraphDef proto, a SaverDef proto, and a set of variable values stored in a checkpoint file, and output a GraphDef with all of the variable ops converted into const ops containing the values of the variables. It's useful to do this when we need to load a single file in C++, especially in environments like mobile or embedded where we may not have access to the RestoreTensor ops and file loading calls that they rely on. An example of command-line usage is: bazel build tensorflow/python/tools:freeze_graph && \ bazel-bin/tensorflow/python/tools/freeze_graph \ --input_graph=some_graph_def.pb \ --input_checkpoint=model.ckpt-8361242 \ --output_graph=/tmp/frozen_graph.pb --output_node_names=softmax You can also look at freeze_graph_test.py for an example of how to use it. N)app) text_format) graph_pb2) saver_pb2) MetaGraphDef)checkpoint_management)session)convert_to_constants)importer)gfile)loader) tag_constants)saved_model_utils)py_checkpoint_reader)savercCs2|jD]}|jds|jdrdSqdS)zjDetermines if the graph has any variables. Args: sess: TensorFlow Session. Returns: Bool. VariableZ VariableOpFT)graphget_operationstype startswithendswith)sessopre/home/www/facesmatcher.com/pyenv/lib/python3.10/site-packages/tensorflow/python/tools/freeze_graph.py_has_no_variables:s  rc s~~| st|std|d|std|r1| r&| jjD]}d|_qn |r1|jD]}d|_q+|r:tj|dd}t }|rPt j ||d}| ||n| rnt j | dd}| |||rm||d dd n| r~| d urvg} t|| | n{i}t|}|}d d |jD}d}|D]'z|jd}tfdd|Drd}Wn tyYqw||<qz t j ||d}Wnty}z|rtdt|rtd|d }~ww| |||r||d dd | r| d dd nd } | r| d dd nd } | r+tj|| j|d dd | | d}ntj|||d dd | | d}Wd n 1sGwY|rpt |d}|!|j"ddWd |S1skwY|S)aConverts all variables in a graph and checkpoint into constants. Args: input_graph_def: A `GraphDef`. input_saver_def: A `SaverDef` (optional). input_checkpoint: The prefix of a V1 or V2 checkpoint, with V2 taking priority. Typically the result of `Saver.save()` or that of `tf.train.latest_checkpoint()`, regardless of sharded/non-sharded or V1/V2. output_node_names: The name(s) of the output nodes, comma separated. restore_op_name: Unused. filename_tensor_name: Unused. output_graph: String where to write the frozen `GraphDef`. clear_devices: A Bool whether to remove device specifications. initializer_nodes: Comma separated string of initializer nodes to run before freezing. variable_names_whitelist: The set of variable names to convert (optional, by default, all variables are converted). variable_names_denylist: The set of variable names to omit converting to constants (optional). input_meta_graph_def: A `MetaGraphDef` (optional), input_saved_model_dir: Path to the dir with TensorFlow 'SavedModel' file and variables (optional). saved_model_tags: Group of comma separated tag(s) of the MetaGraphDef to load, in string format (optional). checkpoint_version: Tensorflow variable file format (saver_pb2.SaverDef.V1 or saver_pb2.SaverDef.V2) Returns: Location of the output_graph_def. zInput checkpoint 'z' doesn't exist!z=You need to supply the name of a node to --output_node_names.r)name) saver_def write_versionT) clear_devices ,NcSs8g|]}|D]}td|jr|jddqqS)z /part_\d+/:r)valuesresearchrsplit).0rtensorrrr s z0freeze_graph_with_def_protos..Fz:0c3s|]}|vVqdSNr)r(rkeyrr sz/freeze_graph_with_def_protos..)var_listrzModels containing partition variables cannot be converted from checkpoint files. Please pass in a SavedModel using the flag --input_saved_model_dir.zuNo variables were found in this model. It is likely the model was frozen previously. You cannot freeze a graph twice.r)variable_names_whitelistZvariable_names_blacklistwb)Z deterministic)#rZcheckpoint_exists ValueError graph_defnodeZdevicer Zimport_graph_defrSession saver_libZSaverrestoreZimport_meta_graphrunreplacer'r loadrZNewCheckpointReaderZget_variable_to_shape_maprrZget_tensor_by_nameanyKeyError TypeErrorrr Zconvert_variables_to_constantsr GFilewriteZSerializeToString)input_graph_definput_saver_definput_checkpointoutput_node_namesrestore_op_namefilename_tensor_name output_graphr initializer_nodesr0variable_names_denylistinput_meta_graph_definput_saved_model_dirsaved_model_tagscheckpoint_versionr4_rrZrestorerr/readerZvar_to_shape_mapZall_partition_variable_namesZhas_partition_varr)eZoutput_graph_deffrr,rfreeze_graph_with_def_protosIs.         Y rQcCst|s td|dt}|rdnd}t||#}|r(||nt ||Wd|SWd|S1sCwY|S)z2Parses input tensorflow graph into GraphDef proto.zInput graph file '' does not exist!rbrN) r ExistsIOErrorrZGraphDefr>ParseFromStringreadrMerge) input_graph input_binaryr@moderPrrr_parse_input_graph_protos    r]cCst|s td|dt}|rdnd}t||}|r'||nt||Wdn1s9wYt d||S)z6Parses input tensorflow graph into MetaGraphDef proto.zInput meta graph file 'rRrSrTNzLoaded meta graph file ') r rUrVrr>rWrXrrYprint)rZr[rIr\rPrrr_parse_input_meta_graph_protos   r_cCst|s td|d|rdnd}t||'}t}|r(||nt ||Wd|SWd|S1sCwY|S)z2Parses input tensorflow Saver into SaverDef proto.zInput saver file 'rRrSrTN) r rUrVr>rSaverDefrWrXrrY) input_saverr[r\rPrrrr_parse_input_saver_proto s    rbcCsd}| r t| |j}n|rt||}d}| rt| |}d}|r%t||}t||||||||| | | || dd|dddD|dS)agConverts all variables in a graph and checkpoint into constants. Args: input_graph: A `GraphDef` file to load. input_saver: A TensorFlow Saver file. input_binary: A Bool. True means input_graph is .pb, False indicates .pbtxt. input_checkpoint: The prefix of a V1 or V2 checkpoint, with V2 taking priority. Typically the result of `Saver.save()` or that of `tf.train.latest_checkpoint()`, regardless of sharded/non-sharded or V1/V2. output_node_names: The name(s) of the output nodes, comma separated. restore_op_name: Unused. filename_tensor_name: Unused. output_graph: String where to write the frozen `GraphDef`. clear_devices: A Bool whether to remove device specifications. initializer_nodes: Comma separated list of initializer nodes to run before freezing. variable_names_whitelist: The set of variable names to convert (optional, by default, all variables are converted), variable_names_denylist: The set of variable names to omit converting to constants (optional). input_meta_graph: A `MetaGraphDef` file to load (optional). input_saved_model_dir: Path to the dir with TensorFlow 'SavedModel' file and variables (optional). saved_model_tags: Group of comma separated tag(s) of the MetaGraphDef to load, in string format. checkpoint_version: Tensorflow variable file format (saver_pb2.SaverDef.V1 or saver_pb2.SaverDef.V2). Returns: String that is the location of frozen GraphDef. NcSsg|]}|r|qSrr)r(tagrrrr*dsz freeze_graph..r!rr")rL) rZget_meta_graph_defr3r]r_rbrQr9r')rZrar[rBrCrDrErFr rGr0rHinput_meta_graphrJrKrLr@rIrArrr freeze_graphsD/  recCs~|jdkr tjj}n|jdkrtjj}ntd|jt|j|j|j |j |j |j |j |j|j|j|j|j|j|j|j|dS)Nz3Invalid checkpoint version (must be '1' or '2'): %d)rLrr`ZV1V2r2rerZrar[rBrCrDrErFr rGr0rHrdrJrK) unused_argsflagsrLrrrmainhs     rkcsxt}|dddd|jdtddd|jd tdd d|jd tdd d|jd tddd|jdtddd|jddddddd|jdtddd|jdtddd|jdtddd|jd ddddd!d|jd"tdd#d|jd$tdd%d|jd&tdd'd|jd(tdd)d|jd*tdd+d|jd,td-d.d|\}fd/d}tj|t j d0g|d1d2S)3zMain function of freeze_graph.rboolcSs |dkS)Ntrue)lower)vrrr|s zrun_main..z --input_graphrz#TensorFlow 'GraphDef' file to load.)rdefaulthelpz --input_saverzTensorFlow saver file to load.z--input_checkpointz"TensorFlow variables file to load.z--checkpoint_versionrgzTensorflow variable file formatz--output_graphzOutput 'GraphDef' file name.z--input_binary?TFz-Whether the input files are in binary format.)nargsconstrrqrrz--output_node_namesz.The name of the output nodes, comma separated.z--restore_op_namezsave/restore_allzg The name of the master restore operator. Deprecated, unused by updated loading code. z--filename_tensor_namez save/Const:0zl The name of the tensor holding the save path. Deprecated, unused by updated loading code. z--clear_devicesz(Whether to remove device specifications.z--initializer_nodeszAComma separated list of initializer nodes to run before freezing.z--variable_names_whitelistz Comma separated list of variables to convert to constants. If specified, only those variables will be converted to constants. z--variable_names_denylistzN Comma separated list of variables to skip converting to constants. z--input_meta_graphz'TensorFlow 'MetaGraphDef' file to load.z--input_saved_model_dirz@Path to the dir with TensorFlow 'SavedModel' file and variables.z--saved_model_tagsZservez Group of tag(s) of the MetaGraphDef to load, in string format, separated by ','. For tag-set contains multiple tags, all tags must be passed in. cs t|Sr+)rk)rirjrrrps r)rkargvN) argparseArgumentParserregister add_argumentstrintparse_known_argsrr8sysrw)parserZunparsedZmy_mainrrvrrun_mainys r__main__),__doc__rxr%rZabslrZgoogle.protobufrZtensorflow.core.frameworkrZtensorflow.core.protobufrZ'tensorflow.core.protobuf.meta_graph_pb2rZtensorflow.python.checkpointrZtensorflow.python.clientrZtensorflow.python.frameworkr r Ztensorflow.python.platformr Ztensorflow.python.saved_modelr r Ztensorflow.python.toolsrZtensorflow.python.trainingrrr6rr`rhrQr]r_rbZSERVINGrerkr__name__rrrrsV                ' Nm