B лdH@sJdZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddZ ddddde j!j"fddZ#ddZ$ddZ%ddZ&ddddej'e j!j"fddZ(dd Z)d!d"Z*e+d#krFe*dS)$ayConverts checkpoint variables into Const ops in a standalone GraphDef file. This script is designed to take a GraphDef proto, a SaverDef proto, and a set of variable values stored in a checkpoint file, and output a GraphDef with all of the variable ops converted into const ops containing the values of the variables. It's useful to do this when we need to load a single file in C++, especially in environments like mobile or embedded where we may not have access to the RestoreTensor ops and file loading calls that they rely on. An example of command-line usage is: bazel build tensorflow/python/tools:freeze_graph && \ bazel-bin/tensorflow/python/tools/freeze_graph \ --input_graph=some_graph_def.pb \ --input_checkpoint=model.ckpt-8361242 \ --output_graph=/tmp/frozen_graph.pb --output_node_names=softmax You can also look at freeze_graph_test.py for an example of how to use it. N)app) text_format) graph_pb2) saver_pb2) MetaGraphDef)checkpoint_management)session) graph_util)importer)gfile)loader) tag_constants)saved_model_utils)py_checkpoint_reader)savercCs4x.|jD] }|jds(|jdr dSq WdS)zjDetermines if the graph has any variables. Args: sess: TensorFlow Session. Returns: Bool. VariableZ VariableOpFT)graphget_operationstype startswithendswith)sessoprV/var/www/html/venv/lib/python3.7/site-packages/tensorflow/python/tools/freeze_graph.py_has_no_variables:s rc s~~| s"t|s"td|d|s.td|rj| rPx2| jjD] }d|_q@Wn|rjx|jD] }d|_q\W|r|tj|dd}t .}|rt j ||d}| ||n| rt j | dd}| |||r||d dd nB| r | d krg} t|| | ni}t|}|}d d |jD}d}xb|D]Zy0|jd}tfdd|Drrd}Wntk rw@YnX||<q@Wyt j ||d}WnNtk r}z.|rtdnt|rtddS|Wd d }~XYnX| |||r*||d dd | rB| d dd nd } | r^| d dd nd } | rtj|| j|d dd | | d}n"tj|||d dd | | d}Wd QRX|rt |d}|!|j"ddWd QRX|S)aConverts all variables in a graph and checkpoint into constants. Args: input_graph_def: A `GraphDef`. input_saver_def: A `SaverDef` (optional). input_checkpoint: The prefix of a V1 or V2 checkpoint, with V2 taking priority. Typically the result of `Saver.save()` or that of `tf.train.latest_checkpoint()`, regardless of sharded/non-sharded or V1/V2. output_node_names: The name(s) of the output nodes, comma separated. restore_op_name: Unused. filename_tensor_name: Unused. output_graph: String where to write the frozen `GraphDef`. clear_devices: A Bool whether to remove device specifications. initializer_nodes: Comma separated string of initializer nodes to run before freezing. variable_names_whitelist: The set of variable names to convert (optional, by default, all variables are converted). variable_names_denylist: The set of variable names to omit converting to constants (optional). input_meta_graph_def: A `MetaGraphDef` (optional), input_saved_model_dir: Path to the dir with TensorFlow 'SavedModel' file and variables (optional). saved_model_tags: Group of comma separated tag(s) of the MetaGraphDef to load, in string format (optional). checkpoint_version: Tensorflow variable file format (saver_pb2.SaverDef.V1 or saver_pb2.SaverDef.V2) Returns: Location of the output_graph_def. zInput checkpoint 'z' doesn't exist!z=You need to supply the name of a node to --output_node_names.r)name) saver_def write_versionT) clear_devices ,NcSs8g|]0}|D]"}td|jr|jddqqS)z /part_\d+/:r)valuesresearchrsplit).0rtensorrrr s z0freeze_graph_with_def_protos..Fz:0c3s|]}|kVqdS)Nr)r(r)keyrr sz/freeze_graph_with_def_protos..)var_listrzModels containing partition variables cannot be converted from checkpoint files. Please pass in a SavedModel using the flag --input_saved_model_dir.zuNo variables were found in this model. It is likely the model was frozen previously. You cannot freeze a graph twice.r)variable_names_whitelistZvariable_names_blacklistwb)Z deterministic)#rZcheckpoint_exists ValueError graph_defnodeZdevicer Zimport_graph_defrSession saver_libZSaverrestoreZimport_meta_graphrunreplacer'r loadrZNewCheckpointReaderZget_variable_to_shape_maprrZget_tensor_by_nameanyKeyError TypeErrorrr Zconvert_variables_to_constantsr GFilewriteZSerializeToString)input_graph_definput_saver_definput_checkpointoutput_node_namesrestore_op_namefilename_tensor_name output_graphr initializer_nodesr.variable_names_denylistinput_meta_graph_definput_saved_model_dirsaved_model_tagscheckpoint_versionr2_rrZrestorerr-readerZvar_to_shape_mapZall_partition_variable_namesZhas_partition_varr)eZoutput_graph_deffr)r+rfreeze_graph_with_def_protosIs.              rOc Csnt|std|dt}|r*dnd}t||*}|rP||nt ||WdQRX|S)z2Parses input tensorflow graph into GraphDef proto.zInput graph file 'z' does not exist!rbrN) r ExistsIOErrorrZGraphDefr<ParseFromStringreadrMerge) input_graph input_binaryr>moderNrrr_parse_input_graph_protos  rZc Csxt|std|dt}|r(dnd}t||*}|rN||nt||WdQRXt d||S)z6Parses input tensorflow graph into MetaGraphDef proto.zInput meta graph file 'z' does not exist!rPrQNzLoaded meta graph file ') r rRrSrr<rTrUrrVprint)rWrXrGrYrNrrr_parse_input_meta_graph_protos   r\c Csnt|std|d|r"dnd}t||2}t}|rP||nt ||WdQRX|S)z2Parses input tensorflow Saver into SaverDef proto.zInput saver file 'z' does not exist!rPrQN) r rRrSr<rSaverDefrTrUrrV) input_saverrXrYrNrrrr_parse_input_saver_proto s  r_cCsd}| rt| |j}n|r&t||}d}| r8t| |}d}|rJt||}t||||||||| | | || dd|dddD|dS)agConverts all variables in a graph and checkpoint into constants. Args: input_graph: A `GraphDef` file to load. input_saver: A TensorFlow Saver file. input_binary: A Bool. True means input_graph is .pb, False indicates .pbtxt. input_checkpoint: The prefix of a V1 or V2 checkpoint, with V2 taking priority. Typically the result of `Saver.save()` or that of `tf.train.latest_checkpoint()`, regardless of sharded/non-sharded or V1/V2. output_node_names: The name(s) of the output nodes, comma separated. restore_op_name: Unused. filename_tensor_name: Unused. output_graph: String where to write the frozen `GraphDef`. clear_devices: A Bool whether to remove device specifications. initializer_nodes: Comma separated list of initializer nodes to run before freezing. variable_names_whitelist: The set of variable names to convert (optional, by default, all variables are converted), variable_names_denylist: The set of variable names to omit converting to constants (optional). input_meta_graph: A `MetaGraphDef` file to load (optional). input_saved_model_dir: Path to the dir with TensorFlow 'SavedModel' file and variables (optional). saved_model_tags: Group of comma separated tag(s) of the MetaGraphDef to load, in string format. checkpoint_version: Tensorflow variable file format (saver_pb2.SaverDef.V1 or saver_pb2.SaverDef.V2). Returns: String that is the location of frozen GraphDef. NcSsg|] }|r|qSrr)r(tagrrrr*dsz freeze_graph..r!rr")rJ) rZget_meta_graph_defr1rZr\r_rOr7r')rWr^rXr@rArBrCrDr rEr.rFinput_meta_graphrHrIrJr>rGr?rrr freeze_graphs:/   rbcCs~|jdkrtjj}n"|jdkr(tjj}ntd|jt|j|j|j |j |j |j |j |j|j|j|j|j|j|j|j|dS)Nz3Invalid checkpoint version (must be '1' or '2'): %d)rJrr]ZV1V2r0rbrWr^rXr@rArBrCrDr rEr.rFrarHrI) unused_argsflagsrJrrrmainhs      rhcsxt}|dddd|jdtddd|jd tdd d|jd tdd d|jd tddd|jdtddd|jddddddd|jdtddd|jdtddd|jdtddd|jd ddddd!d|jd"tdd#d|jd$tdd%d|jd&tdd'd|jd(tdd)d|jd*tdd+d|jd,td-d.d|\}fd/d}tj|t j d0g|d1d2S)3zMain function of freeze_graph.rboolcSs |dkS)Ntrue)lower)vrrr|zrun_main..z --input_graphrz#TensorFlow 'GraphDef' file to load.)rdefaulthelpz --input_saverzTensorFlow saver file to load.z--input_checkpointz"TensorFlow variables file to load.z--checkpoint_versionrdzTensorflow variable file formatz--output_graphzOutput 'GraphDef' file name.z--input_binary?TFz-Whether the input files are in binary format.)nargsconstrrorpz--output_node_namesz.The name of the output nodes, comma separated.z--restore_op_namezsave/restore_allzg The name of the master restore operator. Deprecated, unused by updated loading code. z--filename_tensor_namez save/Const:0zl The name of the tensor holding the save path. Deprecated, unused by updated loading code. z--clear_devicesz(Whether to remove device specifications.z--initializer_nodeszAComma separated list of initializer nodes to run before freezing.z--variable_names_whitelistz Comma separated list of variables to convert to constants. If specified, only those variables will be converted to constants. z--variable_names_denylistzN Comma separated list of variables to skip converting to constants. z--input_meta_graphz'TensorFlow 'MetaGraphDef' file to load.z--input_saved_model_dirz@Path to the dir with TensorFlow 'SavedModel' file and variables.z--saved_model_tagsZservez Group of tag(s) of the MetaGraphDef to load, in string format, separated by ','. For tag-set contains multiple tags, all tags must be passed in. cs t|S)N)rh)rf)rgrrrmrnr)rhargvN) argparseArgumentParserregister add_argumentstrintparse_known_argsrr6sysrt)parserZunparsedZmy_mainr)rgrrun_mainys  r~__main__),__doc__rur%r|ZabslrZgoogle.protobufrZtensorflow.core.frameworkrZtensorflow.core.protobufrZ'tensorflow.core.protobuf.meta_graph_pb2rZtensorflow.python.checkpointrZtensorflow.python.clientrZtensorflow.python.frameworkr r Ztensorflow.python.platformr Ztensorflow.python.saved_modelr r Ztensorflow.python.toolsrZtensorflow.python.trainingrrr4rr]rerOrZr\r_ZSERVINGrbrhr~__name__rrrr#sN               ?m