B ӻd9@s dZddlZddlmZddlmZddlmZddlmZddl m Z ddl m Z dd l m Z dd l mZdd lmZdd lmZdZdZiiiid ZddZddZddZedgdGdddZedgdddddefddZedgdddefddZdS)zWModel Analyzer. Analyze model, including shape, params, time, memory, structure, etc. N)message)tfprof_options_pb2)tfprof_output_pb2)context)errors)ops)option_builder) tfprof_logger)_pywrap_tfprof) tf_export)ZExpensiveOperationCheckerZAcceleratorUtilizationCheckerZ JobCheckerZOperationCheckercCs|r|jddSdSdS)z&Helper to serialize a graph to string.T)Z add_shapesN)Z as_graph_defSerializeToString)graphr[/var/www/html/venv/lib/python3.7/site-packages/tensorflow/python/profiler/model_analyzer.py _graph_string-srcCst}|dd|_|dd|_|dd|_|dd|_|dd|_|dd|_|d d|_ |d d|_ |d d|_ |d d|_ |d d|_ |dd|_|dd|_x |dgD]}|j|qWx |dgD]}|j|qWx"|dgD]}|j|qWx"|dgD]}|j|q4Wx"|dgD]}|j|qXW|dd|_x"|dgD]}|j|qW|dd|_|dd|_|S)zqBuild tfprof.OptionsProto. Args: options: A dictionary of options. Returns: tfprof.OptionsProto. max_depth min_bytesrmin_peak_bytesmin_residual_bytesmin_output_bytes min_microsmin_accelerator_microsmin_cpu_micros min_params min_float_opsmin_occurrencesteporder_bynameaccount_type_regexesstart_name_regexestrim_name_regexesshow_name_regexeshide_name_regexesaccount_displayed_op_onlyFselectoutputstdout dump_to_file)rZ OptionsProtogetrrrrrrrrrrrrr r"appendr#r$r%r&r'r(r)r+)optionsoptsprrr_build_options5s> r2cCsft}|dkr|SxL|D]@\}}tj}x|D]\}}|||<q:W|j||qW|S)zBuild tfprof.AdvisorOptionsProto. Args: options: A dictionary of options. See ALL_ADVICE example. Returns: tfprof.AdvisorOptionsProto. N)rZAdvisorOptionsProtoitemsZ CheckerOptionZcheckersZ MergeFrom)r/r0checkerZ checker_optsZchecker_ops_pbkvrrr_build_advisor_optionses   r7zprofiler.Profiler)Zv1c@sbeZdZdZdddZddZddZd d Zd d Zd dZ ddZ ddZ ddZ ddZ dS)ProfileraTensorFlow multi-step profiler. ```python Typical use case: # Currently we are only allowed to create 1 profiler per process. profiler = Profiler(sess.graph) for i in range(total_steps): if i % 10000 == 0: run_meta = tf.compat.v1.RunMetadata() _ = sess.run(..., options=tf.compat.v1.RunOptions( trace_level=tf.RunOptions.FULL_TRACE), run_metadata=run_meta) profiler.add_step(i, run_meta) # Profile the parameters of your model. profiler.profile_name_scope(options=(option_builder.ProfileOptionBuilder .trainable_variables_parameter())) # Or profile the timing of your model operations. opts = option_builder.ProfileOptionBuilder.time_and_memory() profiler.profile_operations(options=opts) # Or you can generate a timeline: opts = (option_builder.ProfileOptionBuilder( option_builder.ProfileOptionBuilder.time_and_memory()) .with_step(i) .with_timeline_output(filename).build()) profiler.profile_graph(options=opts) else: _ = sess.run(...) # Auto detect problems and generate advice. profiler.advise() ``` NcCsJ|stst}d|_||_tj|j|d}t t |j| dS)zConstructor. Args: graph: tf.Graph. If None and eager execution is not enabled, use default graph. op_log: optional. tensorflow::tfprof::OpLogProto proto. Used to define extra op types. g)op_logN) rexecuting_eagerlyrget_default_graph _coverage_graphr merge_default_with_oplog print_mdlZ NewProfilerrr )selfrr9rrr__init__s zProfiler.__init__cCs tdS)N)r?ZDeleteProfiler)r@rrr__del__szProfiler.__del__cCs4tj|j|d}t|t|j|||_dS)aRAdd statistics of a step. Args: step: int, An id used to group one or more different `run_meta` together. When profiling with the profile_xxx APIs, user can use the `step` id in the `options` to profile these `run_meta` together. run_meta: RunMetadata proto that contains statistics of a session run. )run_metaN)r r>r=r?ZAddSteprr r<)r@rrCr9rrradd_steps  zProfiler.add_stepc Csjt|}t}y |tdd|Wn4tj k rd}zt j d|Wdd}~XYnX|S)a}Profile the statistics of the Python codes. By default, it shows the call stack from root. To avoid redundant output, you may use options to filter as below options['show_name_regexes'] = ['.*my_code.py.*'] Args: options: A dict of options. See core/profiler/g3doc/options.md. Returns: a MultiGraphNodeProto that records the results. codezutf-8z!Cannot parse returned proto: %s. N) r2rMultiGraphNodeProtoParseFromStringr?Profileencoder r DecodeErrorsysstderrwrite)r@r/r0 tfprof_nodeerrrprofile_pythons "zProfiler.profile_pythonc Csjt|}t}y |tdd|Wn4tj k rd}zt j d|Wdd}~XYnX|S)zProfile the statistics of the Operation types (e.g. MatMul, Conv2D). Args: options: A dict of options. See core/profiler/g3doc/options.md. Returns: a MultiGraphNodeProto that records the results. opzutf-8z!Cannot parse returned proto: %s. N) r2rrFrGr?rHrIr rrJrKrLrM)r@r/r0rNrOrrrprofile_operationss "zProfiler.profile_operationsc Csjt|}t}y |tdd|Wn4tj k rd}zt j d|Wdd}~XYnX|S)zProfile the statistics of graph nodes, organized by name scope. Args: options: A dict of options. See core/profiler/g3doc/options.md. Returns: a GraphNodeProto that records the results. scopezutf-8z!Cannot parse returned proto: %s. N) r2rGraphNodeProtorGr?rHrIr rrJrKrLrM)r@r/r0rNrOrrrprofile_name_scopes "zProfiler.profile_name_scopec Csjt|}t}y |tdd|Wn4tj k rd}zt j d|Wdd}~XYnX|S)zProfile the statistics of graph nodes, organized by dataflow graph. Args: options: A dict of options. See core/profiler/g3doc/options.md. Returns: a GraphNodeProto that records the results. rzutf-8z!Cannot parse returned proto: %s. N) r2rrTrGr?rHrIr rrJrKrLrM)r@r/r0rNrOrrr profile_graphs "zProfiler.profile_graphcCs0t}t|}|tdd||S)zAutomatically detect problems and generate reports. Args: options: A dict of options. See ALL_ADVICE example above. Returns: An Advise proto that contains the reports from all checkers. advisezutf-8)r AdviceProtor7rGr?rHrIr )r@r/Z advise_pbr0rrrrWs zProfiler.advisecCstS)zSerialize the ProfileProto to a binary string. Users can write it to file for offline analysis by tfprof commandline or graphical interface. Returns: ProfileProto binary string. )r?r )r@rrrserialize_to_string&s zProfiler.serialize_to_stringcCst|dS)zWrites the profile to a file.N)r?Z WriteProfile)r@filenamerrr_write_profile1szProfiler._write_profile)NN)__name__ __module__ __qualname____doc__rArBrDrPrRrUrVrWrYr[rrrrr8ys&  r8zprofiler.profilerSc Csr|stst}|tkr&tj}tj ||||dkd}t |}|rP| nd}t |}|dksl|dkrt }t||| |d| } y|| Wn4tjk r} ztjd| Wdd} ~ XYnXn|dks|d kr\t }t||| |d| } y|| Wn6tjk rX} ztjd| Wdd} ~ XYnXntddd ||S) aProfile model. Tutorials and examples can be found in: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/profiler/g3doc/python_api.md Args: graph: tf.Graph. If None and eager execution is not enabled, use default graph. run_meta: optional tensorflow.RunMetadata proto. It is necessary to support run time information profiling, such as time and memory. op_log: tensorflow.tfprof.OpLogProto proto. User can assign "types" to graph nodes with op_log. "types" allow user to flexibly group and account profiles using options['accounted_type_regexes']. cmd: string. Either 'op', 'scope', 'graph' or 'code'. 'op' view organizes profile using operation type. (e.g. MatMul) 'scope' view organizes profile using graph node name scope. 'graph' view organizes profile using graph node inputs/outputs. 'code' view organizes profile using Python call stack. options: A dict of options. See core/profiler/g3doc/options.md. Returns: If cmd is 'scope' or 'graph', returns GraphNodeProto proto. If cmd is 'op' or 'code', returns MultiGraphNodeProto proto. Side effect: stdout/file/timeline.json depending on options['output'] rE) add_tracer rQzutf-8z!Cannot parse returned proto: %s. NrrSzunknown cmd: %s )rr:rr;_DEFAULT_PROFILE_OPTIONSrZProfileOptionBuilderZtrainable_variables_parameterr r>r2r rrrFr?PrintModelAnalysisrIrGrrJrKrLrMrTrZInvalidArgumentError) rrCr9cmdr/r0 run_meta_strZ graph_strrNretrOrrrprofile6s>   $ $rfzprofiler.advisec Cs|stst}|tkr$t}tj|d|dd}|rB| nd}t |}t }| tt||| dd| |S)a:Auto profile and advise. Builds profiles and automatically check anomalies of various aspects. For more details: https://github.com/tensorflow/tensorflow/tree/master/tensorflow/core/profiler/README.md Args: graph: tf.Graph. If None and eager execution is not enabled, use default graph. run_meta: optional tensorflow.RunMetadata proto. It is necessary to support run time information profiling, such as time and memory. options: see ALL_ADVICE example above. Default checks everything. Returns: Returns AdviceProto proto NT)r`r rWzutf-8)rr:rr;_DEFAULT_ADVISE_OPTIONS ALL_ADVICEcopyr r>r r7rrXrGr?rbrrI)rrCr/r9rdr0rerrrrWs rW)r_rKZgoogle.protobufrZtensorflow.core.profilerrrZtensorflow.python.eagerrZtensorflow.python.frameworkrrZtensorflow.python.profilerrr Ztensorflow.python.utilr r?Z tensorflow.python.util.tf_exportr rargrhrr2r7r8rfrWrrrrs<          0> F