B һd!@sdZddlZddlZddlmZddlmZddlmZddlm Z ddlm Z ddl m Z dd l mZd d Zd d ZddZddZdddZdddZdddZdS)z;Communicating tracebacks and source code with debug server.N)debug_service_pb2) debug_pb2)common)debug_service_pb2_grpc) source_utils)gfile) tfprof_loggerc Cstt|}t|_||_|j|_|j|_ y0t |d}|j | WdQRXWntk rnYnXdS)Nr)rZStatsocket gethostnamehost file_pathZ mtime_nsecZ last_modifiedlengthbytesZOpenlinesextendread splitlinesIOError)r Zsource_file_protoZ file_statfr[/var/www/html/venv/lib/python3.7/site-packages/tensorflow/python/debug/lib/source_remote.py_load_debugged_source_files  "rcCs||krt|||<||S)N)len)string string_to_idrrr _string_to_id+s rc Csi}d|d<x@|D]8}|\}}}}|jjjt|||t||t||dqW|j}x(|D]\} } | dk rr| nd|| <q^WdS)zFormat a traceback stack for a `CallTraceback` proto. Args: origin_stack: The stack list as returned by `traceback.extract_stack()`. call_traceback_proto: A `CallTraceback` proto whose fields are to be populated. rN)file_idlinenoZ function_idZline_id) origin_stacktracesaddrorigin_id_to_stringitems) r Zcall_traceback_protorframer r func_nameZ line_text id_to_stringkeyvaluerrr_format_origin_stack1s  r*csTt}x(|D] }x|jD]}||jqWq Wfdd|D}dd|D}|S)a4Extract source file paths outside TensorFlow Python library. Args: code_defs: An iterable of `CodeDef` protos, i.e., an iterable of stack traces. id_to_string: A proto map from integer ids to strings. Returns: An iterable of source file paths outside the TensorFlow Python library. c3s|]}|VqdS)Nr).0r)r'rr WszC_source_file_paths_outside_tensorflow_py_library..css&|]}t|st|r|VqdS)N)rZguess_is_tensorflow_py_libraryrZExists)r+rrrrr,Ys)setr!r"r)Z code_defsr'Zfile_idscode_deftraceZ non_tf_filesr)r'r0_source_file_paths_outside_tensorflow_py_libraryHs   r0FTcCs>t|ts|g}dd|D}|r*tjjntjj}|rDtj|ddnd}tj||||r\|jndd}t |||rt } | t dd|j jD|j j| t |jg|jg} x.| D]&} t} t| | j| | qWxT|D]L} d d g}tj| |d }t|}|||rx| D]} || q"WqWdS) arSend the tracebacks of a TensorFlow execution call. To gRPC debug server(s). This applies to graph execution (`tf.Session.run()`) calls and eager execution calls. If `send_source`, also sends the underlying source files outside the TensorFlow library. Args: destinations: gRPC destination addresses, a `str` or a `list` of `str`s, e.g., "localhost:4242". If a `list`, gRPC requests containing the same `CallTraceback` proto payload will be sent to all the destinations. origin_stack: The traceback stack for the origin of the execution call. For graph execution, this is the traceback of the `tf.Session.run()` invocation. For eager execution, this is the traceback of the Python line that executes the eager operation. is_eager_execution: (`bool`) whether an eager execution call (i.e., not a `tf.Session.run` or derived methods) is being sent. call_key: The key of the execution call, as a string. For graph execution, this is a string describing the feeds, fetches (and targets) names of the `tf.Session.run` call. For eager execution, this is ignored. graph: A Python `tf.Graph` object (i.e., *not* a `tf.compat.v1.GraphDef`), which contains op tracebacks, if applicable. send_source: Whether the source files involved in the op tracebacks but outside the TensorFlow library are to be sent. cSs.g|]&}|tjr&|ttjdn|qS)N) startswithrZGRPC_URL_PREFIXr)r+destrrr sz)_send_call_tracebacks..F)Zadd_trainable_varN) call_typecall_keygraph_tracebackZ graph_versioncss|] }|jVqdS)N)r.)r+Z log_entryrrrr,sz(_send_call_tracebacks..)zgrpc.max_receive_message_length)zgrpc.max_send_message_lengthr7)options) isinstancelistrZ CallTracebackZEAGER_EXECUTIONZGRAPH_EXECUTIONrZmerge_default_with_oplogversionr*r-updater0r6Z log_entriesr'r r#rZDebuggedSourceFilesr source_filesr"appendgrpcZinsecure_channelrZEventListenerStubZSendTracebacksZSendSourceFiles) destinationsr is_eager_executionr5graph send_sourcer4r6Zcall_tracebackZsource_file_pathsZdebugged_source_filesr r= destinationZno_max_message_sizesZchannelZstubrrr_send_call_tracebacks^sD          rEcCst||d|||ddS)aSend the tracebacks of a graph execution call to debug server(s). Args: destinations: gRPC destination addresses, a `str` or a `list` of `str`s, e.g., "localhost:4242". If a `list`, gRPC requests containing the same `CallTraceback` proto payload will be sent to all the destinations. run_key: A string describing the feeds, fetches (and targets) names of the `tf.Session.run` call. origin_stack: The traceback of the `tf.Session.run()` invocation. graph: A Python `tf.Graph` object (i.e., *not* a `tf.compat.v1.GraphDef`), which contains op tracebacks. send_source: Whether the source files involved in the op tracebacks but outside the TensorFlow library are to be sent. F)rAr5rBrCN)rE)r@Zrun_keyr rBrCrrrsend_graph_tracebackssrFcCst||d|ddS)aSend the tracebacks of an eager execution call to debug server(s). Args: destinations: gRPC destination addresses, a `str` or a `list` of `str`s, e.g., "localhost:4242". If a `list`, gRPC requests containing the same origin_stack: The traceback of the eager operation invocation. send_source: Whether the source files involved in the op tracebacks but outside the TensorFlow library are to be sent. T)rArCN)rE)r@r rCrrrsend_eager_tracebackss rG)FNNT)T)T)__doc__r r?Ztensorflow.core.debugrZtensorflow.core.protobufrZtensorflow.python.debug.librrrZtensorflow.python.platformrZtensorflow.python.profilerrrrr*r0rErFrGrrrrs&         M