B d@sdZddlmZddlmZddlZddlZddlmZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlZddlZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd l m!Z"dd l m#Z$ddl%m&Z&ddl'm(Z(ddl)m*Z*e*+Z,dZ-dZ.dZ/dZ0Gddde1Z2ddZ3GdddedZ4GdddedZ5Gddde6Z7Gd d!d!e7Z8d"d#Z9Gd$d%d%ej:Z;Gd&d'd'ejdS)(aUtilities for TensorBoard command line program. This is a lightweight module for bringing up a TensorBoard HTTP server or emulating the `tensorboard` shell command. Those wishing to create custom builds of TensorBoard can use this module by swapping out `tensorboard.main` with the custom definition that modifies the set of plugins and static assets. This module does not depend on first-party plugins or the default web server assets. Those are defined in `tensorboard.default`. )ABCMeta)abstractmethodN) defaultdict)flags)argparse_flags)serving)manager)version) application) data_ingester)event_file_inspector)server_ingester) core_plugin) tb_loggingZserveZ__tensorboard_subcommandz NOTE: Using experimental fast data loading logic. To disable, pass "--load_fast=false" and report issues on GitHub. More details: https://github.com/tensorflow/tensorboard/issues/4784 zCould not start data server: %s. Try with --load_fast=false and report issues on GitHub. Details: https://github.com/tensorflow/tensorboard/issues/4784 c@sveZdZdZdddZdddZddd Zd d Zd d ZddZ ddZ ddZ ddZ ddZ ddZddZdS) TensorBoardaOClass for running TensorBoard. Fields: plugin_loaders: Set from plugins passed to constructor. assets_zip_provider: Set by constructor. server_class: Set by constructor. flags: An argparse.Namespace set by the configure() method. cache_key: As `manager.cache_key`; set by the configure() method. Nc Cs|dkrddlm}|}|dkrjyddlm}Wn,tk r`}ztd|Wdd}~XYnX|}|dkrvt}|dkrg}dd|D|_||_||_ i|_ x<|D]4}| } | |j ks| t krt d| ||j | <qWd|_dS) aCreates new instance. Args: plugins: A list of TensorBoard plugins to load, as TBPlugin classes or TBLoader instances or classes. If not specified, defaults to first-party plugins. assets_zip_provider: A function that provides a zip file containing assets to the application. If `None`, the default TensorBoard web assets will be used. (If building from source, your binary must explicitly depend on `//tensorboard:assets_lib` if you pass `None`.) server_class: An optional factory for a `TensorBoardServer` to use for serving the TensorBoard WSGI app. If provided, its callable signature should match that of `TensorBoardServer.__init__`. :type plugins: list[ base_plugin.TBLoader | Type[base_plugin.TBLoader] | Type[base_plugin.TBPlugin] ] Nr)default)assetszbNo `assets_zip_provider` given, but `tensorboard.assets` could not be imported to resolve defaultscSsg|]}t|qS)r Zmake_plugin_loader).0prrE/var/www/html/venv/lib/python3.7/site-packages/tensorboard/program.py sz(TensorBoard.__init__..zDuplicate subcommand name: %r) tensorboardrZ get_pluginsr ImportErrorZget_default_assets_zip_provider$create_port_scanning_werkzeug_serverplugin_loadersassets_zip_provider server_class subcommandsname_SERVE_SUBCOMMAND_NAME ValueErrorr) selfpluginsrrrrre subcommandrrrr__init__`s2   zTensorBoard.__init__cKstjddd}|jdtd}|jtdd}|jfttit|dksV|dd r\|}n|}xH|j D]:\}}|j|| | d } | jft|i| | qlWx|jD]} | |qW|r|d nd } ||dd } t| td d krt| tttjt|dd |d|_| rpxFttj| D]2} t| | jrZtd| jt| | j| jq:Wx:| D].\}}t| |std|t| ||qzWt| ttkrx|jD]} | | qW| |_| gS)a=Configures TensorBoard behavior via flags. This method will populate the "flags" property with an argparse.Namespace representing flag values parsed from the provided argv list, overridden by explicit flags from remaining keyword arguments. Args: argv: Can be set to CLI args equivalent to sys.argv; the first arg is taken to be the name of the path being executed. kwargs: Additional arguments will override what was parsed from argv. They must be passed as Python data structures, e.g. `foo=1` rather than `foo="1"`. Returns: Either argv[:1] if argv was non-empty, or [''] otherwise, as a mechanism for absl.app.run() compatibility. Raises: ValueError: If flag values are invalid. rzTensorBoard is a suite of web applications for inspecting and understanding your TensorFlow runs and graphs. https://github.com/tensorflow/tensorboard )prog descriptionz'TensorBoard subcommand (defaults to %r))helpz3start local TensorBoard server (default subcommand)-)r+r*rr(N)Zworking_directory argumentsZconfigure_kwargszConflicting Abseil flag: %szUnknown TensorBoard flag: %s) rArgumentParseradd_subparsersr add_parser set_defaults_SUBCOMMAND_FLAGlen startswithritemsr+r* define_flagsr parse_argsgetattrsetattrr cache_keyosgetcwdset absl_flagsFLAGSZget_key_flags_for_modulehasattrrr!value fix_flagsr)r"argvkwargsZ base_parserZ subparsersZserve_subparserZ serve_parserrr%Z subparserloaderZarg0rflagkvrrr configuresZ          zTensorBoard.configurecCsL|tjd|t|jt}|tkr2|j}n |j |j }||jpJdS)a'Blocking main function for TensorBoard. This method is called by `tensorboard.main.run_main`, which is the standard entrypoint for the tensorboard command line program. The configure() method must be called first. Args: ignored_argv: Do not pass. Required for Abseil compatibility. Returns: Process exit code, i.e. 0 if successful or non-zero on failure. In practice, an exception will most likely be raised instead of returning non-zero. :rtype: int SIGTERMr) _install_signal_handlersignalrL_fix_mime_typesr:rr4r _run_serve_subcommandrrun)r"Z ignored_argvsubcommand_namerunnerrrrmains  zTensorBoard.mainc Cs|jrttjdS|jrHtdtj |j }t |j ||j dSy&|}||||dStk r}z,t|jtjd|jtjdSd}~XYnXdS)Nrz8Not bringing up TensorBoard, but inspecting event files.z ERROR: %s )Z version_tbprintr VERSIONinspectloggerinfor=path expanduser event_fileefilogdirtag _make_serverprint_serving_message_register_info serve_foreverTensorBoardServerExceptionerrormsgsysstderrwriteflush)r"rr]serverr$rrrrPs(    z!TensorBoard._run_serve_subcommandcCs.|}tj|jdd}d|_||S)a-Python API for launching TensorBoard. This method is the same as main() except it launches TensorBoard in a separate permanent thread. The configure() method must be called first. Returns: The URL of the TensorBoard web server. :rtype: str r)targetrT)ra threadingThreadrddaemonstartget_url)r"rlthreadrrrlaunch/s  zTensorBoard.launchc Csjtj|}tjtjtt |j t |j j|j jp@|j j|j j|jd}ttjt|dS)zWrite a TensorBoardInfo file and arrange for its cleanup. Args: server: The result of `self._make_server()`. )r start_timeportpid path_prefixr_dbr<N)urllibparseurlparserrrZTensorBoardInfor rWinttimervr=getpidrrxr_ logdir_specryr<atexitregisterZremove_info_fileZwrite_info_file)r"rlZ server_urlrZrrrrcDs   zTensorBoard._register_infocs$dfdd}t|dS)afSet a signal handler to gracefully exit on the given signal. When this process receives the given signal, it will run `atexit` handlers and then exit with `0`. Args: signal_number: The numeric code for the signal to handle, like `signal.SIGTERM`. signal_name: The human-readable signal name. NcsFttjtjdtjtjfkr8||tddS)Nz"TensorBoard caught %s; exiting... r)rNSIG_DFLrhrirjSIG_IGNexit)Zhandled_signal_numberframe)old_signal_handler signal_name signal_numberrrhandleris   z4TensorBoard._install_signal_handler..handler)rN)r"rrrr)rrrrrMXs z#TensorBoard._install_signal_handlercCs(tddtddtdddS)aZFix incorrect entries in the `mimetypes` registry. On Windows, the Python standard library's `mimetypes` reads in mappings from file extension to MIME type from the Windows registry. Other applications can and do write incorrect values to this registry, which causes `mimetypes.guess_type` to return incorrect values, which causes TensorBoard to fail to render on the frontend. This method hard-codes the correct mappings for certain MIME types that are known to be either used by TensorBoard or problematic in general. ztext/javascriptz.jsz font/woff2z.woff2z text/htmlz.htmlN) mimetypesadd_type)r"rrrrOxs  zTensorBoard._fix_mime_typesc Cs@|j}t}tj||j|j|j|jt |j d}| |S)z>Creates, starts, and returns a `SubprocessServerDataIngester`.) server_binaryr_reload_intervalchannel_creds_typesamples_per_plugin extra_flags) rr Zget_server_binaryZSubprocessServerDataIngesterr_rgrpc_creds_typershlexsplitZextra_data_server_flagsrq)r"rringesterrrr_start_subprocess_data_ingestersz+TensorBoard._start_subprocess_data_ingesterc Csr|j}|jr*tj|j|jd}||S|jdkry|Stjk r~}z"d|}t j |t dWdd}~XYnBtj k r}z"t|}t j |t dWdd}~XYnX|jdkr\t|r\y"|}t j tt j |Stjk r*}ztd|Wdd}~XYn2tj k rZ}ztd|Wdd}~XYnXt|}||S) z>Determines the right data ingester, starts it, and returns it.)rtruez*Option --load_fast=true not available: %s r-NautozNo data server: %sz2Data server error: %s; falling back to multiplexer)rZgrpc_data_providerr ZExistingServerDataIngesterrrqZ load_fastrZNoDataServerErrorrhrirjrZDataServerStartupError+_DATA_SERVER_STARTUP_ERROR_MESSAGE_TEMPLATE_should_use_data_server_DATA_SERVER_ADVISORY_MESSAGErkrYrZlocal_ingesterLocalDataIngester)r"rrr$rgrrr_make_data_ingesters@       zTensorBoard._make_data_ingestercCs.|}||_d}t|tjr$|j}|j|fS)z2Returns `(data_provider, deprecated_multiplexer)`.N)rZ _ingester isinstancerrdeprecated_multiplexer data_provider)r"rrrrr_make_data_providers  zTensorBoard._make_data_providercCs2|\}}t|j|j||j|}|||jS)z@Constructs the TensorBoard WSGI app and instantiates the server.)rr ZTensorBoardWSGIApprrrr)r"rrZapprrrras zTensorBoard._make_server)NNNN)r')r')__name__ __module__ __qualname____doc__r&rKrTrPrtrcrMrOrrrrarrrrrUs   7 `  ( rcCsd|jr|jstddS|js$dSd|jkrH|jdsHtddS|jdkr`tddSdS)NzNote: --logdir_spec is not supported with --load_fast behavior; falling back to slower Python-only load path. To use the data server, replace --logdir_spec with --logdir.Fz://zgs://zsNote: --load_fast behavior only supports local and GCS (gs://) paths; falling back to slower Python-only load path.Tz~Note: --detect_file_replacement=true is not supported with --load_fast behavior; falling back to slower Python-only load path.)rr_rYrZr6Zdetect_file_replacement)rrrrrs  rc@sDeZdZdZeddZeddZeddZdd Zd d Z d S) TensorBoardSubcommandzDExperimental private API for defining subcommands to tensorboard(1).cCsdS)zName of this subcommand, as specified on the command line. This must be unique across all subcommands. Returns: A string. Nr)r"rrrrs zTensorBoardSubcommand.namecCsdS)adConfigure an argument parser for this subcommand. Flags whose names start with two underscores (e.g., `__foo`) are reserved for use by the runtime and must not be defined by subcommands. Args: parser: An `argparse.ArgumentParser` scoped to this subcommand, which this function should mutate. Nr)r"parserrrrr8s z"TensorBoardSubcommand.define_flagscCsdS)zExecute this subcommand with user-provided flags. Args: flags: An `argparse.Namespace` object with all defined flags. Returns: An `int` exit code, or `None` as an alias for `0`. Nr)r"rrrrrQs zTensorBoardSubcommand.runcCsdS)z=Short, one-line help text to display on `tensorboard --help`.Nr)r"rrrr+ szTensorBoardSubcommand.helpcCsdS)z:Description to display on `tensorboard SUBCOMMAND --help`.Nr)r"rrrr*$sz!TensorBoardSubcommand.descriptionN) rrrrrrr8rQr+r*rrrrrs   r) metaclassc@s<eZdZdZeddZeddZeddZdd Zd S) TensorBoardServerz3Class for customizing TensorBoard WSGI app serving.cCs tdS)zCreate a flag-configured HTTP server for TensorBoard's WSGI app. Args: wsgi_app: The TensorBoard WSGI application to create a server for. flags: argparse.Namespace instance of TensorBoard flags. N)NotImplementedError)r"wsgi_apprrrrr&,szTensorBoardServer.__init__cCs tdS)z6Blocking call to start serving the TensorBoard server.N)r)r"rrrrd6szTensorBoardServer.serve_forevercCs tdS)z7Returns a URL at which this server should be reachable.N)r)r"rrrrr;szTensorBoardServer.get_urlcCs(tjdtj|ftjdS)zxPrints a user-friendly message prior to server start. This will be called just before `serve_forever`. z,TensorBoard %s at %s (Press CTRL+C to quit) N)rhrirjr rWrrrk)r"rrrrb@sz'TensorBoardServer.print_serving_messageN) rrrrrr&rdrrrbrrrrr)s   rc@seZdZdZddZdS)rezException raised by TensorBoardServer for user-friendly errors. Subclasses of TensorBoardServer can raise this exception in order to generate a clean error message for the user rather than a stacktrace. cCs ||_dS)N)rg)r"rgrrrr&Tsz#TensorBoardServerException.__init__N)rrrrr&rrrrreLsrec@seZdZdZdS)TensorBoardPortInUseErroraError raised when attempting to bind to a port that is in use. This should be raised when it is expected that binding to another similar port would succeed. It is used as a signal to indicate that automatic port searching should continue rather than abort. N)rrrrrrrrrXsrcsfdd}|S)auCreate a server factory that performs port scanning. This function returns a callable whose signature matches the specification of `TensorBoardServer.__init__`, using `cls` as an underlying implementation. It passes through `flags` unchanged except in the case that `flags.port is None`, in which case it repeatedly instantiates the underlying server with new port suggestions. Args: cls: A valid implementation of `TensorBoardServer`. This class's initializer should raise a `TensorBoardPortInUseError` upon failing to bind to a port when it is expected that binding to another nearby port might succeed. The initializer for `cls` will only ever be invoked with `flags` such that `flags.port is not None`. Returns: A function that implements the `__init__` contract of `TensorBoardServer`. c s|jdk}|jdkrtjn|j}|dkr8td|df|r@dnd}t||d|}xTt|||D]B}tjft|}||_y ||dSt k r|sYqfXqfWtd||fdS)Niz'TensorBoard cannot bind to port %d > %ddr-i)rrzATensorBoard could not bind to any port around %s (tried %d times)) rvrZ DEFAULT_PORTreminrangeargparse Namespacevarsr)rrZ should_scanZ base_portZ max_attemptsrvZsubflags)clsrrinitzs$    z with_port_scanning..initr)rrr)rrwith_port_scanningcs rc@seZdZdZdZdS)_WSGIRequestHandlerzs\                1#  8 X