B Ù»ˆd¦%ã@srdZddlZddlZddlmZddlmZddlmZ ddl m Z ddl m Z ddlmZGd d „d ejƒZdS) z6Test utilities for tf.data benchmarking functionality.éN)Úsession)Ú dataset_ops)Úoptions)Únest)Úcontext)Útestc@s@eZdZdZdd„Zddd„Zdd d „Zdd d „Zddd„ZdS)ÚDatasetBenchmarkBasez"Base class for dataset benchmarks.c Csrg}t ¡stdƒ‚xRt|ƒD]F}|r6t|ƒ}t|ƒt|ƒ}t ¡}t|ƒt ¡}| ||¡qWt  |¡S)aJBenchmark the iterable in eager mode. Runs the iterable `iters` times. In each iteration, the benchmark measures the time it takes to go execute the iterable. Args: iterable: The tf op or tf.data Dataset to benchmark. iters: Number of times to repeat the timing. warmup: If true, warms up the session caches by running an untimed run. Returns: A float, representing the median time (with respect to `iters`) it takes for the iterable to be executed `iters` num of times. Raises: RuntimeError: When executed in graph mode. z7Eager mode benchmarking is not supported in graph mode.) rÚexecuting_eagerlyÚ RuntimeErrorÚrangeÚiterÚnextÚtimeÚappendÚnpÚmedian) ÚselfÚiterableÚitersÚwarmupÚdeltasÚ_ÚiteratorÚstartÚend©rúb/var/www/html/venv/lib/python3.7/site-packages/tensorflow/python/data/benchmarks/benchmark_base.pyÚ_run_eager_benchmarksz)DatasetBenchmarkBase._run_eager_benchmarkNc Csšg}t ¡rtdƒ‚xzt|ƒD]n}tj|dJ}|rL|rB| |¡| |¡|rZ| |¡t ¡} | |¡t ¡} WdQRX| | | ¡qWt   |¡S)a.Benchmarks the iterable in graph mode. Runs the iterable `iters` times. In each iteration, the benchmark measures the time it takes to go execute the iterable. Args: iterable: The tf op or tf.data Dataset to benchmark. iters: Number of times to repeat the timing. warmup: If true, warms up the session caches by running an untimed run. session_config: A ConfigProto protocol buffer with configuration options for the session. Applicable only for benchmarking in graph mode. initializer: The initializer op required to initialize the iterable. Returns: A float, representing the median time (with respect to `iters`) it takes for the iterable to be executed `iters` num of times. Raises: RuntimeError: When executed in eager mode. z7Graph mode benchmarking is not supported in eager mode.)ÚconfigN) rr r r rÚSessionÚrunrrrr) rrrrÚsession_configÚ initializerrrÚsessrrrrrÚ_run_graph_benchmarkCs"    z)DatasetBenchmarkBase._run_graph_benchmarkéTcCs*t ¡r|j|||dS|j||||dS)a¦Benchmarks the op. Runs the op `iters` times. In each iteration, the benchmark measures the time it takes to go execute the op. Args: op: The tf op to benchmark. iters: Number of times to repeat the timing. warmup: If true, warms up the session caches by running an untimed run. session_config: A ConfigProto protocol buffer with configuration options for the session. Applicable only for benchmarking in graph mode. Returns: A float, representing the per-execution wall time of the op in seconds. This is the median time (with respect to `iters`) it takes for the op to be executed `iters` num of times. )rrr)rrrr!)rr rr$)rÚoprrr!rrrÚrun_op_benchmarkssz%DatasetBenchmarkBase.run_op_benchmarkFc Cst ¡}||j_| |¡}| |d¡}t ¡rL|j|||d}|t |ƒSt   |¡} |   ¡} t  | ¡dj} |j| |||| jd}|t |ƒS)aÃBenchmarks the dataset. Runs the dataset `iters` times. In each iteration, the benchmark measures the time it takes to go through `num_elements` elements of the dataset. Args: dataset: Dataset to benchmark. num_elements: Number of dataset elements to iterate through each benchmark iteration. iters: Number of times to repeat the timing. warmup: If true, warms up the session caches by running an untimed run. apply_default_optimizations: Determines whether default optimizations should be applied. session_config: A ConfigProto protocol buffer with configuration options for the session. Applicable only for benchmarking in graph mode. Returns: A float, representing the per-element wall time of the dataset in seconds. This is the median time (with respect to `iters`) it takes for the dataset to go through `num_elements` elements, divided by `num_elements.` r%)rrrr)rrrr!r")Ú options_libÚOptionsZexperimental_optimizationÚapply_default_optimizationsZ with_optionsÚskiprr rÚfloatrZmake_initializable_iteratorZget_nextrÚflattenr&r$r") rÚdatasetÚ num_elementsrrr*r!rZmedian_durationrZ next_elementr&rrrÚ run_benchmarkŒs$     z"DatasetBenchmarkBase.run_benchmarkéc Csn|j||||||d} |dkr"i}t ¡r>d |¡}d|d<nd |¡}d|d<||d<|j| |||d | S) a„Benchmarks the dataset and reports the stats. Runs the dataset `iters` times. In each iteration, the benchmark measures the time it takes to go through `num_elements` elements of the dataset. This is followed by logging/printing the benchmark stats. Args: dataset: Dataset to benchmark. num_elements: Number of dataset elements to iterate through each benchmark iteration. name: Name of the benchmark. iters: Number of times to repeat the timing. extras: A dict which maps string keys to additional benchmark info. warmup: If true, warms up the session caches by running an untimed run. apply_default_optimizations: Determines whether default optimizations should be applied. session_config: A ConfigProto protocol buffer with configuration options for the session. Applicable only for benchmarking in graph mode. Returns: A float, representing the per-element wall time of the dataset in seconds. This is the median time (with respect to `iters`) it takes for the dataset to go through `num_elements` elements, divided by `num_elements.` )r.r/rrr*r!Nz{}.eagerÚeagerÚimplementationz{}.graphÚgraphr/)Ú wall_timerÚnameÚextras)r0rr ÚformatZreport_benchmark) rr.r/r6rr7rr*r!r5rrrÚrun_and_report_benchmarkÇs$!   z-DatasetBenchmarkBase.run_and_report_benchmark)N)r%TN)r%TFN)r1NTFN) Ú__name__Ú __module__Ú __qualname__Ú__doc__rr$r'r0r9rrrrrs) +  9r)r=rÚnumpyrZtensorflow.python.clientrZtensorflow.python.data.opsrrr(Ztensorflow.python.data.utilrZtensorflow.python.eagerrZtensorflow.python.platformrZ BenchmarkrrrrrÚs