B ®»ˆd¥"ã@sždZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z Gdd„de ƒZ e dƒZGdd „d e ƒZGd d „d e ƒZGd d „d ejƒZdS)z"Writes events to disk in a logdir.éN)Útf)Ú event_pb2)Ú RecordWriterc@seZdZdd„Zdd„ZdS)Ú AtomicCountercCs||_t ¡|_dS)N)Ú_valueÚ threadingÚLockÚ_lock)ÚselfÚ initial_value©r ú^/var/www/html/venv/lib/python3.7/site-packages/tensorboard/summary/writer/event_file_writer.pyÚ__init__szAtomicCounter.__init__c Cs.|jz|jS|jd7_XWdQRXdS)Né)r r)r r r r Úget"szAtomicCounter.getN)Ú__name__Ú __module__Ú __qualname__rrr r r r rsrc@s:eZdZdZddd„Zdd„Zd d „Zd d „Zd d„ZdS)ÚEventFileWritera&Writes `Event` protocol buffers to an event file. The `EventFileWriter` class creates an event file in the specified directory, and asynchronously writes Event protocol buffers to the file. The Event file is encoded using the tfrecord format, which is similar to RecordIO. é éxÚc Cs”||_tjj |¡tj |dt ¡t   ¡t  ¡t   ¡f¡||_tjj |jd¡|_tt|jƒ||ƒ|_tjt ¡dd}| |¡| ¡dS)aœCreates a `EventFileWriter` and an event file to write to. On construction the summary writer creates a new event file in `logdir`. This event file will contain `Event` protocol buffers, which are written to disk via the add_event method. The other arguments to the constructor control the asynchronous writes to the event file: Args: logdir: A string. Directory where event file will be written. max_queue_size: Integer. Size of the queue for pending events and summaries. flush_secs: Number. How often, in seconds, to flush the pending events and summaries to disk. z"events.out.tfevents.%010d.%s.%s.%sÚwbz brain.Event:2)Z wall_timeZ file_versionN)Ú_logdirrÚioZgfileÚmakedirsÚosÚpathÚjoinÚtimeÚsocketÚ gethostnameÚgetpidÚ _global_uidrZ _file_nameZGFileZ_general_file_writerÚ _AsyncWriterrÚ _async_writerrÚEventÚ add_eventÚflush)r ZlogdirÚmax_queue_sizeÚ flush_secsZfilename_suffixZ_eventr r r r6s"  zEventFileWriter.__init__cCs|jS)z7Returns the directory where event file will be written.)r)r r r r Ú get_logdirbszEventFileWriter.get_logdircCs0t|tjƒstdt|ƒƒ‚|j | ¡¡dS)zeAdds an event to the event file. Args: event: An `Event` protocol buffer. z.Expected an event_pb2.Event proto, but got %sN)Ú isinstancerr&Ú TypeErrorÚtyper%ÚwriteZSerializeToString)r Úeventr r r r'fs   zEventFileWriter.add_eventcCs|j ¡dS)zŠFlushes the event file to disk. Call this method to make sure that all pending events have been written to disk. N)r%r()r r r r r(sszEventFileWriter.flushcCs|j ¡dS)zÇPerforms a final flush of the event file to disk, stops the write/flush worker and closes the file. Call this method when you do not need the summary writer anymore. N)r%Úclose)r r r r r1{szEventFileWriter.closeN)rrr) rrrÚ__doc__rr+r'r(r1r r r r r-s  + rc@s2eZdZdZd dd„Zdd„Zdd „Zd d „Zd S)r$zWrites bytes to a file.ércCsB||_d|_t |¡|_t|j|j|ƒ|_t ¡|_ |j  ¡dS)a@Writes bytes to a file asynchronously. An instance of this class holds a queue to keep the incoming data temporarily. Data passed to the `write` function will be put to the queue and the function returns immediately. This class also maintains a thread to write data in the queue to disk. The first initialization parameter is an instance of `tensorboard.summary.record_writer` which computes the CRC checksum and then write the combined result to the disk. So we use an async approach to improve performance. Args: record_writer: A RecordWriter instance max_queue_size: Integer. Size of the queue for pending bytestrings. flush_secs: Number. How often, in seconds, to flush the pending bytestrings to disk. FN) Ú_writerÚ_closedÚqueueÚQueueÚ _byte_queueÚ_AsyncWriterThreadÚ_workerrrr Ústart)r Ú record_writerr)r*r r r rˆs  z_AsyncWriter.__init__c Cs0|j |jrtdƒ‚|j |¡WdQRXdS)z4Enqueue the given bytes to be written asychronously.zWriter is closedN)r r5ÚIOErrorr8Úput)r Ú bytestringr r r r/¡sz_AsyncWriter.writec Cs8|j(|jrtdƒ‚|j ¡|j ¡WdQRXdS)z…Write all the enqueued bytestring before this flush call to disk. Block until all the above bytestring are written. zWriter is closedN)r r5r=r8rr4r()r r r r r(¨s  z_AsyncWriter.flushc CsF|jsB|j0|js8d|_|j ¡|j ¡|j ¡WdQRXdS)z@Closes the underlying writer, flushing any pending writes first.TN)r5r r:Ústopr4r(r1)r r r r r1³s  z_AsyncWriter.closeN)r3r)rrrr2rr/r(r1r r r r r$…s   r$c@s(eZdZdZdd„Zdd„Zdd„ZdS) r9z;Thread that processes asynchronous writes for _AsyncWriter.cCs<tj |¡d|_||_||_||_d|_d|_t ƒ|_ dS)aCreates an _AsyncWriterThread. Args: queue: A Queue from which to dequeue data. record_writer: An instance of record_writer writer. flush_secs: How often, in seconds, to flush the pending file to disk. TrFN) rÚThreadrÚdaemonÚ_queueÚ_record_writerÚ _flush_secsÚ_next_flush_timeÚ_has_pending_dataÚobjectÚ_shutdown_signal)r r6r<r*r r r rÁs z_AsyncWriterThread.__init__cCs|j |j¡| ¡dS)N)rCr>rIr)r r r r r@Ôsz_AsyncWriterThread.stopcCsÊxÄt ¡}|j|}d}zdyH|dkr4|j d|¡}n |j d¡}||jkrNdS|j |¡d|_Wntj k rxYnXWd|rŒ|j  ¡Xt ¡}||jkr|jr¶|j  ¡d|_||j |_qWdS)NrTF) rrFrCrrIrDr/rGr6ÚEmptyÚ task_doner(rE)r ÚnowZqueue_wait_durationÚdatar r r ÚrunØs,         z_AsyncWriterThread.runN)rrrr2rr@rNr r r r r9¾sr9)r2rr6r rrZtensorboard.compatrZtensorboard.compat.protorZ(tensorboard.summary.writer.record_writerrrHrr#rr$rAr9r r r r Ús    X9