A TensorFlow tip to Optimize your Training

Originally posted here.

💡 #TensorFlowTip

Use .prefetch to reduce your step time of training and
extracting data

• overlap the preprocessing and model execution
• while the model executes training step n the input pipeline is
  reading the data for n+1 step
• reduces the idle time for the GPU and CPU

See the speedup with .prefetch in this image. Try it for
yourself
here.

Speedup with .prefetch