tf.contrib.distributions.Exponential.entropy()

tf.contrib.distributions.Exponential.entropy(name='entropy')

Shanon entropy in nats.

Additional documentation from Gamma:

This is defined to be

entropy = alpha - log(beta) + log(Gamma(alpha))
+ (1-alpha)digamma(alpha)

where digamma(alpha) is the digamma function.