Using version 0.2.1. Seems to work fine at every other point.
using TaylorDiff, ForwardDiff
hmm(x) = x^2
ForwardDiff.derivative(hmm, 0.) #0.0
TaylorDiff.derivative(hmm, 0., 1) #NaN
ForwardDiff.derivative(hmm, 1.) #2.0
TaylorDiff.derivative(hmm, 1., 1) #2.0