Differentiating with Depth and Complexity