exponentiation - Why does zero raised to the power of negative one equal infinity?

I had the question of $0^{-1}$ on a math test and I naturally assumed that this evaluates to zero, but from what I have seen from various sources it is equal to infinity which I do not quite understand. I would sooner believe that this it is just undefined.