Nonreciprocal Cavities and the Time-Bandwidth Limit