I shall explore various senses in which ultrafinitism can be fruitfully understood as engaging with a potentialist perspective in mathematics. First, I explain that every model $M$ of the theory of finite arithmetic -- arithmetic with a largest number, in which addition and multiplication are merely partial functions -- is bi-interpretable with a strictly taller model $M^+$, in which the arithmetic operations on objects taken from the original base model $M$ are totally defined in the extended world $M^+$. More generally, I explain how ultrafinitist ideas emerge in the modal potentialist system consisting of all models of arithmetic under end-extension.
