We first prove that any arithmetic subderivative of a rational number defines a function that is everywhere discontinuous in a very strong sense. Second, we show that although the restriction of this function to the set of integers is continuous (in the relative topology), it is not Lipschitz continuous. Third, we see that its restriction to a suitable infinite set is Lipschitz continuous. This follows from the solutions of certain arithmetic differential equations.