Virtual racks and virtual quandles are nonassociative algebraic structures based on the Reidemeister moves of virtual knots. In this note, we enumerate virtual dihedral quandles and several families of virtual permutation racks and virtual conjugation quandles up to isomorphism. We also classify virtual racks and virtual quandles up to order 8 using a computer search. These classifications are based on the conjugacy class structures of rack automorphism groups. In particular, we compute class numbers of holomorphs of finite cyclic groups, which may be of independent interest.