We describe all the holomorphic Hermitian vector bundles (E, h) over the upper half plane in ℂ with the property that (f* E, f* h) is holomorphically isometric to (E, h) for any holomorphic automorphism f of the upper half plane. We give an explicit construction of all such holomorphic Hermitian vector bundles using some linear algebraic data.