We consider leaf preserving maps between manifolds equipped with Riemannian foliations. We construct a transversal tension field for such maps. Then we introduce the notion of transversally harmonic maps. In the last section of the paper we present some examples of transversally harmonic maps.