We study noncommutative probability spaces endowed with infinite sequences of states. Following ideas of Cabanal-Duvillard we extend the notion of conditional freeness. Free product of such spaces is justified by constructing an appropriate ☆-representation. Finally, we provide limit theorems and describe the sequences of orthogonal polynomials related to the limit measures.