This is Part III of Block Relaxation Algorithms in Statistics. It discusses various mathematical, computational, and notational background topics.