This is Part I of Block Relaxation Algorithms in Statistics. It discusses Block Relaxation and Augmentation Methods.