Pre-training Preparations