It's completely safe but you have to carry more layer as the temperature there is approx.-17 in December so just careful about your health other than I really recommend to go spiti during winter as it is less crowded and you can enjoy the white blanket view over the Spiti valley. But make sure to choose shimla- kaza route.