It was supposed to be the perfect weekend away