The new Christmas Island refugee detention center has come to symbolize what many call one of Australia’s defining fears: the arrival of boat people from Asia .