The only royal palace on U.S. soil has been a territorial capitol, a military headquarters, and a prison for a queen.