More than a third of a breeding colony in Antarctica has been lost over 20 years.