The poll found views toward the five living presidents have fluctuated significantly over time.