Saints say it's been tough to relax after poor start