What kept him from remembering what it wasThat brought him to that creaking room was age.

The author is saying that the man is old and isolated effecting his mentality.