PM refused to take LB to the private chambers Mrs. & Mr. Thatsher shared.  Lord Byron is convinced he could have wheedled his way into Mr. & Mrs. Thatsher's home except that he was excluded from these private chambers because the PM did not want documentation of such a visit to exist.  After all, he had in the past managed to get his paramours to include him in their domestic lives, introducing him to both spouse & children.