This is the first image I found where the second generation Richmond House is gone. I think what we see at the house's site is a fence around (possibly) an excavation site for e.g. cellars. The steel rig around the flagpole is still there. A detail is shown below:
Photo uploaded with kind permission by Christian Engl from his website.
