Check the object that was matched
A map point, polygon and street address may identify different objects. Save the source geometry and join rule. When a flag falls near a boundary, ask whether the relevant feature intersects the parcel, the building or only a search buffer.
Source 1