When a UDP packet is encountered traveling in the opposite direction (say inbound), the smarter filter compares this packet against the list of outbound packets it has kept in the other direction.
If the inbound packet has a corresponding outbound packet, the filter assumes that the inbound packet is a UDP reply and the packet is then passed onto our network.