Neural Network Explanations: Where the Model Looks for a Pulse and Whether to Trust It
A treasure map drawn by a neural network promises to show where the gold is buried. But if you take that map to another island, the marks may point to nothing. That is exactly what happened with the explanations from a model that estimates pulse from facial video.
The RhythmFormer neural network picks up subtle color changes in the skin caused by heartbeats.