I had Green Stuff pads in the 164 calipers and found exactly the same... If you trail on the brakes, they soon start to fade. Once I started to stomp on them and get off quickly, I didn't have an issue.
As John mentions above, now that I've changed to Hi-Spec, it does highlight how much of a compromise the 164 brakes are.
Andrew

