Right, but that isn't the case with Pai Mei... All we've seen him fight were trained deadly fighters. All the monks he killed were clearly versed in Kung Fu. As mentioned previously, he casually and jokingly dealt with The Bride, who herself displayed superhuman feats. Everybody we've seen him deal with wasn't just your average human. They were trained fighters, deadly fighters, and he casually beat them.