Maybe they used to, but nowadays every named former cop or criminal turned villain/vigilante can fight relatively on par with the Team Arrow guys, like that crazy Cupid woman, or Danny Brickwell. Which is a great example. Malcolm absolutely wrecked Brickwell when they fought S3. Oliver schooled Malcolm in their sword fight in S4, but then had very, very serious trouble dealing with Brickwell when he re-appeared in S4. The tiers and fighting are terribly inconsistent, and all over the place. The quality of the choreography itself has, on average, gone massively downhill as well. Honestly, I'd take S2 Matt over S4 Oliver at this point.
However, Ra's was on Arrow before the quality downgrade, so I will judge him based on that. At which point he was arguably the best combatant on the planet, with Oliver barely managing to beat him in a hard fight, and only after getting elite personal training from Ra's himself. So, at that level, Ra's should be above Daredevil. So I say Ra's in both, but Matt is fast, skilled and agile enough that Ra's will have to put in a bit of effort.