Look at Elizabeth and Jack: Polar opposites (wealth, privelege, morals, etc), but similar enough (morals 😉, love of freedom and adventure, etc) to annoy each other.
If you look at all the scenes between Elizabeth and Jack, she spends most of her time being annoyed at, irritated by, or angry at Jack. It's what makes them sizzle and sparkle on-screen.
Same with James and Jack. Norrington and Jack are polar opposites, and yet so similar it's annoying to both of them.
The annoyance, irritation, anger....oh yes, that is a great build up to a pairing between them. They both have a longing to have someone love them...why not each other?
I like Norrington/Will together (especially if Sparrabeth is involved -- excellent reason to hook them up), or Will/Jack....
Or honestly, I like Jack/Will/Elizabeth, Will/Elizabeth/James, Will/Liz/James/Jack, and of course, Jack/James/Will (hello, three-way swordfight!).
It's just personal preference. I'm not any more right than you are in LIKING a pairing. 😄
I just don't take the relationship thing seriously enough to actually try to defend N/J, or any other slash pairings. 😄 It's all good fun for me.
I don't mind J/E, but I like W/E more. *shrug* Go figure.