My take on the whole thing is this.
You sign up for what you want to be. If you pick Adventurer, then that class gets certain advantages over the others. Same for Soldier/Dueler and Worker.
The dueler class should just make off better when dueling their class. Maybe 1/2 as well when dueling a Soldier class and only a 1/4 as well in Adventurer or Worker.
Fact is, if you're anything but a Dueler or Soldier, you take advantage of skills/attributes to what makes your player goal to his/her chosen class faster.
Why would I, a Worker class, go and worry about the best weapon?
There should be limitations or at the very least, lowered expectations, if a Dueler goes after something other than a dueler.