Dueling question when you're townless

Hi all,

I've been without a town for about 4 days now (joined one to buy some things and then left) but players are still able to duel me. Is there a period of time that needs to pass before they can't?
 
Top