You can have negative labor points, if you reach a certain level you can start jobs without having the required skills, resulting in a negative amount of labor points. You can hover over the job icon on the map to see if your labor points are positive.