Telling labourers exactly what to do (i.e. build THIS building) doesn't fit KaM. The economy is indirect control, you don't tell anybody exactly what to do. I think some way to increase control over labourers might be worth trying, previously someone suggested making "labourer teams" to work in different parts of the village at once. The suggested here of choosing which tasks each labourer is allowed to do is another possibility.
The problem is all of this requires more micro management of your economy/labourers which takes more time, and IMO you already don't have enough time in fast paced multiplayer games. While it might be nice to have more control over your workers so you can do things more efficiently, I think the simplicity of the current system is nice thing compared to other games where you have to manage all of your builders by hand.
I mean if we added this people might ask to control what serfs do with more detail, and suddenly you spend most of your time poking your citizens to make sure your economy is running efficiently. I like the idea of just letting the villagers do their own thing and the simplicity of the control of construction.
Just something to keep in mind, increased control isn't always a good thing.
Well personally I find the 'roads have higher priority' thing very disturbing and this could be a solution.
It has always been like this in KaM though, and I never found it too frustrating. To me it feels like part of KaM, you have to stop ordering roads at some point and let the labourers do the building. Sure it's more efficient if you control it in more detail, but efficiency doesn't necessarily make the game better.