What legal rights does a traffic census have. For instance, hypothetically, if you were stopped for a traffic census and then you told them that you are on the road at 6.30 am because you have to get to work not to fek around with idiots, then drove off. Would the driver be in trouble?

No. As long as you are civil.
You do have to stop for the copper though, then you can drive off. No obligation to stop for the census man.

sooo
I am not the only person they have pissed off

Nope, for everybody who's pissed off answering the questions at the side of the road, there's also a whole heap of people who are pissed off answering the same questions on PH every week.