Many workers say they are being made to continue doing non-essential work, despite government advice.