The South African Revenue Service building in Pietermaritzburg was evacuated after an anthrax scare on Friday morning, KwaZulu-Natal police said.