I would also check your contract with the agency and its advertised services - if they promised you they would check for/verify vaccination status and didn’t, they should be willing to bear any costs and inconvenience of finding you a new nanny who does meet those standards.
Assume you live in...