Simple (?!) Vat Invoice query

I have received a couple of invoices from a supplier and have just noticed they have not included their Vat registration number on the invoice.

I know for a fact they are Vat registered.  Presumably I need to ask them to Credit our the old invoices (oldest one dates back to early 2010) and raise new ones including the number?