Supplier that won't a provide VAT receipt

[Amateurish]

I've had exactly the same problem with double charging for equipment - once on the debit card and once to the account. This happened last November. Numerous phones calls and emails have not solved the issue.