HMRC have now changed VAT penalties so that not only are you charged for late payment of VAT but you are now charged for the late submission, please see the following link for full details:- VAT penalties and interest – GOV.UK (www.gov.uk)