I've done a bit of research since posting.
I think tax should be deducted from the interest element because it isn't savings interest, but the interest payment is covered by the personal savings allowance so it may be possible to reclaim all/some of the tax deducted.