Former Vote Leave chief thinks impact of no deal more significant politically than economically