High charges can act as a drag on your portfolio’s performance