I think that's going to be a charset problem. Can you view source in your admin and then in one of your store pages and see what you have for each? They should be the same.
Yeah that looks like the issue. So the cart code is using html4 charset yet my frontend is using html5 or UTF8. What is the steps to being the cart code inline and remove that icon?