My original question here was in a sandbox environment, and we determined that the SVG's wouldn't render in community builder, however once published the icons showed up as required.
Now I've got the same community in Production, and Published, and I'm seeing the same error again - this time the published site is showing the error as well.
I'm assuming this is a bug? Is there anyone else seeing this, or does anyone have a workaround?