When we load a custom font from CDN or download a custom font and upload it as static resource, it will work.
However we had one handmade font for us which doesn't work for some reason. It will work fine with random HTML/CSS page, so the issue is only with Visualforce page displaying it.
Are there some Force.com limitation when it comes to very custom font files? Everything is in WOFF format.