For Visualforce pages, you can refer to this knowledge article

For Lightning communities, you can refer to the community templates documentation

Important note for troubleshooting favicon issues:

1. Ensure that the favicon is referenced properly.
2. Using your browsers developer tools, under the network tab, validate the above.
3. Include this information in your post.

Reference on using the network tab for Chrome.