You need to separate your modal from your Lightening Component. Create another Lightening Component with the modal only. So have your first component with the overlayLib call the new modal component. Now it will pop up in the middle of the screen on your mobile. I've spent hours trying to get this work with the embedded modal on the same component, but this is the only way it will work on the salesforce mobile app.