I have a button on opportunity record page which calls a flow, I want the flow to be accessed by specific set of users and no other user should be able to run the flow except admins. Is it possible? I don't want to change the profile settings.
Yes it is possible. You can create a custom permission and assign it to permission set. And on the opportunity record page you can control the visibility of the button using dynamic forms based on permission set.