I have followed the https://developer.salesforce.com/page/Open_CTI documentation and updated the softphone url to reflect the current org domain.
Added users to manage calls.
Now I can see call icon besides the phone field but that is in disabled mode. I am also logged in the softphone.