I created a login form at my domain xyz.com, now user enters salesforce username and password on form residing at my xyz.com, if credentials correct redirect user to salesforce dashboard otherwise flag error message.
FYI - I am following this tut but not sure if I am on correct page
https://help.salesforce.com/HTViewHelpDoc?id=remoteaccess_authenticate.htm