Don't merge within a merge.

{!URLFOR(\'/{!getLoggedInUserContact}\')}
            ^^       redundant      ^
^^    you are already within a merge    ^

Also, unless you named some method getGetLoggedInUserContact, you should remove get from the property name.

Also, you need a concatenation operator (&).

Putting it all together:

finishLocation="{!URLFOR('/' & loggedInUserContact)}"

Although it would be better to use the more standardized $Action global variable:

finishLocation="{!URLFOR($Action.Contact.View, loggedInUserContact)}"

Don't merge within a merge.

{!URLFOR(\'/{!getLoggedInUserContact}\')}
            ^^       redundant      ^
^^    you are already within a merge    ^

Also, unless you named some method getGetLoggedInUserContact, you should remove get from the property name.

Also, you need a concatenation operator (&).

Also, you don't need to use URLFOR if you are constructing a literal url.

Putting it all together:

finishLocation="{!'/' & loggedInUserContact}"

It would be better to use the more standardized $Action global variable:

finishLocation="{!URLFOR($Action.Contact.View, loggedInUserContact)}"