Right now you can enable or disable the google maps feature by going to
Customize > Maps and Locations > Settings -> Enable Maps and Location Services
This will either enable or disable for all objects.
I don't see an option to disable for some objects/page layouts.