I have found to my delight that there is now a standard map component. However, it is apparently not enabled for my org.
How do I enable them? Is this feature still in beta? All the listed features claim availability as of API Version 32. I did not see anything in the docs and although I found out this feature cannot be used in a Developer Edition, I am not using one, so that does not apply here.