Is it possible to query fields like CreatedById on a custom metadata type record? Evidently not, but apparently I should be able to?!

SELECT CreatedById from MyObject__mdt   

No such column 'CreatedById' on entity 'MyObject__mdt'

We can see the field on the object and strangely it can even be referenced in a validation rule.