Apparently the AllowSave only works if the duplicate rule is an Alert rule, not a Block rule.
When you try to save a record that’s identified as a duplicate record by a duplicate rule, you’ll receive a duplicate error. If the duplicate rule contains the Allow action, an attempt will be made to bypass the error.
