`validate_xml_label` responsible for 12% of parsing time

[KaruroChori]

And in many cases it might be undesirable to waste that much performance for what is just validating XML.
I already improved it a bit reclaiming around 3% back from the baseline, but it should be possible to disable it with some flag I guess.