This breaks on Python >= 3.11, since typing_extensions is not required to be installed in that scenario.

Originally posted by @jakob-keller in 74554c2