The option's configuration window does not open anymore after adding and removing the option

When I add an additional setting and then remove it again and then open the “Add Additional Setting” window again and then click on the same setting from before then I expect the setting configuration to reappear but it does not.

Parent Task: #11654 (closed)

Original created by @segfault on 11312 (Redmine)