Ok, tried that as well, same "bug": the plot area only stays in place with x-axis labels off.
So maybe just go with Textbox Labels?