Correct bug in the inverse operator optimisation code which caused segv on ! without a following expression.