Are cellphones ever truly off?

In terms of the screen blacking out and the buttons being unresponsive the answer seems to be yes, but they can still receive calls when the off button has been pressed, so that would have to mean that they’re still putting out a signal. Or could I be mistaken?

I ask this because if radiation isn’t actually being minimized if you leave your phone off and I’d like to know.