Have you been/have you ever been

Yes, there is a difference.

Have you been punched in the face? is more immediate, as in what the hell happened to your face?

The inclusion of the word 'ever' is asking just that... has it ever happened to you.

Look up the use of "ever" to understand more fully.