@oristarA,
Yes, if you are using the word directly to mean as at once, or without a delay.
We can take "literally" as in a literal manner or sense or exactly as what is being described, or word for word.
literally
lit·er·al·ly
adv.
1. In a literal manner; word for word: translated the Greek passage literally.
2. In a literal or strict sense: Don't take my remarks literally.
So some of the congregation left the room of national gatherers right after he mentioned his beliefs regarding the theory of evolution.