You probably need a new battery. How old is the battery? When there's heat due to overheating, that's a really bad sign. Maybe there's a problem with the charger?
Typically the battery has a lifetime of about 3-4 yrs, unless something is causing it drain prematurely. That can vary, depending on how often you allow the screen to stay on or allow applications to run in background.
Something is causing it be closer to the end of it's life...either age..or something in the phone is draining it beyond the norm.
After turning of my phone for few hours i notice that the temperature of battery did not cood down
If it's not cooling down after it's been off, you need to bring it a repair place or change to a new phone.
If you're in USA, I'd say the best thing would be to bring it to an telephone electronics store..or wherever you bought it and have them fix it. For example, in my case, my carrier is Verizon where I bought the phone so I'd go to a Verizon store and get it fixed.