It is infringement although it may
fall under fair use in the United States.
HOWEVER - this answer is FAR from definitive. Best to consult with a lawyer.
You can cite a title and say a song helped you, and even tell your readers to listen closely to the lyrics. But actually printing the lyrics, even just a few lines of them, is far trickier as this book is probably not just for educational purposes (even then, it still might not fall under fair use) because it is for profit. Even if you give all your profits to charity, you might still not be in the clear.
American copyright law (I cannot comment on the law in other countries) falls under Federal and is constantly changing. If you really want permission, you'll need to get it from whoever owns the copyright. E. g. the writer(s), the record label, etc. In the case of an artist who has died, you may need to deal with their estate. Complicated but not impossible.
I don't want to discourage you from writing, but I also don't want you to get sued.