@tintin,
It's not wrong but doesn't follow the strictest grammatical sense that might make it clearer. However, the fact is that caffeine is an inanimate object. A person is unlikely to use 'whose' as modifier.
For a more clearly understood phrase, I suggest:
"they are potentially detrimental to caffeine-sensitive people , whose ..."