As a Muslim who, God willing, still observes prayer, I think this is a foolish opinion and just seeking justification. It's as if praying means you don't pursue the world or are even harmed by it. Indeed, life is full of struggles. It's hard to get rich, hard to be poor, hard to be handsome, or ugly.