Not to be a pedantic ass, but it’s seldom the person or their life we envy, it’s a particular result. Say, some guy sold a million books, but his marriage sucks and he’s an obnoxious jerk. His marriage and his personality have nothing to do with “why” he sold a million books.
Realizing we wouldn’t want the other person’s life is equating his/her life to his/her result. Correlation vs. causation.
A more productive strategy would be to identify the “result” we want, regardless of the person’s personality, and figure out the next small step towards it. The attitude that “If he can do it, I can do it” gets better long term result than saying “he sucks/his life sucks/ I wouldn’t want to be him.”