This is a common paradox many spiritual leaders face. Without direct experience with them, it can be difficult to fully understand their perspectives.
Often, discussions around “detachment” can be confusing as it may not always be clear what we are meant to detach from. The material world is itself composed of endless desires, so it can be challenging to understand what is truly spiritual.
Instead of figuring out how to get detached, exploring the root of our desires and attachments may be more fruitful. Until we do not figure this out, we need continuous effort for detachments and it is the opposite of “Freedom”
If you are not free from “I” - You cannot become free from all desires. Because desires are always about non-self or wrong identification of self (Ego).
When one becomes free from “I” - his body acts as what is needed, not driven by Individual Ego. We may find devotees of the “Self” surrounding them automagically.
One common approach to achieving freedom from the ego is through self-inquiry, which involves examining one’s thoughts and emotions to understand the nature of the self. By asking questions such as “who am I?” one can begin to see beyond the ego and understand the true nature of existence.
Freeing from worldly desires takes away your individual ego. But this is a difficult task to do, as infinite desires surround the individual. Instead of attempting to free ourselves from such desires, we can observe where these desires arise.
We can do this by a simple “Inquiry”.

For example, If you want to write something, you can ask yourself “Who wants to write?”, this question will take you back to the sense of “I am” because you know who will write.
When you carefully observe during this Inquiry, you will discover that all other thoughts and desires will vanish immediately.
So, all the desires or attachments are related to this “I”, not your true self.