Robes for Rags

I'm really thankful that the Lord doesn't just leave us to our own demise. He embraces us when we're filthy and willingly trades His robes for our rags, His righteousness for our stench.
So what's the catch? He won't force us to hand them over. He simply and patiently waits, gently prompting but never forcing, until we're ready.
Why don't we hand them over more willingly? Why do we hold onto our junk when we could give it all to Him and walk in complete freedom?