How to reset xlabel attribute of an edge?

I’m setting the xlabel of an edge with the function agsafeset. Later, I want to change the value of this attribute. Calling agsafeset again with a new value has no effect.

Can you share some small code that repros the problem?