What is the irony in the fact that Jean Valjean broods over the address he finds carved in the garde

What is the irony in the fact that Jean Valjean broods over the address he finds carved in the garden wall and his decision not to tell Cosette about it, as we see in Victor Hugo’s Les MisĂŠrables?