Do I have to transfer the indefinite leave to remain stamp to my new pport to travel abroad?

I have indefinite leave to remain and was given it on an A4 size paper(because my old pport expired when Home office issues the stamp). I just had my new pport recently. I just wonder can I use my new pport(no stamp on) and an A4 size paper(with stamp on) to travel abroad. Do I have to transfer the indefinite leave to remain to my new pport to travel abroad. Thank you!