Removal of bathroom lock

[Johninapickle]

I have a thumb turn bathroom lock, positioned below the latch handle, with an emergecy release on the external side. I want to remove it and have released the grub screw on the internal part of the lock, but the whole unit doesn'twant to come apart as I expected. Can anypne help, please?

John :(