Just drill some holes around it so that worms have access to the scraps in the ground.
Remove all the soil in the pipe and bury them deep covering all the worm holes. Cover the pipe with a cover ( you can use an overturn pot) but I use a proper pipe cover bought from hardware store.
I made a slightly taller one here. You can keep adding kitchen scrap into the pipes. Don't forget to cover it otherwise you will have maggots crawling around.
So now I have pipes all over my raised bed, and I can just keep adding new scrap into the pipes. My worms are fed, and I don't have to collect the poop and pee, it goes direct to my plants. Save my time!