How to clean rollers And here’s how to get the paint off rollers: Put on a pair of rubber gloves. Use a putty knife or another tool with a similar type of flat edge to scrape paint off the roller.