I just sand them down with a high enough grit paper to burnish the wood and leave it without finish. I never wanted to damage the "red velvet" in the middle layer by applying a "wet" finish, although I must admit, I never experimented to see if a wet finish would actually damage the fuzz.
Joe