Something that I don’t think has been mentioned is the roughness of the tool rest. It would be next to impossible to glide any tool smoothly along such a rough surface.
View attachment 60885
I don’t think that lathe owner’s manuals ever mention that the tool rest needs to be dressed both flat and glass smooth. Start with a file laid lengthwise on the rest and clean up all of the roughness as well as getting the edges rounded over. Next, use silicon carbide sandpaper progressing through at least 600 grit to polish the surface. Finally, use paste wax to minimize friction.
Based on the torn grain that I see, I suspect that the SRG isn’t as sharp as it needs to be which generally leads to applying increased pressure to force the tool to cut. It’s also possible that you are using the tool to scrape rather than cut.