Sure. Lots of people do this playing along with YouTube videos or MP3s.
That's one of the reasons that some amps have the inputs for your iPod, etc.
Now, let's listen to the old fogies tell us about wearing out 45s and LPs on their record players doing this back in the good oi' days.