Yeah, you insert the yellow (video) cable into its normal slot on the tv, then the red and white (audio left/right) go into your hi-fi. I have a tv-out graphics card on my pc and do the same thing.
However, if your hi-fi has a digital in socket you'd be better off getting a digital cable and...