It sounds to me like the device settings or video driver settings.
You have to look at the device settings to make certain it is on video composite and not for example S-Video. It will also be the same for the audio.
I have done a guide on my blog that shows how to edit music videos. It has a section on recording from VHS too. You might find it helpful too.
Music Video Editing