Do we dream everytime we go through REM sleep?

Short answer: Yes... rapid eye movement occurs when there is a lot of activity in the brain... namely, dreaming.