A normal adult dreams about 25% of the night, and during sleep, the time inside the dream may be many times faster than reality, as presented in the movie Inception. That is because what's the point of dreaming if you think about it? It's to train the brain! So the faster, the better. 5 mn of physical time equals about 30 mn to 1 h of dream time.

So if you'd “remember your dreams” as you believe, you'd be totally flooded by unreal memories of dreams many many times the small amount of real life memories, and that would drive you crazy and probably would kill you pretty fast, by confusing dream and reality. So no, you don't “remember your dreams”.

What happens is that often, you remember some dreams. That happens because the phenomenon of sleep is complicated, and the forgettery process doesn't align 100% with the dream state, in your case. It's not a big deal. Unless you make it a big deal, like when you think about it and when it gives you a bad feeling about the future. Nothing can be more wrong than that.

You have to understand that your dreams have to be bad, otherwise they wouldn't be useful as a training. And then they have to be forgotten, because they're unreal and memory is there for remembering reality.