Remove all grammatical flaws from this sentence
It doesn't attack me straightway but assaults me when I forget its existence, doing my homework.
It doesn't attack me directly but assaults me when I forget its existence while doing my homework.