Problem with the phone being off and charging

So, i have a issue when the phone is completely off. And it's when i plug in the charger the screen turns on with the charging animation and then

This pops up (Not my screenshot, found it on a reddit thread with the similar problem)

Now the question i have. Is there a permanent fix for it? I know if you hold the power button with volume up at the same time it'll start up after a while. But i'd just like my phone to start when i hold the power button.

Thanks in advance!

Edit: I propably should've posted my ROM and such. I'm using the stock ROM from a german forum named handy-faq. The reason for that is because i accidently wiped my original rom when i flashed a custom one.