Would this be a good twist to Harry Potter?

In the final battle with Lord Voldemort, Harry is thrown into a vortex and sent back in time. In the vortex He looses his memory and his form is changed. Some mean people find him and adopt him giving him the name Voldemort. Making him his own mortal enemy. That is why he hates Harry so much he reminds himself on a minor level of himself.