Point your index finger straight down at the ground at the bottom of your swing and get your index finger behind the ball at the bottom.  Right now don't worry about if you are turning your hand in your back swing.  As long as you can get back to this position at the bottom before release you should be ok.  The rotation in the backswing could be because of limited motion range in your shoulder, arm, and wrist joints.  I have the same issue. 

This is just a guess.  Post a video and it might be easier for people to see exactly what is going on.

If your goal is to develop a release that involves uncocking the wrist at release ( the "collapse"), I would recommend John P's advice. He explains precisely the mechanics behind it. Be advised however, that in most cases it is very difficult to master. It definitely requires a lot of effort and patience and if you have already developed years of muscle memory with your current release style, it may be impossible to pull off.

In addition ( and not related to the yo-yo release), I use the pit of my elbow ( where my forearm connects with my upper arm) as my reference point throughout my swing as a reminder to stay "behind the ball". I focus on keeping this facing the pins instead of
using my bowling hand (ring finger, etc.)as my reference. Unless you need to roll with zero axis rotation, your bowling hand is going to have to rotate at release, or you are going to have to "pre-set" your hand in your stance to the desired angle (of axis rotation) you desire for the condition at hand.  Leading and RELEASING with the ring finger (or pinky) pointing upward will keep you behind the ball but you will not get axis rotation, if axis rotation is what you desire. By focusing on keeping the pit of your elbow facing the pins, you are now in a position to vary your axis rotation angles by
deploying a slight rotation of the wrist and/ or by pre-setting your bowling hand to the desired angle you wish in your stance ( the wrist rotates without affecting the position of the elbow pit).