Ok, firstly which is your gemini? Is it your outside or inside leg which is hooked on to the pole?

If it’s the outside one, I’ve struggled with that one too and can only do it if I pull my top up so my belly and sides are uncovered. that way you get the side gripping, it just provides an extra point of contact. Also make sure the pole is right in the crook of the knee and try to point the lower leg downwards