I wouldn't worry about it. In 36 years of playing and multiple learning sessions with world class instructors my pinky has never come up once. And it does some weird stuff at times.

Is your wonky pinky preventing you from being musical? If not, cut yourself a break because really imo being musical is the one true goal.