If I understand you, you are learning to read from a score? Have you seen this forum?
http://classicalguitardelcamp.com/
There is a lot of talk there about learning to sight read and play from a score and many threads mention staying in one position for years, sometimes, before moving to the rest of the fretboard.
I see this as something like learning to type. Once you understand the symbols, it's then a matter of seeing the symbol, the note on the staff, and going straight to a position that plays that note on the fretboard.
I used Musescore to create simple exercises for myself to practice, so that I'd learn to associate seeing the dot with directly placing my finger on the fret. No translation of note names in the middle. Seemed to work so far, but, yes, slow.