Turns out, you don't need to clear the named from the area with the scroll. Hug the wall on the other side of tsscroll and move the camera angle so you can see the end of the scroll. You're close enough you can collect it without haveing to kill any of the Ry'Gors.