Miravelle has answered your title question. Any playable race has a starting village and the scribe there will sell their "Language Primer" for 12 silver. You learn the language on buying it so it never enters your inventory. This means that an Ogre wanting to learn High Elf or a Wood Elf wanting to learn ratonga have an interesting shopping trip.
____________________________
Wherever I go - there I am.