You can re-do the normal AF quests after you upgrade all of your artifact armor. Pay the guy 10000 Gil in Jeuno to restart the qeusts. And if you're 74+ like the HQ artifact armor requires, you won't have any problem getting your normal AF back.
Does this mean I would have to drop my Whm AF to do this? And since I don't think you have the new +1 AF how do you know you won't have to drop the AF+1's?
Much like how you trade a brown belt to get the rare ex black belt, you trade your 1st AF and items to get it. and like it said above, you can redo the quest for your AF to get it again.