Rewatched the season 4 episode where Beth got taken. No one took the warnings down; they heard them clang and the walkers went right through. So, new theory:
Plenty of time has passed since the "Clear" episode of season 3; I wonder if the stash was Morgan's, and that's how he was able to start tracking them, to Terminus and beyond.