Quoted By:
OP I've done this lots of times. You can't get rid of them if you don't find the nest. Yellow jackets and hornets make nests two ways: one is to build a nest up in the air, and other is to occupy a stone wall or similar outcropping and live safely in the caves and tunnels.
Only once I had to destroy a nest up in the trees, which involved lifting a jug of gasoline up on a long tree limb and dousing it, and then quickly lifting a burning rag up to immolate it. Yes they flew around angry and crazy for a minute between, but the dumb fuckers literally fly back to the burning nest and die in a fire.
The second way I've done many times - get pic related. Stuff a rodent smokebomb into their hive entrance and drop a heavy rock on it. They sometimes have other exits but don't worry, they'll all die in there. They don't abandon the nest and they'll get smoked to death in seconds.
In the ~5 times I've done this I only got one sting on my arm. But you have to find the nest, otherwise you have no chance.