Do hornets hold a grudge? Do they have memory?

I just killed one hornet with rolled up paper. It took a surprising amount of time, you need to do many follow up strikes to subdue it. I thought I had dealt with the problem, but immediately another hornet appeared. I tried to the same but wasn't quick enough on the second strike. It started chasing me. Now I have barricaded myself in my room and I'm too afraid to go make lunch.

What should I do?

This is the 3rd hornet that has entered my cabin today. There's probably a nest in the wall.