can you lower affection in pokemon amie?

pic related i want that shitty thing to hate me, even though his "friendship" level is at the lowest (frustration doing nice damage), in amie that thing still likes me.