To attack one in the area that is most vulnerable or that will result in the most harm. Usually does not refer to physical violence. By questioning his parenting, Gina hit Ken where it hurt most. The best way to take down the cartel is to hit them where it hurts most—in their bank accounts.