To make an already bad, unpleasant, or difficult situation even more so. (Sometimes used as an independent clause in the infinitive form: "to make matters worse.") I heard that Julie is being let go from her job, and to make matters worse, she hasn't been there long enough to qualify for severance pay! Breaking up with someone is always very difficult, but don't go making matters worse by doing it in a very public place.