It is rather unremarkable, unimportant, or unimpressive (that something is the case) relative to someone or something else or some broader picture. True, the economy has improved under this president, but it's hardly saying much if you consider how his predecessor left things. A: "So you are a better cook than your wife, who hates cooking?" B: "Yeah, I know, it's hardly saying much."