Grantaire, in this case, is the one who runs out of energy first. Between the practice he'd been doing before Sagramore entered and the fact that he hasn't been doing much in the way of physical activity¹ since arriving, he starts to flag. He steps back and holds up a hand. "Give me a moment."

¹.... You know what I mean.