Torreya grandis here should refer to torreya grandis seeds. This is a kind of nut.
Here, giving you a nut to eat should be similar to giving you a head to eat. That means hitting you.
In the twenty-sixth chapter of A Dream of Red Mansions, Daiyu said, "I didn't say anything." Baoyu smiled and said, "I'll give you a donkey to eat! I heard it all. "
It can be seen that Baoyu said that Daiyu lied to punish her. It is the language of banter.
PS: Upstairs means throwing dice, which is different from giving you dice to eat.