Confucius refers to Confucius, who is a thinker and educator. There must be many books at home. So, if he moves, what he moves must be a book. So use this two-part allegorical saying to take the homonym of "book"-"losing" to describe the result of gambling or competition as losing.
Second, this sentence comes from two-part allegorical sayings in idioms and has a long history.
Confucius (English: Conficius, 55 BC1to 479 BC), whose real name was Zhong Ni, was born in the late Spring and Autumn Period in China, and his ancestral home was Lu (now southeast of Qufu, Shandong, China).