During the Anti-Japanese War in Rehe, Chairman of the Rehe Provincial Government Tang Yulin considered Geng Jizhou as his old subordinate. In order to show his support for the anti-Japanese war, he pretended to appoint Geng Jizhou as the major general commander of the Third Rehe Security Brigade. The brigade has two regiments, each with about 500 people. After reorganization, weapons and ammunition were replenished, and after a short rest, he was ordered to be transferred to Chaoyang Temple in Fuxin County in early 1933. Together with the 107th Infantry Brigade of the Northeast Army, he was responsible for the defense between Chaoyang County and Chaoyang Temple.

Chaoyang Temple is only more than 10 miles away from Heishan County, Liaoning Province. It is the junction area between the enemy-controlled areas and the enemy-controlled areas. For Jehol Province, which had not yet fallen, it was tantamount to a forward position and its strategic position was very important. There is Yangshan Mountain to the south of Chaoyang Temple, which is parallel to Nanling in Beipiao. The terrain is dangerous and it was the first key target of the Japanese army to invade Rehe. After the fall of Jinzhou, the Japanese army made many attempts to invade Chaoyang Temple but failed. It was not until July 1932 that they occupied Chaoyang Temple Station on the pretext of the arrest of a Japanese spy by the Chinese Volunteer Army. However, the land in Chaoyang Temple Township was not occupied. .

After Geng Jizhou troops stationed in Chaoyangsi Township, they actively deployed their troops and recaptured Chaoyangsi Station after a bloody battle. More than 70 enemies were wiped out, a train of machine vehicles was intercepted, and a lot of military supplies were seized. This was the last battle in Geng Jizhou's life that he independently commanded and won.