Shunjiang Building was first built from Yuan Dynasty to the first year of Yuan Dynasty (1335). It was designed by Ye Heng in Yuyao, and was called "Drum Tower" by the people. In Ming and Qing dynasties, Shunjiang Tower was rebuilt many times due to disasters. The existing building was rebuilt in the 11th year of Guangxu reign in Qing Dynasty (1885), and a bronze bell was placed upstairs for both time telling and fire alarm. In 1985, Shunjiang Building underwent another overhaul, and the calligrapher Mr. Sha Menghai inscribed the plaque "Shunjiang Building". In April 1995, Shunjiang Building was named as one of the first patriotic education bases by Yuyao Municipal Party Committee and Municipal Government, and was listed as a provincial-level cultural relics protection unit in Zhejiang Province in 211.