Belonging to the Myoshinji school of the Rinzai sect, the temple is said to have been founded in the Ashikaga period.

On the temple grounds, there are the graves of Jirocho Shimizu, the “ruffian of the Tokaido,” his aides Oomasa, Komasa, and Masukawa Sen'emon, and his wife Ocho, whom he loved throughout his life.

The “Tomb of Jirocho the Chivalrous” was written by Takeaki Enomoto, a former shogunate retainer who later served as Minister of Communications in the Meiji government.

He was the only chivalrous person in Japan to have a bronze statue installed in recognition of his life’s service. The first bronze statue was given away during the Pacific War, and the current one was made by Tatsuo Tsutsumi in 1952.

The stone wall behind the statue represents Sunpu Castle, and the pond in front represents Suruga Bay, which shows the spirit of Jirocho who put down roots in his hometown Shimizu.

The Jirocho Museum displays relics such as a crystal ball presented by Katsuzo of Kurokoma, a Bishamonten amulet travel sword (dochuzashi), a clock, a telescope, and a matchlock gun.

The temple was founded in the first year of the Meio era (1492, in the Ashikaga period) by the monk Tenrin Domyo, a disciple of the monk Tokoku.

The temple was first named Baiin-an and became vermilion-seal land of the Takeda family during the Eiroku era; the old documents still survive today. It was later renamed Baiinji Temple.

In the Keicho era (1596–1615), the halls and treasures were destroyed by fire. The temple was later rebuilt, but all the halls collapsed in the Great Ansei Earthquake.
In the 36th year of Meiji (1903), the present main hall was rebuilt under the 14th head priest, Mankyu. (From materials for general visitors)