From http://www.kenthistoryforum.co.uk

The "Admiral Elliott" opened in the 1870s as was named after Admiral Elliott who was returned to Parliament in 1874. Whether this Elliott was any relation to the Elliotts who had a factory up near Rochester airport in the 20th century I am unsure.

The Ancient Order of Prussian Hermits began in Prussia in 1801; the first hermitage in England was founded in Canterbury a few years later. In the late 19th century it was used as a meeting place of the 68th Hermitage of the Ancient Order of Prussian Hermits. There were said to be 200-300 members locally and the excess of weekly contributions over benefits paid out was £26.

I believe it closed in the late 1990s or early 2000s and has now been converted to flats with the name Admiral House.