It owes its name to the Chapel of La Soledad located in the same square. The chapel, also known as the Chapel of the Venerable Third Order and dating back to 1695, is attached to the current Church of San Pedro, which was part of the Franciscan Convent existing in this place. In the preserved dependencies of this convent, the Provincial Museum is located.