Vejer de la Frontera is one of the nicest and best conserved white towns in Cadiz province. This lovely town is situated on top of  a peak 200 meters over the sea with a strategic location near the highly valued entrance from the Atlantic Ocean to the Mediterranean Sea called the Pillars of Hercules, and the Barbate river which was a highly crucial trading point thousand of years ago. The river today is almost dried out.

This unique town was founded by the phenicians 800 years B.C. and was by them named Besaro. After the town foundation thousands of years of history passing from one empire to another takes place. After the empire of the phoenicians the town was taken over by the carthaginians, the ancestries of the phoenicians up to the Roman empire conquest in 300 B.C. The Roman Empire called Vejer de la Frontera for Bessipe and governed the town until the 3rd century. After the fall of the Roman Empire the Visigodos took over until the 6th century when the Bizantinos took over and until the Visigodos once again took over the town in the 7th century. In the year 711 the Tarique Musulmans Empire conquered the empire of the Visigodos King Rodrigo and took over the town and named it Bekkeh. They governed Vejer de la Frontera until 1264 when the Crown of Castile by King Alfonso X «The Saint» conquested the town once again. The town was first named Vejer de la Miel (Vejer of  honey) due to the lovely honey that was produced in the area however it later was changed to Vejer de la Frontera (Vejer on the border) to indicate the border between the christian and muslim territory which was pretty blended during this period.

After the christian conquest of Vejer de la Frontera Alfonso Pérez de Guzmán also called “Guzman the good one” governed and protected the area. The dukes later known as Dukes of Medina Sidonia was ancestries of Alfonso Pérez de Guzmán and had a big part of the later history of the area during the Spanish colonization of the Americas.

Due to an incredible love story between a muslim emir named Sidi Ali Ben Rachid and a Spanish woman from Vejer named Zhora, the Moroccan town Chaouen was built. After leaving Al-Andalus heading to Morocco after the christian conquest of Vejer, Zhora missed her hometown. Sidi Ali Ben Rachid, wanting to cheer up his wife, created a town based on the design of Vejer. This way his wife could feel once again at home. This is why Chaouen is a copy of Vejer in the middle of Morocco.

In 1811, after several military movements between the British army led by Nelson, the Spanish and French army close to Cape Trafalgar, the French army led by Napoleon tried to conquer Vejer. However they failed thanks to successful campaign lead by the general governor José Miranda Cabezón in Vejer.