From the bridge over the river Merwede can be seen the ruin of the castle of the Lords van der Merwede. There is no longer much of the castle remaining but what does remain shows the magnificence that once stood there. What is left of the 14th century castle has walls over 6 feet thick and a mighty tower with a wicker type overlay on the stone.

There were 2 castles on this site. The first was built in the late 11th or early 12th century. This castle had a tower house in the on the north-east and three round towers on the other corners. Residence buildings joined these towers. It is not certain but most believe this first castle was built by one of the Counts of Holland, Possibly Dirk IV.

The second, and much larger castle was built about 1307 by Daniël van of the Merwede after the first castle was destroyed. This castle remained in the possesion of the Lords of the Merwede until 1403. Daniël VII van der Merwede died in 1403 without a male hier. His oldest daughter Margaretha inherited the castle. She married William van Brederode who then became the lord of the castle.