There are several caves on the waters edge at Blackfellows Caves formed by the sea eroding into the rock cliffs made of limestone. One cave has a flat rock visible at low tide, within the cave. It is said that the roof of the caves have smoke damage from fires lit by the Aborigines who hid in the caves. The area is named Blackfellows Caves as legend has it that in the days when the first settlers hunted the Aborigines, who often speared sheep and cattle for food, the Aborigines would run out to the point, dive into the sea and swim into the caves to hide. Along the coastline along either side of Blackfellows Caves, campsites where Aboriginal people lived were common, however wind and erosion, clearing and stocking and natural causes have covered, ruined or hidden these sites.
The Caves, as it is often locally referred to, produced a good quantity of flint pebbles along its coastline. Generally four-wheeled wagons were used to cart the bags of pebbles, as it had been learned by experience that 2-wheeled drays were too easily tipped over on the unmade tracks. At one time, Council banned the movement of these wagons over some tracks as they damaged them so badly, other vehicles could not use them. With the advent of pneumatic tyres, roads were improved and transport was made easier.
Blackfellows Caves provides anchorage for several cray fishing boats.