Some are hollow and some are full rock. There are certain rocks that will float, volcanic pumice is one. It floats because it is sort of like foam rock and its density is less then water
.
.