Cleaning Old Gravestones. Some care must be taken when you go to clean old gravestones. You must also take in consideration the type of gravestone used too.