You should definitely try. Most people fear the first few minutes until they get acclimated to breathing under water and if you have a good instructor/dive master they will slowly help you get over your fear and calm down. Who knows, you may end up loving it.