That's cool. Just be safe. It is good to go with someone who has caving experience. Remember to take at least TWO head mounted light sources each. We usually carry three or four head mounted, plus extra batteries and bulbs. And make sure that there is someone who will call 911 if you guys do not return before a set time.
Also, remember three rules of caving:
Take nothing but photos
Leave nothing but tracks
Kill nothing but time
They sound hokey, but they are true. It really makes me sick when I see a once beautiful cave that took millions of years to develop full of garbage and graffiti. Another retard thing is that people break off delicate formations, I assume for souvenirs. I don't know, maybe I'm just a cave hugger. Anyway it is nice to be courteous to future cavers by experiening nature without destroying it.
I know that you will have a blast!