What are some offbeat things to do in France?

I'm going to France with my family and we are looking for suggestions on some less touristy places to go. A lot of us are really into science and history so things like caves, wildlife reserves, gem mining, ect. are right up our ally.