If you're traveling to Pondicherry, then you must add Auroville and Matri Mandir (especially!) to your bucketlist. Try to grab breakfast at Auroville bakery, it's superb!
You can explore the Rock Beach, Serenity Beach and Paradise Beach. Walk or cycle around the White Town, and eat at the boutique cafes there. My favorite place is Villa Shanti :)
You can check out more about the things to do in Pondy, here!