Add to the experience
Sometimes people invite you to go on small, fun quests with them because they think your presence would add to their experience.
Nobody needs to hear "The chocolate is so expensive!" when all they care about doing is to buy some chocolate to share with you. Comments like that detract from, rather than add to, the experience.
If you accept the invitation, give them the opportunity to lead, be supportive, and just enjoy the experience.