Should I use past tense or present tense in memories captions?

It depends on your preference and the context of the memory. Both past and present tense can work, so choose the one that feels more natural for the story you’re telling.