When is the object of a verb the subject of the gerund in structure "subject + verb + object + preposition + gerund"?

1) This reminds me of climbing Ben Nevis years ago.

2) I told you about losing my credit card, didn't I?

I'm quite sure that the person who climbed Ben Nevis is "I" not "This" in 1).
But, I'm not so sure that the person who lost "my credit card" is "I" not "you" in 2).

My question is when the object of a verb is the subject of the gerund in structure "subject + verb + object + preposition + gerund"?