grammar - Whom and who in the same sentence

I'm struggling to wrap my brain around this and would appreciate some advice please.

Are there situations where it is appropriate to use Who immediately after Whom?

Here's my example from a story I'm writing (the text is from a faux historian)

While one can understand the actions of a lonely few – some of whom
who perhaps did make good their escape...

When I try it with just the whom it sounds wrong. I'm unsure if I'm just getting super confused with tenses here but this is the second time I've tried to word a sentence like this and its annoying me that I can't get it right. Previously I just ended up reworking it to avoid the issue altogether, but I feel it should be possible to construct in this way.

In my head if I was saying this as an aside in conversation right now, I might say:

some of them who perhaps did make good on their escape...

So is it ok to substitute them with whom?

Suggestions gratefully received!