Is it natural to answer a yes-no question with just yes/no?

Given a yes-no question such as:

Did you call him?

Is it idiomatic to simply answer:

Yes. / No.

As opposed to:

Yes, I did. / No, I didn't.

or just:

I did. / I didn't.

I've noticed that in some languages simply answering yes or no seems to be the common unmarked way of answering (e.g. Spanish), but not in others (e.g. Portuguese).