grammaticality - "a question by you" or "a question of you"

Is it grammatically correct to say,

"What a silly question of you..."

My friend is trying to convince me that

"What a silly question by you..."

is the only correct way.