If I ask the question "Where are you going?", is it okay for me to say,
"What place are you going to?"
or
"To what place are you going?"
instead?
Both questions are grammatically correct.
Compare:
'Where are you going?' - 'Overseas.'
'What place are you going to?' - 'France and Germany.'