Can I be exempt from tax witholdings and just pay the full amount in April with my filing?

If you owe over $1000 then there is an additional penalty for illegally claiming exempt. So no. Everyone is obligated to make estimated payments as the year goes along.