A rocket just going straight up would be very inefficient. It can do it, but not without running out of fuel first. It has to do that (gravity) turn so that it picks enough horizontal speed to orbit.
(and about that rocket just going straight up, it still cant get you into an orbit, only out of earth's sphere of influence. And by the way, I dont think we have any rockets that have enough fuel to do something like that.)