Memorial Day marks the start of the summer driving, and already drivers are limiting trips due to record gasoline prices that are expected to go even higher.