The Grozny-Tuapse Pipeline appears to be the first major crude oil pipeline in the USSR, built in 1927 - 1928. (Note, the Russian version of that article has more information.) Tuapse is a port city on the Black Sea, and crude oil was exported there.
I would like to know how much crude oil the USSR exported in the 1930's, and what did the Soviets receive in exchange for oil? Obviously to build such a large pipeline, they must have been exporting a lot. Note the capacity of the pipeline is stated as 1.5 Mt per year, but that does not mean it was always used at maximum capacity.