The previous recipe covered transfers with a large number of operations; this one is targeted at individual large files.

Upload the file as several simultaneous chunks and observe transfer speed. If your previous upload saturated your link, you may not see a performance increase.

You’ll notice we set the file size threshold that triggers parallel composite uploads (250 MB) and how large these composite files should be (50 MB), and we tell gsutil to use eight processes to enable uploading these files at the same time. All of these can be tuned to increase performance.

gsutil -o
"GSUtil:parallel_composite_upload_threshold=200M,GSUtil
:parallel_composite_upload_component_size=50M,GSUtil:parallel_process_count=8" cp LC08_L1GT_044017_20200809_20200809_01_RT_B8.TIF gs://$BUCKET_NAME

Leveraging parallel composite uploads is particularly helpful when uploading large files. However, this requires both the source and destination environments to have a CRC32C library installed for integrity checking.