A new Google tool helps double the speed of cloud storage downloads

Google Cloud is set to launch a new tool that will enable users to create and manage
Direct specific resources and services, as well as giving a performance advantage.

The cloud giant claims that the tool, dubbed “gcloud storage CLI,” will allow for up to 94% faster data transfer when using cloud storage.

Users were previously able to modify their Google Cloud resources on the command line or via scripts via the Google Cloud CLI, but the new tool is presumably set up to update the experience.

How it works?

Google claims that the faster transfer rates are the result of two major innovations in gcloud storage.

First, it appears that gcloud storage uses faster hashes to verify the integrity of CRC32C data that bypasses the complex setup required for gsutil, the predecessor of the Python-based tool.

Second, the new tool uses a new parallelization strategy that treats task management as a graph problem, which is said to allow “more work to be done in parallel with much less overhead.”

When transferring 100 files that were 100MB in size, Google claims that gcloud storage is 79% faster than gsutil on download and 33% faster on upload using a parallel composite upload strategy.

In addition to performance improvements, Google is also introducing the new tool as a “consistent way” to manage all Google Cloud resources such as cloud storage containers, Compute Engine VMs, and Google Kubernetes Engine clusters.

For example, gcloud storage is said to significantly reduce the number of higher level commands that users have to use to manage cloud storage resources, by grouping commands under common headers.

gcloud CLI storage is currently available and ready to use at no additional charge. You can install or upgrade to the latest Google Cloud SDK here (Opens in a new tab) to access the new CLI.

If you want to learn more about how gcloud CLI storage works, you can refer to the documentation here (Opens in a new tab).

Leave a Reply

Your email address will not be published. Required fields are marked *

Exit mobile version