Big Data

HCC supports Big Data by providing resources to store, process, and transfer data. We are dedicated to supporting researchers with their data and processing needs. Big Data provides a unique challenge to researchers that we are here to solve.

Create an HCC Account

Storage

HCC provides large file systems on each of our clusters for temporary storage of Big Data datasets while processing. Combined for a total of over 3 Petabytes, HCC's work storage is connected to our clusters through high speed interconnects. In addition to the cluster's filesystems, HCC provides large data set storage on our Attic storage system. This storage is designed to be for large datasets that are not currently being processed.

Start Storing

Processing

HCC provides over 20,000 processing cores to researchers for their Big Data analysis. Over 2 PBs of fast storage is connected to the processing cores to store datasets. Researchers may use tools such as R, Matlab, or even you're own custom processing software.

Start Processing

Transfers

Utilizing Globus Online, users are able to easily transfer data to and from their desktops and the HCC supercomputers. Documentation on how to use Globus Online is provided on the HCC Documentation website.