Skip to content

Using Data with HiPerGator

A big part of using HiPerGator involves interacting with data — transferring, managing, and accessing your research files efficiently and securely. Because HiPerGator supports large-scale, high-performance computing workloads, moving data to and from the system is a critical step in the research workflow. Whether you are preparing input files for simulations, uploading large datasets for analysis, or downloading results for further processing, having reliable and efficient data transfer methods is essential to your success.

HiPerGator provides multiple tools and protocols designed to accommodate diverse user needs and environments. From command-line utilities to graphical interfaces, these options help you work with data in a way that fits your workflow and technical comfort level.

This page offers a comprehensive overview of the data transfer options available to HiPerGator users, including best practices for secure file movement, tips for maximizing transfer speeds, and instructions for connecting your local system to HiPerGator storage. We cover both simple transfers for small files and more advanced methods suited for large datasets or automated workflows.

Key topics covered on this page include:

  • Globus: A high-performance, secure file transfer service optimized for moving large datasets quickly and reliably across networks and institutions.
  • Samba: A protocol that enables sharing and accessing files between Windows and HiPerGator systems, allowing seamless integration with Windows file-sharing environments.
  • Rsync: A command-line utility for efficient file synchronization and transfer, minimizing data transfer by copying only changed parts of files.
  • Sharing Within A Cluster: Methods to share data and collaborate with other users within the HiPerGator cluster environment, facilitating team-based research workflows.

Understanding these tools and workflows will empower you to manage your data effectively and leverage HiPerGator’s computational resources to their fullest potential. Whether you are new to high-performance computing or an experienced researcher, this guide will help you navigate data transfer processes with confidence.

For detailed instructions, examples, and links to additional resources, continue exploring the sections below.