Skip to main content

Available storage systems

The NYU HPC clusters are served by a General Parallel File System (GPFS) storage cluster. GPFS is a high-performance clustered file system software developed by IBM that provides concurrent high-speed file access to applications executing on multiple nodes of clusters.

GPFS​

Configuration​

The NYU HPC cluster storage runs on Lenovo Distributed Storage Solution DSS-G hardware:

  • 2x DSS-G 202
    • 116 Solid State Drives (SSDs)
    • 464TB raw storage
  • 2x DSS-G 240
    • 668 Hard Disk Drives (HDDs)
    • 9.1PB raw storage

Performance​

  • Read Speed: 78 GB per second read speeds
  • Write Speed: 42 GB per second write speeds
  • I/O Performance: up to 650k input/output operations per second (IOPS)

Flash Tier Storage (VAST)​

  • An all flash file system, using VAST Flash storage, is now available on Greene. Flash storage is optimal for computational workloads with high I/O rates. For example, If you have jobs to run with huge amount of tiny files, VAST may be a good candidate. If you and your lab members are interested, please reach out to hpc@nyu.edu for more information.
  • NVMe interface
  • Total size: 778 TB
  • Access: /vast is available for all users to read and available to approved users to write data.

Research Project Space (RPS)​

  • Research Project Space (RPS) volumes provide working spaces for sharing data and code amongst project or lab members.
  • RPS directories are available on the Greene HPC cluster.
  • There is no old-file purging policy on RPS.
  • RPS is backed up.
  • There is a cost per TB per year and inodes per year for RPS volumes.

More information on the Research Project Space is available page.

Data Transfer Nodes Specs (gDTN)​

  • Node type: Lenovo SR630
  • Number of nodes: 2
  • CPU: 2x Intel Xeon Gold 6244 8C 150W 3.6GHz Processor
  • Memory: 192GB (total) - 12x 16GB DDR4, 2933MHz
  • Local disk: 1x 1.92TB SSD
  • Infiniband interconnect: 1x Mellanox ConnectX-6 HDR100 /100GbE VPI 1-Port x16 PCIe 3.0 HCA
  • Ethernet connectivity to the NYU High-Speed Research Network ( HSRN ): 200Gbit - 1x Mellanox ConnectX-5 EDR IB/100GbE VPI Dual-Port x16 PCIe 3.0 HCA