New Data Transfer Tool Developed at ORNL to Be Made Available for Public Use

New Data Transfer Tool Developed at ORNL to Be Made Available for Public Use

Jake Wynne, an HPC storage systems engineer at ORNL, created the hsi_xfer tool to simplify the process of transferring large quantities of data. A new data transfer tool created at the Oak Ridge Leadership Computing Facility could be available to facilities nationwide after making its debut at the Department of…

Angela GosnellDecember 4, 2024

Featured

2024 Notable System Changes: Summit and HPSS

HPSS Decommission and Kronos Availability After decades in service and having served hundreds of users that have archived over 160 petabytes, HPSS is reaching end of its life and will be decommissioned early in 2025. Please pay attention to the following key dates as you migrate workloads from the center’s…

Katie BetheaAugust 22, 2024

Science

Compelling Evidence of Neutrino Process Opens Physics Possibilities

SCGSR Awardee Jacob Zettlemoyer, Indiana University Bloomington, led data analysis and worked with ORNL’s Mike Febbraro on coatings, shown under blue light, to shift argon light to visible wavelengths to boost detection. Image Credit: Rex Tayloe/Indiana University The COHERENT particle physics experiment at the Department of Energy’s Oak Ridge National…

Dawn LevyJanuary 26, 2021

Technology

New Year Brings New Directory Structure for OLCF’s High-Performance Storage System

The High-Performance Storage System (HPSS) at the Oak Ridge Leadership Computing Facility (OLCF) will soon transition to a project-based directory structure. This may sound like a small change, but for research teams storing their project data on HPSS, the update promises to simplify file management and streamline searching for (or…

Coury TurczynJanuary 2, 2020

Technology

New Storage System Boosts Efficiency to Better Preserve OLCF User Data

Tape recorders and videocassette tapes may be considered archaic in the entertainment industry, but magnetic tape storage remains one of the most durable, secure, and cost-effective ways to archive big data generated by supercomputers. After researchers run code on high-performance computing (HPC) systems, key results are initially stored on disks…

Elizabeth RosenthalDecember 3, 2018

Technology

OLCF Staff Develops Digital Object Identifier Framework to Facilitate Open Access to Datasets

OLCF users can log in to the DOI portal, provide relevant metadata, and upload their datasets. OLCF staff then work with the US Department of Energy’s Office of Scientific and Technical Information to provide a DOI for the dataset. Scientists using supercomputing resources at the US Department of Energy’s (DOE’s)…

Jonathan HinesMarch 28, 2017

Technology

ORNL–Oracle Collaboration Offers Data Safeguard

ORNL recently partnered with Oracle to test some of the database technology company’s new firmware. Pictured here: Quinn Mitchell, high-performance computing storage system administrator at the OLCF, with the OLCF’s tape libraries. Image Credit: Rachel McDowell, ORNL The US Department of Energy’s (DOE’s) Oak Ridge National Laboratory (ORNL) recently partnered with Oracle to test some…

Rachel McDowellJanuary 4, 2017

Technology

Data Transfer Service Upgrades to Improve Efficiency and Performance

OLCF Staff members recently upgraded the OLCF’s data transfer service. The team included (front row, left to right) Sergey Shpanskiy, Jason Anderson, and Dustin Leverman; (back row, left to right) Jason Kincl, Jason Hill, and Clay England; (not pictured) Daniel Pelfrey, Jesse Hanley, and Lawrence Sorrillo. Data transfer can be…

Rachel McDowellSeptember 28, 2016

Technology

OLCF Storage Upgrades Paying Off for Users

Ongoing upgrades to the OLCF’s data storage services are expanding users’ opportunities to extract science from large datasets.

Jonathan HinesMarch 8, 2016

Technology

Storage System Infrastructure Upgrades Improve Performance, Data Security

OLCF staff have invested heavily in making sure users can access data quickly while also taking steps to keep data safe.

Eric GedenkMay 5, 2015

Technology

New RAIT System Keeps Large Data Sets Safe

The OLCF’s RAIT system allows incoming data to be striped across four tapes, but it also has an extra tape—called a parity tape—that can allow the data to be reconstructed in the event that a tape is damaged or lost.

Eric GedenkMay 5, 2015

Technology

New Tool to Help Verify Integrity of Archival Data Holdings

A new data quality assurance tool developed by the Technology Integration Group at the OLCF will help protect that data by validating the integrity of the High Performance Storage System (HPSS) archive.

Jeff GaryNovember 11, 2014

Technology

Protecting Big Data

The OLCF recently relocated the center’s archive tape library to a centralized location with a more controlled environment, resulting in better overall availability and uptime for OLCF system users and better resiliency of the media.

OLCF Staff WriterNovember 6, 2013

Science

ORNL Experts Work to Manage Big Data from Climate Science

HPCwire sat down with Galen Shipman to discuss strategies for coping with the “3 Vs”—variety, velocity, and volume—of the big data that climate science generates.

Dawn LevySeptember 17, 2012

HPSS