Lustre® Error “No Space Left on Device”
Categories: Data Management, File Systems
Print this article
When storing files to a Lustre® filesystem, you may occasionally receive a
no space left on device error even though
df shows a substantial amount of free space. The error message is related to how Lustre stores files within the filesystem.
A Lustre filesystem consists of many disk targets called Object Storage Targets (OSTs). When a file is stored, it is striped across one or more OSTs. If any of those OSTs becomes full, then further writes to it will result in a
no space left on device error. It is very possible for a handful of OSTs to be full while the rest of the filesystem is not.
To see if this is the reason you’ve received this error, you must first determine over which OSTs your file is striped. You can see a file or directory’s associated OST(s) with the
lfs getstripe command. With this information
lfs df can then be used to see the usage on each individual OST.
For more information on the OLCF’s primary Lustre filesystem, see the Spider Overview page.