...
In theory, a bucket can hold millions of files. We have noticed, though, that with path prefix searching the more objects that have that prefix, typically related to the number of objects in a bucket, the longer the search takes. While this is not dissimilar to POSIX filesystems, where the more files there are in a directory. the longer it takes to do a directory lookup, on an object store, being a flat namespace (no directory hierarchy), such searches can be much slower.
What APIs are supported by ROSS
ROSS supports multiple object protocol APIs. The most common is S3, followed by Swift (from the Open Stack family). Although ROSS can support the NFS protocol, our experiments show that the native NFS support is slower for many use cases than other options that simply emulate a POSIX file system using object protocols. ROSS can also support HDFS (used in Hadoop clusters) and a couple of Dell/EMC proprietary protocols (ATMOS and CAS); however, we have not tested any of these other protocols, hence the HPC Admins could only offer limited support for these other options. The primary protocols that the HPC Admins support is S3 and Swift. We have more experience with S3, hence most of this article assumes S3. Later we describe our two favorite tools for accessing ROSS, but you are not required to use our suggested tools.
How do I get access credentials?
blahIn order to use either S3 or Swift, you need credentials. The credentials are tied to a particular namespace. In fact
How do I create a bucket or container?
...