How to automate stripping setup on Lustre using iRODS for data ingest management.

If iRODS[1] is used to manage petabytes of data on high perfromance filesystem like Lustre[2]. You may want to set some specific parameters (like striping) before uploading the data set. This can usually be done by command-line tools, however, when you expect a high throughput of I/O calling os.system from python rule engine for every… Continue reading How to automate stripping setup on Lustre using iRODS for data ingest management.