This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).
Shape the future of IBM!
We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:
Search existing ideas
Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,
Post your ideas
Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,
Post an idea
Upvote ideas that matter most to you
Get feedback from the IBM team to refine your idea
Specific links you will want to bookmark for future use
Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.
IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.
ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.
IBM Employees should enter Ideas at https://ideas.ibm.com
This RFE's Headline was changed after submission to reflect the headline of an internal request we were already considering, but will now track here.
Solution already exists
You're welcome Juan,
We will close this RFE.
Kind Regards,
Jeff Wang
Hi Jeff,
I think that new feature included in LSF 9.1.3 fits our needs. Thanks for improving this wonderful product.
Can you close the RFE for me?
Best regards,
Juan Palomino
Hi Juan,
Currently, LSF 9.1.3 already has a feature that I believe meets the use case that you described.
You can utilize the LSB_JOB_TMPDIR parameter to designate a directory under which jobs can create job-specific temporary directories. At the same time, you can define LSF_TMPDIR as the LSF daemon's working directory where core dumps will be placed and where sbatchd creates the .XXX.fanout and .XXX.sbd directories.
For example I can set:
LSB_JOB_TMPDIR=/scratch
LSF_TMPDIR=/tmp (this is actually the default setting)
Then as I run jobs with LSF, my directories may look something like this:
[jeff]$ ls -la /scratch
total 12
drwxrwxrwx 3 jeff dev 4096 Oct 15 15:43 .
drwxrwxrwx 10 root root 4096 Oct 15 11:20 ..
drwx------ 2 jeff dev 4096 Oct 15 15:13 820.tmpdir
[jeff]$ ls -la /tmp
total 2424
drwxrwxrwx 4 jeff dev 4096 Oct 15 15:43 .
drwxrwxrwx 10 root root 4096 Oct 15 11:20 ..
-rw-r--r-- 1 jeff dev 52 Oct 15 15:13 .1555530476.820.hostAffFilePath
-rw-r--r-- 1 jeff dev 44 Oct 15 15:13 .1555538476.820.hostFilePath
-rw------- 1 root root 15040512 Oct 15 15:43 core.22750
-rw-r--r-- 1 root root 15 Oct 15 15:44 .sbd.jeffcluster.820.rusage
-rw------- 1 root dev 16 Oct 15 15:41 .tmp.shm
drwx------ 2 root root 4096 Oct 15 15:43 .jeffcluster.fanout
drwx------ 2 root root 4096 Oct 15 15:43 .jeffcluster.sbd
You can see that in LSB_JOB_TMPDIR (/scratch), there is a job-specific temporary directory named 820.tmpdir. Then, in LSF_TMPDIR (/tmp), there are the .XXX.fanout and .XXX.sbd directories.
These two parameters can be set in lsf.conf to fully control the job-specific temporary directories and the directory for LSF daemons. When using these two parameters, make sure the permissions are correctly set for designated directories. Also, after changing these parameters in lsf.conf, run "badmin hrestart all" to make the new settings take effect.
I have found that the LSB_JOB_TMPDIR parameter is not included in the LSF admin/reference guide. I am working on including them into the guide.
For reference, you may look at the document below for information on LSB_JOB_TMPDIR. This is a guide for LSF running on GPFS which is not the file system that you're using, but the information may still be helpful as a future reference.
https://www.ibm.com/developerworks/community/wikis/form/anonymous/api/wiki/99245193-fced-40e5-90df-a0e9f50a0fb0/page/359ab0d9-7849-4c6a-8cb8-7a62050b5222/attachment/18c55395-5fb2-4140-9376-cb5ca6d63f07/media/LSF_GPFS_BPG.pdf
Thanks,
Jeff Wang
Creating a new RFE based on Community RFE #71830 in product Platform LSF.