This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).
Shape the future of IBM!
We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:
Search existing ideas
Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updateson them if they matter to you. If you can't find what you are looking for,
Post your ideas
Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,
Post an idea
Upvote ideas that matter most to you
Get feedback from the IBM team to refine your idea
Specific links you will want to bookmark for future use
Submitting spark applications without the use of spark-submit binary
We would like to be able to submit Spark applications from external client as follows: "java --classpath... --spark-master ...."without the use of spark-submit binary. We tested this approach with java SparkPi example by adding parameters spark ur...
Blocking hosts participation in any cluster activity
Request for enhancement to have slot allocations get blocked for spark drivers / executors on nodes that are already declared as blocked by EGO in a scenario in which the Instance Group has not yet been deployed to those nodes. Today, when a node ...
Request for enhancement in which Conductor allows a running instance group to perform a resource group deploy push to all hosts in a resource group, resulting in a parallel deployment of the SIG onto those hosts. Currently today, that functionalit...
Conductor clean up service currently supports periodic clean up of data and logs with global cluster level retention parameters. Request is to support custom log/data retentions of files at per SIG level overriding global settings.
We are currently using Conductor rest call, however due to some limitations e.g. Memory numbers are not correct, we are looking at exploring the ELK API where most of the data are correctly available. But driver_id is missing, please add the same ...
Duplicate Spark's cleanup functionality for eventLog directories inside the cleanup script
Duplicate Spark's cleanup functionality for eventLog directories inside the cleanup script, add new env var to cleanup service like CLEANUP_SPARK_EVENT_LOGS (This would be a medium amount of work, as it involves modifying and testing more changes ...
We are using WMLA to run GPU based jobs fine and also able to scale across the cluster. However, we are trying to run a model only on CPU (not on GPU) using the WMLA framework. We have prepared a model which runs only on CPU and not at all sending...
Do not place IBM confidential, company confidential, or personal information into any field.