Skip to Main Content
IBM Data Platform Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data Platform organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com



ADD A NEW IDEA

Clear

Ideas

Showing 692

"lim -t" phrases for aarch

Referring to TS018491466. We obtain the following architecture details by doing the $LSF_SERVERDIR/lim -t on the AARCH machines. AArch64Processorrev2aarch64 AArch64Processorrev1aarch64 AArch64Processorrev0aarch64 And this looks to not be in phrase...
9 months ago in Spectrum LSF / Administration 0 Future consideration

Azure Synapse Stage - Exposing the Merge Query Options

Currently, the MERGE logic in StreamSets Synapse SQL Stage is largely fixed, limiting users in scenarios where custom match logic, conditional updates, or fine-grained control over insert/update/delete behaviour is needed. This idea is for a featu...
5 months ago in StreamSets 1 Needs more information

[Customer-HCA-Parallon] Projects Feature: Allow moving of organization level objects (pipelines, jobs, connections etc.) to relevant project

HCA has been keen on using Projects feature since it was demoed to them. They have the feature enabled now, they have explored it and shared feedback. HCA currently has many teams using StreamSets and they have numerous pipelines, fragments, jobs,...
5 months ago in StreamSets 4 Functionality already exists

MERGE statement should respect table DDL's default values and specify column in Snowflake stage

When processing data with the Snowflake destination, it does not respect the target table's DDL for default values. For example, if the table has a column with the default value set to CURRENT_TIMESTAMP in Snowflake, the stage will just insert a n...
10 months ago in StreamSets 1

Allow "MongoDBAtlasLookup" stage to search collections dynamically

I would like to use ${record:value("/collection")} in "MongoDBAtlasLookup" stage as I need my pipeline to check multiple different collections. Due to be only allowed to use a hardcoded value or parameter I'm forced to have to use multiple "MongoD...
5 months ago in StreamSets 0 Under review

Add INCLUDE file capabilities into LSF License Scheduler configuration

The ability to specify the License Scheduler configuration in multiple include files where each include file contains the separate configuration of each independent software vendor. For example, #INCLUDE /path/cadence.lsf.license_scheduler #INCLUD...
10 months ago in Spectrum LSF / License Management 0 Planned for future release

Affinity scheduling must take L3 cache hierarchy into account

Newer CPUs have multiple L3 caches, with dedicated cores per L3 cache. Running multi-threaded jobs on all cores within a shared L3 cache can reduce runtime in our cases up 70%, compared to running over multiple L3 caches. Think of the AMD EPYC 935...
about 1 year ago in Spectrum LSF / Scheduling 2 Planned for future release

Limit Priority Over Time and Max User Priority by Queue

There are user workflows that require using priority to order flows and their execution. However, when priority over time is enabled, those methods break down. Using Priority Over Time to APS and Priority Queues is essential, but causes issues in ...
5 months ago in Spectrum LSF / Scheduling 0 Future consideration

Support MIG declaration in resource connector templates for gpu VMs

We use to provision new GPU hosts (having MIG enabled using post install) in cloud using resource connector but when the job contains "mig" in the gpu resource requirement, it does not provision the host. When checked upon to declare MIG in the re...
10 months ago in Spectrum LSF / Cloud Bursting 0 Planned for future release

Improve Orchestrator Connection functionality for Control Hub REST API Processor

In SDC 5.12.0, there is a new Connection Orchestrator Connection which is available in all Orchestrator stages such as the Start Jobs stages. ControlHub Rest API Processor also supports this connection. The issue is that ControlHub Rest API stage ...
over 1 year ago in StreamSets 1 Not under consideration