Skip to Main Content
IBM Data and AI Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


ADD A NEW IDEA

StreamSets

Showing 35

Data Collector thread consuming CPU after closing preview

Faulty code, such as an infinite loop in a Groovy Evaluator stage, will not destroy threads after closing a pipeline preview. The lingering threads will consume CPU resources until the engine is restarted. The request for this Idea is to implement...
about 1 month ago in StreamSets 0 Under review

Job Status is not consistent in Sequences, Job Details and in Operations Dashboard

The job status in Sequences in Job Details and Operations Dashboard is not the same. For example in a Sequence it looks like the job is running and everything is ok: https://streamsets.atlassian.net/browse/CI-2191 Looking at the same job in Job de...
about 1 month ago in StreamSets 0 Is a defect

StreamSets Platform: SDK: Support for time-based SLAs on long-running jobs

Historically, StreamSets Control Hub and Data Collector had rules and alerts that could notify if pipelines/jobs hit a certain record count and other related metrics. These are only somewhat useful, such as for jobs which typically have a certain ...
about 1 month ago in StreamSets 0 Under review

Improve Snowflake Error Behavior When Merge Enabled for CDC Data

When moving CDC data to Snowflake using the MERGE statement, some records in a batch may occasionally be invalid. The "continue" error behavior configuration for the Snowflake stage does not apply for MERGE statements, and the entire batch fails, ...
2 months ago in StreamSets 0 Under review

We need to be able to detect a change to a table in the CDC origin in order to create a DDL

No description provided
about 1 month ago in StreamSets 1 Planned for future release

Allow specification of VolumeType when provisioning a new EMR cluster through Transformer

When the Cluster Manager Type is set to EMR and Define Cluster Start Option is set to Provision New Cluster, there should be an option to set the VolumeType for EBS storage. Since this is possible when actually creating an EMR cluster and attachin...
about 2 months ago in StreamSets 0 Submitted

Subscriptions on job failure is firing during job failover between data collectors

For high availability usually a job is setup to run on a data collector label associated with more than one data collectors. If a job is failed over from one data collector to another due to some issues the subscription gets fired as a job failure...
about 2 months ago in StreamSets 1 Is a defect

SST Kafka Producer "Send Message Keys" key field to be sent as json format

Product - StreamSets Transformer for SparkVersion - 5.6.1 Customer is looking to send the Kafka Producer "Send Message Keys" key field to be sent as json format. They are using Transformer and want to pass Key Field in Kafka destination. Ideally i...
about 2 months ago in StreamSets 0 Submitted

Snowflake Destination does not support "Array" data type.

IBM StreamSets Control Hub | PlatformSDC 5.10 High level pipeline logic:MongoDB → Snowflake The customer is attempting to ingest data from MongoDB and write it into Snowflake. They utilize the “Array” datatype a considerable amount in both MongoDB...
about 2 months ago in StreamSets 0 Functionality already exists

Snowflake Destination does not support "Object" data type.

IBM StreamSets Control Hub | PlatformSDC 5.10 High level pipeline logic:MongoDB → Snowflake The customer is attempting to ingest data from MongoDB and write it into Snowflake. They utilize the “Object” datatype a considerable amount in both MongoD...
about 2 months ago in StreamSets 0 Under review