StreamSets

Showing 44

Improve Snowflake Error Behavior When Merge Enabled for CDC Data

When moving CDC data to Snowflake using the MERGE statement, some records in a batch may occasionally be invalid. The "continue" error behavior configuration for the Snowflake stage does not apply for MERGE statements, and the entire batch fails, ...

4 months ago in StreamSets 0 Not under consideration

1 VOTE

Store User Settings on Backend

When a user needs to clear browser cache and cookies they need to reconfigure their user settings in Platform (Control Hub). Please consider storing these settings on the backend so that users do not need to do this. The need to reconfigure negati...

2 months ago in StreamSets 2 Needs more information

1 VOTE

Data Collector thread consuming CPU after closing preview

Faulty code, such as an infinite loop in a Groovy Evaluator stage, will not destroy threads after closing a pipeline preview. The lingering threads will consume CPU resources until the engine is restarted. The request for this Idea is to implement...

3 months ago in StreamSets 0 Is a defect

1 VOTE

Job Status is not consistent in Sequences, Job Details and in Operations Dashboard

The job status in Sequences in Job Details and Operations Dashboard is not the same. For example in a Sequence it looks like the job is running and everything is ok: https://streamsets.atlassian.net/browse/CI-2191 Looking at the same job in Job de...

3 months ago in StreamSets 0 Is a defect

1 VOTE

StreamSets Platform: SDK: Support for time-based SLAs on long-running jobs

Historically, StreamSets Control Hub and Data Collector had rules and alerts that could notify if pipelines/jobs hit a certain record count and other related metrics. These are only somewhat useful, such as for jobs which typically have a certain ...

3 months ago in StreamSets 0 Planned for future release

1 VOTE

We need to be able to detect a change to a table in the CDC origin in order to create a DDL

No description provided

3 months ago in StreamSets 1 Planned for future release

1 VOTE

Allow specification of VolumeType when provisioning a new EMR cluster through Transformer

When the Cluster Manager Type is set to EMR and Define Cluster Start Option is set to Provision New Cluster, there should be an option to set the VolumeType for EBS storage. Since this is possible when actually creating an EMR cluster and attachin...

3 months ago in StreamSets 0 Under review

1 VOTE

Subscriptions on job failure is firing during job failover between data collectors

For high availability usually a job is setup to run on a data collector label associated with more than one data collectors. If a job is failed over from one data collector to another due to some issues the subscription gets fired as a job failure...

3 months ago in StreamSets 1 Is a defect

1 VOTE

SST Kafka Producer "Send Message Keys" key field to be sent as json format

Product - StreamSets Transformer for SparkVersion - 5.6.1 Customer is looking to send the Kafka Producer "Send Message Keys" key field to be sent as json format. They are using Transformer and want to pass Key Field in Kafka destination. Ideally i...

3 months ago in StreamSets 0 Under review

1 VOTE

Snowflake Destination does not support "Array" data type.

IBM StreamSets Control Hub | PlatformSDC 5.10 High level pipeline logic:MongoDB → Snowflake The customer is attempting to ingest data from MongoDB and write it into Snowflake. They utilize the “Array” datatype a considerable amount in both MongoDB...

3 months ago in StreamSets 0 Functionality already exists

Please enter your email address

FILTER BY CATEGORY