StreamSets

Showing 96 of 16491

CDC-style ingestion using Google BigQuery as a source in SDC

Google BigQuery origin does not natively support CDC. As part of requirement in our project , we are expecting to use the CDC type ingestion for Google BigQuery as a source in Streamsets. Please consider this requirement and enable this functional...

3 days ago in StreamSets 1 Under review

2 VOTE

Snowpipe Streaming destination for Snowflake

Current Snowflake destination has performance limitations due to the nature of file-based process of uploading to Snowflake. Since 2023, Snowflake supports Snowpipe Streaming ingestion which doesn't have problems related to file-based upload, has ...

4 days ago in StreamSets 0 Under review

3 VOTE

StreamSets Data Collector 6.0,0 is Using Old ADAL Library to Connect to Azure Key Vault Which is Going to be Deprecated on June 30

Hi Team, We have observed that StreamSets data collector 6.0.0 is using old ADAL library to connect to Azure key vault and it is going to be deprecated on June 30th. Could you please help us updating this to new MSAL library? Please find the attac...

5 days ago in StreamSets 0 Under review

1 VOTE

ADAL library that StreamSets uses is going to be discontinued when the transition to Microsoft Graph happens at the end of June.

At the moment, StreamSets is using the ADAL library for Azure Key Vault connections. The library has been in maintenance state for some time and will be discontinued when the transition from Azure AD Graph to Microsoft Graph happens at the end of ...

5 days ago in StreamSets 0 Under review

1 VOTE

Add a support for processing CDC data for "uuid, json, jsonb" data types in PostgreSQL.

Product: StreamSets Data Collector. Stage: PostgreSQL CDC Client Please add a support for "PostgreSQL CDC Client" to process the data with "uuid, json, jsonb" data types.

11 days ago in StreamSets 0 Under review

1 VOTE

Check for and prevent multiple parameters with the same key name

In the May 21, 2025 Control Hub update, we introduced a new feature in the API regarding pipeline parameters. This feature introduced an issue in an edge case (the presence of duplicate parameters) which we did not anticipate. As a followup in the...

16 days ago in StreamSets 0 Under review

2 VOTE

Expand credential fields to include. endpoint URLs

Expand credential fields to include endpoint URLs. This would allow better security for example in the case where a Redis URL contains a password as well as better parameterization whenmoving connections across environments. One can already retrie...

18 days ago in StreamSets 0 Under review

1 VOTE

Add a dedicated Postgres JDBC Producer with MERGE support similar to what we have recently done for Oracle

18 days ago in StreamSets 1 Under review

1 VOTE

Provide an easy and supportable way to have StreamSets write its logs in JSON format by including the log4j-layout-template-json-2.xx.x.jar

Provide an easy and supportable way to have StreamSets write its logs in JSON format. This would allow much easier Datadog integration, as Datadog prefers to deal with JSON-based logs As mentioned here: https://docs.datadoghq.com/logs/log_configur...

18 days ago in StreamSets 1 Under review

1 VOTE

Ability to Enable and Change Logging Levels and Log Destinations/Formats for Pipelines and Stages

It's possible now to add log4j appenders to a Data Collector's sdc.properties file to set or change logging levels, writing to the sdc.log file, but the file is verbose and difficult to interpret. It would be great to be able to do this within the...

22 days ago in StreamSets 0 Under review

Please enter your email address

FILTER BY CATEGORY