StreamSets

Showing 54

Support LDAP when uid's do are not "full dn"

Add SCH On-Prem's LDAP synchronization support for the posixGroup object class. Currently does not have support for LDAP directories using posixGroup uid’s because they don’t include a member's full dn.

5 months ago in StreamSets 0 Not under consideration

3 VOTE

Improve Orchestrator Connection functionality for Control Hub REST API Processor

In SDC 5.12.0, there is a new Connection Orchestrator Connection which is available in all Orchestrator stages such as the Start Jobs stages. ControlHub Rest API Processor also supports this connection. The issue is that ControlHub Rest API stage ...

5 months ago in StreamSets 1 Future consideration

2 VOTE

Allow the Schema Generator to be able to use Complex Data Types for Parquet and Avro

The schema generator currently is only able to generate basic schema. For example a map with mixed data types is considered complex and will cause an error: { "answers":{ "field1": "somestring", "field2": 123 } } SCHEMA_GEN_0007 - Map '/answer...

9 days ago in StreamSets 0 Submitted

2 VOTE

Snowflake Bulk not able to read from read-only database due to the temporary file format.

When Snowflake Bulk stage tries to read from a read-only database, it fails with the message: "Could not create a temporary file format (SNOWFLAKE_47)" due to the lack of permissions to create the file format object in the source database. This is...

about 1 month ago in StreamSets 1 Submitted

2 VOTE

Snowflake destination events

Upon writing the data to snowflake table, we don't get any events which means we're unable to trigger any further action after writing to snowflake table. Currently we're facing two problems because of this: We need to write data to two snowflake ...

3 months ago in StreamSets 0 Future consideration

2 VOTE

Azure Key Vault for Deployable Transfomer for Snowflake

For security conscious customers being able to store credentials in the cred stores we support in SDC would be helpful, Azure being this customers

3 months ago in StreamSets 1 Planned for future release

2 VOTE

Control Hub Platform - Option to delete runtime parameters in Job configuration

We have observed that in the StreamSets On-Prem Control Hub, there is a simple way to remove Runtime Parameters at the job level. In the UI, there is a red button on the side of each runtime parameter to remove them, if desired. In StreamSets Plat...

3 months ago in StreamSets 0 Future consideration

2 VOTE

Support list in field mapping for MongoDB Lookup Stage

Customer has raised a request to specify list (array) in the “SDC field” while defining Document to SDC Field Mappings in MongoDB atlas lookup processor stage. Usually we specify field names for mapping but here we require to fetch the records whe...

3 months ago in StreamSets 0 Under review

2 VOTE

Improve Snowflake Error Behavior When Merge Enabled for CDC Data

When moving CDC data to Snowflake using the MERGE statement, some records in a batch may occasionally be invalid. The "continue" error behavior configuration for the Snowflake stage does not apply for MERGE statements, and the entire batch fails, ...

5 months ago in StreamSets 0 Not under consideration

1 VOTE

Processing Time per Batch Metric

There is a Stage Batch Processing Timer that show the most recent batch, but could there be a processing timer per batch where it shows a small recent history? This would help with the design of a pipeline and fine tuning to make it more efficient.

5 days ago in StreamSets 1 Needs more information

Please enter your email address

FILTER BY CATEGORY