Allow to JOIN even when data types are different.

We can't choose columns as join key when they have different data types.

For example we have two csv files as below.

FirstName.csv

ID, FirstName

1, taro

2, hanako

LastName.csv

ID, LastName

1, yamada

2, sato

When we create DR flow with FirstName.csv file, data types are converted automatically. So ID column become Integer type, and FirstName column remain String type.

Then we want to join with LastName.csv. But in JOIN step we can't choose ID column in LastName.csv as join key with ID column in FirstName.csv. Because FirstName's ID is Integer but LastName's ID is remain String.

So we hope to allow to join with different data types.

Needed by Date

Jun 30, 2020

Post comment

Guest

Jul 29, 2020

Data Refinery automatically added a step to detect correct data types. That's why if another data set is not with correct data types user can't use them for join.
Option 1: Whenever possible user can inject join step before join before the auto convert step
Option 2: Change data type another CSV file so this will be user can join these files on Data Refinery.
Allowing joining on different datatype is not a valid ask.
We can look into enhancement where Data Refinery can add automatic step for data type conversion on another data set before using it for join. Aha epic - https://bigblue.aha.io/epics/WS-E-380

Reply
Hide replies

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.

Please enter your email address

RELATED IDEAS

Allow to JOIN even when data types are different.