Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Support map_concat function #5405

Closed
viadea opened this issue Apr 29, 2022 · 1 comment · Fixed by #5533
Closed

[FEA] Support map_concat function #5405

viadea opened this issue Apr 29, 2022 · 1 comment · Fixed by #5533
Assignees
Labels
feature request New feature or request

Comments

@viadea
Copy link
Collaborator

viadea commented Apr 29, 2022

I wish we can support map_concat function.
For example:

from pyspark.sql.functions import map_concat
map_concat_df1 = spark.sql("SELECT map(1, 'a', 2, 'b') as map1, map(3, 'c') as map2")
map_concat_df1.select(map_concat("map1", "map2").alias("map3")).show(truncate=False)

Not-supported messages:

! <MapConcat> map_concat(map(keys: [1,2], values: [a,b]), map(keys: [3], values: [c])) cannot run on GPU because GPU does not currently support the operator class org.apache.spark.sql.catalyst.expressions.MapConcat
@viadea viadea added feature request New feature or request ? - Needs Triage Need team to review and classify labels Apr 29, 2022
@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label May 3, 2022
@HaoYang670
Copy link
Collaborator

I'd like to have a try!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants