You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I get this error:
org.apache.iceberg.exceptions.ValidationException: Cannot delete file where some, but not all, rows match filter ref(name="entity") == "E001": s3://axiom-dev-external-execution-data/iceberg-data/a_46601/data/00026-182924-6f71cefd-10bc-47e8-8fc7-77799ff9c32e-0-00001.parquet
at org.apache.iceberg.exceptions.ValidationException.check(ValidationException.java:49) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.ManifestFilterManager.manifestHasDeletedFiles(ManifestFilterManager.java:383) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.ManifestFilterManager.filterManifest(ManifestFilterManager.java:313) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.ManifestFilterManager.lambda$filterManifests$0(ManifestFilterManager.java:195) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.util.Tasks$Builder.access$300(Tasks.java:69) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.util.Tasks$Builder$1.run(Tasks.java:315) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
at java.lang.Thread.run(Thread.java:840) ~[?:?]
The text was updated successfully, but these errors were encountered:
Apache Iceberg version
1.5.2
Query engine
Spark
Please describe the bug 馃悶
When trying to overwrite with a condition:
org. apache. spark. sql. DataFrameWriterV2.overwrite(condition: Column)
it creates spark action:
datasources.v2.OverwriteByExpressionExec
I get this error:
org.apache.iceberg.exceptions.ValidationException: Cannot delete file where some, but not all, rows match filter ref(name="entity") == "E001": s3://axiom-dev-external-execution-data/iceberg-data/a_46601/data/00026-182924-6f71cefd-10bc-47e8-8fc7-77799ff9c32e-0-00001.parquet
at org.apache.iceberg.exceptions.ValidationException.check(ValidationException.java:49) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.ManifestFilterManager.manifestHasDeletedFiles(ManifestFilterManager.java:383) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.ManifestFilterManager.filterManifest(ManifestFilterManager.java:313) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.ManifestFilterManager.lambda$filterManifests$0(ManifestFilterManager.java:195) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.util.Tasks$Builder.access$300(Tasks.java:69) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at org.apache.iceberg.util.Tasks$Builder$1.run(Tasks.java:315) ~[iceberg-spark-runtime-3.5_2.12-1.5.0.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
at java.lang.Thread.run(Thread.java:840) ~[?:?]
The text was updated successfully, but these errors were encountered: