Skip to content

[iceberg] CometBypassMergeSortShuffleWriter freePage error #2088

@andygrove

Description

@andygrove

Describe the bug

[Executor task launch worker for task 1.0 in stage 116.0 (TID 6951)] ERROR org.apache.spark.sql.comet.execution.shuffle.CometBypassMergeSortShuffleWriter - Error while deleting file /private/var/folders/d2/b93h6k7174ddqxltrxgb51040000gn/T/blockmgr-fd858ada-1024-4003-b3b3-5750d5863fdc/1d/temp_shuffle_3ba6142e-cc64-41fd-929b-3a3277a740fd

[Executor task launch worker for task 1.0 in stage 116.0 (TID 6951)] INFO org.apache.spark.executor.Executor - Executor killed task 1.0 in stage 116.0 (TID 6951), reason: Stage cancelled: Job aborted due to stage failure: Task 0 in stage 116.0 failed 1 times, most recent failure: Lost task 0.0 in stage 116.0 (TID 6950) (172.24.0.48 executor driver): java.lang.AssertionError: Called freePage() on a memory block that has already been freed
	at org.apache.spark.memory.TaskMemoryManager.freePage(TaskMemoryManager.java:361)
	at org.apache.spark.memory.MemoryConsumer.freePage(MemoryConsumer.java:130)
	at org.apache.spark.shuffle.comet.CometUnifiedShuffleMemoryAllocator.free(CometUnifiedShuffleMemoryAllocator.java:61)
	at org.apache.spark.sql.comet.execution.shuffle.SpillWriter.freeMemory(SpillWriter.java:222)
	at org.apache.spark.sql.comet.execution.shuffle.CometDiskBlockWriter.doSpill(CometDiskBlockWriter.java:234)
	at org.apache.spark.sql.comet.execution.shuffle.CometDiskBlockWriter$ArrowIPCWriter.spill(CometDiskBlockWriter.java:454)
	at org.apache.spark.sql.comet.execution.shuffle.SpillWriter.acquireNewPageIfNecessary(SpillWriter.java:141)
	at org.apache.spark.sql.comet.execution.shuffle.CometDiskBlockWriter.insertRow(CometDiskBlockWriter.java:284)
	at org.apache.spark.sql.comet.execution.shuffle.CometBypassMergeSortShuffleWriter.write(CometBypassMergeSortShuffleWriter.java:231)
	at org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)

Steps to reproduce

No response

Expected behavior

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions