-
- Downloads
[SPARK-12084][CORE] Fix codes that uses ByteBuffer.array incorrectly
`ByteBuffer` doesn't guarantee all contents in `ByteBuffer.array` are valid. E.g, a ByteBuffer returned by `ByteBuffer.slice`. We should not use the whole content of `ByteBuffer` unless we know that's correct. This patch fixed all places that use `ByteBuffer.array` incorrectly. Author: Shixiong Zhu <shixiong@databricks.com> Closes #10083 from zsxwing/bytebuffer-array.
Showing
- core/src/main/scala/org/apache/spark/network/netty/NettyBlockTransferService.scala 3 additions, 9 deletions...pache/spark/network/netty/NettyBlockTransferService.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala 4 additions, 2 deletions.../main/scala/org/apache/spark/scheduler/DAGScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/Task.scala 2 additions, 2 deletionscore/src/main/scala/org/apache/spark/scheduler/Task.scala
- core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala 4 additions, 1 deletion...a/org/apache/spark/serializer/GenericAvroSerializer.scala
- core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala 2 additions, 2 deletions...in/scala/org/apache/spark/serializer/KryoSerializer.scala
- core/src/main/scala/org/apache/spark/storage/TachyonBlockManager.scala 1 addition, 1 deletion.../scala/org/apache/spark/storage/TachyonBlockManager.scala
- core/src/main/scala/org/apache/spark/util/Utils.scala 14 additions, 1 deletioncore/src/main/scala/org/apache/spark/util/Utils.scala
- core/src/test/java/org/apache/spark/unsafe/map/AbstractBytesToBytesMapSuite.java 3 additions, 2 deletions...apache/spark/unsafe/map/AbstractBytesToBytesMapSuite.java
- core/src/test/scala/org/apache/spark/scheduler/TaskContextSuite.scala 2 additions, 1 deletion...t/scala/org/apache/spark/scheduler/TaskContextSuite.scala
- examples/src/main/scala/org/apache/spark/examples/pythonconverters/AvroConverters.scala 4 additions, 1 deletion...ache/spark/examples/pythonconverters/AvroConverters.scala
- external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala 3 additions, 3 deletions.../org/apache/spark/streaming/flume/FlumeInputDStream.scala
- external/flume/src/test/scala/org/apache/spark/streaming/flume/FlumePollingStreamSuite.scala 2 additions, 2 deletions...pache/spark/streaming/flume/FlumePollingStreamSuite.scala
- external/flume/src/test/scala/org/apache/spark/streaming/flume/FlumeStreamSuite.scala 2 additions, 2 deletions...a/org/apache/spark/streaming/flume/FlumeStreamSuite.scala
- extras/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisStreamSuite.scala 2 additions, 1 deletion...g/apache/spark/streaming/kinesis/KinesisStreamSuite.scala
- sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java 4 additions, 3 deletions...ion/datasources/parquet/UnsafeRowParquetRecordReader.java
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlSerializer.scala 2 additions, 1 deletion...a/org/apache/spark/sql/execution/SparkSqlSerializer.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarTableScan.scala 4 additions, 1 deletion...rk/sql/execution/columnar/InMemoryColumnarTableScan.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystRowConverter.scala 4 additions, 4 deletions.../execution/datasources/parquet/CatalystRowConverter.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala 3 additions, 2 deletions...ache/spark/streaming/scheduler/ReceivedBlockTracker.scala
- streaming/src/main/scala/org/apache/spark/streaming/util/BatchedWriteAheadLog.scala 6 additions, 9 deletions...rg/apache/spark/streaming/util/BatchedWriteAheadLog.scala
Loading
Please register or sign in to comment