-
- Downloads
[SPARK-13823][CORE][STREAMING][SQL] Always specify Charset in String <->...
[SPARK-13823][CORE][STREAMING][SQL] Always specify Charset in String <-> byte[] conversions (and remaining Coverity items) ## What changes were proposed in this pull request? - Fixes calls to `new String(byte[])` or `String.getBytes()` that rely on platform default encoding, to use UTF-8 - Same for `InputStreamReader` and `OutputStreamWriter` constructors - Standardizes on UTF-8 everywhere - Standardizes specifying the encoding with `StandardCharsets.UTF-8`, not the Guava constant or "UTF-8" (which means handling `UnuspportedEncodingException`) - (also addresses the other remaining Coverity scan issues, which are pretty trivial; these are separated into commit https://github.com/srowen/spark/commit/1deecd8d9ca986d8adb1a42d315890ce5349d29c ) ## How was this patch tested? Jenkins tests Author: Sean Owen <sowen@cloudera.com> Closes #11657 from srowen/SPARK-13823.
Showing
- common/network-common/src/main/java/org/apache/spark/network/client/StreamInterceptor.java 1 addition, 2 deletions...va/org/apache/spark/network/client/StreamInterceptor.java
- common/network-common/src/main/java/org/apache/spark/network/protocol/Encoders.java 4 additions, 4 deletions...main/java/org/apache/spark/network/protocol/Encoders.java
- common/network-common/src/main/java/org/apache/spark/network/sasl/SparkSaslServer.java 5 additions, 5 deletions...n/java/org/apache/spark/network/sasl/SparkSaslServer.java
- common/network-common/src/main/java/org/apache/spark/network/util/JavaUtils.java 3 additions, 3 deletions...rc/main/java/org/apache/spark/network/util/JavaUtils.java
- common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java 6 additions, 6 deletions...e/spark/network/shuffle/ExternalShuffleBlockResolver.java
- common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolverSuite.java 22 additions, 14 deletions...rk/network/shuffle/ExternalShuffleBlockResolverSuite.java
- common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleCleanupSuite.java 12 additions, 9 deletions...he/spark/network/shuffle/ExternalShuffleCleanupSuite.java
- common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java 2 additions, 8 deletions...c/main/java/org/apache/spark/unsafe/types/UTF8String.java
- core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala 4 additions, 4 deletions...rc/main/scala/org/apache/spark/api/python/PythonRDD.scala
- core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala 2 additions, 1 deletion...ala/org/apache/spark/api/python/PythonWorkerFactory.scala
- core/src/main/scala/org/apache/spark/api/python/WriteInputFormatTestDataGenerator.scala 2 additions, 2 deletions.../spark/api/python/WriteInputFormatTestDataGenerator.scala
- core/src/main/scala/org/apache/spark/api/r/SerDe.scala 2 additions, 1 deletioncore/src/main/scala/org/apache/spark/api/r/SerDe.scala
- core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala 3 additions, 1 deletion...in/scala/org/apache/spark/deploy/FaultToleranceTest.scala
- core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala 2 additions, 1 deletion.../scala/org/apache/spark/deploy/SparkSubmitArguments.scala
- core/src/main/scala/org/apache/spark/deploy/rest/RestSubmissionClient.scala 2 additions, 2 deletions...a/org/apache/spark/deploy/rest/RestSubmissionClient.scala
- core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala 2 additions, 2 deletions...n/scala/org/apache/spark/deploy/worker/DriverRunner.scala
- core/src/main/scala/org/apache/spark/deploy/worker/ExecutorRunner.scala 2 additions, 2 deletions...scala/org/apache/spark/deploy/worker/ExecutorRunner.scala
- core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala 2 additions, 2 deletions...ala/org/apache/spark/scheduler/EventLoggingListener.scala
- core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala 2 additions, 1 deletion...a/org/apache/spark/serializer/GenericAvroSerializer.scala
- core/src/main/scala/org/apache/spark/util/Utils.scala 3 additions, 2 deletionscore/src/main/scala/org/apache/spark/util/Utils.scala
Loading
Please register or sign in to comment