-
- Downloads
SPARK-5199. FS read metrics should support CombineFileSplits and track bytes from all FSs
...mbineFileSplits Author: Sandy Ryza <sandy@cloudera.com> Closes #4050 from sryza/sandy-spark-5199 and squashes the following commits: 864514b [Sandy Ryza] Add tests and fix bug 0d504f1 [Sandy Ryza] Prettify 915c7e6 [Sandy Ryza] Get metrics from all filesystems cdbc3e8 [Sandy Ryza] SPARK-5199. Input metrics should show up for InputFormats that return CombineFileSplits
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala 6 additions, 10 deletions.../main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala
- core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala 0 additions, 1 deletion...rc/main/scala/org/apache/spark/executor/TaskMetrics.scala
- core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala 7 additions, 5 deletionscore/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala
- core/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala 8 additions, 7 deletionscore/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala
- core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala 4 additions, 7 deletions...rc/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala
- core/src/test/scala/org/apache/spark/metrics/InputOutputMetricsSuite.scala 95 additions, 2 deletions...la/org/apache/spark/metrics/InputOutputMetricsSuite.scala
Loading
Please register or sign in to comment