3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 186 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
58 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
386.0 KiB / 3989
Shuffle Write Size / Records:
68.4 KiB / 797
Associated Job Ids:
117
DAG Visualization
digraph G { subgraph clusterstage_186 { label="Stage 186"; subgraph cluster1760 { label="Scan csv "; 840 [labelType="html" label="FileScanRDD [840]<br>toJavaRDD at AbsExportExecutor.java:55"]; 841 [labelType="html" label="MapPartitionsRDD [841]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1756 { label="WholeStageCodegen (3)"; 842 [labelType="html" label="MapPartitionsRDD [842]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1765 { label="Scan csv "; 843 [labelType="html" label="FileScanRDD [843]<br>toJavaRDD at AbsExportExecutor.java:55"]; 844 [labelType="html" label="MapPartitionsRDD [844]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1761 { label="WholeStageCodegen (4)"; 845 [labelType="html" label="MapPartitionsRDD [845]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1755 { label="Union"; 846 [labelType="html" label="UnionRDD [846]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1754 { label="Exchange"; 847 [labelType="html" label="MapPartitionsRDD [847]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 840->841; 841->842; 843->844; 844->845; 842->846; 845->846; 846->847; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time