3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 171 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
94 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
386.0 KiB / 3989
Shuffle Write Size / Records:
68.4 KiB / 797
Associated Job Ids:
108
DAG Visualization
digraph G { subgraph clusterstage_171 { label="Stage 171"; subgraph cluster1607 { label="Scan csv "; 765 [labelType="html" label="FileScanRDD [765]<br>toJavaRDD at AbsExportExecutor.java:55"]; 766 [labelType="html" label="MapPartitionsRDD [766]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1603 { label="WholeStageCodegen (3)"; 767 [labelType="html" label="MapPartitionsRDD [767]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1612 { label="Scan csv "; 768 [labelType="html" label="FileScanRDD [768]<br>toJavaRDD at AbsExportExecutor.java:55"]; 769 [labelType="html" label="MapPartitionsRDD [769]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1608 { label="WholeStageCodegen (4)"; 770 [labelType="html" label="MapPartitionsRDD [770]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1602 { label="Union"; 771 [labelType="html" label="UnionRDD [771]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1601 { label="Exchange"; 772 [labelType="html" label="MapPartitionsRDD [772]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 765->766; 766->767; 768->769; 769->770; 767->771; 770->771; 771->772; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time