3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1352 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 2
Input Size / Records:
23.4 KiB / 420
Output Size / Records:
0.0 B / 420
Associated Job Ids:
899
DAG Visualization
digraph G { subgraph clusterstage_1352 { label="Stage 1352"; 3930 [labelType="html" label="SQLExecutionRDD [3930]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3935 [labelType="html" label="SQLExecutionRDD [3935]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster9379 { label="Scan parquet "; 3926 [labelType="html" label="FileScanRDD [3926]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3927 [labelType="html" label="MapPartitionsRDD [3927]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9375 { label="WholeStageCodegen (1)"; 3928 [labelType="html" label="MapPartitionsRDD [3928]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9374 { label="DeserializeToObject"; 3929 [labelType="html" label="MapPartitionsRDD [3929]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9380 { label="mapPartitions"; 3931 [labelType="html" label="MapPartitionsRDD [3931]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9381 { label="map"; 3932 [labelType="html" label="MapPartitionsRDD [3932]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster9383 { label="WholeStageCodegen (1)"; 3933 [labelType="html" label="MapPartitionsRDD [3933]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9382 { label="DeserializeToObject"; 3934 [labelType="html" label="MapPartitionsRDD [3934]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9386 { label="mapPartitions"; 3936 [labelType="html" label="MapPartitionsRDD [3936]<br>jdbc at SqlDbWriter.java:111"]; } } 3926->3927; 3927->3928; 3928->3929; 3929->3930; 3930->3931; 3931->3932; 3932->3933; 3933->3934; 3934->3935; 3935->3936; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time