3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 87 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 2
Output Size / Records:
0.0 B / 11307
Shuffle Read Size / Records:
2.2 MiB / 56111
Associated Job Ids:
54
DAG Visualization
digraph G { subgraph clusterstage_87 { label="Stage 87"; 401 [labelType="html" label="SQLExecutionRDD [401] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 406 [labelType="html" label="SQLExecutionRDD [406] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster809 { label="AQEShuffleRead"; 394 [labelType="html" label="ShuffledRowRDD [394] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster806 { label="WholeStageCodegen (9)"; 395 [labelType="html" label="MapPartitionsRDD [395] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster814 { label="AQEShuffleRead"; 396 [labelType="html" label="ShuffledRowRDD [396] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster811 { label="WholeStageCodegen (10)"; 397 [labelType="html" label="MapPartitionsRDD [397] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster800 { label="WholeStageCodegen (11)"; 398 [labelType="html" label="ZippedPartitionsRDD2 [398] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 399 [labelType="html" label="MapPartitionsRDD [399] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster799 { label="DeserializeToObject"; 400 [labelType="html" label="MapPartitionsRDD [400] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster815 { label="mapPartitions"; 402 [labelType="html" label="MapPartitionsRDD [402] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster816 { label="map"; 403 [labelType="html" label="MapPartitionsRDD [403] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster818 { label="WholeStageCodegen (1)"; 404 [labelType="html" label="MapPartitionsRDD [404] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster817 { label="DeserializeToObject"; 405 [labelType="html" label="MapPartitionsRDD [405] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster821 { label="mapPartitions"; 407 [labelType="html" label="MapPartitionsRDD [407] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } } 394->395; 396->397; 395->398; 397->398; 398->399; 399->400; 400->401; 401->402; 402->403; 403->404; 404->405; 405->406; 406->407; }
393,394
386,396
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time