Sr Data Engineer Interview Questions

2,437 sr data engineer interview questions shared by candidates

State and describe the different types of SQL joins. What is referential integrity? With regard to statistics and machine learning, state your knowledge of: p-value, hypothesis testing, overfitting, ensembling. With regard to working on the command-line, demonstrate your knowledge of these tools: awk, cat, cut, grep, sed.
avatar

Senior Data Engineer

Interviewed at Atomwise

3.6
Jun 25, 2019

State and describe the different types of SQL joins. What is referential integrity? With regard to statistics and machine learning, state your knowledge of: p-value, hypothesis testing, overfitting, ensembling. With regard to working on the command-line, demonstrate your knowledge of these tools: awk, cat, cut, grep, sed.

1. Can you provide an overview of your experience working with PySpark and big data processing? 2. What motivated you to specialize in PySpark, and how have you applied it in your previous roles? 3. Explain the basic architecture of PySpark. 4. How does PySpark relate to Apache Spark, and what advantages does it offer in distributed data processing? 5. Describe the difference between a DataFrame and an RDD in PySpark.
avatar

Senior Data Engineer

Interviewed at Pantar Solutions

4.6
Jul 31, 2024

1. Can you provide an overview of your experience working with PySpark and big data processing? 2. What motivated you to specialize in PySpark, and how have you applied it in your previous roles? 3. Explain the basic architecture of PySpark. 4. How does PySpark relate to Apache Spark, and what advantages does it offer in distributed data processing? 5. Describe the difference between a DataFrame and an RDD in PySpark.

Viewing 331 - 340 interview questions

Glassdoor has 2,437 interview questions and reports from Sr data engineer interviews. Prepare for your interview. Get hired. Love your job.