Data Engineer Interview Questions

18,790 data engineer interview questions shared by candidates

1. Explain about your projects 2. What and how will optimise spark jobs in your work(Spark related questions) 3. How will justify reliability and durability of data 4. What is Lineage graph and check points in Spark 5. Explain Strategic of Spark Coding 1. Input is an array of integers. There is a sliding window of size W which is moving from the very left of the array to the very right. Each time the sliding window moves rightwards by one position. Find the maximum number from each window. Input array is [1, 3, -1, -3, 5, 3, 6, 7] and Sliding window (W) is 3. Output array is [3, 3, 5, 5, 6, 7] 2. Write a query to provide number of times an employee got increment and max increment he has got along with columns emp_id, emp_name, joining_date, dept_name Additional info: a. An emp may not be tagged to any dept b. An emp may not have got any hike Emp table emp_id | emp_name | joining_date | Dept_id Dept table dept_id | dept_name | Dept_Location | Dept_Manager salary_increase table emp_id | increment_date | inc_amount 3. Write a Python program to find element in a list from current element to next index list is ["Mon","Tue","Wed","Thu","Fri","Sat","Sun"] If current element is “Wed” and next index is 2, result is “Fri” If current element is “Sat” and next index is 23 (cyclic), result is “Mon”
avatar

Senior Data Engineer

Interviewed at NIKE

3.9
Sep 16, 2021

1. Explain about your projects 2. What and how will optimise spark jobs in your work(Spark related questions) 3. How will justify reliability and durability of data 4. What is Lineage graph and check points in Spark 5. Explain Strategic of Spark Coding 1. Input is an array of integers. There is a sliding window of size W which is moving from the very left of the array to the very right. Each time the sliding window moves rightwards by one position. Find the maximum number from each window. Input array is [1, 3, -1, -3, 5, 3, 6, 7] and Sliding window (W) is 3. Output array is [3, 3, 5, 5, 6, 7] 2. Write a query to provide number of times an employee got increment and max increment he has got along with columns emp_id, emp_name, joining_date, dept_name Additional info: a. An emp may not be tagged to any dept b. An emp may not have got any hike Emp table emp_id | emp_name | joining_date | Dept_id Dept table dept_id | dept_name | Dept_Location | Dept_Manager salary_increase table emp_id | increment_date | inc_amount 3. Write a Python program to find element in a list from current element to next index list is ["Mon","Tue","Wed","Thu","Fri","Sat","Sun"] If current element is “Wed” and next index is 2, result is “Fri” If current element is “Sat” and next index is 23 (cyclic), result is “Mon”

Three SQL queries one was to JOIN two tables to pull required results. Second was about Group & Order by. Third was Window query all very simple and basic. One Python related to write a function to sort an array so it produce only odd numbers.
avatar

Data Engineer

Interviewed at Amazon

3.5
Jun 16, 2021

Three SQL queries one was to JOIN two tables to pull required results. Second was about Group & Order by. Third was Window query all very simple and basic. One Python related to write a function to sort an array so it produce only odd numbers.

It wasn't the sort of interview you could characterise by listing questions. Each interview probed a different facet of the job (e.g. database knowledge, customer skills, coding, etc.). They were all disconnected: I had the impression I was interviewing for 8 different jobs.
avatar

Principal Data Engineer

Interviewed at Amazon

3.5
Jan 13, 2021

It wasn't the sort of interview you could characterise by listing questions. Each interview probed a different facet of the job (e.g. database knowledge, customer skills, coding, etc.). They were all disconnected: I had the impression I was interviewing for 8 different jobs.

Viewing 1871 - 1880 interview questions

Glassdoor has 18,790 interview questions and reports from Data engineer interviews. Prepare for your interview. Get hired. Love your job.