1. Explain about your projects 2. What and how will optimise spark jobs in your work(Spark related questions) 3. How will justify reliability and durability of data 4. What is Lineage graph and check points in Spark 5. Explain Strategic of Spark Coding 1. Input is an array of integers. There is a sliding window of size W which is moving from the very left of the array to the very right. Each time the sliding window moves rightwards by one position. Find the maximum number from each window. Input array is [1, 3, -1, -3, 5, 3, 6, 7] and Sliding window (W) is 3. Output array is [3, 3, 5, 5, 6, 7] 2. Write a query to provide number of times an employee got increment and max increment he has got along with columns emp_id, emp_name, joining_date, dept_name Additional info: a. An emp may not be tagged to any dept b. An emp may not have got any hike Emp table emp_id | emp_name | joining_date | Dept_id Dept table dept_id | dept_name | Dept_Location | Dept_Manager salary_increase table emp_id | increment_date | inc_amount 3. Write a Python program to find element in a list from current element to next index list is ["Mon","Tue","Wed","Thu","Fri","Sat","Sun"] If current element is “Wed” and next index is 2, result is “Fri” If current element is “Sat” and next index is 23 (cyclic), result is “Mon”
Data Engineer Interview Questions
18,790 data engineer interview questions shared by candidates
What would motivate me to work at Baires?
Mi experience with cdc approach challenging
How to select department wise top 3 salaries for each department. Note limit doesn’t work here
Can you write a PySpark code snippet to load a JSON file and perform a filter operation on a column named H?to find records h greater than 30
On SQL, Python, Data Engineering and Data Modelling Concepts
Three SQL queries one was to JOIN two tables to pull required results. Second was about Group & Order by. Third was Window query all very simple and basic. One Python related to write a function to sort an array so it produce only odd numbers.
Describe a situation that your colleague failed the job and what did you do?
I have signed NDA so I can't disclose those but glassdoor has lot of such already mentioned by others.
It wasn't the sort of interview you could characterise by listing questions. Each interview probed a different facet of the job (e.g. database knowledge, customer skills, coding, etc.). They were all disconnected: I had the impression I was interviewing for 8 different jobs.
Viewing 1871 - 1880 interview questions