Implementing data processing job in with spark and postgresql.
Senior Data Engineer Interview Questions
2,442 senior data engineer interview questions shared by candidates
The HR interview was just a relaxed chat based around values and general compatibility for the role. They ensured that you have done your reading around the company and role. The tech challenge was python based, using a provided API to gather/filter/resubmit data. You had to upload the solution along with appropriate tests to Git. The engineer interview didn’t cover the tech challenge solution at all (surprisingly). It was a general discussion on past experience and projects. Later it switched gears to some more general questions like ‘what is etl?’ or ‘tell us about data streaming products?’ or ‘what problems have you had using semi-structured or unstructured data?’. AWS experience and services used was also covered. The whiteboard session I found the hardest part and was again scenario based where you had to diagnose problems in a process and work with the other engineers to come up with a solution. Later (once the main problem had been covered) more requirements/problems were added to see how you thought on your feed and you were questioned on which products you would use (and why)
what is the meaning of big o notation
Third pat - payroll, Azure services, Databricks, optimizations
2 rounds of technical interview plus 1 hr discussion revolving around projects,past experiences, questions on skills and technology
Signed a NDA so cannot go over the actual details. The interviews were a good mix of algorithms data structures and system designs question. Since I applied for a very specialized role there was more focus on my actual skill set.
SQL and Spark queries that compute aggregates across multiple big tables
Like leetcode code questions
Transaction isolation levels
Tell me the toughest challenges you faced in your current project
Viewing 711 - 720 interview questions