How do you debug spark jobs?
Data Engineer Interview Questions
18,785 data engineer interview questions shared by candidates
Given a timeseries dataset with the following columns: device_type, timestamp, number_of_requests. Find a the minute in which the next 60 minutes sum up to the greatest total for each type of device.
what is the most complex thing you faced in your recent project?how did you resolve that?what was your approach?what did you learn from that
Q: The USA and Russia has the Largest natural gas resources in the world. Qater is 4th although 849 times smaller than USA. Which Country ranks 3rd?
Mostly CV based Questions were asked.
SQL (follow up) Now imagine that you have a user that is "always" accessing table A, but you need to move the changes (in 10000 rows) from the temp table into table A without the user being affected. How would you do that ?
SQL Imagine you want to make some changes to table A, without actually changing table A. How do you do it ?
Python: Have you ever used a context manager ?
Are you willing to relocate?
Tell me about the main differences between transient clusters and permanent (& shared) clusters?
Viewing 1791 - 1800 interview questions
See Interview Questions for Similar Jobs
Modeling EngineerAnalytics EngineerPerl DeveloperDatawarehouse DeveloperEtl DeveloperData ModelerDatastage DeveloperEtl TesterData AnalystOracle Data IntegratorMachine Learning ScientistData ScientistData MinerBusiness Objects DeveloperDatabase AdministratorData Warehouse DeveloperData Warehouse ManagerData Warehouse ArchitectBusiness Intelligence Specialist