What challenges have you faced in past teams and how did you resolve the conflict? (one of many STAR based questions in the behavioral interview)
Senior Data Engineer Interview Questions
2,442 senior data engineer interview questions shared by candidates
What is the difference between normalized and de-normalized tables?
Design an ETL solution using Go that would upload CSV files from the directory to Postgres database. Functionality should include: - listing CSV files status (are files already uploaded?) - manual upload from provided CSV file to db - real-time syncing (if file arrived to the folder, and not uploaded yet - ingest data to db)
Por que querer sair da empresa atual?
Perguntas sobre redundância e indepotência de dados.
Signed confidentiality agreement not to convey technical interview information
SQL : 1. create Pivot tables, 2. find the sequence gap and aggregate the result python: 1. Tricky python questions like function and their output 2. Normal and basic level of coding Pyspark: 1. Please check this topics of pyspark Windows functions , date_diff, case when , watermark and aggregation
How is Kafka different from MQ
Round 1 Coding Questions: Write a program to count the number of binary 1s in a number. Example: For 7 → Output should be 3. Write a program to check whether the given input contains valid parentheses. SQL Question: List all employees whose salary is greater than the average salary of their respective department. Scala Theory Question: What is implicit in Scala? Spark Questions: How do you copy data from HDFS to the local file system? What is the command for spark-submit? What is the difference between reduceByKey and groupByKey? What happens during a broadcast join in Spark, and how does it reduce shuffling? What happens when we use the collect() action in Spark? How do you define the minimum and maximum number of executors in Spark?
Times X{open, close} , Y{open, close} rec_type, status, time x1, open, 930 x1, close 1030 x2, open, 1035 y1, open, 1040 y2, open, 1041 x2, close, 1100 x3, open, 1110 x3, close, 1115 y1, close, 1120 y2, close, 1121 |---x1, open, 930 |---x1, close 1030 |-----x2, open, 1035 | y1, open, 1040----| | y2, open, 1041 ---+---| |-----x2, close, 1100 | | |---x3, open, 1110 | | |---x3, close, 1115 | | y1, close, 1120---| | y2, close, 1121-------| Find the pairs of x-type and y-type where they have any time overlap between them.
Viewing 1891 - 1900 interview questions