What are data quality metric you would implement for a real-time ingestion pipeline ?
Senior Data Engineer Interview Questions
2,395 senior data engineer interview questions shared by candidates
Write a SQL and PySpark code to display the 2nd lowest salary employees for each department having more than 10 employees, along with their employee name and department name. Two tables Employee and Department is giving? What to use Row_Number, Rank or Dense Rank?
Project management, SQL, Spark, Python
A few generic questions around Data Warehousing/ETL approach, scenario based questions. One interviewer was asking questions from Interview Q&A website, was not happy if answers and terms didn't match exactly. You don't ask syntactical questions to experienced staff who can lookup manual in a minute and figure things out.
Quais serviços de cloud (GCP) você usa ou já usou ?
Technical and few behavioral questions
Very broad range of questions covering data engineering, data science, distributed computing, architecture... and specialties like record linkage / deduplication + multiple code exercises
Are you from IIT or NIT?
This was a Scala position but they were open to allowing me to use Python or Java for the interview. Standard data eng questions - SQL, Spark, ETL, and some not so standard like API and microservices. I have not been actively interviewing, some of these questions were hard as I was very rusty.
On window Functions, Query optimization and BIg Query optimization
Viewing 1361 - 1370 interview questions