Ai Software Engineer Interview Questions

6,058 ai software engineer interview questions shared by candidates

It was a good interview process.First it started with introduction of myself. Then the interivewer asked about the advanced machine learning topics, Then he moved forward with the question, what is brute force in machine learning and what is best fit circle.
avatar

AI/ML Engineer

Interviewed at IDfy

3.7
Jul 30, 2025

It was a good interview process.First it started with introduction of myself. Then the interivewer asked about the advanced machine learning topics, Then he moved forward with the question, what is brute force in machine learning and what is best fit circle.

How do you scale a LLM microservice if it has 10min cold start up time? How to load balance LLM service? How to scale up high servicec load? Whats the difference between ... and rerank? Explain why and how NN activation maps in consume GPU memory. Explain activation functions and its function in FFNs. What is LORA? How do you decrease model size (Quantization, etc)? How do you decide to shift to more complex model architecture (how do you evaluate that the simpler model reached its max capability)? More questions I don't remember
avatar

AI LLM Engineer

Interviewed at Deutsche Telekom

3.8
Jul 2, 2025

How do you scale a LLM microservice if it has 10min cold start up time? How to load balance LLM service? How to scale up high servicec load? Whats the difference between ... and rerank? Explain why and how NN activation maps in consume GPU memory. Explain activation functions and its function in FFNs. What is LORA? How do you decrease model size (Quantization, etc)? How do you decide to shift to more complex model architecture (how do you evaluate that the simpler model reached its max capability)? More questions I don't remember

Viewing 4731 - 4740 interview questions

Glassdoor has 6,058 interview questions and reports from Ai software engineer interviews. Prepare for your interview. Get hired. Love your job.