AI Agent Engineer

About the Role

This AI Agent Engineer role involves designing, building, and optimizing AI agents and the infrastructure used to evaluate their real-world performance. You'll work on agent frameworks, orchestration pipelines, benchmarking systems, and evaluation tools while collaborating with researchers and engineers to improve the reliability and effectiveness of modern AI systems.

As an AI Agent Engineer at Dusker AI, you'll have the opportunity to work on cutting-edge projects that involve developing AI agents using modern agentic frameworks, integrating LLMs, vector databases, APIs, and external tools, and collaborating with research, product, and engineering teams to improve agent behavior.

Key Responsibilities

• Design and develop AI agents using modern agentic frameworks.
• Build and integrate agent orchestration pipelines and evaluation workflows.
• Develop benchmarking scenarios and automated test harnesses.
• Analyze agent performance across reasoning, reliability, safety, and robustness.
• Integrate LLMs, vector databases, APIs, and external tools into AI agents.
• Collaborate with research, product, and engineering teams to improve agent behavior.
• Maintain production-quality code and documentation.
• Contribute to internal tooling that streamlines AI evaluation and benchmarking.

Skills & Qualifications

• Strong programming skills in Python, TypeScript/JavaScript, or similar languages.
• Experience with LLMs, LangChain, LangGraph, PyTorch, TensorFlow, or other AI frameworks.
• Hands-on experience building AI agents or agentic workflows.
• Knowledge of AI evaluation, benchmarking methodologies, and performance metrics.
• Experience with APIs, distributed systems, cloud platforms (AWS, GCP, or Azure), and observability tools.
• Strong analytical, problem-solving, and communication skills.
• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.

What You'll Learn

In this role, you'll gain hands-on experience with cutting-edge AI technologies, including LLMs, LangChain, and PyTorch. You'll also develop strong analytical and problem-solving skills, as well as the ability to collaborate effectively with cross-functional teams.

As an AI Agent Engineer at Dusker AI, you'll have the opportunity to work on a wide range of projects that involve developing AI agents, integrating LLMs, and collaborating with research and engineering teams. This will help you develop a deep understanding of AI evaluation, benchmarking methodologies, and performance metrics.

Resume Tip

When applying for this role, be sure to highlight your hands-on experience with AI frameworks, such as PyTorch and TensorFlow. Also, be prepared to provide specific examples of how you've applied AI evaluation and benchmarking methodologies in previous projects or roles.