Software Engineer-AI

About the Role

This Software Engineer-AI role is part of Telnyx's broader AI organization, focusing on developing platforms, services, and tooling that support AI-powered products. You'll work in a fast-paced environment where reliability, performance, and usability matter just as much as innovation.

You'll be part of a team that builds highly available, low-latency microservices using modern, cloud-native technologies, and contribute to AI inference, embeddings, and platform services that support real-time and low-latency workloads.

Key Responsibilities

• Build, test, and deploy scalable microservices for AI-powered systems, including text and voice processing.
• Design developer-friendly APIs, agents, and internal tools that make AI easy to use across the Telnyx product ecosystem.
• Contribute to AI inference, embeddings, and platform services that support real-time and low-latency workloads.
• Optimize performance, reliability, and observability in production environments.
• Collaborate closely with Product, Infrastructure, and ML teams to bring features from ideation to production.
• Troubleshoot, debug, and support critical systems running in production.
• Participate in code reviews and uphold high engineering and operational standards.

Skills & Qualifications

• Strong understanding of async programming, concurrency, and parallel execution.
• Experience with microservice-based systems.
• Excellent communication skills and the ability to work effectively across teams.
• Familiarity with LLM frameworks and tools (e.g. PyTorch, Transformers, DeepSpeed, vLLM).
• Experience with distributed computing frameworks such as Ray (Ray Core, Serve, Train).
• Exposure to cloud-native stacks (Docker, Kubernetes, Prometheus, Jaeger).
• Knowledge of LLM optimization techniques (e.g. quantization, speculative decoding).
• Background in Retrieval Augmented Generation (RAG) systems.
• Bachelor's or Master's degree in Computer Science or related field.
• 0-2 years of experience in software engineering, preferably in AI/ML.

What You'll Learn

In this role, you'll gain hands-on experience with building and deploying scalable microservices for AI-powered systems, and contribute to the development of AI inference, embeddings, and platform services.

You'll work closely with experienced engineers and learn from them, and have the opportunity to take ownership of meaningful projects and contribute ideas that shape the product roadmap.

Resume Tip

When applying for this role, make sure to highlight your experience with cutting-edge AI tooling and your ability to build and deploy scalable microservices. Emphasize your problem-solving skills and ability to work effectively across teams.

Also, be specific about your experience with LLM frameworks and tools, distributed computing frameworks, and cloud-native stacks. This will help the hiring team understand your skills and experience better.