AI/LLM Data Intelligence Engineer

About the Role

This role sits at the heart of Clearstate's AI-powered data intelligence engine for the global MedTech market, where you will design and own the LLM-based ingestion and analysis pipeline that transforms large volumes of unstructured proprietary data into high-accuracy structured intelligence.

You will work closely with research analysts and operations leadership to understand the domain, shape the architecture, and prove what is possible - then build it into production.

Key Responsibilities

• Design and own the LLM-based ingestion and analysis pipeline that transforms large volumes of unstructured proprietary data into high-accuracy structured intelligence.
• Work closely with research analysts and operations leadership to understand the domain, shape the architecture, and prove what is possible - then build it into production.
• Immerse yourself in Clearstate's data, understand the structure of interview transcripts, import datasets, HS code mappings, and market sizing models.
• Audit existing Python scripts, Google Apps Scripts, and ML experiments to understand the current state.
• Define the pre-processing pipeline, convert raw PDFs, Word documents and structured files into clean, normalised inputs suitable for LLM ingestion.
• Implement domain-specific validation rules to catch hallucinations and data errors before they reach analysts.

Skills & Qualifications

• Strong Python engineering skills, with the ability to write clean, testable, production-quality code.
• Deep practical knowledge of large language models, including prompt engineering, temperature / sampling parameters, context management, hallucination mitigation.
• Experience pre-processing unstructured data (PDFs, Word, HTML, plain text) into structured formats suitable for LLM input.
• Familiarity with open-source LLM frameworks (Hugging Face, Ollama, vLLM, LangChain, or similar).
• Understanding of structured output extraction from LLM responses (JSON schema, function calling, constrained generation).
• Solid grounding in data engineering, including ETL/ELT concepts, SQL, data pipeline design.
• Ability to design and run rigorous accuracy evaluations and build confidence in model outputs.
• Strong scientific rigour, with the ability to validate before shipping and quantify improvement.

What You'll Learn

In this role, you will gain hands-on experience with large language models, data engineering, and AI development tools, as well as a deep understanding of the MedTech industry and Clearstate's data assets.

You will learn to design and build scalable, production-ready pipelines, and to work closely with research analysts and operations leadership to understand the domain and shape the architecture.

You will also develop strong scientific rigour, with the ability to validate before shipping and quantify improvement.

Resume Tip

When applying for this role, be sure to highlight your experience with large language models, data engineering, and AI development tools, as well as your ability to design and run rigorous accuracy evaluations.

Include specific examples of your work, such as projects or code repositories, to demonstrate your skills and experience.

Also, be sure to tailor your resume to the specific requirements of the role, and to use language from the job description to describe your skills and experience.