AI Engineer - GenAI & Customer Service
GeekSoft Consulting
1 day ago
Contract
On-site
Utrecht, Utrecht, Netherlands
Generative AI
- Help design, build and continuously improve the clients online platform.
- Research, suggest and implement new technology solutions following best practices/standards.
- Take responsibility for the resiliency and availability of different products.
- Be a productive member of the team.
Requirements
- AI Data & Evaluation Engineer to work within a Scrum team, preparing, structuring, enriching, and validating enterprise data for AI knowledge bases and AI chatbots.
- Build and maintain Databricks data pipelines to process structured and unstructured data for AI knowledge bases.
- Prepare, clean, transform, and enrich source data to improve the quality and reliability of information used by AI assistants.
- Develop and maintain evaluation datasets covering realistic conversations, complex scenarios, edge cases, and multi-step workflows.
- Apply evaluation frameworks to test advanced chatbots across single-turn, multi-turn, simulation-based, and agentic scenarios.
- Implement automated testing, monitoring, and quality gates for changes to data, prompts, models, retrieval, and orchestration.
- Deploy and manage cloud infrastructure using Infrastructure as Code, particularly Azure Bicep and CI/CD pipelines.
- Analyze evaluation results and translate findings into improvements across knowledge, retrieval, prompts, tools, and application logic.
- Strong proficiency in Python, data engineering, and automated testing.
- Hands-on experience with Azure, Databricks, DevOps, CI/CD, and Infrastructure as Code, preferably Bicep.
- Experience building data pipelines and preparing structured and unstructured enterprise data for AI knowledge bases and RAG applications.
- Experience with chatbot evaluation, including multi-turn, simulated, and agentic interactions.
- Familiarity with Context Engineering, Agentic AI, Function Calling, retrieval strategies, and tool use.
- Strong engineering and data-quality mindset with an affinity for Agile development.
- Strong critical thinking, ownership, accountability, and problem-solving skills.
- Excellent communication skills and a customer-focused approach.
-
Relevant HBO or university degree and fluency in English.
Benefits
- A challenging, innovating environment.
-
Opportunities for learning where needed.