AI/LLM Engineer

Andersen is hiring an AI/LLM Engineer to enhance a secure cloud-based board management platform. The role focuses on improving collaboration features, meeting tools, and analytics for executive governance.

The customer is a provider of a secure SaaS platform that supports executive and board-level collaboration. Their solution streamlines meeting preparation, document sharing, and decision-making for organizations across multiple industries. They focus on improving governance efficiency and ensuring a clear, reliable communication environment for leadership teams.

The project is focused on improving a secure, cloud-based board management platform by enhancing meeting tools, collaboration features, and analytics to support efficient and informed governance.

Responsibilities:

• Designing and maintaining a centralized platform for prompt management, versioning, and A/B testing.
• Implementing observability and evaluation frameworks to trace LLM calls and measure model performance.
• Researching and selecting tools and technologies for monitoring, evaluation, and future ML workloads.
• Leading the technical strategy for scalable and secure LLM infrastructure.
• Collaborating with cross-functional teams to integrate LLM capabilities into production systems.
• Conducting technical spikes, contributing to sprint planning, and documenting solutions.

Must-haves:

• Experience in AI/ML engineering focused on LLM-based solutions for 5+ years.
• Strong Python development skills and experience with modern LLM frameworks.
• Proven hands-on experience with LangChain or Semantic Kernel.
• Deep understanding of RAG pipelines (document chunking, retrieval optimization, multi-step summarization).
• Experience building and deploying AI Agents.
• Familiarity with LLM observability and evaluation tools such as Langfuse or Arize.
• Proficiency with Azure OpenAI and Azure Service Bus.
• Ability to design scalable APIs and integrate AI components with .NET backend systems.
• Level of English – Upper-Intermediate and above.

Nice-to-haves:

• Experience in model fine-tuning and domain adaptation.
• Practical knowledge of A/B testing, prompt management, and versioning.
• Understanding of observability metrics and evaluation best practices for LLMs.
• Experience collaborating in cross-functional teams within agile environments.
• Ability to contribute to technical strategy for scalable and secure LLM infrastructure.

Reasons why this job would be interesting to you:

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc.
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Your personal data is protected in accordance with GDPR regulations.

Join us!