Public summary
A leading European digital investment and banking platform seeks an AI Platform Engineer to develop and maintain infrastructure for generative AI applications. The role involves building an AI provisioning platform, ensuring secure, performant, and cost-effective AI workflows, and collaborating with AI software engineers within a cross-functional team. The company offers a dynamic fintech environment, international team culture, career development opportunities, flexible working models, relocation support, and various employee benefits.
Location and work setup
- Location
- Berlin
- Remote status
- Unknown
- German requirement signal
- No German Required Detected
- Detected job language
- English
Responsibilities
Design, develop, and maintain an internal AI provisioning platform for seamless access to multiple language models (LLMs) and servers. Implement observability, logging, and alerting for LLM usage, enforcing model governance including security, data privacy, rate limiting, and cost management. Collaborate with AI software engineers on cloud-native architectures and agentic workflow integrations. Monitor the reliability and performance of production AI systems to ensure optimal operation.
Qualifications
Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field. Several years of experience in Platform Engineering, DevOps, SRE, or backend development. Proficiency with cloud infrastructure (preferably AWS) and Infrastructure as Code (Terraform). Strong programming skills in Python, Go, or similar languages and experience with CI/CD pipelines and containerization tools like Docker. Knowledge of API cost management, security standards, and data privacy for AI. Willingness to work with or learn LLM gateways, telemetry, and observability platforms such as LiteLLM, Langfuse, and Datadog. Strong problem-solving skills and the ability to work effectively within a collaborative, cross-functional AI and data science team.