Machine Learning Engineer – On-Premise LLM Agents - Madagascar
JOB DESCRIPTION Machine Learning Engineer – On-Premise LLM Agents Information Technology |
Ref.: DIA-2026-IT-18 |
■ Location | ■ Seniority | ■ Estimated duration | ■ Contract |
Madagascar – Remote | Senior – 5 to 10 years | 6 months to 1 year | To be confirmed |
ABOUT THE PROJECT
Our client, an international multi-entity group, is building a security-critical, privacy-first information system on its own on-premise infrastructure: hardened mobile and desktop applications, hardware-key authentication, legally isolated data for each group entity, and self-hosted finance and AI capabilities.
The programme is delivered by a senior, multi-disciplinary team working in two-week agile sprints, with compartmentalised access and a strong culture of security by design.
WORK ARRANGEMENT
This is a remote position: you will work from home, from Madagascar. No attendance at DI-Africa's offices is required.
THE ROLE
Build on-premise LLM agents supporting accounting and finance teams, with strict tool policies, per-entity retrieval and evaluation harnesses, on an air-gapped GPU infrastructure.
KEY RESPONSIBILITIES
● Deploy quantised open-weight models (7B–32B class) on llama.cpp, with vLLM as fallback.
● Build accounting and finance agents with hard tool policies and restriction lists.
● Implement per-entity RAG with strict tenant isolation for AI.
● Build evaluation harnesses for agent quality and safety.
● Integrate agents with ERP tools, the ERP remaining the sole caller.
TECHNICAL ENVIRONMENT
● Python (serving, evaluation, RAG, agents), CUDA literacy, Go / TypeScript integration.
● llama.cpp, vLLM, Qwen / DeepSeek / Mistral-class models.
● Air-gapped GPU network, signed model weights.
PROFILE
Location | ● Based in Madagascar, working remotely from home. |
Experience | ● Senior – 5 to 10 years of relevant professional experience. |
Required skills | ● Production on-premise LLM. ● Hard tool policies. ● Evaluation harnesses. ● Tenant isolation for AI. |
Nice to have | ● Quantisation and multi-GPU. ● Document AI. |
Languages | ● Professional English required; French is a plus. |
Ways of working | ● Work independently on software development tasks. ● Write clean, straightforward, efficient code that meets acceptance criteria and specifications. ● Cover code with unit, property and integration tests where applicable. ● Write code documentation. ● Willingness to handle hardware: YubiKeys, HSMs, air-gapped machines, phone flashing. ● Comfortable working with compartmentalised access. ● Proactive, requiring minimal supervision or mentoring. ● Proactive in identifying potential problems and implementing solutions. ● Efficient time management and respect of deadlines. ● Practical experience with agile software development methods. |
HR Consulting · www.di-africa.com
Confidential – For recruitment purposes only
À propos de DI-Africa
DI-Africa accompagne les groupes industriels, miniers, pétroliers et de services dans leurs recrutements en Afrique : portage salarial (EOR), recrutement & sourcing, paie & conformité, immigration & permis de travail, mobilité internationale, assurance santé.
Notre process de recrutement
- Candidature en ligne — accusé de réception sous 48 h.
- Entretien DI-Africa — échange avec un consultant recrutement.
- Entretien client — présentation de la short-list au client.
- Offre & intégration — nous vous accompagnons jusqu'à la prise de poste.
Ce poste vous correspond ?
Votre candidature est traitée par l'équipe Recrutement DI-Africa.
Postuler maintenant Toutes les offres