AI Evaluation Engineer/Researcher
Abuja, Nigeria1mo ago
Key details
- Location
- Abuja, Nigeria
- Work style
- Onsite
- Job type
- Full-time
- Function
- Software engineering
- Focus area
- AI / ML
- Posted
- 1mo ago
Skills
llmpython
About the role
Summary
This position at HumAngle focuses on testing, comprehending, and refining artificial intelligence systems tailored for journalism, human security, humanitarian analysis, and African contexts. The role is pivotal in supporting the organization's strategic goal of developing locally grounded humanitarian AI that accurately interprets African conflict environments while ensuring human judgment remains central to decision-making processes.
Responsibilities
- Acquire proficiency in contemporary methodologies for assessing large language models and diverse AI architectures.
- Plan and execute structured evaluation protocols under the guidance of senior researchers.
- Create and curate comprehensive evaluation datasets, test scenarios, scoring rubrics, and performance benchmarks.
- Evaluate model responses to determine accuracy, contextual relevance, potential bias, safety compliance, and areas of failure.
- Assess how AI technologies interpret specific dynamics within Nigerian, Sahelian, and broader African conflict and humanitarian landscapes.
- Perform comprehensive literature reviews and replicate relevant scientific experiments.
- Leverage Python and specialized research tools to automate assessment workflows and analyze outcome data.
- Document research methodologies, key findings, identified limitations, and ensure reproducibility of results.
- Collaborate with journalists, subject-matter experts, researchers, and engineers to integrate local insights into the evaluation framework.
- Formulate independent research questions and design experiments with increasing autonomy.
How well do you match this job?
Skills
Experience
Level
Title
Location
Salary
Freshness
Similarity
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.