AI Testing Specialist
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.
Key details
- Location
- Warsaw, Poland
- Work style
- Onsite
- Level
- Mid level
- Job type
- Full-time
- Experience
- 3–6 yrs
- Function
- Operations & Strategy
- Focus area
- other
- Posted
- 3w ago
Skills
ai/ml
About the role
We are looking for an AI Testing Specialist to support the validation and continuous improvement of AI/ML models used to detect events in football matches. The role focuses on preparing test datasets, comparing model outputs against annotated ground truth, and evaluating performance using precision, recall, and F1-score. The consultant will analyse errors, edge cases, outliers, and complex visual scenarios, document findings, and work closely with ML teams in an iterative feedback loop to improve model accuracy and reliability.
Responsibilities
- Test AI/ML models detecting football match events such as passes, fouls, shots and interceptions
- Prepare test datasets and compare AI results against manually annotated ground truth
- Analyse model performance using precision, recall and F1-score
- Identify errors, edge cases, outliers and unusual scenarios affecting model performance
- Analyse issues such as occlusions, camera angle changes and overlapping actions
- Document findings and provide recommendations to the ML team
- Support annotation and iterative model improvement
- Verify whether implemented changes improve model performance
Requirements
- Master's degree
- 3+ years of relevant experience
- Experience testing / validating AI or ML models
- Experience preparing test datasets
- Experience analysing large datasets for anomalies, outliers and rare scenarios
- Ability to document findings and provide actionable recommendations
- Experience working in an iterative feedback loop with ML/AI teams
Benefits
• Solid, competitive salary
• Work in a multinational environment on international projects
• Comprehensive healthcare
• Long-term B2B contract with a stable project pipeline
Get jobs like this as soon as they're posted
JobSuited checks company career sites all day and ranks every opening against your profile. Free to join.