Data Scientist

Job Description:

The main job of a ML Data Scientist in GenAI Research team focusing on Evals is to produce collect and ensure integrity of evaluation numbers for AI models.

Top Skills Details:

Python

LLM

SQL

Job Responsibilities:

Work with DS DE and Research Science teams to run evals for GenAI models on a number of benchmarks. This requires having a sound understanding of the linux environment being able to troubleshoot errors arising out of parallelization of large models across GPUs for inference purposes.

Identify and help build new evaluations text based multi-modal and others.

Work with a human evaluation team to collect evaluation data and ensure consistency of evaluation settings over time and models.

Help the leadership prepare model performance reports and narrative for sharing internally and externally and driving decisions based on evaluations.

Education/Experience:

Bachelors degree in Computer Science Mathematics Statistics a relevant technical field or equivalent practical experience.

Preferred: Masters or Ph.D. Degree in a quantitative field.

About TEKsystems:

Were partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. Thats the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.