Back to all jobs
G

AI Content Specialist (Mathematics & Python)

Gramian

Remote · vn Contract 11d ago

Job description

# AI Content Specialist (Mathematics & Python) > Gramian Consulting Group · Pakistan (Remote) · Contract · Posted 2026-09-20 **Workplace:** remote **Department:** Partnerships ## Description Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. **Role Overview** We are seeking a mathematics-focused professional to support an advanced AI research initiative developing high-quality STEM coding datasets. In this role, you will create **rigorous mathematical problems**, implement verified Python solutions, and develop evaluation tests designed to assess the capabilities of frontier AI models. The position combines **mathematical problem-solving, scientific programming, and AI quality evaluation**, with a strong emphasis on accuracy, determinism, and first-submission quality. **CONTRACT:** Contractor assignment, 4 weeks **COMMITMENT:** Hourly, up to 40h/week **LOCATIONS:** Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, Vietnam **PROCESS:** Interest Check Form, CV and Google Scholar review **Key Responsibilities** - **Author mathematical coding tasks** containing one main problem and at least 3 logically connected sub-problems that progressively build toward the main solution. - Implement verified **golden solutions in Python** with complete unit test coverage. - Design discriminative test cases that distinguish correct from incorrect AI-generated outputs. - Perform quality control validation using the Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics. - Refine problem specifications, solutions, and test cases based on QC feedback. - Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron. - Ensure mathematical correctness, well-posedness, determinism, and compliance with project quality standards. - Maintain high first-submission quality and minimize rework, targeting consistent L1 approval. - Participate in review sessions, feedback meetings, and project standups during required overlap hours. ## Requirements - Master's degree or PhD in **Mathematics**. - Strong Python programming skills with experience in scientific computing. - Experience using scientific Python libraries such as **NumPy, SciPy, SymPy**, or relevant domain-specific tools. - Ability to formulate rigorous mathematical problems with clear constraints and expected outputs. - Experience implementing scientific or mathematical solutions with unit tests and deterministic outputs. - Prior experience in AI data annotation, scientific research, or scientific writing. - Familiarity with LLM evaluation frameworks, coding benchmarks, or AI-generated code assessment. - Published research or academic project experience in mathematics or another STEM discipline. ## Apply [Apply at Gramian Consulting Group](https://apply.workable.com/gramian/j/AAF6493A6B/apply) --- Powered by [Workable](https://www.workable.com)

Similar open jobs