Back to all jobs
A

Technical Programme Manager - Model Transparency

AI Security Institute

London · gb 10h ago

Job description

About the AI Security Institute The AI Security Institute is the world's largest and best-funded team dedicated to understanding advanced AI risks and translating that knowledge into action. We’re in the heart of the UK government with direct lines to No. 10 (the Prime Minister's office), and we work with frontier developers and governments globally. We’re here because governments are critical for advanced AI going well, and UK AISI is uniquely positioned to mobilise them. With our resources, unique agility and international influence, this is the best place to shape both AI development and government action. The deadline for applying to this role is Sunday 1st November, end of day, anywhere on Earth. About the role AISI aims to turn progress on important research questions in AI security into real insight and impact for our partners and the public. This requires running research programmes that actually deliver, and making these programmes rigorous and fast is its own discipline. The AI Security Institute is hiring a Technical Programme Manager for our Model Transparency team to do exactly this. Over the next twelve months, this team will need to move faster, deliver more complex research programmes and evaluations, and engage more deeply with partners in major AI labs and across government than ever before. Technical Programme Managers make this work possible. You will work directly with the team's researchers and engineers to turn vast research questions into tractable programmes. You will be held responsible for ensuring our research stands up to rigorous empirical standards to inform policy, recommending which technical work needs to happen, and untangling knotty dependencies across workstreams. About the team The ability to effectively evaluate and monitor AI systems will grow in importance as models become more capable, autonomous, and integrated into society. If models can detect and game evaluations, obscure their reasoning, or behave differently under observation, the safety claims that governments and developers rely on become unreliable.Understanding and addressing these risks is essential to ensuring that oversight of advanced AI systems keeps pace with their capabilities. The Model Transparency team is a research team within AISI focused on ensuring that evaluations, assessments, and monitoring of frontier AI systems remain reliable as models become less transparent. We research how and why oversight is declining – through phenomena such as evaluation awareness, unfaithful chain-of-thought reasoning, and changes in model architectures – and develop methods (including white and black box methods) to detect, measure, and mitigate potential issues. We share our findings with frontier AI companies (including Anthropic, OpenAI, DeepMind), UK government officials, and allied governments, and publicly to inform their deployment, research, and policy decisions. We also work directly with safety teams at frontier labs, contributing to safety case reviews and helping improve their alignment evaluation methodology. Our recent work includes the loss of oversight report , auditing games for sandbagging , reproducing natural emergent misalignment from reward hacking , and identifying open-weight language models that game propensity evaluations . What you will own Programme architecture. You will work directly with your team's technical staff to set the scope of projects: refining what questions we're actually trying to answer, what the milestones and success criteria are for technical work, and how to sequence dependencies, resource, and time across the team. You will turn "we should probably look into X" into a tractable plan with clear deliverables, without imposing process that gets in the team's way. You must be comfortable with ambiguity: you will be immersed in a fast-moving environment and won’t always have a settled roadmap. . Delivery tracking and unblocking. You will spot and solve problems so that the team's delivery continually improves, and own tracking progress to create visibility and establish control without overhead. You will surface technical blockers before they become crises, intervene directly to resolve them, and know exactly when and to whom to escalate. The goal is the team spending their time on the work, not logistics . Cross-government technical engagement. You will speak with government part ners on a technical level and be a trusted representative and ambassador for good relationships with them. Team operations and pace. You will determine the operational rhythm that lets a small, high-performing team inside government move at the speed of billion-dollar AI companies. You will ensure the team has what it needs to deliver and be unfussy about doing whatever needs to be done to unblock things and prevent them from falling through the cracks. Role Requirements A track record working with technical colleagues. You have delivered technical programmes in a similarly high-ambiguity environment. You know how to scope and structure open - en ded goals (not just deliver against a pre-defined plan). You have earned the trust of technical teams by understanding their work deeply enough to provide critical challenge and engage beyond process. Comfort operating at the frontier of AI. You do not need to be a machine learning researcher, but you need to be fluent enough in frontier AI to operate in constant conversation with technical staff about our work, strate gy , and research taste; you should have your own taste on what's hard, what's speculative, what's blocked, and what "good" looks like for a given experiment or evaluation. High agency and ownership. You take responsibility for outcomes, not activities. When something is stuck, you pick up the phone. You do not wait for someone else to escalate. Credibility with technical teams. Researchers trust you because you understand their work, respect their constraints, and demonstrably make their lives easier. You influence through competence and service, not authority or process. Strong prioritisation under pressure. You can identify what actually matters on a daily, weekly, monthly, and quarterly level and focus the team's energy. You have the judgement to recognise work that isn't landing and the confidence to recommend that it stop. Discretion and judgement in a sensitive domain. You understand that the work we do often carries sensitivity. Strong candidates may also have: Existing security clearances. Fluen cy in , or eager ness to adopt , modern productivity tools (coding agents, Linear, Slack) and willingness to use AI tools as part of daily work. Selection process Applications are reviewed on a rolling basis. We encourage you to apply early. Application - CV and a short cover note (max 500 words) explaining what draws you to this role and what you would bring. Please also indicate which team you would prefer to join. Screening interview - Lightweight conversation on trajectory, motivation and fit. Work test - A take-home exercise designed to test programme management judgement in context. You will receive this after the screening interview. Technical interview - Discussion of your work test. Behavioural interview - Deeper dive on stakeholder management, prioritisation and team dynamics. Senior leadership interview (30 min) - Final conversation with AISI senior leadership. Security Clearance Appointment is conditional on successfully completing UK Government SC clearance. Prior clearance is not required —we will sponsor and support you. You should normally have been resident in the UK for the past 5 years. More detail on clearance eligibility can be found on the UK Government website: National security vetting: clearance levels - GOV.UK. What We Offer Impact you couldn't have anywhere else Incredibly talented, mission-driven and supportive colleagues. Direct influence on how frontier AI is governed and deployed globally. Work with the Prime Minister’s AI Advisor and leading AI companies. Opportunity to shape the first & best-resourced public-interest research team focused on AI security. Resources & access Pre-release access to multiple frontier models and ample compute. Extensive operational support so you can focus on research and ship quickly. Work with experts across national security, policy, AI research and adjacent sciences. Growth & autonomy If you’re talented and driven, you’ll own important problems early. 5 days off and annual stipends for learning and development, and funding for conferences and external collaborations. Freedom to pursue research bets without product pressure. Opportunities to publish and collaborate externally. Life & family* Modern central London office, or where applicable, option to work in similar government offices in Birmingham, Cardiff, Darlington, Edinburgh, Salford or Bristol. Hybrid working, flexibility for occasional remote work abroad and stipends for work-from-home equipment. At least 25 days’ annual leave, 8 public holidays, extra team-wide breaks and 3 days off for volunteering. Generous paid parental leave (36 weeks of UK statutory leave shared between parents + 3 extra paid weeks + option for additional unpaid time). On top of your salary, we contribute 28.97% of your base salary to your pension. Discounts and benefits for cycling to work, donations and retail/gyms. *These benefits apply to direct employees. Benefits may differ for individuals joining through other employment arrangements such as secondments. Salary Annual salary is benchmarked to role scope and relevant experience. Most offers land between £65,000 and £145,000 made up of a base salary plus a technical allowance (take-home salary = base + technical allowance). An additional 28.97% employer pension contribution is paid on the base salary. This role sits outside of the DDaT pay framework given the scope of this role requires in depth technical expertise in frontier AI safety, robustness and advanced AI architectures. The full range of salaries are available below: Level 3: £65,000–£75,000 (Base £40,850 + Technical Allowance £24,150–£34,150) Level 4: £85,000–£95,000 (Base £48,540 + Technical Allowance £36,460–£46,460) Level 5: £105,000–£115,000 (Base £63,165 + Technical Allowance £41,835–£51,835) Level 6: £125,000–£135,000 (Base £76,475 + Technical Allowance £48,525–£58,525) Level 7: £145,000 (Base £76,475 + Technical Allowance £68,525) Additional Information Use of AI in Applications Artificial Intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance for more information on appropriate and inappropriate use. Use of AI tools in recruitment We may use AI tools to help our hiring teams review applications, for example by summarising application materials and helping us prioritise applications against the published criteria. People make every decision. AI tools do not decide the outcome of any application. Every decision is made by a member of our hiring team, and we do not make solely automated decisions about candidates. We only use the information you provide in your application. We do not use AI tools to collect information about you from other sources, including the internet. These tools are approved for use within AISI and operate in our secure environment. We process this information in line with our wider recruitment retention policy. You can ask how AI was used in relation to your application, request a human review, or object to AI being used, by contacting the hiring manager. This will not affect how your application is assessed. Internal Fraud Database The Internal Fraud function of the Fraud, Error, Debt and Grants Function at the Cabinet Office processes details of civil servants who have been dismissed for committing internal fraud, or who would have been dismissed had they not resigned. The Cabinet Office receives the details from participating government organisations of civil servants who have been dismissed, or who would have been dismissed had they not resigned, for internal fraud. In instances such as this, civil servants are then banned for 5 years from further employment in the civil service. The Cabinet Office then processes this data and discloses a limited dataset back to DLUHC as a participating government organisations. DLUHC then carry out the pre employment checks so as to detect instances where known fraudsters are attempting to reapply for roles in the civil service. In this way, the policy is ensured and the repetition of internal fraud is prevented. For more information please see - Internal Fraud Register. Security Successful candidates must undergo a criminal record check and get baseline personnel security standard (BPSS) clearance before they can be appointed. Additionally, there is a strong preference for eligibility for counter-terrorist check (CTC) clearance . Some roles may require higher levels of clearance, and we will state this by exception in the job advertisement. See our vetting charter here. Nationality requirements We may be able to offer roles to applicant from any nationality or background . As such we encourage you to apply even if you do not meet the standard nationality requirements (opens in a new window). Working for the Civil Service The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants. The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria. The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy. Diversity and Inclusion The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window) . As part of the application process, we monitor statistics on D&I. You can see how we process this data here: Recruitment privacy notice - GOV.UK .

Similar open jobs