Hide table of contents

Hiring Resources Playbook v0.1


For my SPAR project, which is to help improve the hiring process for new AI Safety organizations, and after the last couple of weeks having several interviews with hiring managers, there is an urgent bottleneck needed to resolve this. All these organizations are actively growing and hiring, and will continue on this trend into the near future. 

The Hiring Problem

I have focused my SPAR project to helping founders and hiring managers at new AI Safety organizations, typically small teams of <7 full time employees who are expected to grow 5x within the next year. 

The reason why my focus is with these organizations, is because I see the greatest pain in their hiring process (usually broken or none existent) and if resolved, will allow these organizations to have the greatest impact in improving their hiring process, not only with matching them efficiently with the ideal candidate, but also allowing them to overcome these barriers of hiring, and returning to continuing their main focus work on AI Safety. I believe that these smallest and newest organizations have not only the most growth potential in terms of their project's impacts, but the new people that they hire can help accelerate this work, greater than at a more established organization.

These new AI Safety organizations are dealing with two issues that my research indicates that are contributing to this hiring and growth bottlenecks. These are:

  1. They are trying to grow very quickly, and they fully understand the urgency that there is a very short window for AI Safety alignment before ASI, which all AI Safety organizations understand. Compound this with while in super drive to work on their research or project, that as a small or new organization, they are also trying to dramatically build their organization, work on their projects research while also compounding an increase in hiring to catch up.
     
  2. This leads to a bottleneck of their own design. Building and Growing are hard to do even for a larger organization, and with the intensity and the closing window for obtaining AI alignment it is even more urgent.  With more AI Safety organizations hiring right now, the application volume will rise. 

The Work test and Scoring Problem

The biggest issue I have discovered with my interviews of hiring managers of new AI Safety organizations, is that there is a discrepancy on who writes the tests, who scores them, and can the review tell a good work for merely OK work?

Here’s what I’ve discovered:

  • Small hiring teams that review tests build upon a mixture of older work tests, with no clear check on reviewer expertise or no-researcher roles.
  • Hiring for specialized roles (i.e. CFO) and unsure on how they will verify a good response in a work test
  • Few organizations have used their network to use trusted outside experts to design and evaluate the tests and conduct interviews, but this is unique in new AI Safety organizations.
  • Most candidates, due to these inefficiencies, are waiting months or more, and the hiring teams worry about losing strong candidates to other AI Safety organizations. 

The outside-expert model

I’ve conducted numerous interviews, and one interview with a hiring manager was very insightful. In fact, the most insightful to date. We spoke about the use of “outside experts” that are brought into the hiring process, and in particular for specialized roles, such as Operations, HR managers, Legal Council, and even Communications/PR leads. 

Interestingly, 80,000 Hours and twelve other organizations are actively hiring for the General/Legal Council. This indicates to me that there is a trend in AI Safety organizations expanding from their researcher roles to the need for more operational roles needed to grow. 

These experts should be sourced from outside the AI Safety community, as they require individuals who have multiple years of experience, and have built organizations from 3 people to 50 or 100 full time hires. 

I see the role of these outside experts as assisting with the specific role work tests (designing with real-world examples from actual work activities), interviewing and assessing and validating the codex scoring of candidates. 

This approach not only allows the AI Safety organization to demonstrate credibility when interviewing candidates for these specialized roles, but also allows for trusted experts who have multiple years of experience in these roles to understand the difference between candidates with OK or good skills and exceptional skills. 

The hiring teams can still test with interviews, applications and work tests for a candidate's alignment to their organization's mission, culture and AI Safety alignment and cultural fit, that may be more generalized to an individual organization's fit. 

How This Works in Practice

The importance of finding trusted experts from other fields is something that as a Founder, must be something that requires a continuous search, and using your connections of other founders, advisors and boards to discover outside your network, the industry experts to connect with. Also, expanding your network connections as a Founder outside of the AI Safety community, offers other benefits, such as Ambassadors/support of your project to larger communities, additional funding opportunities and even undiscovered talent and resources. 

What this means in practice, is that these outside experts should be compensated for their time, and especially since hiring the right people into this business operational roles can have the greatest impact for growth of the organization, and therefore, the highest usage of your capital for a return on investment (ROI).

The Hiring Framework Playbook

One of the ways that I can help these hiring managers is to provide best practices and resources to help improve their hiring processes. Use of the “out-side expert” is just one part of this. 

The Hiring Framework Playbook, which will be my deliverable for these hiring teams at the conclusion of my SPAR project (Dec 2026) will address these questions and include these sections:

  • How to source candidates (especially for specialized roles) that extends the usability of the Talent Commons  or internal applications received, to pro-actively finding candidates for roles that are specialized and may not be in your network.
  • Referrals pipeline, and how to use these to continue building your referral list (and on-going networking.
  • Negotiation skills and methodologies for closing a candidate (completing this before you make the offer) - i.e. bringing in a HR Manager as an advisor to help train the hiring team on Federal/State laws on hiring & privacy requirements. 
  • How to create specialized work tests and rubrics that are specific - especially for Specialized roles.
  • How to find outside experts as “advisors” for Role Specific and Work test (creation & scoring verification - part AI tools + human (expert) validation of score), what they need to complete the task and how to continue using their expertise for future hiring rounds, and how expand your network of finding other role specific experts.
  • Why it’s important for hiring managers and Founders to have a basic understanding of a role (20-50%) before a job description is written.
  • How to conduct an effective interview - tips and best practices
  • Why cultural fit interviews are best conducted by Founders vs. application forms
  • Why every organization should conduct a screening call - no more than 30 mins - to understand motivations and org mission alignment understanding.
  • Why including Role specific interviews after the completion of a work test - with an expert in the role - provides situational understanding that a work test cannot. A work test is conducted at home and allows for the candidate to practice their answer before submitting it. A role specific interviews makes the candidate think on their feet and explores a deeper understanding of the role (can be up to three - 60 minutes interview).
  • The need for a final interview with Leadership focusing on mission alignment and organizational cultural fit  (AI Safety alignment and context is discoverable in the Application phase and the Screening Call phase). 
     

Untested Theory and Quick Test Pilot

As I continue working on this Hiring Framework Playbook, I want to also conduct a couple of Quick tests with a couple of small AI Safety organizations who are currently hiring for specialized roles (non-researchers), such as Legal Council, Communications/GTM Leads, or CFO roles. 

My untested theory is that I want to verify if providing an “outside expert” to assist in conducting interviews, if it will improve the success of higher skill quality candidates. 

My Ask

If you’re a hiring manager or founder who is currently or about to start the process to source and hire for a specialized role - specifically for a Legal Council, Communications/GTM Lead, or CFO role, I would like to help you. 

Also, my intent is to continue to improve this process and Hiring Framework Playbook with practical hiring processes for the AI Safety community, and specifically, for the new organizations that I believe have the greatest impact if they solve their hiring bottlenecks and allow them to focus on their projects and research. 

If I have mis-stated or missed important steps to include this process, I want to hear from you, or comment. Please feel free to reach out to me at: [email protected] 

6

1
0

Reactions

1
0

More posts like this

Comments1
Sorted by Click to highlight new comments since:

Hi Alison, 

I think this is a really valuable project, and I'll be interested to see how the playbook develops. 

Including external experts in recruitment processes where staff dont have expertise is a good suggestion. This is particularly relevant when organisations start to hire for specialised roles, without perhaps having fully defined what the role will do, what competencies are required to do the job well, how these competencies should be assessed, and how to made tradeoffs when candidates dont meet all the ideal selection criteria. 

What seems to happen is that organisations use similar or the same selection criteria and processes for these specialist roles as they've used for their core team selection. Then the organisation and candidates are both frustrated when this doesnt translate smoothly to specialist roles.

My untested theory is that I want to verify if providing an “outside expert” to assist in conducting interviews, if it will improve the success of higher skill quality candidates. 

 Including an outside expert when conducting interviews could be helpful, since it provides an expert perspective on how to score and rank candidates' technical abilities. However, I think including the outside expert from an earlier stage would be even more valuable - including defining the TORs and the competencies for the role, taking into account best practices for that professional role (eg assessing the organisation's first accountant based on how accountants are normally selected and hired, rather than how the AI safety organisation has previously hired their researchers).

Curated and popular this week
Relevant opportunities