Measuring skill-based uplift from AI in a real biological laboratory

📝 Original Info

• Title: Measuring skill-based uplift from AI in a real biological laboratory
• ArXiv ID: 2512.10960
• Date: 2025-10-29
• Authors: Ethan Obie Romero-Severson, Tara Harvey, Nick Generous, Phillip M. Mach

📝 Abstract

Understanding how AI systems are used by people in real situations that mirror aspects of both legitimate and illegitimate use is key to predicting the risks and benefits of AI systems. This is especially true in biological applications, where skill rather than knowledge is often the primary barrier for an untrained person. The challenge is that these studies are difficult to execute well and can take months to plan and run. Here we report the results of a pilot study that attempted to empirically measure the magnitude of skills-based uplift caused by access to an AI reasoning model, compared with a control group that had only internet access. Participants-drawn from a diverse pool of Los Alamos National Laboratory employees with no prior wet-lab experience-were asked to transform E. coli with a provided expression construct, induce expression of a reporter peptide, and have expression confirmed by mass spectrometry. We recorded quantitative outcomes (e.g., successful completion of experimental segments) and qualitative observations about how participants interacted with the AI system, the internet, laboratory equipment, and one another. We present the results of the study and lessons learned in designing and exe...

📄 Full Content

...(본문 내용이 길어 생략되었습니다. 사이트에서 전문을 확인해 주세요.)