Google study: AI aids senior patent lawyers' judgment, not juniors'
Google Research and NBER published a three-month randomized trial with 133 patent lawyers at eleven firms. Lawyers given an unreleased Google Labs AI drafting tool scored 0.38 standard deviations higher on a drafting task at 90 days. On a redlining task done without AI, the gain came entirely from senior lawyers with 7 or more years of experience, who beat controls by 0.45 standard deviations. Junior lawyers showed no average improvement, and their scores split into more very low scores and more good ones. The authors note the sample is small and the study ran only three months.