Job Description

We are seeking a dynamic Legal Prompter / Evaluator who is a qualified solicitor, barrister or legal executive and possesses a strong interest in emerging technologies. This role is crucial in our mission to pioneer innovative solutions within the legal industry, specifically leveraging Large Language Models (LLMs) and other advanced technologies to meet the needs of legal professionals.


In this role, you will be responsible for both the assessment of new product opportunities and the hands-on development of LLM-driven solutions. You will play a key role in crafting and refining prompts, developing methodologies for evaluating and grading LLM outputs, and integrating these technologies into our suite of legal products. The ideal candidate is a legal professional with a passion for technology, who can creatively and effectively translate legal expertise into innovative solutions.

About the Role

Responsibilities in this role as

Legal AI Prompter / Evaluator

will include:

Product Opportunity Assessment:

Collaborate with cross-functional teams to evaluate the feasibility and potential impact of new product ideas and enhancements. Stay informed about the latest developments in legal technology, particularly in the area of Large Language Models (LLMs), and apply this knowledge to guide product strategy.

LLM Prompt Development:

Create, test, and refine prompts for LLMs, ensuring they deliver accurate, legally sound, and contextually appropriate responses. Develop and iterate on LLM-driven experiences that enhance productivity and delight our customers. Collaborate with engineers and data scientists to integrate LLMs into multi-step systems, assessing their performance and making necessary modifications.

Evaluation:

Develop and implement evaluation schemes to test model outputs. Create and implement automated testing methods to ensure quality and consistency over large datasets and time periods.

Stakeholder Collaboration:

Engage with legal professionals, industry leaders, and internal stakeholders to gather insights and validate product concepts. Liaise with various teams to understand requirements and ensure that products meet the needs of legal professionals across different sectors. Represent the company at industry conferences, webinars, and other events to promote our technology solutions and gather feedback.

About You

You're a fit for the role of

Legal AI Prompter / Evaluator

if you have:


Qualification as a solicitor, barrister, or legal executive Juris Doctor (JD) and 2+ years of practice experience, transactional experience preferred. Strong interest in and understanding of emerging technologies, particularly in the context of the legal profession. Experience with Large Language Models (LLMs) or other AI technologies is highly desirable. Excellent communication and collaboration skills, with the ability to work effectively across departments. Ability to think creatively and strategically about the future of legal technology. Experience using large language models through code (e.g., OpenAI, Anthropic, Cohere, Llama, Mistral) is highly desirable. Candidates with little or no experience in this area will be expected to develop coding skills if hired.
#LI-AB1

What's in it For You?

Hybrid Work Model:

We've adopted a flexible hybrid working environment (2-3 days a week in the office depending on the role) for our office-based roles while delivering a seamless experience that is digitally and physically connected.

Flexibility & Work-Life Balance:

Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.

Career Development and Growth:

By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow's challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.

Industry Competitive Benefits:

We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.

Culture:

Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.

Social Impact:

Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.

Making a Real-World Impact:

We are one of the few companies globally that helps its customers pursue justice, truth, and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world.

About Us

Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news.


We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward.


As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals. To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.


We also make reasonable accommodations for qualified individuals with disabilities and for sincerely held religious beliefs in accordance with applicable law. More information on requesting an accommodation here .


Learn more on how to protect yourself from fraudulent job postings here .


More information about Thomson Reuters can be found on thomsonreuters.com.