Research Schwartz Reisman Institute Research Schwartz Reisman Institute

Unequal outcomes: Tackling bias in clinical AI models

A new study by SRI Graduate Affiliate Michael Colacci sheds light on the frequency of biased outcomes when machine learning algorithms are used in healthcare contexts, advocating for more comprehensive and standardized approaches to evaluating bias in clinical AI.

Read More
Research Schwartz Reisman Institute Research Schwartz Reisman Institute

Safeguarding the future: Evaluating sabotage risks in powerful AI systems

As AI systems grow more powerful, ensuring their safe development is critical. A recent paper led by David Duvenaud with contributions from Roger Grosse introduces new methods to evaluate AI sabotage risks, providing insights into preventing advanced models from undermining oversight, masking harmful behaviors, or disrupting human decision-making.

Read More
Research Jo-Ann Osei Twum, Michael Colacci, Felix Menze Research Jo-Ann Osei Twum, Michael Colacci, Felix Menze

Innovating care: Exploring the role of AI in Ontario’s health sector

What opportunities and challenges are there for the use of AI in healthcare? At a recent SRI workshop, experts explored how AI is transforming Ontario's healthcare sector, highlighting its potential to improve care and exploring pressing challenges around patient involvement, health equity, and trustworthy implementation.

Read More
Research Dan Browne Research Dan Browne

What do we want AI to optimize for?

SRI researcher Silviu Pitis draws on decision theory to study how the principles of reward design for reinforcement learning agents are formulated. He also aims to understand how large language models make decisions by examining their implicit assumptions. Pitis has received a prestigious OpenAI Superalignment Fast Grant to support his research.

Read More