What is it about?
This research examines whether artificial intelligence (AI) can help public servants in their work, specifically in creating documents like briefing notes used for decision-making. The study explores whether AI can assist or even replace human policy analysts. It asks if AI can effectively perform policy analysis tasks and support what human analysts do. This research also looks at whether academic institutions and governments should rethink how they teach and approach policy analysis. To test these questions, the study created briefing notes in three ways: ones generated by AI, ones created with AI support, and ones made by humans. Then, two groups of retired senior public servants evaluated these notes, pretending to be senior decision-makers in the government. They used a rubric to grade each note. The results of this evaluation help us understand if current AI technology can produce policy analysis that is believable, convincing, and helpful.
Featured Image
Photo by Lyman Hansel Gerona on Unsplash
Why is it important?
This research is unique in its practical exploration of AI, particularly natural language processing (NLP), in policy analysis for government and public service. It shows that while fully AI-generated policy analysis isn't yet possible, AI, when integrated into e-governance systems, can significantly enhance efficiency and accuracy. Importantly, it recognizes the need to train AI on unbiased data sources and highlights its potential role in policy education. Additionally, the study envisions AI-driven systems with cross-governmental access to big data, offering solutions to complex policy problems and empowering policy analysts with improved data analytics skills. In essence, this research sheds light on how AI can serve as a valuable tool to enhance policy analysis, government operations, and policy education, while addressing critical challenges like bias in AI-generated content.
Perspectives
Empirical evidence plays a pivotal role in illuminating our path and facilitating informed predictions of the future, offering invaluable guidance to humanity. In a world marked by inherent uncertainty, the coming two decades present a distinct prospect: witnessing the transformation of age-old governance and policy paradigms. This transformation necessitates a deliberate and seamless transition into the digital era, ensuring that our systems remain agile, responsive, and relevant in the face of evolving challenges and opportunities. In essence, harnessing the power of empirical insights and embracing technological advancements will empower us to navigate the uncharted waters of the future with confidence and foresight. As we adapt to an ever-changing landscape, the fusion of evidence-based decision-making and digital innovation will serve as the cornerstone of effective governance and policy evolution in the years to come.
Mehrdad Safaei
Canada School of Public Service
Read the Original
This page is a summary of: The End of the Policy Analyst? Testing the Capability of Artificial Intelligence to Generate Plausible, Persuasive, and Useful Policy Analysis, Digital Government Research and Practice, August 2023, ACM (Association for Computing Machinery),
DOI: 10.1145/3604570.
You can read the full text:
Contributors
The following have contributed to this page
