Resources - AIGS Canada

Career Guidance

Are you curious about how you can reduce AI risk? AIGS is here to help.

How to pursue a career in technical AI alignment by Charlie Rogers-Smith (written article, estimated reading time 47 minutes)

Guide to working in AI policy and strategy by Miles Brundage (written article, estimated reading time 20 minutes)

A database of training resources from AI Safety Support (a series of events and opportunities, geared toward those further along on their path to working in AI Safety)

Want to get involved with AIGS directly? Join our Slack or volunteer.

Other AI Organisations

Want to know who else is working on AI governance and safety initiatives? Here are some organizations in Canada and abroad.

Canadian AI Orgs

Global AI Safety-focused organisations:

Collection of general AI safety organizations from AI safety fundamentals

Helpful Links

Here are some materials for those looking to dig deeper.

General resources
- Apart Research Recommended Reading
- AI Safety Fundamentals (12-week, part-time course)
- ML Safety Scholars: Intro to ML Safety
- Jacob Hilton’s Deep Learning Curriculum (very technical)
- AI Tracker (track the latest AI models)
Technical AI safety and alignment
- Introductory
  - Intro to AI Safety – Rob Miles
  - The case for taking AI seriously as a threat to humanity – Kelsey Piper
- Technical
  - How Rogue AIs might arise – Yoshua Bengio
  - The alignment problem from a deep learning perspective – Ngo et al.
  - Without specific countermeasures, the easiest path to transformative AI likely leads to AI takeover – Ajeya Cotra
  - Unsolved problems in ML safety – Dan Hendrycks et al
AI governance and policy
- AI Governance Curriculum – AGI Safety Fundamentals
- AI Strategy, Policy, and Governance – Allan Dafoe
- The Brussels Effect and Artificial Intelligence – Siegmann and Anderljung
- The Offense-Defense Balance of Scientific Knowledge: Does Publishing AI Research Reduce Misuse? – Shevlane and Dafoe
AI forecasting and economics
- Introductory
  - Forecasting transformative AI: what's the burden of proof? – Holden Karnofsky
  - Phil Trammell on Economic Growth under Transformative AI – Hear This Idea podcast (see also the associated paper)
- Technical
  - Literature review of Transformative Artificial Intelligence timelines – Wynroe et al
  - Bioanchors report – Ajeya Cotra
  - Collection of blog posts on trends in Machine Learning – Epoch
Navigating AI - resources for youth
- Will AI outsmart humanity? Explaining the Singularity – CBC Kids
- Balancing AI Exploration: Educator Best Practices for Student AI Interaction – AIFWD
Newsletters
- AIGS Newsletter (Archive available here)
- Alignment Newsletter – Rohin Shah et al
- ML Safety Newsletter – Dan Hendrycks et al
- Import AI – Jack Clark
- Policy.ai – Center for Security and Emerging Technology
- ChinAI – Jeffrey Ding
Podcasts