2023-11-22 · auto-analysis (draft)

Who Will Govern the Future of AGI? with Emad Mostaque (Stability AI Founder) | X (Twitter) Spaces

Discussion on AI governance, emphasizing the importance of transparency, openness, and localization of AI models. The conversation focuses on the challenges of governing AGI, the importance of data transparency, and predictions about AI capabilities and standards. Emad Mostaque discusses the uncertainty around AGI timelines, swarm intelligence, the need for government regulation, and the future of jobs and education in the context of AI. Discussion on the capabilities of generative AI, an upcoming $101 million X Prize, and future governance strategies.

▶ Watch on YouTube

Topics

AI governance AI|Governance ▶ 0:38
Discussion on the importance of transparency and openness in AI governance.
AGI safety AI|Safety ▶ 8:00
Debate on the separation of governance and safety discussions in AI, emphasizing the need for alignment with goals.
Open source models AI|Tech ▶ 2:03
Emphasis on the role of open source models in AI governance and their benefits.
Local governance AI|Governance ▶ 6:48
Proposal for localized governance of AI models to ensure cultural and ethical alignment.
Data transparency AI|Tech ▶ 9:42
Emphasizes the importance of transparency and openness in data sets used for AI models, citing examples of data misuse and the need for better quality data standards.
AI capabilities AI|Tech ▶ 10:49
Claims that within 12 to 18 months, GP4-level performance could be achieved on a smartphone, highlighting the implications of distributed training and synthetic data use.
Open AI standards AI|Tech ▶ 12:33
Proposes the establishment of data standards similar to food standards, suggesting that transparency and quality data are crucial for AI alignment and governance.
AI transparency AI ▶ 19:10
Emad Mostaque discusses the importance of transparency in AI models, especially in regulated industries.
AI alignment AI ▶ 20:39
Emad Mostaque defines alignment in terms of objective functions and emphasizes the need for AI to be aligned with societal interests.
Societal impact of AI Society ▶ 23:40
Emad Mostaque discusses the societal impact of AI, particularly the potential for large numbers of unemployed professionals and the need for open innovation and education.
AGI and future infrastructure AI ▶ 27:05
Emad Mostaque discusses the importance of national ownership of AI models and infrastructure, emphasizing the need for this to be embedded in cultural values.
AI timeline AI ▶ 28:31
Emad Mostaque discusses the uncertainty around the timeline for AGI and digital superintelligence.
Swarm intelligence AI ▶ 29:21
Emad Mostaque mentions swarm intelligence as a key aspect of future AI outcomes.
AI regulation Geopolitics ▶ 34:33
Emad Mostaque discusses the need for government regulation and the current state of AI safety efforts.

Predictions made

open Emad Mostaque: AI models will be localized to ensure cultural and ethical alignment.
EP #? · · due: unspecified · ▶ watch
“I think it eventually has to be localized.”
Your call:
open Emad Mostaque: GP4-level performance on a smartphone within 12 to 18 months
EP #? · · due: 12-18 months · ▶ watch
“within 12 to 18 months you'll see gp4 level performance on a smartphone”
Your call:
open Emad Mostaque: AGI will be developed within 12 months.
EP #? · · due: 12 months · ▶ watch
“it will never be less than 12 months right because it's such a step change”
Your call:
open Emad Mostaque: There will be a significant reduction in the need for certain jobs due to AI productivity enhancements.
EP #? · · due: unspecified · ▶ watch
“why would there be what are interfaces you had a 50% drop I just post that on my Twitter in hiring from Indian iits that's crazy so what you're going to have in a couple of years is around the world at the same time these kids that have gone through the trauma of Co Highly Educated stem programming accountancy law simultaneously people will hire massively less of them because productivity enhances and you don't need as many of them”
Your call:
open Emad Mostaque: Governments need to focus on infrastructure and national data sets to prepare for the future of AI.
EP #? · · due: unspecified · ▶ watch
“Governments have to focus on the tangibles AI killer ISM again it can be addressed by considering this is infrastructure what infrastructure do we need to give our people to survive Thrive.”
Your call:
open Emad Mostaque: Five years of chaos due to the mismatch between human societal growth rates and tech growth rates.
EP #? · · due: 2028 · ▶ watch
“five years of chaos that's why I called it stability”
Your call:
open Emad Mostaque: A Star Trek future is possible with the right alignment of AI with human potential.
EP #? · · due: unspecified · ▶ watch
“Star Trek future versus that Star Wars future yes right I'm into that”
Your call:
open Emad Mostaque: Longevity and abundance will be achieved within our lifetimes.
EP #? · · due: unspecified · ▶ watch
“that's so amazing right but then we think about as you said why”
Your call:
open Emad Mostaque: AI can help mitigate lies and conflicts by aligning with the potential of each human.
EP #? · · due: unspecified · ▶ watch
“if we have ai that is aligned with the potential of each human that can help mitigate those lies then we can get away from more”
Your call:
open Emad Mostaque: AI will make things that were seemingly crazy before likely to become inevitable.
EP #? · · due: unspecified · ▶ watch
“nonlinear future because we are able to utilize AI and make things that were seemingly crazy before uh likely to become inevitable”
Your call:

Numbers that matter