The New York City Council held what they are calling a first-of-its-kind hearing with artificial intelligence whistleblowers, city agencies, and tech leaders to talk about the risks of AI.

NYC Council has 10 proposals aimed at assessing the risks and safeguarding AI.

"On the current path, I think that is more likely than not that humanity loses control to these AIs and it could end in human extinction," said AI whistleblower and former Anthropic researcher Jacob Coxin.

The hearing comes after President Donald Trump appointed a director of a new government task force on artificial intelligence.

The hearing hosted a panel of whistleblowers and tech leaders to discuss the topic of balancing the risks but also benefits of AI.

"AI can help scientists develop new cancer treatments, help entrepreneurs grow and develop new businesses, and help protect critical infrastructure by helping detect cybersecurity threats,' said Morgan Dwyer, who works in Policy Development and Operations for OpenAI.

NYC Council says the goal is to evolve with the technology while also safeguarding it. The different legislative proposals include things like human overrides to AI systems, protections for whistleblowers, safety and transparency regulations, etc.

Daniel Kokotajlo, whistleblower and former OpenAI researcher, says even with safeguards there are risks.

"AIs are becoming situationally aware. They understand their situation, they understand when they are being monitored and when humans are looking over their shoulder," said Kokotajlo.

The proposed legislation will now go through the standard legislative process and review and will be voted on at a later date.