Anthropic says California AI bill’s benefits likely outweigh costs

August 23, 2024

(Reuters) – The benefits of California’s revised bill that seeks to regulate how artificial intelligence is developed and deployed in the state likely outweigh the costs, Anthropic said on Thursday.

San Francisco-based Anthropic is a rival to ChatGPT-maker OpenAI and is backed by Amazon and Alphabet.

California’s proposed bill on AI regulation, SB 1047, advanced by State Senator Scott Wiener, a Democrat, mandates safety testing for many of the most advanced AI models that cost more than $100 million to develop or those that require a defined amount of computing power.

Developers of AI software operating in the state would need to outline methods for turning off the AI models if they go awry, effectively a kill switch. The bill would also give the state attorney general the power to sue if developers are not compliant.

WHY IT’S IMPORTANT

Senator Wiener recently revised the bill to appease tech companies, relying in part on input from Anthropic. The revised bill did away with a provision for a government AI oversight committee.

Tech companies developing AI – which can respond to prompts with fully-formed text, images or audio as well as run repetitive tasks with minimal intervention – have largely balked at the bill.

Alphabet’s Google and Meta have expressed concerns in letters to Wiener, with Meta saying the bill threatens to make the state unfavorable to AI development and deployment.

OpenAI had said AI should be regulated by the federal government and that the California bill creates an uncertain legal environment.

KEY QUOTES

“In our assessment the new SB 1047 is substantially improved, to the point where we believe its benefits likely outweigh its costs. However, we are not certain of this, and there are still some aspects of the bill which seem concerning or ambiguous to us,” Anthropic CEO Dario Amodei said in a letter to California Governor Gavin Newsom on Aug. 21.

“Our initial concerns about the bill potentially hindering innovation due to the rapidly evolving nature of the field have been greatly reduced in the amended version.”

(Reporting by Jahnavi Nidumolu in Bengaluru; Editing by Mrigank Dhaniwala)

aiOla Releases Whisper-NER: An Open Source AI Model for Joint Speech Transcription and Entity Recognition

Speech recognition technology has made significant progress, with advancements in AI improving accessibility and accuracy. However, it still faces challenges, particularly in understanding spoken entities like names, places, and specific terminology. The issue is not only about converting speech to text accurately but also about extracting meaningful context in real-time.... Read more
CMU Researchers Propose XGrammar: An Open-Source Library for Efficient, Flexible, and Portable Structured Generation

The field of structured generation has become important with the rise of LLMs. These models, capable of generating human-like text, are now tasked with producing outputs that follow rigid formats such as JSON, SQL, and other domain-specific languages. Applications like code generation, robotic control, and structured querying depend heavily on... Read more
Meet CircleMind: An AI Startup that is Transforming Retrieval Augmented Generation with Knowledge Graphs and PageRank

In an era of information overload, advancing AI requires not just innovative technologies but smarter approaches to data processing and understanding. Meet CircleMind, an AI startup reimagining Retrieval Augmented Generation (RAG) by using knowledge graphs and the established PageRank algorithm. Funded by Y Combinator, CircleMind aims to improve how large... Read more
Uncovering How Vision Transformers Understand Object Relations: A Two-Stage Approach to Visual Reasoning

Despite the success of Vision Transformers (ViTs) in tasks like image classification and generation, they face significant challenges in handling abstract tasks involving relationships between objects. One key limitation is their difficulty in accurately performing visual relational tasks, such as determining if two objects are the same or different. Relational... Read more
WebDreamer: Enhancing Web Navigation Through LLM-Powered Model-Based Planning

Strategic planning in artificial intelligence has reached significant milestones, especially in achieving superhuman performance in complex games like Go. Large Language Models (LLMs) integrated with advanced planning algorithms have shown remarkable improvements in complex reasoning tasks. However, several critical challenges emerge when these capabilities are applied to web-based environments for... Read more
Neural Magic Releases LLM Compressor: A Novel Library to Compress LLMs for Faster Inference with vLLM

Neural Magic has released the LLM Compressor, a state-of-the-art tool for large language model optimization that enables far quicker inference through much more advanced model compression. Hence, the tool is an important building block in Neural Magic’s pursuit of making high-performance open-source solutions available to the deep learning community, especially... Read more
Training-Free Guidance (TFG): A Unified Machine Learning Framework Transforming Conditional Generation in Diffusion Models with Enhanced Efficiency and Versatility Across Domains

Diffusion models have emerged as transformative tools in machine learning, providing unparalleled capabilities for generating high-quality samples across domains such as image synthesis, molecule design, and audio creation. These models function by iteratively refining noisy data to match desired distributions, leveraging advanced denoising processes. With their scalability to vast datasets... Read more
OpenLS-DGF: An Adaptive Open-Source Dataset Generation Framework for Machine Learning Tasks in Logic Synthesis

Logic synthesis is one of the important steps in designing digital circuits, in which high-level descriptions are turned into detailed gate-level designs. The development of ML algorithms is transforming fields such as autonomous driving, robotics, and natural language processing. Various Machine learning approaches have been used to integrate domains. These... Read more
Missingness-aware Causal Concept Explainer: An Elegant Explanation by Researchers to Solve Causal Effect Limitations in Black Box Interpretability

Concept-based explanations of machine learning applications have a greater intuitive appeal, as established by emerging research as an alternative to traditional approaches. Concept-driven methods explain the decisions of a model by aligning its representation with human understandable concepts. Conventional approaches to ML explainability attribute a model’s behavior to low-level features... Read more
OpenAI Researchers Propose a Multi-Step Reinforcement Learning Approach to Improve LLM Red Teaming

As the use of large language models (LLMs) becomes increasingly prevalent across real-world applications, concerns about their vulnerabilities grow accordingly. Despite their capabilities, LLMs are still susceptible to various types of adversarial attacks, including those that generate toxic content, reveal private information, or allow for prompt injections. These vulnerabilities pose... Read more
Hugging Face Releases Observers: An Open-Source Python Library that Provides Comprehensive Observability for Generative AI APIs

Hugging Face has introduced Observers, a cutting-edge tool that enhances transparency and understanding of generative AI interactions. This open-source Python SDK offers developers an easy and flexible way to track, analyze, and manage interactions with AI models, marking a significant advancement in AI observability. Observers is a comprehensive solution for... Read more
Researchers from the University of Maryland and Adobe Introduce DynaSaur: The LLM Agent that Grows Smarter by Writing its Own Functions

Traditional large language model (LLM) agent systems face significant challenges when deployed in real-world scenarios due to their limited flexibility and adaptability. Existing LLM agents typically select actions from a predefined set of possibilities at each decision point, a strategy that works well in closed environments with narrowly scoped tasks... Read more
LTX-Video: A Groundbreaking Real-Time Video Generation Open-Source Model with Day-One Native Support in ComfyUI, Empowering Innovators to Transform Content Creation

Lightricks, a company renowned for its innovative technological advancements in creative tools, has unveiled its groundbreaking video generation open-source model, LTX Video (LTXV). Setting a benchmark for the industry, LTXV was released with native support in ComfyUI on the very first day. This significant launch has sparked excitement in the... Read more
Researchers from MBZUAI and CMU Introduce Bi-Mamba: A Scalable and Efficient 1-bit Mamba Architecture Designed for Large Language Models in Multiple Sizes (780M, 1.3B, and 2.7B Parameters)

The evolution of machine learning has brought significant advancements in language models, which are foundational to tasks like text generation and question-answering. Among these, transformers and state-space models (SSMs) are pivotal, yet their efficiency when handling long sequences has posed challenges. As sequence length increases, traditional transformers suffer from quadratic... Read more
MemoryFormer: A Novel Transformer Architecture for Efficient and Scalable Large Language Models

Transformer models have driven groundbreaking advancements in artificial intelligence, powering applications in natural language processing, computer vision, and speech recognition. These models excel at understanding and generating sequential data by leveraging mechanisms like multi-head attention to capture relationships within input sequences. The rise of large language models (LLMs) built upon... Read more