Google DeepMind introduces SynthID, a watermarking technology extending from digital media to biological sequences, to trace AI provenance and combat misuse.
Jeremy Ratcliffe of Google DeepMind stated that the goal is to differentiate between sequences originating in nature and those produced by AI systems, allowing researchers to identify AI-designed proteins or enzymes.
For a watermarking system to be effective, it must possess human imperceptibility, making it difficult for individuals to discern which parts of the data have been watermarked, thus preventing easy erasure.
High detectability is also crucial for confirming the AI origin of content with statistical confidence, alongside generalizability to ensure the method can be applied across various data types without needing specific solutions for each.
Pushmeet Kohli outlined three essential properties for AI watermarks: they must not degrade the quality of the AI output, otherwise, the system loses its purpose.
System scalability requires that watermarks remain robust against manipulation while ensuring the technology is easy to integrate.
Early methods for detecting AI-generated content focused on identifying tiny artifacts in manipulated images, a strategy that is now largely obsolete.
Modern generative AI models have become so sophisticated that they eliminate these traditional artifacts, making post-hoc detection almost impossible through conventional means.
Generative AI advances necessitate model-level signals, enabling the human tracing of content origins.
Image systems incorporate millions of numbers into an imperceptible pattern to mark visual data with high-dimensional signals.
However, watermarking text is more challenging because text is low-dimensional and requires preserving the original meaning, limiting the flexibility to introduce changes, necessitating distinct approaches for textual content compared to high-dimensional modalities like audio or video.
Traditional AI detection methods typically involve training machine learning models to classify content by identifying specific 'tells' or patterns indicative of AI generation.
As generative AI models become increasingly sophisticated, these 'tells' diminish, causing traditional classifiers to lose accuracy over time, whereas watermarking provides a more robust and reliable method for tracing the provenance of AI-generated content.
Large language models choose from a distribution of possible next tokens, allowing SynthID to embed an invisible signal by leveraging the inherent optionality in that selection process.
A secret key biases these selections during content generation without altering the visible meaning, and detectors then use the corresponding key to identify specific patterns of word choices.
However, very short and factual texts, such as "What is the capital of France? It is Paris," may be 'unwatermarkable' due to a lack of optionality in token choices.
The broader AI ecosystem is transitioning towards watermarking as a standard, yet not all developers are expected to make their detection systems publicly available.
Publicly accessible detectors face the risk of being reverse-engineered or bypassed by malicious actors through methods like iterative querying, meaning there is no current 'cast-iron' guarantee for detecting all AI-generated content globally.
Unlike text-based watermarking, a neural network injects an imperceptible signal into the pixels of images, ensuring the watermark survives transformations like cropping or rotation.
This system is co-trained with a separate detector neural network, ensuring the watermark's robustness against common image transformations like cropping, rotation, or the addition of noise, effectively preventing users or malicious actors from easily removing it.
Media images circulating with false claims about war zones or natural disasters are now tracked using SynthID to combat misinformation.
The detection capabilities of SynthID are integrated into Google's Gemini app, allowing users to verify if an image was generated by Google's AI models.
Cross-company detection is also possible if partner institutions agree to share their watermarking keys through a central portal, enhancing the system's reach and impact.
One aspect, SynthID Bio Structure, focuses on subtly adjusting the positions of individual atoms or the angles between them within a predicted protein structure.
The second component, SynthID Bio Sequence, introduces watermarks directly into protein sequences by substituting specific amino acids, carefully ensuring that the protein's essential biological function remains unchanged.
Concerns exist that malicious actors could use AI to design harmful pathogens, such as an extinct influenza strain, and then order the synthetic DNA from a company to produce them in a laboratory.
Although DNA synthesis companies typically screen orders against databases of known hazardous sequences, AI can create entirely novel sequences.
These novel sequences might fold into dangerous proteins while appearing innocuous in their linear sequence, potentially bypassing current biosafety checks.
This allows DNA synthesis companies to trust sequences generated by AI models equipped with safety guardrails, providing an extra verification step before processing potentially problematic orders.
The research team conducted extensive laboratory experiments to determine whether embedding watermarks into amino acid sequences would alter the function of proteins.
Jeremy Ratcliffe confirmed that watermarked proteins exist as real, functional entities, not just simulations, and their laboratory tests, particularly using protein binders, showed near-identical hit rates between watermarked and non-watermarked proteins.
Despite initial skepticism, the results demonstrated that the watermarking process did not change the protein's function at all, ensuring that these proteins are both detectable and fully functional.
The successful implementation of DNA watermarking technology necessitates coordination among various stakeholders, including AI model developers and DNA synthesis companies.
Google DeepMind is open-sourcing the code for SynthID Bio, which will enable developers to integrate the system without direct coordination, acting as a catalyst for industry standards rather than setting them alone.
Future efforts will involve secure key exchanges and parameter sharing between providers, alongside additional engineering to optimize detectability and ease of embedding.
Google DeepMind's approach to biological safety is aligned with the UK's national biological security strategy, which encompasses prevention, detection, and response to biological risks.
The overarching goal is to leverage AI to mitigate biological risks, addressing both naturally occurring threats and those enhanced by AI, with SynthID Bio serving as a prime example of tools for pathogen detection.
Protein sequences incorporate an integral signal through the use of secret keys within the SynthID system.
Any attempt to strip these identifiers would likely destroy the biological function of the molecule, deterring malicious actors from removing the signals.
Google DeepMind asserts that while watermarking is not a new concept, their SynthID Bio technology represents a significant advancement by being the first to demonstrate both imperceptibility and functional preservation in biological sequences.
The researchers have rigorously validated these claims through both in vitro and lab-based experiments, confirming the technology's ability to embed an 'origin story' directly into biological materials, proactively addressing future global threats.
Answers come from the transcript, with the exact spot cited.
Want the next article from Google DeepMind?
When Google DeepMind publishes, we'll write it up like the one you just read and email it to you.
