Google inks a major contract to help the Pentagon use AI. Hundreds of employees sign an open letter opposing the deal. The companyâs leadership initially digs in its heels. Several employees resign in protest. As the employee revolt builds, Googleâs management reverses course and opts not to renew the lucrative military relationship.
That was 2018. Back then, Google was the Pentagonâs partner on Project Maven, a Pentagon initiative that used AI to analyze drone surveillance footage as part of targeting workflows. And employee backlash not only forced the company to give up on Project Maven, it made Google wary of any projects to help the U.S. defense industry.
Flash forward eight years, and history seems, at first glance, to be repeating itself. Google has followed OpenAI and xAI in agreeing to allow its Gemini AI models to be used inside the U.S. militaryâs classified networks for âany lawful purpose.â When news of the likely deal leaked, close to 600 employees signed an open letter opposing it. But Googleâs leadership has again dug in its heels.
This time, however, things may out quite differently than they did with Project Maven. Current and former Google employees tell Fortune the leverage that once allowed technology workers to influence significant sway over the companyâs policies has eroded. Gone are the days when threats of resignations and a petition signed by thousands were enough to sway Mountain Viewâs position.
Rather than give in to employee pressure, Google seems to be doubling down on its controversial deal with the Pentagon, first reported by The Information last week, telling staff in a memo that it âproudlyâ works with the U.S. military and plans to continue to do so.
Unlike with Project Maven, Google can also fall back on the argument that it is hardly the only company to agree to allow its AI models to be used in classified U.S. military systems for âany lawful purposeââand on the contention that failing to agree to such language could present significant legal and business risks to the company. OpenAI and xAI have both agreed to similar contract terms, as have Nvidia, Microsoft, and Amazon. Only the AI lab Anthropic has refused to agree to these terms, resulting in the Pentagon ordering the military and all defense contractors to stop using Anthropicâs products within the next six months and labeling it a âsupply chain risk.â Anthropic has been challenging that designation in court.
While Google has struck a defiant tone, internal backlash appears to be mounting, with several employees criticizing the deal publicly.Â
âI spent the last 2 months trying to prevent this,â Alex Turner, a research scientist at Google DeepMind, the unit that builds the companyâs Gemini models, said in a post on X. âGoogle affirms it canât veto usage, commits to modify safety filters at government request, and aspirational language with no legal restrictions. Shameful.â
Tensions between tech workers and management over military applications are not new, particularly when AI systems risk being used in warfare, but Googleâs own stance has been gradually shifting in ways that alarm critics. In the wake of the Project Maven controversy, for example, Google published a set of AI principles pledging not to develop AI for weapons or for surveillance that violates internationally accepted norms. But, in February 2025, the company updated those principles and removed that explicit pledge from its public website.
Laura Nolan, a former Google employee who resigned over Project Maven, told Fortune it is unsurprising that employees working on a general-purpose technology, such as AI, would be uneasy about their work contributing to military targeting systems.
âThese are not people who are necessarily expecting to work at a defense constructor as suddenly they are,â she said. However, she also said that workers today have less influence than they once did, as cost-cutting and layoffs across the tech sector have weakened employee leverage and made collective organizing more difficult.
âThe companies want to redirect money into AI, and they think that this may even be able to replace engineers,â Nolan said. âStaff in tech have also never been particularly well organized because historically, itâs been a good business to be in and staff have normally been treated very well,â she said.
Google also appears to have learnt lessons from the Project Maven controversy.Â
âOne of the things the company learnt from the Maven incident was they very much started to crack down on internal communication, they decommissioned a lot of the internal mailing lists, and they decommissioned the internal social network,â she said. âIt is harder to organize internally now.âÂ
The only organized pushback from employees so far is primarily an open letter to management protesting the use of the tech in military situations, which has now amassed around a thousand signatures, according to one Google DeepMind researcher who spoke to Fortune but asked for anonymity to speak freely about their employer. Part of the issue, the researcher said, is that some within the company feel the Pentagon deal fundamentally clashes with DeepMindâs values, and has left employees questioning whether the AI systems they help to build will now be deployed in ways they consider dangerous and cannot see or verify.
âThere was a pride in doing AI for good for a very long time,â the researcher said. âSuddenly, the things Iâve pushed to improve might be used in very different ways with not enough oversight to harm people.â
The researcher also said many staff were still unaware of the deal because Google never clearly communicated that it was negotiatingâor had signedâthe contract. The closest Google has come to responding to employeesâ concerns is publishing an internal memo about âresponsible AIâ and military partnerships that did not explicitly acknowledge the agreement, they said. The researcher called the lack of transparency around the contract âpretty indictingâ for Google and said it felt as if the deal had been done âin the dark.â
âWe need to use the little leverage that exists to maybe get leadership to sort of maybe at least commit to more transparency,â the researcher said. They added that as AI-driven automation reduces headcounts across the industry, it has become harder to mount the kind of internal pushback that helped kill Googleâs Project Maven contract in 2018.
Representatives for Google did not respond to a request for comment from Fortune by the time of publication.
Concerns about mass surveillance and autonomous weapons
The dealâand Googleâs decision to push through with it despite strong employee oppositionâhas put fresh pressure on a question that has dogged the AI industry since Anthropicâs negotiations with the Pentagon publicly collapsed earlier this year: whether AI companies can or should impose meaningful limits on how governments use their technology, especially when it comes to autonomous weapons and mass surveillance, and whether employees have any real power over how the technology they create is used.Â
The areas of concern around Googleâs deal are the same two that have plagued other AI companies: autonomous weapons and mass surveillance. On weapons, critics worry AI could theoretically be used to autonomously identify and select targets without direct human oversight. On surveillance, AIâs ability to aggregate scattered data points into a comprehensive picture of a personâs life is already technically feasibleâand, according to legal experts, currently lawful. These experts say this is the case even though several U.S. laws, including the 1978 Foreign Intelligence Surveillance Act, the 2015 USA Freedom Act, and the Fourth Amendment of the U.S. Constitutionâwhich protects individual citizens from illegal searches and seizuresâwould all seemingly prohibit mass surveillance of U.S. citizens. But legal experts say that under existing U.S. law, government authorities can buy commercially available data from brokers and feed it to AI systems, amounting in practice to mass surveillance of Americans.
While the Google agreement states that the companyâs tech âis not intended for,â and âshould not be used forâ domestic mass surveillance or autonomous weapons without appropriate human oversight and control, experts have said that it imposes no enforceable obligation on the Pentagon to abide by those limits. Â
âGiven that we offer general-purpose models and not models that are specifically trained or evaluated for such purposes, there are huge risks,â the Google researcher said. âWith mass surveillance, itâs very clear that this is really dangerous, and we just donât have the laws or the regulations.â
He noted that current large language models like Gemini are not yet suited to run on weapons systems directly as they are too slow and too large to be embedded in something like a drone.Â
However, he said the issue is around the precedent these âall lawful purposesâ contracts set for future, more capable systems. He argued Googleâs agreement risks normalising a model in which companies hand over powerful, generalâpurpose AI to the Pentagon with few meaningful constraints, making it much harder to roll back or tighten those terms later.
Weaker guardrails on military AI
Google is not the first AI company to sign a Pentagon deal that critics say falls short on these two issues, but legal experts say its contract appears to be the most permissive yet.
Following Anthropicâs rupture with the Department of War over its refusal to sign a contract that included the âall lawful purposesâ language that the Pentagon has been insisting on, both OpenAI and Elon Muskâs xAI both inked deals with the Pentagon that allowed their tech to be deployed for âall lawful useâ by the government. OpenAIâs decision, coming after it has stated publicly that it supported Anthropicâs red lines too, sparked employee dissent within OpenAI, led to customer boycotts of ChatGPT, and caused at least one senior employee to resign from the AI lab. The backlash was so widespread that OpenAI CEO Sam Altman later publicly apologized for the âsloppy and opportunisticâ deal and said the company will re-negotiate parts of the deal.
In comparison to OpenAI, Googleâs deal hasnât had quite the same level of scrutiny, even within the company.
âSome people actually arenât even aware of the letter because there is no internal communication about this at all,â the Google researcher said. âWith all the blowback against OpenAI, this is just a hope that people have moved on and this is the new normal.â
Legal experts have said that the language in Googleâs deal appears to be less restrictive and more permissive of government use than OpenAIâs.Â
âThe OpenAI contract seemed like it did give some kind of contractual guarantee that the models werenât going to [be] used for certain kinds of mass domestic surveillance,â Charlie Bullock, a senior research fellow on LawAIâs U.S. Law and Policy team, told Fortune. âEven that contractual guarantee is not present in Googleâs deal.â
Bullock added that under Googleâs terms, if there are technical safeguards within the models that prevent the government from doing something it wants to do, Google is obliged to step in and remove those safeguards. The government can do whatever it wants, as long as itâs lawful, according to Bullockâs assessment of the contract, whereas OpenAIâs contract appeared to lack the language about removing and adjusting safety settings from filters.
However he also noted that, unlike Google, OpenAI had published a smaller portion of its contract with the Pentagon and these assurances may be undermined in other places.
SeĂĄn Ă hĂigeartaigh, a research professor at the Centre for the Future of Intelligence, said the Google agreement appeared âstrictly weakerâ than OpenAIâs on the available evidence.Â
âFrom a legal perspective, it looks less strong and thus more concerning,â he said, adding that it was âdisappointingâ that Googleâs deal had not attracted the same level of public discourse and internal debate as OpenAIâs.
This story was originally featured on Fortune.com
