Thousands of U.S. Government Web Pages Have Been Taken Down Since Friday

More than 8,000 web pages across more than a dozen U.S. government websites have been taken down since Friday afternoon, a New York Times analysis has found, as federal agencies rush to heed President Trump’s orders targeting diversity initiatives and “gender ideology.”

The purges have removed information about vaccines, veterans’ care, hate crimes and scientific research, among many other topics. Doctors, researchers and other professionals often rely on such government data and advisories. Some government agencies appear to have removed entire sections of their websites, while others are missing only a handful of pages.

Among the pages that have been taken down:

• More than 3,000 pages from the Centers for Disease Control and Prevention, including a thousand research articles filed under preventing chronic disease, S.T.D. treatment guidelines, information about Alzheimer’s warning signs, overdose prevention training and vaccine guidelines for pregnant people (the use of the phrase “pregnant people” could have contributed to its removal).

• More than 3,000 pages from the Census Bureau, the vast majority of which are articles filed under research and methodology. Other missing pages include data stewardship policies and documentation for several data sets and surveys.

• More than 1,000 pages from the Office of Justice Programs, including a feature on teenage dating violence and a blog post about grants that have gone toward combating hate crimes.

• More than 200 pages from Head Start, a program for low-income children, including advice on helping families establish routines and videos about preventing postpartum depression.

• More than 180 pages from the Department of Justice, including all state-level hate crime data and seven pages discussing anti-L.G.B.T.Q. hate crimes.

• Close to 150 pages from the Substance Abuse and Mental Health Services Administration, including more than 50 press announcements about the use of the National Disaster Distress Helpline in the aftermath of shootings or natural disasters.

• More than 100 pages from the Food and Drug Administration, including more than 60 regulatory guidelines on topics such as increasing diversity in clinical trials and the potential for addiction and abuse in drug trials.

• Almost 50 research papers from the Office of Scientific and Technical Information. The removed papers span multiple fields, including optics, chemistry and experimental medicine.

• More than 25 pages from the Internal Revenue Service, including the transcript of a video titled “Here’s how to avoid I.R.S. penalties and interest” and the form private schools must submit annually to certify that they have not engaged in racially discriminatory behavior.

• Two dozen research notices from the Nuclear Regulatory Commission — but only notices from the year 2000. Notices from before and after 2000 remain.

• 20 web pages from the National Institute for Science and Technology, including a page detailing the organization’s zero tolerance harassment policy.

• 18 pages from the Health Resources and Services Administration, including a tool kit to care for women with opioid addictions and an FAQ about the Mpox vaccine.

• 18 pages from the U.S. Patent and Trademark Office, including pages about veterans’ innovation and entrepreneurship and a program to teach high schoolers about intellectual property.

• Eight pages from the Department of the Interior, including several detailing environmental policy initiatives (the phrase “environmental justice” may have contributed to the removal of some pages).

• Three pages from the Department of Veterans Affairs: on L.G.B.T.Q. veteran care, minority veteran care and the equity of the Louisiana health care system.

• Two pages from the Marshals Service, one linking to a revision of correctional facility standards and another linking to the department’s fitness readiness program.

Many of the missing pages appeared related to a Trump administration directive — with a deadline of 5 p.m. Friday — to terminate any programs that promote “gender ideology,” and to withdraw documents and any other media that may do so.

In many cases, the removed pages mentioned words like “inclusion” or “transgender.” It is not clear why other pages were removed; how many of the pages will be permanently removed; and how many may be restored with revisions.

And things are still in flux: Since Friday, several pages have gone down and then come back online; others stayed up well past 5 p.m. Friday and were removed only recently. Other government pages, while still accessible, have already been stripped of words related to diversity, gender and climate change, as reported by The Washington Post and others.

In all, these pages represent a tiny sliver of the millions of pages hosted on government domains — roughly one tenth of one percent of all pages.

What The Times did

On Friday, The Times downloaded the list of the most visited government domains in the U.S. and began compiling the complete list of pages available on each one using each site’s sitemap, a file that outlines the structure of a website and is typically used by search engines to keep track of what’s on the internet. (Some sites, including state.gov and weather.gov, were not included in our analysis because we were unable to identify a complete list of web pages on their sites, or for other technical reasons.) In all, we were able to identify more than seven million pages across more than 150 sites.

We then repeated this process several times Friday night and on Saturday, and compared our new list of websites with those we originally found.

What remains uncertain

It’s hard to capture every single change on a system of websites as vast as those that span the federal government. Some things to keep in mind:

• Our approach has some trade-offs. We chose to measure changes on government websites using sitemaps rather than trying to download a complete copy of millions of web pages. This allowed us to measure a much larger scope of changes quickly, but means we may have missed instances where pages weren’t removed but still had substantive edits.

• This is a snapshot. In their efforts to take down some pages to comply with the executive order, officials across the government may be taking down wider swaths of sites while changes are being made. As such, some pages may yet return online. The C.D.C., for example, has already had many pages return after going offline. And the website for Sandia National Laboratories, a research and development lab under contract with the Department of Energy, was live on Friday and Saturday, but was down early Sunday morning.

• Our figures may be underestimates. We looked at only the most visited government domains, and as discussed above, some high-profile sites like state.gov were outside our analysis. But the sites we checked do represent the majority of the pages most people actually visit.

• Our figures may be overestimates. Some pages we identified as missing may have simply been moved to a new URL that we were not able to identify. (We counted URLs as being removed if we found they had been redirected to substantively different pages, such as the home page of a website.) And it’s possible that the original list of government websites we identified on Friday included pages in their sitemaps that had already been taken down weeks or months before. The subjects and topics of the pages that have been taken down suggest that’s probably not the case, on average, but it’s possible.

• We don’t have comparable measures of changes in other administrations. Although government websites often change between administrations, this weekend’s changes appear to be of a much wider scope than those that have happened in the past. Still, we do not have the same measures from previous administrations.

Figures are as of 9 a.m. Eastern on Sunday.

Josh Katz and Andrew Fischer contributed reporting.