Blog Posts in Scientific Integrity

EPA Scientific Integrity Proposal Missing Critical Elements

 

The U.S. Environmental Protection Agency’s (EPA) draft scientific integrity policy is missing critical elements needed to effectively safeguard science at the agency, OMB Watch said in comments filed yesterday. The policy must be improved if the agency is to ensure that the best science informs policy decisions that affect the health and environmental quality of all Americans.

The Obama administration recognizes that sound, uncensored science is critically important to protecting our health, economy, and environment. Consequently, President Obama issued a memo shortly after taking office, establishing protections for scientific integrity and directing agencies to implement them. Unfortunately, implementation of that memo has been sluggish and uneven. However, there have been some bright spots, such as the draft policy at the National Oceanic and Atmospheric Administration (NOAA), which OMB Watch praised.

EPA's efforts have been more mixed. For example, the process to develop a policy at EPA has been mostly open: the agency posted a draft policy and solicited public comment. But the openness has been less than full-fledged, as important appendices and references are missing from the policy posted. EPA should be sure the public has an opportunity to comment on a complete version of the policy before finalizing it.

The content of EPA's draft policy is also flawed. The draft policy moves in the right direction but stops short of what's needed to adequately protect scientific integrity. Fundamentally, an effective scientific integrity policy must do two things: prevent political interference with science and protect the free flow of scientific information. EPA's draft policy is inadequate on both counts. As we say in our comments:

In general, the portions of EPA’s draft policy that have been released to date establish the appropriate principles for scientific integrity, particularly in striving to keep science free from political interference and to foster a culture of scientific openness. However, the translation of these principles into effective policies is lacking, and we recommend that EPA make significant changes to the draft policy to address this gap.

To improve EPA's draft policy, OMB Watch makes these recommendations in our comments:

  1. Make the prohibitions on political interference with science enforceable;
  2. Strengthen protections for the free flow of scientific information;
  3. Protect personnel who blow the whistle on scientific integrity violations;
  4. Improve scientific integrity in peer review and federal advisory committees;
  5. Expand the role and responsibilities of the Scientific Integrity Committee; and
  6. Strengthen scientific integrity in interagency processes.

EPA's draft suggests that the agency understands the central role of scientific integrity in achieving its critical work to protect Americans' health and natural resources. But EPA needs more than just principles in order to have a policy that effectively upholds scientific integrity. Luckily, EPA has a great model to draw from: the draft NOAA policy. We're hopeful that EPA will make the revisions necessary to ensure that EPA science continues to be top-caliber research that Americans can trust.

Follow Gavin Baker on Twitter

(Gavin Baker 09/07/11; 2 comments)

How to Strengthen Transparency in the U.S. Open Government Plan

 

Yesterday, OMB Watch submitted its recommendations for the Obama administration's national plan for the Open Government Partnership (OGP). The administration will unveil its plan, with new concrete commitments to increase transparency, at the international OGP meeting on Sept. 20.

Seven other countries will also announce their national open government plans at that summit, organized around the United Nations General Assembly meeting. For the U.S. as well as the other participants, OGP has been an impetus to action for transparency. The national plan to be released in September is an important opportunity for the administration to expand on its progress in strengthening open government in order to empower Americans and build a better democracy.

In blog posts on Aug. 8 and Aug. 22, the administration asked for feedback on six topics to inform the development of its national plan. Reforms in these areas, including improving federal websites and promoting corporate accountability, would constitute a positive agenda for the U.S. Open Government Plan.

Our comments offer recommendations on each of the six topics. Among the ideas offered, OMB Watch encouraged the administration to:

  1. Transform Regulations.gov into a one-stop shop for citizens to learn about rulemaking
  2. Establish federal website standards that encourage proactive disclosure, identification of public priorities, and visualization tools
  3. Improve Data.gov with common data formats, identifiers, and user-friendly interfaces
  4. Strengthen records management with smarter IT investments and email policy
  5. Make regulatory compliance information more user-friendly
  6. Promote corporate accountability with better disclosure

In addition to these comments, OMB Watch has consulted with the administration on other topics that would make excellent contributions to the U.S. Open Government Plan. Meaningful reforms to the six consultation topics would be a significant step forward, but we hope that the administration will consider additional initiatives as well. For instance, the White House could establish an award, similar to the SAVE Award, to recognize the best contributions to open government by federal employees. Such an award could be an important way to foster a culture of openness within government and would be a helpful complement to the policy reforms the administration is considering.

We invite readers to join the discussion by sending their thoughts on the six topics by email to opengov@ostp.gov.

Follow Gavin Baker on Twitter

(Gavin Baker 09/01/11; 3 comments)

NOAA Takes Lead on Protecting Scientific Integrity

 

The National Oceanic and Atmospheric Administration's (NOAA) efforts to protect scientific integrity make the agency a leader among its federal counterparts, OMB Watch said in comments filed last week.

The Obama administration recognizes that sound, uncensored science is critically important to protecting our health, economy, and environment. Consequently, President Obama issued a memo shortly after taking office, establishing protections for scientific integrity and directing agencies to implement them. However, implementation has been sluggish and uneven.

NOAA represents some of the best efforts so far. The agency's draft scientific integrity policy and procedural handbook, released to the public in June, are thoughtful and detailed. In addition, NOAA has been an exemplar of openness in developing its policy, most importantly by soliciting public comments on its draft policy.

Fundamentally, an effective scientific integrity policy must do two things: prevent political interference with science and protect the free flow of scientific information. NOAA's draft policy makes strong provisions for both.

In our comments, OMB Watch makes the following recommendations:

  1. Retain strong protections to prevent and redress political interference with science;
  2. Retain and strengthen protections for the free flow of scientific information;
  3. Strengthen protections for personnel who blow the whistle on violations of scientific integrity;
  4. Improve the timeliness of investigations of scientific integrity violations;
  5. Improve the transparency of investigations of scientific integrity violations;
  6. Regularly review the policy and update it as appropriate; and
  7. Strengthen scientific integrity in interagency processes.

Although our suggestions would further improve the policy, NOAA should be commended for its leadership for posting a strong draft. At a time when some agencies are struggling to meaningfully move scientific integrity forward, other agencies should look to NOAA as a model.

At the same time – as we point out in our final recommendation – NOAA alone can't fully protect its science. The biggest recent scientific integrity controversy at NOAA, regarding the mysteriously delayed disclosure of worst-case models for the BP oil spill, revolves around the role of the White House Office of Management and Budget (OMB), not NOAA itself. As we write in our comments:

Consequently, while NOAA has done its duty to develop strong scientific integrity protections, the task of fully securing NOAA science will not be complete until other agencies do so as well, particularly OMB and other White House offices.

Follow Gavin Baker on Twitter

(Gavin Baker 08/22/11; 0 comments)

Scientific Integrity Policies Moving Forward, But Still Little Sunlight

 

The White House Office of Science and Technology Policy (OSTP) announced in a blog post today that nearly all the agencies participating in the development of scientific integrity policies had submitted draft policies to OSTP. The deadline for agencies to do so was last week. The State Department and the U.S. Agency for International Development (USAID) are behind schedule but are expected to submit their policies soon.

The progress toward implementing President Obama's scientific integrity memo is promising. Unfortunately, the implementation process continues to be haphazard. OSTP still hasn't set a deadline for agencies to finalize their policies, directed agencies to solicit public comment on their policies, or even to publish their final policies.

In fact, the most surprising part of today's announcement is that five agencies have already finalized their policies! The Interior Department had already finalized its policy late last year, after soliciting public comment. But the other four agencies – the Departments of Commerce and Justice, as well as the National Aeronautics and Space Administration (NASA) and the Intelligence Community – do not appear to have done public consultation in developing their policies. While Commerce and NASA have posted their final policies online, it's unclear if Justice and the Intelligence Community have taken even that most basic step toward transparency.

Thankfully, a few other agencies are taking the wiser approach of being more open. The Environmental Protection Agency (EPA), the National Oceanic and Atmospheric Administration (NOAA), and the National Science Foundation (NSF) have published their draft policies for public comment. The other agencies should do so as well, with the goal of finalizing their policies later this year.

Follow Gavin Baker on Twitter

(Gavin Baker 08/11/11; 1 comment)

Finally, a Deadline for Scientific Integrity Policies

 

Today, the Office of Science and Technology Policy (OSTP) announced that it was asking agencies to submit their draft scientific integrity policies within 90 days.

Although the announcement doesn't include a deadline to finalize the policies and begin implementation, with luck the new policies could be in place later this year. The new policies should further protect federal science from interference, ensuring that government decisions are based on sound science and improving public trust.

Unfortunately, the announcement doesn't address the question of public consultation. Before finalizing their policies, agencies should publish their proposed policies for public comment.

The announcement is the light at the end of what has been a long tunnel. In March 2009, President Obama explained his principles for protecting scientific integrity in a memo to agencies. After considerable delay, OSTP followed up with guidelines in December 2010. Those guidelines asked for progress reports from agencies, which were delivered two weeks ago. Today's announcement is the first deadline for agencies to begin putting the OSTP guidelines into practice.

What will the new policies look like? We can find some clues from the U.S. Environmental Protection Agency (EPA) and the National Aeronautics and Space Administration (NASA), which have posted their progress reports online. Hopefully, more agencies will follow suit and post their reports online as well.

Follow Gavin Baker on Twitter

(Gavin Baker 05/05/11; 2 comments)

Agencies Report Progress on Scientific Integrity – in Private

 

Thirty agencies have reported on their progress to strengthen scientific integrity, according to a blog post yesterday by the White House Office of Science and Technology Policy (OSTP). This week was the deadline to submit those reports, per OSTP director John Holdren's December 2010 memo.

In addition, six agencies have submitted draft or final policies to OSTP. The Holdren memo did not set a deadline for agencies to revise their policies to protect scientific integrity.

That's progress, but at a snail's pace. President Obama issued his memorandum more than two years ago, in March 2009. Worse, OSTP hasn't made the reports or policies public.

In a Greenwire report today, OSTP spokesman Rick Weiss won't even name the agencies that submitted policies. But, he says, "We will be asking for further progress with deadlines in the near future."

That's a move in the right direction, even if OSTP is being unnecessarily secretive about the process. Agencies should move expeditiously to complete their plans to strengthen scientific integrity and publish them for public comment, with an eye toward beginning implementation this year.

After all, the public deserves to know that decisions about protecting public health and the environment are based on sound, uncensored science – and they shouldn't have to wait.

(Gavin Baker 04/22/11; 0 comments)

Transparency Hearing Highlights Spending Data Issues

 

Even though Sunshine Week is officially this week, the House of Representatives got the ball rolling last Friday. The House Oversight and Government Reform Subcommittee on Technology, Information Policy, Intergovernmental Relations and Procurement Reform (say that ten times fast) held a hearing called "Transparency Through Technology: Evaluating Federal Open-Government Initiatives," although the hearing focused more on spending transparency than anything else. While one would expect that an oversight hearing in the House “evaluating” the Obama administration’s transparency efforts would be contentious, the most surprising aspect of the hearing was that it wasn’t.

The subcommittee’s chairman, Rep. James Lankford (R-OK), started the hearing off with a balanced tone. In his opening statement, Lankford commended the Office of Management and Budget (OMB), specifically on its efforts with USAspending.gov, Recovery.gov, and Data.gov. “It is not our intent today to belittle the efforts of this administration,” Lankford said, “only to discover the important lessons learned and to hear the steps being taken to move things forward.” It was good to see that the subcommittee was more focused on solving problems than scoring political points, a concern some have with a Republican House Oversight Committee.

The good feelings, however, didn’t last the entire hearing. Full committee chairman Rep. Darrell Issa (R-CA) was more critical of the administration than Lankford, calling the spending data "useless." Several members of the subcommittee were miffed that Daniel Werfel, the head of OMB’s Office of Federal Financial Management, asked to be on a panel by himself, citing an apparent long-standing precedent. The subcommittee’s vice-chair, Rep. Mike Kelly (R-PA), was particularly incensed, saying it betrayed the administration’s transparency rhetoric.

Eventually, the subcommittee got around to debating actual policies. With Sunlight Foundation executive director Ellen Miller as one of the witnesses, the conversation quickly focused on spending transparency and data quality. Subcommittee members used research from Sunlight to press two of the other witnesses, chief information officers (CIOs) from the departments of Agriculture and Education, on USAspending.gov data quality. Kaitlin Lee over at Sunlight has a pretty good rundown of two of the more contentious issues debated during the hearing, school lunch block grants and student loans. Sadly, the hearing provided little in the way of new details from the administration, with the CIOs simply saying that the administration is making unprecedented strides in spending transparency, and that their data isn’t as bad as Sunlight suggested.

In a more positive note, towards the end of the hearing, the subcommittee’s ranking member, Rep. Gerry Connolly (D-VA), brought up tax expenditure transparency. Saying “I don’t think we pay enough attention up here to tax expenditures,” Connolly correctly pointed out that they are a “real life spending item by any other name” and should be tracked. He asked Werfel what OMB was doing to make sure the federal government “shed enough light on tax expenditures and their relationship to the deficit.” Werfel dodged the question, saying he first needed to talk with Internal Revenue Service, but in a show of bipartisan support, Lankford chimed in, saying it’s important to have transparency in this area. With tax expenditures consuming a trillion dollars a year, we couldn’t agree more, and look forward to Congress and the administration working together on tax expenditure transparency.

Image by Flickr user cliff1066TM used under a Creative Commons license.

(Sam Rosen-Amy 03/16/11; 0 comments)

Get Ready for a Lot More Information on Government Performance

 

On Tuesday, the House passed the Senate's amendments to the Government Efficiency, Effectiveness, and Performance Improvement Act (HR 2142), also called the Government Performance and Results Modernization Act. The bill now heads to President Obama for his signature.

The bill institutes a range of reforms to government performance management and planning. Among the changes are a number of transparency and reporting requirements which will significantly expand the amount of information available to the public about government performance.

Agencies will be required to post online their quadrennial strategic plans, annual performance plans, and annual performance reports. Performance reports for the first time will be required to include information on the data's accuracy and validity, and any limitations of the data.

In addition, the bill requires the Office of Management and Budget (OMB) for the first time to create a government-wide performance plan, and requires that the plan be posted online. The government-wide and agency plans will reference each other, identifying how each agency contributes to overall goals.

Initially, each agency's documents are required be posted on the agency's website. Starting FY 2012, all the performance documents must be posted on a single website in a searchable, machine-readable format.

That site will also contain information on all agencies' programs, including each program's description, how it contributes to the agency's mission and goals, and its funding level. The website will also list priority goals for agencies and the government overall, and will post quarterly results for each goal. The site will identify programs, policies, and tax expenditures contributing to each goal, with an assessment of whether or not they're working.

Making such a vast amount of new information available online could shed valuable light on how well federal agencies and programs are performing. The new site could potentially be a powerful tool in helping citizens to understand what they get for their money – and to demand that under-performing programs shape up.

But effectively communicating complex information about the performance of thousands of federal programs will be no mean feat. The right metrics and a coherent presentation will be needed to make the site accessible.

The requirements codify many of the elements detailed in a September 2010 OMB memo announcing performance.gov. That site is currently accessible only to government officials, although the memo indicated plans to open it to the public.

An interesting provision passed in the earlier House version but left out of the final legislation would have required linking programs' performance to their spending on USASpending.gov. It also would have required a report on the feasibility of including performance and spending information in a single site.

Follow Gavin Baker on Twitter

(Gavin Baker 12/23/10; 1 comment)

White House’s Long-Awaited Scientific Integrity Plan Released

 

White House Office of Science and Technology Policy Director John Holdren issued a memo to executive branch agencies today that could improve scientific integrity in the federal government. "The memo is a sign of relief for federal scientists who are unsure of their rights and whose work is too susceptible to manipulation," said Gary D. Bass, Executive Director of OMB Watch.

For more on the memo, read OMB Watch’s statement.

The memo is the result of a March 2009 request from President Obama for recommendations on scientific integrity. The recommendations were due in July 2009, but had stalled.

Groups like OMB Watch and the Union of Concerned Scientists applauded Obama’s focus on scientific integrity. After years of abuse during the Bush administration – including censorship of scientists, suppression or alteration of research, and manipulation of findings used in policymaking – Obama’s decision to attempt to restore scientific integrity was, and still is, a breath of fresh air.

(Matthew Madia 12/17/10; 0 comments)

Three Months Later, Missing "Oil Budget" Methodology Released

 

The government responders to the BP Deepwater Horizon oil spill today released its report on the "oil budget" tool used to calculate what happened to the spilled oil. Unlike the version of the report released on Aug. 4, this one comes peer-reviewed and with methodology.

As we noted in our earlier commentary, the August report was criticized for not disclosing the methods used to reach its conclusions. As a congressional staffer wrote at the time, "Essentially, nobody can check the math."

Critics also noted the administration's claims that the August report had been peer-reviewed by independent scientists turned out to be untrue. National Oceanic and Atmospheric Administration (NOAA) administrator Jane Lubchenco acknowledged today, "That report was not peer-reviewed, and I was in error." The new report contains an appendix listing 14 peer reviewers and their responses to an earlier draft of the document – a welcome step to provide much-needed transparency.

Perversely, the peer review process delayed the disclosure of the study's methodology but not the conclusions. Chairman Ed Markey (D-MA), in an Aug. 19 hearing of the House Energy and Environment Subcommittee, asked NOAA's Bill Lehr if the methodology would be released. Lehr replied that it would be – but only after completing a peer review process that could take several more months. The report released today is the result of that process.

Peer review is an important part of the scientific process, but it was a poor reason to withhold the report's methodology. If the administration was confident enough in the study's conclusions to release them publicly, then it should have been confident enough to release the methodology, too.

Quality control does take time, and there can be a value in releasing earlier drafts – particularly in a situation like the BP spill, where there was tremendous demand for timely information. But the tension between quality and promptness cannot be resolved by publicly trumpeting conclusions while their very basis is still under review and hidden from the public.

Science isn't based on assertion: it's based on disclosed methods that others can examine and critique. The public shouldn't have to take the government at its word. The administration should seriously consider the Oil Spill Commission's suggestion that government study groups release more of their underlying methodology and data.

(Gavin Baker 11/23/10; 0 comments)