Thursday 14 December 2023

Auditor general flags lack of evidence-based records to back COVID decisions

 
 

Auditor general flags lack of evidence-based records to back COVID decisions

Department of Health unable to provide documents for 33 recommendations by office of chief medical officer

The Department of Health was unable to provide evidence-based documentation to substantiate 33 Public Health decisions made during the COVID-19 pandemic, Auditor General Paul Martin says in an audit released Thursday.

The audit covered key operational areas that were meant to reduce the spread of COVID-19, including testing, contact tracing, contact management, and infection prevention and control guidance.

Martin said the department "had numerous systems and procedures in place that were designed to reduce the spread of COVID-19," and went "above and beyond to support New Brunswickers."

But he found "areas for improvement should the need arise," according to Volume 2 of his annual report, which includes chapters on pandemic preparedness and responses between April 1, 2020 and March 31, 2022, by the Department of Health, Department of Justice and Public Safety and Department of Education and Early Childhood Development.

He made a total of 18 recommendations and the departments agree with them.

Hotel isolation program cost more than $5.4M

In his first volume on the government's pandemic response, released in September,  Martin found problems with the level of preparedness, the decision-making process, record keeping and communications.

As part of the next volume on the COVID response, Martin found the Department of Justice and Public Safety's hotel isolation program, cost taxpayers more than $5.4 million and only nine travellers tested positive for COVID-19.

A large, multi-storey brick and metal building with a car port and sign, Hyatt Place, across the top. The Hyatt Place in Moncton was one of several hotels across the province that had a designated area for isolating travellers. The program, overseen by the Red Cross, included guards and contactless food dropoff. (Kate Letterick/CBC)

The program, implemented in May 2021 to reduce non-essential travel and operated by the Red Cross until the end of June 2021, required leisure travellers to self-isolate at an isolation hotel at their own expense for at least seven days upon return to New Brunswick.

The department doesn't know whether the program decreased travel or mitigated COVID-19 risks, he said, because it didn't have clearly established goals and didn't review the outcomes.

Students lost 17 weeks of learning

With the Department of Education, Martin found students lost about 17 weeks of learning time because of school closures due to COVID-19.

Virtual learning training provided to teachers at the district level was ad hoc, he said, and the teachers, in turn, were tasked with training students on how the technology worked. There was no centralized co-ordination or oversight by the
department; "thus, no way for them to know how well things were going or where the gaps were."

While the department has evaluated and reported upon various aspects of the pandemic response plan, it has not performed an after-action review, and has no plan to, said Martin. He found "opportunities for improvement" in the areas of planning, training and communication, to better prepare the education system should future disruptions occur.

'Key' COVID decisions with provincewide impact

For the Department of Health review, Martin's office selected a sample of 33 recommendations from the Office of the Chief Medical Officer of Health and asked the department to provide evidence-based documentation to substantiate the decisions, he said during a presentation to the legislature's public accounts committee.

"The department was unable to provide requested documentation, acknowledging that they 'did not create a compendium or a repository of all of the scientific articles, papers, publications and analyses it consulted during the pandemic and therefore we cannot provide a fulsome and detailed list of all of the evidence consulted and used when recommendations were being formulated.'"

On the other hand, the department was able to provide evidence to support 31 of 35 infection prevention and control policy decisions, which Martin described as being related to internal operations rather than "public-facing" like the 33.

These records should be retained. People want to know —you, the public, they want to know that Health was being heard in their decisions that were being referred to government. They want to know there was no political interference. I have no evidence that there was, or wasn't.​​​​​​
- Paul Martin, auditor general

Martin did not provide details about what the 33 decisions were, what percentage of decisions they represented, or why his office chose to focus on them.

Green Party health critic Megan Mitton said she found the lack of evidence provided by the department "extremely concerning" and asked about the nature of the 33 decisions.

Martin replied saying, "Normally, we don't get into all the details." But generally, they were "key decisions" that had provincewide impacts, he said, citing border closures and masking as examples.

A woman seated at a table in front of a microphone with her hands folded. Martin found in September that the Office of the Chief Medical Officer of Health was at the bottom of New Brunswick's COVID-19 pandemic decision-making hierarchy, but Dr. Jennifer Russell, who resigned, called that a 'misconception or misperception.' She participated in high-level meetings, she said, but ultimately it was cabinet that made decisions. (Jacques Poitras/CBC)

Liberal health critic Rob McKee questioned whether Martin was able to "dig deeper," and asked specifically about what he described as "one of the most high-profile decisions the department faced scrutiny for" —  the lifting of masking rules in March 2022.

Dr. Jennifer Russell, who was chief medical officer of health, cited a study at the time, but internal emails subsequently made public showed she was seeking evidence to back up the decision days after it was made, McKee noted.

He asked whether Martin was able to review emails and whether it's possible some decisions were not based on evidence.

"We're looking for evidence that supports the decisions made and when there's no evidence, all we can do is state the fact to you," said Martin.

He hopes the committee will hold the department accountable, he added.

"I hope that this won't happen again. It's not appropriate.These records should be retained. People want to know — you, the public, they want to know that Health was being heard in their decisions that were being referred to government. They want to know there was no political interference. I have no evidence that there was, or wasn't. The evidence isn't there."

 A woman with short blond hair and glasses speaks into reporters' microphones and recorders.Former Health minister and Tory MLA Dorothy Shephard said the department made decisions based on the best information it had at the time. (CBC)

Former Health minister Dorothy Shephard told reporters she was surprised that the department didn't keep track of those documents. 

"I'm not saying they're not there because as I said, everything was moving very rapidly. One decision was made, the next one came right on it, and that kind of stuff just went through," the Tory MLA said.

"I do have to say that I'm fairly confident, very confident that the information that Public Health gave us was validated by them," she added, suggesting a "broader scope of a discussion" about how decisions were made is in order.

Public inquiry raised

Mitton asked Martin if he thinks New Brunswick needs a public inquiry.

"Would that maybe capture everything that needs to be captured and maybe be able to have the scope needed to dig into things that maybe your office wasn't able to or isn't able to?"

"I couldn't comment whether an inquiry would help or not. That would be a decision amongst yourselves and those in government," replied Martin.

McKee quickly followed up, asking if Martin felt limited by legislation. 

"I'm just wondering if … there's information that we want to dig deeper, is it somewhere else that we have to turn to?"

Martin said he feels he has enough access. But it doesn't matter how far he digs — if the evidence isn't there, it isn't there.

A close-up of a rapid test, showing a line beside the letter "C," which stands for control and means the virus wasn't detected. The Department of Health was unable to ensure COVID test kits were provided when and where they were most needed, the auditor general found. (Alexandre Silberman/CBC)

The audit revealed a similar problem surrounding the 300 compassionate travel exemption requests received by the chief medical officer of health.

There was a lack of established criteria to ensure consistent application and transparency of decision-making, according to the report, and 36 per cent of the exemption requests tested by his office did not have a documented rationale for the decision.

While the department had established performance metrics, such as testing turnaround times, outcomes were not monitored or reported upon.

In addition, a lack of inventory-monitoring systems contributed to the department being unable to ensure supplies were provided when and where needed most, said Martin, citing periods of high demand and rural locations as examples. More than 17 million tests were were distributed as of January 2023, he said.

Department will ensure 'enhanced record keeping'

The auditor general made seven recommendations for the Department of Health. Among them: ensure the development and retention of adequate documentation to substantiate Public Health measures. The target date is listed as "ongoing."

In its response, the Department of Health said it agrees that documentation related to meetings and decisions should be "reinforced to ensure greater transparency on the decision-making process during health emergencies" and will ensure that "enhanced record keeping practices are integrated into its health emergency operations."

Martin also recommended the department ensure decision criteria are established and consistently applied for any process that may result in exceptions for adherence to mandatory orders, and that the rationale used for decision-making for exemptions is well-documented.

Data-systems capacity should be increased, he said, to adequately monitor test inventory during a pandemic to ensure supply meets demand.

Other recommendations for the department include:

  • Develop, monitor and report on established key performance indicators. Targets should be regularly reviewed for ongoing relevance and revised accordingly.
  • Provide clear targets to support the decision-making process when moving between various phases of a staffing crisis action plan. This should form part of an up-to-date pandemic plan.
  • Develop a contingency plan, as part of the business continuity planning, that outlines backup procedures for key personnel, both at the department and regional levels.
  • Review the efficacy of the critical care nursing initiative to determine if it accomplished its intended objectives and note any future improvements should the need arise again.

Auditor general flags lack of evidence-based records to back COVID decisions

Department of Health unable to provide documents for 33 recommendations by office of chief medical officer

The Department of Health was unable to provide evidence-based documentation to substantiate 33 Public Health decisions made during the COVID-19 pandemic, Auditor General Paul Martin says in an audit released Thursday.

The audit covered key operational areas that were meant to reduce the spread of COVID-19, including testing, contact tracing, contact management, and infection prevention and control guidance.

Martin said the department "had numerous systems and procedures in place that were designed to reduce the spread of COVID-19," and went "above and beyond to support New Brunswickers."

But he found "areas for improvement should the need arise," according to Volume 2 of his annual report, which includes chapters on pandemic preparedness and responses by the Department of Health, Department of Justice and Public Safety and Department of Education and Early Childhood Development.

A close-up of a rapid test, showing a line beside the letter "C," which stands for control and means the virus wasn't detected. The Department of Health was unable to ensure COVID test kits were provided where needed most, the auditor general found. (Alexandre Silberman/CBC)

In his first volume on the government's pandemic response, released in September,  Martin found problems with the level of preparedness, the decision-making process, record keeping and communications.

As part of the next volume on the COVID response, Martin found the Department of Justice and Public Safety's hotel isolation program cost taxpayers more than $5.4 million and only nine travellers tested positive for COVID-19.

With the Department of Education, he found "opportunities for improvement" in the areas of planning, training and communication, to better prepare the education system should future disruptions occur.

For the Department of Health review, his office selected a sample of 33 recommendations from the Office of the Chief Medical Officer of Health and asked the department to provide evidence-based documentation to substantiate the decisions, he said during a presentation to the legislature's public accounts committee.

"The department was unable to provide requested documentation, acknowledging that they 'did not create a compendium or a repository of all of the scientific articles, papers, publications and analyses it consulted during the pandemic and therefore we cannot provide a fulsome and detailed list of all of the evidence consulted and used when recommendations were being formulated.'"

'Key' decisions with provincewide impact

Martin did not provide details about what those 33 decisions were, what percentage of decisions they represented, or why his office chose to focus on those ones.

Green Party health critic Megan Mitton said she found the lack of evidence provided by the department "extremely concerning" and asked about the nature of the 33 decisions.

Martin replied saying, "Normally, we don't get into all the details." But generally, they were "key decisions" that had provincewide impacts, he said, citing border closures and masking as examples.

Liberal health critic Rob McKee questioned whether Martin was able to "dig deeper," and asked specifically about what he described as "one of the most high-profile decisions the department faced scrutiny for" —  the lifting of masking rules in March 2022.

Dr. Jennifer Russell, who was chief medical officer of health, cited a study at the time, but internal emails subsequently made public showed she was seeking evidence to back up the decision days after it was made, McKee noted.

He asked whether Martin was able to review emails and whether it's possible some decisions were not based on evidence.

"We're looking for evidence that supports the decisions made and when there's no evidence, all we can do is state the fact to you," said Martin.

Martin found a similar problem surrounding the 300 compassionate travel exemption requests received by the chief medical officer of health.

There was a lack of established criteria to ensure consistent application and transparency of decision-making, according to the report, and 36 per cent of the exemption requests tested by his office did not have a documented rationale for the decision.

While the department had established performance metrics, such as testing turnaround times, outcomes were not monitored or reported upon.

In addition, a lack of inventory-monitoring systems contributed to the department being unable to ensure supplies were provided where needed most, said Martin, noting the demand for COVID test kits was high, with more than 17 million tests distributed as of January 2023.

7 recommendations

The auditor general made seven recommendations to address these issues. Among them: ensure the development and retention of adequate documentation to substantiate Public Health measures. The target date is listed as "ongoing."

In its response, the Department of Health said it agrees that documentation related to meetings and decisions should be "reinforced to ensure greater transparency on the decision-making process during health emergencies" and will ensure that "enhanced record keeping practices are integrated into its health emergency operations."

Martin also recommended the department ensure decision criteria are established and consistently applied for any process that may result in exceptions for adherence to mandatory orders, and that the rationale used for decision-making for exemptions is well-documented.

Data-systems capacity should be increased, he said, to adequately monitor test inventory during a pandemic to ensure supply meets demand.

Other recommendations for the department include:

  • Develop, monitor and report on established key performance indicators. Targets should be regularly reviewed for ongoing relevance and revised accordingly.
  • Provide clear targets to support the decision-making process when moving between various phases of a staffing crisis action plan. This should form part of an up-to-date pandemic plan.
  • Develop a contingency plan, as part of the business continuity planning, that outlines backup procedures for key personnel, both at the department and regional levels.
  • Review the efficacy of the critical care nursing initiative to determine if it accomplished its intended objectives and note any future improvements should the need arise again.
CBC's Journalistic Standards and Practices
 
 
 
94 Comments
 
 
 
David Amos 
Higgy et al know I have a huge bone to pick with New Brunswick's auditor general 
 
 
David Amos
The plot thickens  
 
 
David Amos
Reply to David Amos
Why is it I do not believe the Health Minister who denied my right to a Health Care Card?

''Former Health minister Dorothy Shephard told reporters she was surprised that the department didn't keep track of those documents."

 
rick haars  
Reply to David Amos 
The plot was always there it's just how thick it is, is the guess. 
 
 
David Amos
Reply to rick haars  
I am not guessing


 
David Amos 
Why is it that I am not surprised? 
 
 
 
David Amos 
Methinks the lack of data just bit Higgy's arse N'esy Pas? 
 
 
 
David Amos 
Methinks the lack of data just bit Higgy we all know where N'esy Pas?  
 
 
 
David Amos 
If Higgy's data was so good howcome he declared the "pandemic" was over in NB as he danced unmasked on a stage with Russell and Cardy then called an unnecessary election in order to win a majority before locking us down again?


Lou Bell
Reply to David Amos
How come ? Because the opposition were demanding one . They claimed NBers were demanding one be called . They even had the ** ahem * polls to show it ! He called their bluff and they lost . Again !  
 
 
Ronald Miller
Reply to David Amos
He never said the pandemic was over. 
 
 
David Amos
Reply to Lou Bell 
Yea Right 
 
 



 
Allan Marven 
The first decision was to hold an election....oh wow , we've got the rubes over a barrel now. Karma is gonna bite hard.


David Amos
Reply to Allan Marven.
Amen
 
 
 
 
Robert Losier
Auditor general flags lack of evidence-based records to back COVID decisions

What a surprise.


Allan Marven
Reply to Robert Losier
Truth might be a surprise to you.


Robert Losier.
Reply to Allan Marven
I don't comprehend what you say.


David Amos
Reply to Robert Losier
Why is it I am not surprised?


Robert Losier
Reply to David Amos
How would an accusation be construed as being relevant.


David Amos
Reply to Robert Losier
Its very relevant to the person being arrested


Robert Losier
Reply to David Amos
Check out Fredericton Independent.


David Amos
Reply to Robert Losier
Are you teasing me? Everybody knows I ran in Fredericton as an independent after I was falsely arrested an imprisoned under the charges of "other" then I was falsely arrested in Federicton


Robert Losier
Reply to David Amos
I have seen the videos where you are in the starring role.


David Amos
Reply to Robert Losier
Say Hey to the RCMP for me will ya?


Robert Losier
Reply to David Amos
I know no RCMP. And if ever I do I am sure their files on you need no replenishing.


David Amos
Reply to Robert Losier
Oh My My


Robert Losier
Reply to David Amos
You broadcast your gripes. You think RCMP don't know that about you?


David Amos
Reply to Robert Losier
Why else would I sue the Crown in 2015? 
 

Robert Losier

Reply to David Amos
Maybe that explains why you in a election debate reached out to The NDs. And if I recall correctly she didn't like that.


David Amos
Content Deactivated

Reply to Robert Losier
BINGO


David Amos
Reply to Robert Losier
Bingo


David Amos
Reply to Robert Losier
Did Mr Outhouse mention our recent conversation? 


Robert Losier
Reply to David Amos
Mr Outhouse who?


David Amos
Reply to Robert Losier
Why play dumb? Heres the thing that even Higgy would understand if this spit and chew goes "Poof" then we will know who you are working for Correct? 
 

Harvey York

Reply to Robert Losier
You'll have to forgive old Dave....he's become quite excitable since he discovered Higgs is building a new retirement home for him in Minto


Robert Losier
Reply to David Amos
I am a self employed housing renovator.


Robert Losier
Reply to Harvey York
Oh. I was wondering.
 

Harvey York

Reply to David Amos
What do you think? Nobody will admit to talking to you. Jeez.


Robert Losier
Reply to Harvey York
Man on a Mission for sure. 


 
 
 
Jimmy Cochrane
"The department was unable to provide requested documentation, acknowledging that they 'did not create a compendium or a repository of all of the scientific articles, papers, publications and analyses it consulted during the pandemic and therefore we cannot provide a fulsome and detailed list of all of the evidence consulted and used when recommendations were being formulated.'"

Gar ba ge, political word salad.

 
David Amos
Reply to Jimmy Cochrane
I concur  
 
 
robert lawson 
Reply to Jimmy Cochrane
definitely long winded to say "we did not keep copies of all the referenced materials used" but I fail to see the political part  
 
 
 
 
Jimmy Cochrane 
Junk/political science was all that was at play. 
 
 
David Amos
Reply to Jimmy Cochrane
I second that emotion  
 
 
 
 
Kyle Woodman
Another failure by the Higgs government.   
 
 
David Amos
Reply to Kyle Woodman
Welcome back to the circus  
 
 
Kyle Woodman 
Reply to David Amos  
Indeed!
 
 
Ronald Miller
Reply to Kyle Woodman  
This gov't has performed so well, and since you don't support it, it has reduced you to a blathering no mind who can only regurgitate the same sentence over and over, I suggest a trip to the therapist, it's a start anyways.
 
 
Micheal Wilson
Reply to Kyle Woodman  
I bet you praised Higgs when we had zero cases lol.
 
 
SW Home 
Reply to Kyle Woodman 
It's like wash, rinse and repeat with Higgs and failures. He is well past his Best Before date 
 
 
Ronald Miller
Reply to SW Home 
You still seem upset taxpayers are not on the hook for pension over runs, maybe you could volunteer to cover them and Higgs can put them back on the unsustainable defined risk plan than everyone is abandoning. Meanwhile Higgs will continue to fail with surpluses, debt reduction, reduced debt payments, tax breaks, more help for the homeless, shorter doctor wait lists, etc. etc. etc. etc. etc. etc. etc. etc. etc. etc. 
 
 
David Amos
Reply to SW Home  
Methinks Higgy's "Best Before Date" expired many moons ago when his beloved COR Party did not want him to lead them N'esy Pas?
 
 
Kyle Woodman 
Reply to Micheal Wilson
Not really.  
 
 
Lou Bell
Reply to David Amos 
Sounds like some other political wannabe we hear from on these pages . Lots of fodder , no substance .  
 
 
David Amos
Reply to Lou Bell 
Say hey to Cardy for me will ya?  
 
 
 
 
 
Micheal Wilson
What a shocker. A lot of the rules was kind of nonsense. Such as having no family for thanksgiving but you were allowed to eat with them in a restaurant


MR Cain
Reply to Micheal Wilson
When the concept is taken out of context, a lot of people were confused.


Robert Brannen
Reply to Micheal Wilson
The rationale for that rule is that "family" gatherings at Thanksgiving customarily involve several individual families with members gathering from far-flung localities, with participants numbering in the double digits.

Those types of "family" gatherings had the option of gathering at restaurants; however, they would likely have groused about the requirement to be seated at multiple, appropriately distanced, shielded tables, with a limit of four diners per table.

So, where do you see a problem?


MR Cain
Reply to Robert Brannen
Most restaurants had better ventilation as well.


Micheal Wilson
Reply to Robert Brannen
So it was safer to eat in a restaurant surrounded by 50 strangers opposed to my 5 or 6 family members? Please explain.


David Amos
Reply to Micheal Wilson
Remember when Higgy wanted your neighbours to snitch on you if you ignored his orders and had a Thanksgiving Dinner with your loved ones? 
 
 
 
 
MR Cain
Data my a**! 
 
 
David Amos
Reply to MR Cain 
Ditto

No comments:

Post a Comment