Category Archives: Department of Health

Another fine NHS IT mess

By Tony Collins

Today the National Audit Office reports on the General Practice Extraction Service, an IT system that allows patient data to be extracted from all GP practices in England.

The report says that Department of Health officials – who were then working for the NHS Information Centre – signed off and paid for a contract even though the system was unfit for use. The original business case for the system grossly underestimated costs.

And the system was developed using the highest-risk approach for new IT – a combination of agile principles and traditional fixed-price contract.

Some of the officials involved appear to be those who worked for NHS Connecting for Health – the organisation responsible for what has become the UK’s biggest IT-related failure, the £10bn National Programme for IT (NPfIT).

As with the NPfIT it is unlikely anyone responsible for the latest failure will be held accountable or suffer any damage to their career.

The NAO says officials made mistakes in the original procurement. “Contract management contributed to losses of public funds, through asset write-offs and settlements with suppliers.” More public money is needed to improve or replace the system.

Labour MP Meg Hillier MP, the new chairman of the Public Accounts Committee, sums up today’s NAO’s report:

“Failed government IT projects have long been an expensive cliché and, sadly for the taxpayer and service user, this is no exception.

“The expected cost of the General Practice Extraction Service ballooned from £14m to £40m, with at least £5.5m wasted on write-offs and delay costs.

“GPES has managed to provide data for just one customer – NHS England – and the data was received 4 years later than originally planned.

“While taxpayers are left picking up the tab for this failure, customers who could benefit, such as research and clinical audit organisations, are waiting around for the system to deliver what they need to improve our health service.”

Some GPs who do not want patient data to be extracted from their systems – they believe it could compromise their bond of confidentiality with patients – may be pleased the extraction system has failed to work properly.

But their concern about patient confidentiality being compromised will not make the failure of the extraction service any more palatable.

The NAO says it only learned of the failure of the extraction system through its financial audit of the Health and Social Care Information Centre. It learned that the system was not working as expected and that HSCIC had agreed to pay additional charges through a settlement with one of the main suppliers, Atos IT Services UK Ltd.

An NHS Connecting for Health legacy?

Work on the GP Extraction Service project began in 2007, first by the NHS Information Centre, and then by the HSCIC.

The NHS Information Centre closed in 2013 and responsibility transferred to the HSCIC which combines the Department of Health’s informatics functions – previously known as NHS Connecting for Health or CFH – and the former NHS Information Centre.

What went wrong 

The original business case said the extraction service would start in 2009-10, but it took until April 2014 for HSCIC to provide the first data extract to a customer.

Meanwhile other potential users of the system have found alternative sources of patient data in the absence of the HSCIC system.

The NAO says that officials changed the procurement strategy and technical design for the GPES extraction systems during the project. “This contributed to GPES being unable to provide the planned number and range of data extracts.”

The NHS Information Centre contracted with Atos to develop a tool to manage data extraction. In March 2013, the Centre accepted delivery of this system from Atos.

But officials at the HSCIC who took over the system on 1 April 2013 found that it had fundamental design flaws and did not work. “The system test did not reflect the complexity of a ‘real life’ data extract and was not comprehensive enough to identify these problems”.

To work in a ‘real life’ situation, the GPES query system needed to communicate accurately with the four separate extraction systems and other systems relying on its data.  The test officials and Atos agreed was less complex. It did not examine extractions from multiple extraction systems at once.

Nor did the test assess the complete process of extracting and then passing GPES data to third-party systems.

Fixed price and agile – a bad combination

Officials began procuring the GPES query tool in April 2009, using a fixed-price contractual model with ‘agile’ parts. The supplier and officials would agree some of the detailed needs in workshops, after they signed the contract.

But the NAO says there was already evidence in central government at this time that the contractual approach – combining agile with a fixed price – was high risk.

The NAO’s report “Shared Services in the Research Councils”reviewed how research councils had created a shared service centre, where a similarly structured IT contract failed.

In the report, Fujitsu and the shared service centre told the NAO that: “the fixed-rate contract awarded by the project proved to be unsuitable when the customers’ requirements were still unclear.”

The court case of De Beers vs. Atos Origin highlighted a similar failure.

To make matters worse officials relied too heavily on contractors for development and procurement expertise.  And 10 project managers were responsible for GPES between 2008 and 2013.

Once health officials and Atos had signed the query tool contract, they found it difficult to agree the detailed requirements. This delayed development, with Atos needing to start development work while some requirements had yet to be agreed. Officials and Atos agreed to remove some minor components. Others were built but never used by HSCIC.

A Department of Health Gateway 4 review in December 2012 found that difficulties with deciding requirements were possibly exacerbated by development being offshore.

They raised concerns about the project management approach:

“The GPET-Q [query tool] delivery is being project managed using a traditional ‘waterfall’ methodology. Given the degree of bespoke development required and the difficulties with translation of requirements during the elaboration parts of R1, the Review Team considers that, with hindsight, it might have been beneficial to have adopted an Agile Project Management approach instead.”

General Practice Extraction Service – an investigation. NAO report. 

Latest healthcare IT disaster is a reminder of how vital government digital transformation is.

 

What do Ben Bradshaw, Caroline Flint and Andy Burnham have in common?

By Tony Collins

Ben Bradshaw, Caroline Flint and Andy Burnham have in common in their political past something they probably wouldn’t care to draw attention to as they battle for roles in the Labour leadership.

Few people will remember that Bradshaw, Flint and Burnham were advocates – indeed staunch defenders – of what’s arguably the biggest IT-related failure of all time – the £10bn National Programme for IT [NPfIT.

Perhaps it’s unfair to mention their support for such a massive failure at the time of the leadership election.

A counter argument is that politicians should be held to account at some point for public statements they have made in Parliament in defence of a major project – in this case the largest non-military IT-related programme in the world – that many inside and outside the NHS recognised was fundamentally flawed from its outset in 2003.

Bradshaw, Flint and Burnham did concede in their NPfIT-related statements to the House of Commons that the national programme for IT had its flaws, but still they gave it their strong support and continued to attack the programme’s critics.

The following are examples of statements made by Bradshaw, Flint and Burnham in the House of Commons in support of the NPfIT, which was later abandoned.

Bradshaw, then health minister in charge of the NPfIT,  told the House of Commons in February 2008:

“We accept that there have been delays, not only in the roll-out of summary care records, but in the whole NHS IT programme.

“It is important to put on record that those delays were not because of problems with supply, delivery or systems, but pretty much entirely because we took extra time to consult on and try to address record safety and patient confidentiality, and we were absolutely right to do so…

“The health service is moving from being an organisation with fragmented or incomplete information systems to a position where national systems are integrated, record keeping is digital, patients have unprecedented access to their personal health records and health professionals will have the right information at the right time about the right patient.

“As the Health Committee has recognised in its report, the roll-out of new IT systems will save time and money for the NHS and staff, save lives and improve patient care.”

[Even today, 12 years after the launch of the National Programme for IT, the NHS does not have integrated digital records.]

Caroline Flint, then health minister in charge of the NPfIT,  told the House of Commons on 6 June 2007:

“… it is lamentable that a programme that is focused on the delivery of safer and more efficient health care in the NHS in England has been politicised and attacked for short-term partisan gain when, in fact, it is to the benefit of everyone using the NHS in England that the programme is provided with the necessary resources and support to achieve the aims that Conservative Members have acknowledged that they agree with…

“Owing to delays in some areas of the programme, far from it being overspent, there is an underspend, which is perhaps unique for a large IT programme.

“The contracts that were ably put in place in 2003 mean that committed payments are not made to suppliers until delivery has been accepted 45 days after “go live” by end-users.

“We have made advance payments to a number of suppliers to provide efficient financing mechanisms for their work in progress. However, it should be noted that the financing risk has remained with the suppliers and that guarantees for any advance payments have been made by the suppliers to the Government…

“The national programme for IT in the NHS has successfully transferred the financing and completion risk to its suppliers…”

Andy Burnham, then Health Secretary, told the House of Commons on 7 December 2009:

“He [Andrew Lansley] seems to reject the benefits of a national system across the NHS, but we do not. We believe that there are significant benefits from a national health service having a programme of IT that can link up clinicians across the system. We further believe that it is safer for patients if their records can be accessed across the system…” [which hasn’t happened].

Abandoned NHS IT plan has cost £10bn so far

Why was NHS e-Referral service launched with 9 pages of known problems?

By Tony Collins

Were GPs guinea pigs for live testing of the new national NHS e-Referral Service?

Between 2004 and 2010 the Department of Health marked as confidential its lists of problems with national NPfIT systems, in particular Choose and Book.

So the Health and Social Care Information Centre deserves praise for publishing a list of problems when it launched the national “e-Referrals” system on Monday. But that list was 9 pages long.

The launch brought unsurprised groans from GPs who are used to new national systems going live with dozens of known problems.

The e-Referral Service, built on agile “techniques” and based on open source technology, went live early on Monday to replace “Choose and Book” for referring GP patients to hospitals and to other parts of the NHS.

Some GPs found they could not log on.

“As expected – cannot refer anything electronically this morning. Surprise surprise,” said one GP in a comment to “Pulse” on its article headlined “Patient referrals being delayed as GPs unable to access e-Referrals system on launch day.”

A GP practice manager said: “Cannot access in south London. HSCIC debacle…GPs pick up the pieces. Changing something that wasn’t broken.”

Another GP said: “I was proud never to have used Choose and Book once. Looks like this is even better!”

Other GPs said they avoided using technology to refer patients.

“Why delay referral? Just send a letter. (Some of us never stopped).”

Another commented: “I still send paper referrals – no messing, you know it has gone, no time wasted.”

Dr Faisal Bhutta, a GP partner in Manchester, said his practice regularly used Choose and Book but on Monday morning he couldn’t log in. “You can’t make a referral,” he said.

The Health and Social Care Information Centre has apologised for the disruption. A statement on its website says:

“There are a number of known issues, which are currently being resolved. It is not anticipated that any of these issues will pose a clinical safety risk, cause any detriment to patient care or prevent users from carrying out essential tasks. We have published the list of known issues on our website along with details of how to provide feedback .”

But why did the Centre launch the e-Referral Service with 9 pages of known problems? Was it using GPs as guinea pigs to test the new system?

Comment

The Health and Social Care Information Centre is far more open, less defensive and a better communicator than the Department of Health ever was when its officials were implementing the NPfIT.

But is the HSCIC’s openness a good thing if it’s accompanied by a brazen and arrogant acceptance that IT can be introduced into the NHS without a care whether it works properly or not?

In parts of the NHS, IT works extraordinarily well. Those who design, test, implement and support such systems care deeply about patients. In many hospitals the IT reduces risks and helps to improve the chances of successful outcomes.

But in other parts of the NHS are some technology enthusiasts – at the most senior board level – who seem to believe that all major IT implementations will be flawed and will be improved by user feedback.

The result is that IT that’s inadequately designed, tested and implemented is foisted on doctors and nurses who are expected to get used to “teething” troubles.

This is dangerous thinking and it’s becoming more and more prevalent.

Many poorly-considered implementations of the Cerner Millennium electronic patient record system have gone live in hospitals across England with known problems.

In some cases, poor implementations – rather than any faults with the system itself – have affected the care of patients and might have contributed to unnecessary deaths when records needed urgently were not available, or hospitals lost track of urgent appointments.

A CQC report in March 2015 said IT was a possible factor in the death of a patient because NHS staff were unable to access electronically-held information.

In another incident a coroner criticised a patient administration system for being a factor in the death of three year-old Samuel Starr whose appointment for a vital scan got lost in the system.

Within NHS officialdom is a growing cultural acceptance that somehow a poor IT implementation is different to a faulty x-ray machine that delivers too high a dose of radiation.

NHS officials will always brush off IT problems as teething and irrelevant to the care and safety of patients. Just apologise and say no patient has come to any harm.

So little do IT-related problems matter in the NHS that unaccountable officials at the HSCIC have this week felt sufficiently detached from personal accountability to launch a national system knowing there are dozens of problems with the use of it.

Their attitude seems to be: “We can’t know everything wrong with the system until it’s live. So let’s launch the system and fix the problems as GPs give us their feedback.”

This is a little like the NHS having a template letter of regret to send to relatives and families of patients who die unexpectedly in the care of the NHS. Officials simply fill in the appropriate name and address. The NHS can then fix the problems as and when patients die.

It’s surely time that bad practice in NHS IT was eradicated.  Board members need to question more. When necessary directors must challenge the blind positivism of the chief executive.

Some managers can learn much about the culture of care at the hospitals that implement IT successfully.

Patients, nurses and doctors do not exist to tell hospital managers and IT suppliers when electronic records are wrong, incomplete, not available or are somebody else’s record with a similar name.

And GPs do not exist to be guinea pigs for testing and providing feedback on new national systems such as the e-Referral Service.

e-Referral Service “unavailable until further notice”

Hundreds of patients lost in NPfIT systems

Hospital has long-term NPfIT problems

An NPfIT success at Croydon? – Really?

Physicians’ views on electronic patient records

Patient record systems raise some concerns, says report

Electronic health records and safety concerns

After billions spent on NHS IT, a carrier bag to transfer x-ray images

By Tony Collins

After fracturing my angle (slipping on a slope while mowing the lawn) I’ve been surprised how well parts of the NHS work – but not when it comes to the electronic transfer of records and PACS x-ray images from one trust area to another.

The minor injuries unit at one trust wasn’t able to send its PACS images to another trust’s orthopaedic department because it used a different PACS.  [The NHS has spent more than £700m on PACS ]

“Can’t we email the images?” said a senior nurse at the minor injuries unit. In reply the clinician looking at my x-rays gave a look that suggested emailing x-rays was impossible,  perhaps for security and cost reasons. [PACS images are sometimes tens of MBs.]

In the end the minor injuries unit (which within its own sections shared data electronically) had to download my x-rays onto CD for me to take the other trust’s orthopaedic department.  The CD went into a carrier bag.

The next day, at a hospital with an orthopaedic department, after 4-5 hours of waiting in a very busy A&E, I gave a doctor the CD. “I don’t think we can read that,” he said. “We don’t have any computers which take CDs.”

After a long search around a large general hospital the tired doctor eventually found a PC with a CD player. Fortunately the minor injuries unit had downloaded onto the disc a self-executing program to load the x-rays. Success. He gave his view of the fracture.

Even then he didn’t have my notes from the minor injuries unit.

Comment

My care was superb. What was surprising was seeing how things work – or don’t – after the NHS has spent more than £20bn on IT over the past 20 years.

The media is bombarded with press releases about IT innovations in the NHS. From these it’s easy to believe the NHS has the most up-to-date IT in the world. Some trusts do have impressive IT – within that trust.

It’s when records and x-rays need to be transferred outside the trust’s area that the NHS comes unstuck.

As a nurse at my GP’s practice said, “Parts of the NHS are third-world.”

Since 2004 billions has been spent on systems to create shareable electronic patient records.  But it’s not happening.

Within those billions spent on IT in the NHS, couldn’t a little bit of money be set aside for transferring x-rays and patient notes by secure email? That’s the real innovation the NHS needs, at least for the sake of patients.

In the meantime the safest way for x-rays and notes to be transferred from one trust to another is within the patient’s carrier bag.

Raytheon/Home Office IT dispute rolls on

By Tony Collins

Another big, old government IT contract goes wrong. It’s part of civil service tradition that officials blame the supplier for missing milestones and not delivering what the end-users needed or wanted; and the supplier blames the customer for causing or contributing to the alleged defaults.

The Raytheon Systems/Home Office eBorders legal dispute is going along these lines – as did the Department of Health’s dispute with CSC over parts of the failed National Programme for IT [NPfIT].

It’s tradition for the civil service not to take big IT suppliers to court: a hearing could mean that civil servants have to talk about government business in an open courtroom.

Senior Whitehall officials do not want the public knowing how departments are really managed, or not managed.

In 2002 a 44-day court case between National Air Traffic Services and EDS [now HP] ended suddenly – minutes before a senior civil servant was due to give evidence.

Arbitration is different. It’s in secret so a long dispute can be tolerated.

And so a Home Office mega-contract awarded to US company Raytheon in 2007 has ended up in arbitration and is set for a sequence of hearings and appeals that could last years.

It took 10 years for an IT dispute between HP and BSkyB to be settled, and it could take this long for Raytheon and the Home Office to settle their dispute.

Chronology 

In 2003 Tony Blair launches the eBorders programme. He wants a database of foreign travellers entering and leaving Britain to help fight the war on terror.

A year later the Home Office launches Project Semaphore with IBM to pilot an electronic borders system.

In 2007 Jacqui Smith, Labour’s home secretary, signs an eBorders contract with Raytheon Systems as lead supplier and Serco, Detica, QinetiQ and Accenture as subcontractors. It’s worth £750m. Within two years Home Office officials are expressing concern that milestones are being missed.

In 2010 a new coalition government that’s determined not to put up with big, underperforming IT deals, terminates the Raytheon contract after a recommendation by the Major Projects Authority and a coalition review group.

In 2011 it emerges that Raytheon is threatening to sue the Home Office for £500m for repudiating the contract. Raytheon blames project delays on UK Border Agency mismanagement. It’s far from clear that officials knew what they wanted from the systems.  Arbitration proceedings begin.

In 2013 it emerges that IBM, Fujitsu and Serco are carrying out some of the original eBorders work.

Home Office loses arbitration

Last year an arbitration tribunal ruled that the Home Office must pay £224m to Raytheon. It found that the decision to terminate Raytheon’s contract was unlawful on a number of grounds. The Home Office had not fully considered the extent to which the Home Office and the UK Border Agency had caused or contributed to the alleged defaults.

Home Office wins appeal

Now the Home Office has won an appeal against the arbitration tribunal’s ruling. A good account of the appeal judgment is on the Pinsent Masons website. Pinsent Masons was acting for the Home Office.  The appeal judge found that the arbitration award had been tainted by legal irregularities that could have caused a substantial injustice. The judge took the unprecedented step of setting aside the arbitration award and ordered that the dispute be resolved by a new tribunal.

Raytheon appeal

Raytheon has announced that it is appealing. It points out that the arbitration had 42 days of oral hearings with testimony from multiple witnesses, and had issued a 276 page award decision. Raytheon says it is determined to recover the sums it is due because of the “wrongful” termination of the contract.

Comment:

It’s five years since Raytheon’s contract was cancelled. It could easily be another five years before all the rulings and appeals are finally over.

It’s easy in hindsight to say, but would it have been better if the Home Office and coalition ministers had spent longer negotiating with Raytheon rather than doing the macho thing of cancelling the contract?

Pinsent Masons – latest ruling

Raytheon contests Home Office’s High Court verdict over e-Borders
 

Secrecy is one reason gov’t IT-based projects fail says MP

By Tony Collins

The BBC, in an article on its website about Fujitsu’s legal dispute with the Department of Health, quotes Richard Bacon MP who, as a member of the Public Accounts Committee, has asked countless civil servants about why their department’s IT-based change projects have not met expectations.

Bacon is co-author of a book on government failures, Conundrum, which has a chapter on the National Programme for IT [NPfIT] in the NHS.

In the BBC article Bacon is quoted as saying that the culture of secrecy surrounding IT-based projects is one of the main reasons they keep going so badly – and expensively – wrong.

He says it has been obvious to experts from an early stage that the NPfIT, which was launched by Tony Blair’s government, would be a “train wreck” because the contracts were signed “in an enormous hurry” and contained confidentiality clauses preventing contractors from speaking to the press.

He says the urge to cover things up means that “we never learn from our mistakes because there is learning curve, but when things go wrong with IT the response is to keep it quiet”.

Citing the example of air accident investigations, which are normally conducted in a spirit of openness so lessons can be learned, he says “It is the complete opposite in IT projects, where everyone keeps their heads down and goes hugger-mugger.”

Fujitsu versus Department of Health

Fujitsu sued the Department of Health for £700m after the company was ejected six years early [2008] from a 10-year £896m NPfIT contract signed in January 2004.  The case went to arbitration – and is still in arbitration, largely over the amount the government may be ordered to pay Fujitsu.  Bacon says the amount of the settlement will have to be disclosed.

“I don’t know how the government can honestly keep this number quiet. It simply cannot do it. It is not possible or sensible to keep it quiet when you are spending this much money,” says Bacon.

The BBC article quotes excerpts from a Campaign4Change blog

Government ‘loses £700m NHS IT dispute with Fujitsu’ – BBC News

 

Medication errors 6 months after “admin” system goes live

By Tony Collins

When Croydon Health Services NHS Trust went live with Cerner Millennium in October 2013 a spokesman told eHealth Insider:

“The new system will give everyone working at the trust better access to information and an accurate picture of what all of our services are doing. This will allow staff to make quicker, more informed decisions about the care patients need. It will improve the quality, safety and efficiency of care.”

The go-live has indeed brought some benefits. The trust says these include more efficient management of medicines, more detailed patient information being conveyed between shifts and departments, and better management of beds.

But earlier this week Campaign4Change reported on some of the problems associated with the go-live including 50,000 patients on the trust’s waiting list and a “serious incident” declared over diagnostic waits including extended waits for patients with suspected cancer.

Said the trust’s Audit Committee in March 2014 – 6 months after the go-live of the Cerner Millennium Care Records Service [CRS] :

“CRS Millennium Lessons Learned

“KB [COO and Deputy Chief Executive] outlined the context in which the implementation of CRS had taken place from the time the Business case had been approved in 2010 to the commencement of deployment in January 2011 and its subsequent implementation to date.

“She noted the 7 official “go live” dates which were reflected in the lessons learned report many of which fell during a period of organisational change.

“She noted that the deployment in CHS [Croydon Health Services NHS Trust] had been the most comprehensive deployment to take place nationally.

“It was noted that Programme Team had considered the lessons learned from other [NPfIT] Care Records Service deployments as part of the implementation programme at CHS and that there was no evidence of harm to patients despite the challenges around delivery of service.

” However significant operational challenges were experienced and a deep dive into the implementation of CRS was carried out and the findings submitted to the Finance & Performance Committee and the Trust Development Authority.

“In relation to ‘no harm to patients’ SC [Chairman] asked what empirical evidence there was to support the findings of the Deep Dive.

“KB explained from October 2013 to date there were 50,000 patients on the waiting list, but a patient validation exercise had taken place which had confirmed that no patients had come to any harm.

“The potential backlog would be cleared by the end of March but in the meantime those patients on waiting lists would be subject to a further clinical review to ensure that there was no harm.”

In fact the trust is still working through the backlogs; and long waiting times are not the only matters arising from the Cerner Millennium implementation. A medication safety report for the month of March 2004 highlights these lessons:

“The patient was prescribed Furosemide for acute pulmonary oedema on 12/03/2014. The drug was not administered and the reason not documented. On review of the incident, it was identified that there was a mis-communication between both nurses and the fact that they have started using a new computer system had caused confusion which led to the error. Once error identified the dose was given and ward sister has ensured that staff will go for further training if unsure on how to use the CRS Millennium system…

“Third incident was a failure to administer fluids (Normal Saline) in an acute kidney injury patient with an admission creatinine of greater than 700. Again there was confusion with the electronic prescribing system and the nurse thought that patient did not have a drug chart as the electronic prescribing system had gone live whereas in fact there was a paper drug chart for the fluid. The position of the venflon on the patient arm also contributed to the delay. Once error identified the fluids were given but were not running to time and patient improved. Ward sister has ensured that staff will go for further training if unsure on how to use the CRS Millennium system and staff were also briefed about poor documentation of the incident…

“Fourth incident occurred involved a patient prescribed ACS protocol for NSTEMI, Positive trop T. The aspirin 300mg, clopidogrel 300mg and fondaparinux 2.5mg were not administered and not signed for. Omission of medicines was discussed with doctor looking after the patient and the patient did not come to any harm. Omission occurred as agency staff did not know how to use CRS Millennium. On review of incident all staff were briefed on importance of patients being administered medicines on time and in particular a discussion took place between agency staff and for agency staff to have adequate CRS Millennium training. There are champion users nurses on wards who are able to train Agency staff.

NPfIT

Cerner Millennium is provided to the trust under a national contract hosted by the Department of Health and managed via a Local Service Provider (LSP) contract with BT. The contract covers trusts in London and the south of England.

The DH contract expires on 31st October 2015 after which point the DH will no longer fund any of the services currently hosted by them. This includes both the software and licencing costs for Cerner Millennium as well as the BT data storage facilities and other costs.

The DH requires all trusts with Cerner under the NPfIT to commit to an exit strategy before 31st October 2015.

Comment

Is Cerner Millennium merely an administrative system as officials at Croydon Health Services NHS Trust claim it is?  The implication is, with an administrative system, that it cannot be involved in any harm to patients. Officials at Connecting for Health when they ran the NPfIT used to describe Cerner Millennium as an administrative system.

It is the deployment of this “admin” system at Croydon that is implicated in medication errors, a waiting list of 50,000 people, and long waits for diagnostic tests for people with suspected cancer.

If Whitehall and NHS officials cannot see the system as other than administrative, this is a mistake that may help to explain why a poor service for patients, which sometimes has serious potential clinical implications,  is so commonplace, even months after go-live.

50,000 on waiting list and cancer test delays after NPfIT go-live

50,000 on waiting list and cancer test delays after NPfIT go-live

By Tony Collins

Croydon hospitals have built up a waiting list of 50,000 patients since a Cerner electronic patient record system go-live last October, according the trust’s latest board papers.

And, since the go-live, more than 2,200 patients have waited at least 6 weeks for diagnostic tests, of which 160 have been identified as “urgent suspected cancer and urgent patients”.  This backlog may take until the end of August to clear, say the board papers of the Croydon Health Services NHS Trust which includes Croydon’s Mayday Hospital, now the University Hospital.

The trust has declared a “serious incident” as a result of the diagnostics backlog. An SI can be reported when there is possibility of unexpected or avoidable death or severe harm to one or more patients.

“No harm”

The trust concedes that its waiting times pose a “potential clinical risk” but the board papers say several times that there is no evidence any patient has come to harm.  This assurance has been questioned by some trust board members. The trust continues to investigate.

Croydon is the latest in a long line of trusts to have had serious disruption after a Cerner go-live under the NPfIT, with BT as the installation partner.

The trust has kept the implications for patients confidential. This may contravene the NHS’s “duty of candour” – to report publicly on things that go wrong. The duty has come about in the wake of the suffering of hundreds of people in the care of Mid Staffordshire NHS Trust.

Croydon Health Services NHS Trust has decided not to publish its “Cerner Deep Dive” or Cerner “Lessons Learnt” reports, and discussions on the reports have been in Part 2 confidential sections of board meetings.

The trust defended its “Part 2” approach in its statement (below).

Meanwhile the Health and Social Care Information Centre, which runs the NPfIT local service provider contracts, including BT’s agreement to supply Cerner to hospitals in London,  has commissioned Cerner to capture the benefits nationally of Cerner installations.

Q&A

My questions and points to the trust, and its responses are below.

From me to the trust:

Croydon had good reasons to go live with Cerner, and DH funding was a further incentive but the trust does not appear to have been in a position to go live – at any stage – with a Big Bang Cerner implementation. The 7 aborted official go-live dates might have been a sign of why.  It would have been a brave decision to cancel the implementation, especially as:

–  the trust had spent 2 years preparing for it

– DH, BT and Cerner had put a lot of work into it

– there was DH pressure to go live especially after all the missed go-live dates.

The latest board papers say 6 or more times in different places that there has been no harm to patients as a result of the delays and waits.  Some members have raised questions on this and there is the matter of whether the trust is commissioning its own assessments (marking its own work).

On this:

– 50,000 on waiting list

– Cerner deep dive not published

– Lessons Learnt not published (concealment of failures, against the spirit of duty of candour called for by Robert Francis QC and Jeremy Hunt?)

– Diagnostics – an SI reported. The trust has considered the contributing issues which related to Cerner implementation but has not published details of the discussion. Again a concealment of failures?

– An accumulation of over 2,200 patients that were waiting over 6 weeks for diagnostics. Out of that number 160 patients were identified as urgent suspected cancer (USC) and urgent patients.  Can the trust – and patients – be sure there has been no harm?

– “… external assurance through an external clinician will provide the assurance that no patients have suffered harm as a result of the length of the waiting times”. Bringing in an external clinician to provide an assurance no patients have been harmed seems to pre-judge the outcome.  The trust appears to be marking its own work, especially as the backlog of patients awaiting diagnostics may not be cleared until the end of August.

– Managing public and GP perceptions? “Members agreed that GP interactions should be held off until the investigations had produced definite findings. However the Communications Department are on standby to publish information to GPs if required, and the Trust is ready to react to other enquiries. The Trust will in any event publish the incident report after the investigation has been completed.”

– “… the implementation of Cerner in October 2013 had an impact on activity levels and the delivery of RTT standards”. Again no report on this published.

– “An independent assessor would re-check all patients to assure that no harm has resulted. The Committee noted the progress report and requested that this is referred to a Part 2 meeting of the Trust Board …” Concealment of failures again?

– In the past the DH has been prepared to treat patients as guinea pigs in Cerner Big Bang implementations. The philosophy appears to be that the implementations will inevitably be disruptive but it’s for the good of patients in the longer term. That this approach may be unfair on patients in the short term, however, seems not to trouble the NHS hierarchy.

It’s clear clinicians and IT staff are doing their best and working hard for the benefit of patients but the implementation was beyond their control. Meanwhile complaints are increasing, Croydon Health Services was one of the lowest rated trusts for overall patient experience and a sizeable minority of local residents don’t choose the local hospitals for care or treatment. That said some patients rate their care very highly on NHS Choices (although some don’t). The University hospital is rated 2.5 stars out of 5.

One of the most surprising statements in the board papers is this: “… despite the weaknesses in the programme, the overall success of the deployment had been recognised at a national level”. A success? Can the trust in essence say what it likes? Nobody knows for sure what the facts are, given that the trust decides on what to publish and not to publish.

The trust’s response to the above points and questions:

“Due to a temporary failure of our administrative systems, the Trust found in February 2014 that a number of patients who needed to be seen by the imaging service were in breach of the six week waiting standard.

“We have taken immediate action to correct this and are undertaking a thorough review to confirm that no patients were harmed as a result.  The Trust is now working hard to treat patients currently on our waiting lists.  This is referenced in our publicly available Board papers.

“CRS Millennium has delivered a number of improvements that support improving patient experience at the Trust, including more efficient management of medicines, more detailed patient information being conveyed between shifts and departments and better management of beds within the organisation.”

Lessons?

Below are some of the lessons from Croydon’s Cerner go-live. Although the trust hasn’t published its “Lessons Learnt” report, some of lessons are mentioned in its latest board papers:

  • Insufficient engagement from operational and clinical colleagues
  • Time pressures were felt when a full dress rehearsal stretched the capabilities of the information team.
  • Insufficient time and resources were allocated to completion of the outline business and full business cases, as well as to due diligence on the options and costs.  [Business cases for Cerner are still unpublished.]
  • Trust directors agreed that a business case for a project of the size and complexity of the CRS Millennium should have taken longer than 6 weeks to prepare.
  • A failure of senior managers to take stock of the project at its key stages.
  • Too strong a focus on technical aspects
  • Clinicians not always fully appreciating the impact of the changes the system would deliver
  • The hiring of an external change manager to lead the deployment who proved to be “less than wholly successful because of the resulting deficiency in previous experience or knowledge of the culture of the organisation”.
  • The individual left the organisation part way through deployment which led to further challenges.
  • The right people with the right skills mix were not in place at the outset to achieve the transformational change necessary to successfully deploy a new system such as CRS

Comment 

NHS trusts have good reason to modernise their IT using the widely-installed  Cerner electronic patient record system, especially  if it’s a go-live under the remnants of the NPfIT, in which case hospitals receive DH funding and gain from having BT as their installation partner.

But why does a disruption that borders on chaos so often follow NPfIT Cerner implementations? Perhaps it’s partly because the benefits of Cerner, and the extra work required by nurses and doctors and clerical staff to harvest the benefits, is underestimated.

It is in any case difficult to convey to busy NHS staff that the new technology will, in the short-term, require an increase in their workload. Staff and clinicians will need to capture more data than they did on the old system, and with precision. The new technology will change how they work, so doctors may resent it initially, especially as there may be shortcomings in the way it has been implemented which will take time to identify and solve.

The problem with NPfIT go-lives is that they take place in an accountability void. Nobody is held responsible when things go badly wrong, and it’s easy for trusts to play down what has gone wrong. They have no fear of authoritative contradiction because they keep their implementation assessments confidential.

What a difference it would make if trusts had an unequivocal duty of candour over electronic health record – EHR – deployments. They would not be able to go live until they were ready.

The disruption that has followed NPfIT Cerner go-lives has been serious. Appointments and tests for suspected cancer have been lost in the administrative confusion that follows go-live. There have been backlogs of appointments for tens of thousands of patients. Operating theatres have gone under-used because of mis-scheduled appointments.

Now and again a patient may die unnecessarily but the problems have been regarded by the NHS centrally as collateral damage, the price society pays for the technological modernisation of the NHS.

Richard Granger, when head of the NPfIT, said he was ashamed of some Cerner installations. He described some of them as “appalling” but since he made his comments in 2007, some of the Cerner installations have been more disruptive than those he was referring to.

Provided each time there is no incontrovertible evidence of harm to patients as a result of a go-live, officials give the go ahead for more NPfIT Cerner installations.

Guinea pigs?

Disruption after go-live is too often treated as an administrative problem. Croydon’s statement refers to a “temporary problem with our administrative systems”. But new patient record systems can harm patients, as the inquest on 3-year-old Samuel Starr heard.

It’s time officials stopped regarding patients as guinea pigs in IT go-lives. It compounds the lack of accountability when trusts such as Croydon keep the reports from the go-live secret.

Trusts need better technological support but not at the cost of treating any harm to patients as collateral damage.

A tragic outcome for Cerner implementation at Bath?

Openness and honesty is a rarity after health IT problems

Mishandled electronic health record transition

A botched Cerner EHR implementation?

Trinity Medical Center reaches Cerner settlement

CEO and CIO resign after troubled EHR go-live

By Tony Collins

At the foot of the Blue Ridge Mountains, Georgia, in America’s deep south, about 70 miles from Atlanta, is Athens .

It was named at the turn of the 19th century to associate its university with Aristotle and Plato’s academy in Greece. It is home to the Athens Regional Medical Centre, one of the USA’s top hospitals.

There on 4 May 2014 the Centre went live with what it described as the most meaningful and largest scale information technology system in its 95-year history – a Cerner EHR implementation.

Now the Centre’s CEO James Thaw and CIO Gretchen Tegethoff have resigned. The Centre’s implementation of the electronic health record system seems to have been no more or less successful than at UK hospitals.

The main difference is that more than a dozen doctors complained in a letter to Thaw and Tegethoff.  A doctor leaked their letter to the local paper.

“Medication errors”

The letter said the timescales to install the Cerner EHR system were too “aggressive” and there was a “lack of readiness” among the intended users. They called the system cumbersome.

The letter referred to “medication errors … orders being lost or overlooked … (emergency department) and patients leaving after long waits”. An inpatient wasn’t seen by a physician for five days.

“The Cerner implementation has driven some physicians to drop their active staff privileges at ARMC [Athens Regional Medical Centre],” said the letter. “This has placed an additional burden on the hospitalists, who are already overwhelmed. Other physicians are directing their patients to St. Mary’s (an entirely separate local hospital) for outpatient studies, (emergency room) care, admissions and surgical procedures. … Efforts to rebuild the relationships with patients and physicians (needs) to begin immediately.”

The boldness of the letter has won praise in parts of the wider American health IT community.

It was signed by the centre’s most senior medical representatives: Carolann Eisenhart, president of the medical staff; Joseph T. Johnson, vice president of the medical staff; David M. Sailers, surgery department chair; and, Robert D. Sinyard, medicine department chair.

A doctor who provided the letter to the Athens Banner-Herald refused a request to openly discuss the issues with the computer system and asked to remain anonymous at the urging of his colleagues.

Swift action

One report said that at a meeting of medical staff 200 doctors were “solid in their vote of no confidence in the present hospital administration.”

Last week Thaw wrote in an email to staff: “From the moment our physician leadership expressed concern about the Cerner I.T. conversion process on May 15, we took swift action and significant progress has been made toward resolving the issues raised … Providing outstanding patient care is first and foremost in our minds at Athens Regional, and we have dedicated staff throughout the hospital to make sure the system is functioning as smoothly as possible through this transition.”

UK implications?

The problems at the Athens centre raise questions about whether problematic Cerner installations in the NHS should have consequences for CEOs.  Health IT specialists say that, done well, EHR implementations can improve the chances of a successful recovery. Done badly an EHR implementation can harm patients and contribute to death.

The most recent installations of Cerner in the NHS, at Imperial College Healthcare NHS Trust and Croydon Health Services NHS Trust, follow the pattern of other Cerner EHR go-lives in the NHS where there have been hints of problems but the trusts are refusing to publish a picture of how patients are being affected.

What has gone wrong at Athens Regional?

IT staff, replying to the Banner-Herald’s article, have given informed views on what has gone wrong. It appears that the Athens Regional laid off about a third of the IT staff in February 2014, about three months before go-live.

Past project disasters have shown that organisations often need more, not fewer, IT staff, advisers and helpers, at the time of a major go-live.

A further problem is that there appears to have been little understanding or support among doctors for the changes they would need to make in their business practices to accommodate the new system.  Had the organisation done enough to persuade doctors and nurses of the benefits to them of changing their ways of working?

If clinicians do not support the need for change, they may focus unduly on what is wrong with the new system. An organisation that is inherently secretive and resentful of constructive criticism will further alienate doctors and nurses.

Doctors who fully support an EHR implementation may find ways around problems, without complaining.

One comment on the Banner-Herald website says:

“While I have moved on from Athens Regional, I still have many friends and colleagues that are trying to work through this mess. Here is some information that has been reported to me…

“Medications, labs and diagnostic exams are not getting done in a timely manner or even missed all together. Some of this could be training issues and some system.

“Already over worked clinical staff are having to work many extra hours to get all the information in the system. This obviously takes away from patient care.

“Senior leadership tried to implement the system in half the amount of time that is usually required to do such things, with half the staff needed to do it. Why?

“Despite an environment of fear and intimidation the clinical staff involved with the project warned senior administration that the system was not ready to implement and posed a safety risk.

“I have ex-colleagues that know staff and directors that are involved with the project. They have made a valiant effort to make things right. Apparently an 80 to even a 100 hour work week has been the norm of late.

“Some questions that I have: where does the community hospital board stand with all this? Were they asking the questions that need to be asked? Why would the software company agree to do such a tight timeline? Shouldn’t they have to answer some questions as well?”

“Hopefully, this newspaper will continue to investigate what has happened here and not cave to an institution that spends a lot of money on frequent giant full page ads.

“Please remember there are still good people (staff, managers and administrators) that work at ARMC and I am sure they care about the community they serve and will make sure they provide great patient care.”

“The last three weeks have been very challenging for our physicians, nurses, and staff,” said Athens Regional Foundation Vice President Tammy Gilland. “Parts of the system are working well while others are not. The medical staff leadership has been active in relaying their concerns to the administration and the administration has taken these concerns very seriously. Maintaining the highest quality of patient care has always been the guiding principle of Athens Regional Health System.”

Keeping quiet

NHS trusts go quiet about the effect on patients of EHR implementations despite calls by Robert Francis QC and health secretary Jeremy Hunt for openness when things go wrong.

Imperial College Healthcare NHS Trust, which comprises St Mary’s Paddington, Hammersmith Hospital, Charing Cross Hospital, Queen Charlotte’s and Chelsea Hospital, and Western Eye hospital in Marylebone Road, went live with Cerner– but its managers and CEO are refusing to say what effect the system is having on patients.

An FOI request by eHealth Insider elicited the fact that Imperial College Healthcare had 55 different consultants working on the Cerner Millennium project and 45 Trust staff. The internal budget for electronic patient record deployment was £14m.

Croydon Health Services NHS Trust, which comprises Croydon University Hospital (formerly Mayday) and the Purley War Memorial Hospital, went live with Cerner last year, also under BT’s direction.

The trust has been a little more forthcoming than Imperial about the administrative disruption, unforeseen extra  costs and effects on patients, but Croydon’s officials, like Imperial College Healthcare’s spokespeople,  refuse to give any specific answers to Campaign4Change’s questions on the Cerner implementation.

Comment

It was probably unfair of doctors at Athens Regional to judge the Cerner system so soon after go-live but their fierce reaction is a reminder that doctors exist to help patients, not spend time getting to grips with common-good IT systems.

Would an NHS CEO resign after a rebellion by UK doctors over a problematic EHR implementation? It’s highly unlikely – especially if trusts can stop news leaking out of the effects on patients. In the NHS that’s easy to do.

Athens Regional CEO resigns

A tragic outcome for Cerner Millennium implementation?

Athens Regional is addressing computer problems encountered by doctors

Athens Regional is addressing computer problems after patients put at risk

CEO forced out?

 

Survive a Public Accounts Committee hearing – a lesson for ministers and top civil servants?

By Tony Collins

Mark Thompson was Director General of the BBC for eight years from 2004 to 2012. He was one of the highest paid in the public sector, earning more than £800,000.  He’s now CEO of the New York Times Company.

When he went before the Public Accounts Committee in February 2014 he faced accusations he had mislead MPs over the BBC’s Digital Media Initiative which was cancelled in 2013. The BBC wrote off £98.4m on the project.

Thompson has emerged from the affair unscathed although he had presided over the project.  Indeed he seems to have impressed the committee’s MPs who are notoriously hard to please.

In today’s PAC report on the failure of DMI, MPs appear to have preferred Thompson’s evidence over that of other witnesses. So how is it possible to come to a PAC to answer accusations of misleading Parliament and end up winning over your accusers?

Today’s PAC report on DMI criticises the BBC for:

–  complacency in taking a “very high-risk” project in-house from Siemens

–  spending years working on a system that did not meet users’ needs

–  not knowing enough about progress which led to Parliament being   misinformed that all was well when it wasn’t

– ending up with a system that costs £3m a year to run, compared to £780,000 a year for the 40 year-old “Infax” system it was designed to replace. And Infax works 10 times faster.

In February 2014 Committee chairman Margaret Hodge began her questioning of Thompson over DMI by pointing out that, three years earlier, in 2011, he had assured the PAC that all was well with the project when it wasn’t.

Thompson told Hodge in February 2011 that DMI was “out in the business” and “there are many programmes that are already being made with DMI”. In reality, the DMI had been used to make only one programme, called ‘Bang Goes the Theory’ – and problems on the project at that time were deepening but, as in many public sector IT-based projects that go wrong, such as Universal Credit, bad news from the project team was not being escalated to top management (or the BBC Trust).

How Thompson won over PAC MPs

At the PAC hearing in February 2014 Hodge asked Thompson if he had misled the Committee when he spoke positively about DMI in 2011.

Thompson’s reply was so free of reserve that it appears to have taken the wind out of Hodge.

Thompson replied: “I don’t believe that I have misled you on any other matter, and I do not believe that I knowingly misled you on this one.

“I will answer your question directly, but can I just make one broad point about DMI before then? In my time at the BBC, we had very many successful technology projects—very large projects, some of them much larger than DMI. I believe that the team, including John Linwood [then the BBC’s Chief Technology Officer], who were in the middle of DMI, had many successes—for example, digital switchover, West One, Salford and BBC iPlayer.

“I just wanted to say … everything I have heard and seen makes me feel that DMI was not a success. It failed as a project. It failed in a way that also meant the loss of a lot of public money. As the director-general who was at the helm when DMI was created and developed and who, in the end, oversaw much of the governance system that, as we will no doubt discuss, did not perform perfectly in this project, I just want to say sorry.

“I want to apologise to you and to the public for the failure of this project. That is the broad point.”

Hodge (who would normally, at a point such as this, launch her main offensive) said simply:

“Thank you.”

Usually civil servants will deny that a big IT-based project has actually failed. Many times the archetypal civil servant Sir David Nicholson, when Chief Executive of the NHS, defended the failed NPfIT at PAC hearings.

But Thompson told PAC MPs:  “Here we are in the beginning of 2014—I am not going to debate with you whether or not this project [DMI] failed. I am sure we can talk about how, why, where and so forth, but it definitely failed.

“When I came to see you in February 2011, I believed that the project was in very good shape indeed. Why did I believe that? I had seen a number of programmes myself—I had been and seen parts of DMI working on ‘Bang Goes the Theory’; I knew that ‘The One Show’ had started to use elements of DMI a few weeks earlier; and I knew that a kind of prototype version of the technology had been used in the very, very successful ‘Frozen Planet’ natural history series.

“I have gone back and asked the BBC to look at all the briefing materials—I had a voluminous amount of briefing from the BBC—and there is a real consistency between the briefing I got – .”

Richard Bacon: Sorry, a real inconsistency?

Thompson: No, a real consistency between the briefing I got and the evidence that I gave. To be honest, some of this is going to go very much to the point Mr Bacon was making earlier on (about what is or is not a deployment).

Stephen Barclay: Just a second…So it was consistent, but consistently wrong, wasn’t it, because just the following month, after the consistent briefing, you were then aware that it was going to miss the key milestone? From March 2011 you knew it [DMI] was not going to hit the deadline.

Thompson: If I may say so, what I am trying to focus on at the moment is the question—I understand, given subsequent events, the perfectly reasonable question—about whether the testimony I gave in February 2011 misled you or not… My belief is that my testimony gave a faithful and accurate account of my understanding of the project at this point.

Hodge: But were you misled, then?

Thompson: Let me give you just a sense of my briefing. To be honest, there were echoes of this in John Linwood’s testimony a few minutes ago, and Mr Bacon has helped me to understand this by putting his finger on the use of one word in particular, which is ‘deployment’. This is the timeline …”

Thompson then did something civil servants rarely do, if ever, when they appear before the committee. He read from the internal briefings he had received on the project in 2010 and 2011 . Those briefings indicated all was well.

He was not even shown a draft Accenture report in December 2010 that said the elements of the DMI examined (by Accenture) were not robust enough for programme-making and that significant remedial work was required.

Thompson said that the day before he gave evidence to the PAC in February 2011 he was given an internal note which said:

“Our next release [of DMI], Enhanced Production Tools, entered into user acceptance testing this week. This release builds on the production tool we previously delivered in 2010, Fabric Workspace, and desktop editing and logging.

“We will deploy its release to pilot users in Bristol, the ‘Blue Peter’ production team, ‘The One Show’ current affairs team, ‘Bang Goes the theory’ — again — ‘Generation Earth’, weather and ‘Pavlopetri’ inside London Factual.”

Thompson had the firm impression that DMI was challenging but that the BBC was starting to deliver the system and users had been positive about the elements delivered.

Thompson said in February 2014, “Mr Bacon is right about the very bullish use of the world “deployed”, meaning, perhaps, elements that have been loaded on to a desktop but not really extensively used: that was the background to the remarks I made to you in February 2011. I am absolutely clear that at the time that was what I knew and believed about the project.”

Hodge: So you were misled?

Thompson replied, in essence, that the BBC’s business users tried to make DMI work but most of them gave up. There were tensions between the project team who were enthusiastic about DMI and the business users who, mostly, weren’t.

These were complicated, difficult issues, said Thompson. “There was a pronounced and, it would appear, growing difference of opinion between the team making DMI and the business users on how effective and how real the technology was.

“You will understand that I have been involved in a lot of projects at the BBC and in other organisations, and I can smell business obstinacy. I can smell when a business is unready, is not prepared to play ball or is constantly moving the goalposts.

“I absolutely understand John Linwood’s particular perspective, given what he was doing. He was a very passionate advocate of the project, and I understand all of that.

“In my time, which ended when I left in September 2012, I saw great efforts being made by the business—in other words, by colleagues inside BBC Vision, BBC North and elsewhere—to get DMI to work. Although there were tensions, I do not believe that those tensions, which frankly were more or less inevitable, were themselves a central and critical part of the project’s failure.”

Richard Bacon: … It sounds to me as if the people getting the business case through the main governance processes were technology and finance people. I want to be clear on what you are saying. It sounds to me as if the technology people were very gung-ho and the experience of the business people on the ground was that it was not necessarily working as well as they had been led to believe, so they probably lost faith in it. Is that a fair summary?

Thompson: “I believe that that was definitely what started to happen, certainly by the end of 2011 and through 2012. It happened for understandable reasons. This has been a troubled project…

“I thought great efforts were made in BBC Vision and in BBC North both by senior people and by some front-line programme makers to help us to get the thing to work.

“Where my perspective perhaps differs from John’s perspective – it is very easy for me to sit here and say that this project failed because some difficult programme makers refused to use it, although there may have been an element of that somewhere – is that I thought that, overall, this was a project on which there was a lot of work and effort to try to get it to work on the business side…”

Hodge asked again if Thompson had been misled when he assured the PAC in February 2011 that DMI was being used at the BBC.

Thompson: I believed it.

Hodge: You believed it?

Thompson: Yes.

Hodge:  You believed it, but were you being misled?

Thompson: “I think that the language that the team was using, combined to some extent with the fact that I had seen what looked like a very positive demonstration of it … I had heard that “The One Show” had also started using it, and I saw a list of other programmes that were also using it. That combined with the language in the briefing led me to believe that it was being more extensively used.”

PAC conclusion

The PAC could have concluded in its report today that the BBC had misled Parliament in February 2011. But MPs used the word “misinformed” instead.

“Neither the [BBC’s] Executive Board nor the [BBC] Trust knew enough about the DMI’s progress, which led to Parliament being misinformed. While [Thompson] assures us that he gave a faithful and accurate account of his understanding of the project at that point in early 2011, he was mistaken and there was confusion within the BBC about what had actually been deployed and used.

“In its reporting on major projects, the BBC needs to use clear milestones that give the Executive and the Trust an unambiguous and accurate account of progress and any problems.”

Comment

The PAC had every right to be angry.  So credible were the BBC’s assurances about DMI in February 2011 that the Committee published a report in April 2011 that reflected those assurances. It was wrong.

But there is a positive element in the failure of DMI – and that is the completely open and honest testimony of Mark Thompson.

MPs on the PAC are used to be being misled – usually by the sin of omission – when civil servants and ministers come before them. But when Thompson read from his internal briefings it was easy to see how he came to the view that DMI in February 2011 was showing signs of a success.

It was clear to MPs that Thompson had not set out to mislead.

Perhaps the moral of the story is that you can go far with honesty and openness. That’s not an easy lesson for the ministers and civil servants who have to appear before the PAC, but it has certainly served Thompson well.

BBC Digital Media Initiative – Public Accounts Committee report