Category Archives: Government IT

BBC’s DMI project – another fine mess that was predictable

By Tony Collins

A National Audit Office memorandum published today on the BBC’s failed £125.9m Digital Media Initiative is a reminder – as in most failed big IT-enabled projects – that the causes have nothing to do with software and everything to do with management and people.

The NAO’s memorandum tells an all too familiar story with government IT (and the BBC is a public sector organisation):

– Over-optimism about the ability to implement

– Over-optimism about the ability to achieve the benefits

– Unclear requirements

– No thorough independent assessment of the technical design to see whether the DMI was technically sound

– The successful completion of the most straightforward of technology releases for the DMI, but these proved an unreliable indicator of progress.

– Technical problems and releases not meeting user expectations which contributed to repeated extensions to the timetable for completing the system, eroding user confidence and undermining the business case.

– Poor internal reporting. “The governance arrangements for the DMI were inadequate for its scale, complexity and risk. The BBC did not appoint a senior responsible owner to act as a single point of accountability and align all elements of the DMI. Reporting arrangements were not fit for purpose,” said the NAO.

– In the same way as the DWP failed with Universal Credit to take full account of recommendations in review reports, the BBC “did not adequately address issues identified by external reviewers during the course of the programme”.  The BBC had been aware that business requirements for the DMI were not adequately defined.

The BBC estimates that it spent £125.9m on the DMI. It offset £27.5m of spending on the DMI against transfers of assets, cash and service credits that formed part of its financial settlement with DMI’s previous developer Siemens. This left a net cost of £98.4m.

The BBC cancelled the DMI without examining the technical feasibility or cost of completing it, said the NAO.

The Corporation has written off the value of assets created by the programme, but is exploring how it can develop or redeploy parts of the system to support its future archiving and production needs.

Diane Coyle, Vice Chairman BBC Trust, said:

“We are grateful to the NAO for carrying out this report, which reinforces the conclusions of the PwC review commissioned by the Trust. It is essential that the BBC learns from the losses incurred in the DMI project and applies the lessons to running technology projects in future.

“The NAO’s findings, alongside PwC’s recommendations will help us make sure this happens. As we announced last December, we are working with the Executive to strengthen project management and reporting arrangements within a clearer governance system.  This will ensure that serious problems can be spotted and addressed at an earlier stage.”

Amyas Morse, head of the National Audit Office, said today:

“The BBC Executive did not have sufficient grip on its Digital Media Initiative programme. Nor did it commission a thorough independent assessment of the whole system to see whether it was technically sound.

“If the BBC had better governance and reporting for the programme, it would have recognized the difficulties much earlier than May 2012.”

Comment

The DMI project is exemplar of all that tends to go wrong in big government IT-enabled projects. Strong independent oversight and independent reviews that were published would have provided the accountability to counterbalance over-optimism.  But these things never seems to happen.

There are also questions about why the BBC took on the project from Siemens  and turned what could have been a success into a financial disaster.

NAO memorandum on the BBC’s Digital Media Initiative

BBC World at One’s focus on Government IT

By Tony Collins

The lead item on BBC R4’s World at One on Friday was about Government IT contracts.

On the programme were the government’s Chief Procurement Officer Bill Crothers, Cabinet Office minister Francis Maude, the chairman of the Public Accounts Committee Margaret Hodge, the UK IT Association, and me.

Some of the points made:

–  Bill Crothers gave an example of what he called “abuse” by some big IT suppliers. He said a young man who works for him lost his power cable. The supplier quoted £65 for a replacement. The price should have been £5 or £6.  When Crothers queried it, the supplier justified its price on grounds of security. Crothers could not believe that a power lead had security implications so he questioned the price again and received several pages of explanation from the supplier, which he did not read. Eventually the supplier “was good enough to reduce the price to £37”.

– HMRC was charged £30,000 for changing some text on its website.

– Francis Maude said a DWP team and a further 12 people from the Cabinet Office’s Government Digital Service had built – in only three months – a prototype of a digital solution to support the introduction of Universal Credit. The system cost just over £1m, he said. [Separately big IT suppliers at DWP have been paid £303m up to March 2013 for Universal Credit work.] Maude declined to predict the outcome of the “twin-track” work on the UC project.

– Some big legacy systems may soon need replacing – those that pay about £60bn a year in state pensions and collect nearly £100bn a year in VAT. “Those are going to be big projects,” said Margaret Hodge. “I don’t think we have seen the end of big projects, or the end of disasters.”

World at One in detail

Presenter Shaun Ley and BBC political correspondent Ross Hawkins focused on government IT because of an announcement by the Cabinet Office that it is drawing the line on “bloated and wasteful IT contracts”. The Cabinet Office was pitching its announcement as marking a “massive change,” said Hawkins.

Ley said Francis Maude announced the safeguards  in an attempt to ensure that IT contracts don’t become multi-billion pound failures. He said that the abandoned NPfIT had cost close to £10bn.

Hawkins quoted the UK IT Association as saying that  government did not know how to do deals with smaller suppliers. On the government’s relationship with big suppliers UKITA said the government was like a “battered wife or husband who doesn’t seem to know how to leave.”

Appalling

Hawkins said Crothers has the air of a man going to war. Crothers’ conclusion on the way things are at the moment:

“This is about the oligopoly, the cluster of big suppliers that have had it took good for too long. It’s reflective of monopolistic or oligopolistic behaviour.  It is not acting as if they are in hungry and in a competitive market.  That’s appalling.”

Universal Credit

Hawkins asked Francis Maude how confident he was that what was being put in place on Universal Credit would work.

“I hope it will work,” said Maude. “The digital solution was created by a team within DWP with a dozen or so GDS [Government Digital Service] staff assisting.

“They created a working prototype for a digital solution within 3 months at a cost of only a bit over £1m. That certainly can be basis of a successful long-term solution.”

Hawkins [to Maude] “I asked you whether you were confident the approach with DWP would work and you said you hoped it would. That suggests to me that maybe you are not (confident).”

Maude: “N0-one knows with these things. Anyone who says you are certain everything is going to succeed … the way we do things now is build something quickly, test it, prove it, test it with users, and so you can’t have certainty about any of these outcomes.”

Outsourcing failures

Hawkins said “We have had story after embarrassing story about outsourcing failures [such as the] government being charged for tagging dead people … now ministers  have an interest in coming out on the front foot and just for once being on the attack and having a whack at the IT companies.

“You don’t need to be a political genius to work out why they would like to do that rather than be endlessly explaining themselves after embarrassing stories in the papers.”

Ley (to me): “Is this the best way to deal with the problems government has experienced? The journalist Tony Collins has written widely  about project failures in IT in both the public and private sectors.”

I replied that big companies have sometimes charged a lot to make small software changes.  The Cabinet Office’s “red lines” were a good idea though they were a formalising of restrictions that had been in place some time.

The Cabinet Office doesn’t have the power to make changes happen because departments are accountable to Parliament for their spend and so don’t want much interference from the Cabinet Office. But the Cabinet Office is right to try and reduce the amounts spent on big projects.

Ley: “What will be the effect of breaking up contracts?”

I said I hoped the Cabinet Office’s restrictions would bring about a change in culture in departments against the assumption that big is beautiful. Big projects should be split into components which would give SMEs a greater involvement and could reduce the risks of projects failing.

More project disasters?

Hodge gave her reaction to the Cabinet Office’s restrictions in the context of the Universal Credit project.

“Francis Maude and Cabinet Office have been trying really hard to get some sense into the way that project has developed. But sadly the news we have had lately suggests to me that they have failed. It is about £400m so far on IT.

“What went wrong there was that the department [DWP] thought it [UC] was a big IT project instead of thinking:  we are going to be changing our business; we are going to get 6 benefits rolled into one. They [the DWP] have not written off that money [£303m] which is what my committee thinks they should have done, because they want to save face. Down the line I think we’ll see some disasters there.

“There are a lot of projects around  government, what are called legacy projects, where old systems need to be replaced . They are big projects – pensions in DWP where £60bn is given out a year;  VAT receipts  in HMRC where nearly £100bn is collected. Those are going to be big projects. I don’t think we have seen the end of big projects, or the end of disasters.”

Ley: “What about breaking them up into smaller projects? Won’t that reduce potential risks?”

Hodge: “The important thing is what Tony Collins was saying to you. What we find is that the skills don’t exist within departments, either to commission the IT properly or to manage the suppliers once they have the IT in place.

“We are about to examine the army recruitment contract – I think that is what we’ll find.  The MoD hasn’t got the skills to manage it.

Ley: “Do you welcome the ending of automatic contract extensions?”

“I warmly welcome that. This is a small step in the right direction. Having an expert as we have in Bill Crothers in the Cabinet Office is really important. What we haven’t got are skills in the departments. It is not like a business. If it was, Bill Crothers would probably run IT across the whole of government. Our departments run in silos. They haven’t got the skills. They have this demand for big, big programmes in the future and I don’t think we have seen, sadly, the end of IT disasters.”

Update

Thank you to Dave Orr for drawing my attention to an excellent piece on the World at One item by procurement expert Peter Smith who concludes:

“… There is a big issue – large suppliers have not covered themselves in glory, but small suppliers just can’t develop huge systems for DWP or MOD.

“The large suppliers must have a role, but we have to manage these contracts better. And the answer can’t just be a small hit squad in Cabinet Office. This needs real capability development across government, which we haven’t really seen as yet in a coordinated fashion.”

BBC World at One – Government IT contracts

Bill Crothers on BBC Radio 4 – suppliers get another good kicking

Are Govt IT-based project disasters over? Ask the Army

By Tony Collins

When senior civil servants know an IT-based project is in trouble and they’re unsure how bad things are, they sometimes offer their minister an all-encompassing euphemism to publicly describe the status of the scheme – teething.

Which may be why the defence secretary Philip Hammond told the House of Commons in November 2013 that the IT project to support army recruiting was having “teething” problems.

Now Hammond knows more, he says the problems are “big”. He no longer uses the “t” word. Speaking about the £440m 10-year Recruitment Partnering Project in the House of Commons this week Hammond said:

“Yes, there are big problems with the IT and I have told the House on repeated occasions that we have IT challenges…”

Only a few days ago Cabinet Office minister Francis Maude suggested that Government IT was no longer a byword for disaster, though he accepted there were still challenges.

In a speech on how he expected the UK to become the G8’s most digital government by next year (whatever that means) Maude said: “… it’s great news that DVLA is about to launch online driving records which can be used by anyone with a driving licence as well as by the insurance industry.

“Back in 2010 our digital offering was limited at best and government IT was a by-word for disaster … There are still challenges but with the help of the Government Digital Service I am determined that the UK will be the G8’s most digital government by next year.”

A few days later The Times reported on a leaked Gartner report on the army Recruitment Partnering Project. The report expressed concerns about the entire plan, including a poor project management team and delays that were allowed to spiral out of control.

It claimed that the Army’s recruitment division had failed to challenge MoD policy in 2011 that had apparently favoured the less suitable of the two competing bidders chasing the contract.

Hammond is said to be mulling over a £50m payout for Capita to build a new infrastructure for the recruiting system instead of trying to integrate it with systems supplied by the “Atlas” consortium under the Defence Information Infrastructure project. Hammond told the House of Commons this week:

“… there have been initial difficulties with that recruiting process as we transition to the new recruiting arrangements with Capita.

“In particular, we have encountered difficulties with the IT systems supporting the application and enlistment process. The decision to use the legacy Atlas IT platform was deemed at the time to be the quickest and most cost-effective way of delivering the new recruitment programme.

“An option to revert to a Capita hosting solution was included in the contracts as a back-up solution.

“I was made aware in the summer of last year that the Army was encountering problems with the integration of the Capita system into the Atlas platform. Since then we have put in place a number of workarounds and mitigation measures for the old IT platform to simplify the application process, and we have reintroduced military personnel to provide manual intervention to support the process.

“Having visited the Army’s recruitment centre in Upavon [Wiltshire] on 30 October, it became clear to me that, despite the Army putting in place measures to mitigate those problems in the near term, further long-term action was needed to fix the situation.

“It was agreed in principle at that point that the Atlas system was not capable of timely delivery of the Capita-run programme and that we would need to take up the option of reverting to Capita building a new IT platform specifically to run its system, which will be ready early next year.

“… we have already taken action to bring in a range of new initiatives that will make it progressively easier and quicker for applicants … the introduction this month of a new front-end web application for Army recruitment; a simplified online application form; more streamlined medical clearance processes …

“With an improved Army recruitment website, streamlined medicals and an increase in the number of recruiting staff, recruits should see a much-improved experience by the end of this month.

“.. we are looking at further ways of improving the management of the recruiting process in the intervening period before the introduction of the advanced IT system now being developed in partnership with Capita, which is expected to be deployed in February 2015…”

Vernon Croaker, Labour’s defence spokesman, said the recruitment project was an IT fiasco. He wondered why Hammond had initially described the problems as teething.

“Today we have learned [from newspapers] that the problems are even worse than anyone thought and still have not been fixed.

“Will the Defence Secretary tell the House which Minister signed off the deal and who has been responsible for monitoring it?

“… Will the Secretary of State also confirm that £15.5m has been spent building the existing flawed computer system behind the project? Finally, is it correct that this continuing disaster is costing taxpayers £1 million every month?…”

Croaker quoted a minister Andrew Robathan as telling MPs on 10 April 2013 that the “Recruiting Partnering Project with Capita…will lead to a significant increase in recruiting performance”.

Croaker said: “Is there any Member of this House, any member of our armed forces or, indeed, any member of the British public who still believes that?”

In March 2012 Capita announced that the Recruitment Partnering Project was valued at about £44m a year for 10 years and was expected to deliver benefits in excess of £300m to the armed forces. It would “release military recruiters back to the front line” said Capita.

Comment. Francis Maude is probably right: there don’t seem to be as many big IT-based project failures as in previous decades. But then the truth isn’t known because progress reports on big IT-related schemes are not published.

Indeed little would be known about the Capita Recruitment Partnering Project is not for the leaked report to The Times. Without the leak, public information on the state of the project would be confined to Hammond’s “teething problems” comment to MPs last November.

Internal and external reports on the state of the Universal Credit IT project continue to be kept secret.  It’s not even clear whether ministers are properly briefed on their big IT projects. Hammond almost certainly wasn’t last year. IDS was left to commission his own “red team” review of Universal Credit IT.

Perhaps the “good news” reporting culture in Whitehall explains why the NHS IT scheme, the NPfIT, continued to die painfully slowly for 7 years before senior officials and ministers started to question whether all was well.

Hammond is still getting wrong information. He described “Atlas” systems in the House of Commons as the “legacy IT platform”.

The Atlas contract for the Defence Information Infrastructure was awarded in 2005 for 10 years. It doesn’t even expire until next year. It may be convenient for officials to suggest that the reason Capita has been unable to link new recruitment systems into the DII network is because DII is old – legacy IT.  But the multi-billion pound Atlas DII project cannot be accurately described as “legacy” yet.

If ministers don’t get the truth about their big IT projects until serous problems are so obvious they can no longer be denied, how can Parliament and taxpayers expect to get the truth?

Lessons from NASA?

NASA put in place processes, procedures and rules to ensure engineers were open and deliberately adversarial in challenging assumptions. Even so it has had difficulties getting engineers to express  their views freely.

Diane Vaughan in her excellent book “The Challenger Launch Decision” referred to large organisations that proceeded as if nothing was wrong “in the face of evidence that something was wrong”.  She said NASA made a series of seemingly harmless decisions that “incrementally moved the space agency towards a catastrophic outcome”.

After the loss of Challenger NASA made many changes. But an investigation into the subsequent tragedy of the Columbia space shuttle indicated that little had actually changed – even though few of the top people who had been exposed to the lessons of Challenger were still in position.

If NASA couldn’t change when lives depended on it, is it likely the UK civil service will ever change?  A political heavyweight,  Francis Maude has tried and failed to get departments to be more open about progress or otherwise on their big IT-based projects.  Permanent secretaries now allow the out-of-date “traffic light” status of some projects to be published in the annual report of the Major Projects Authority. That is not openness.

The failure so far of the Recruitment Partnering Project, the routine suppression of information on technology-based scheme such as this, and the circumscribed “good news” briefings to ministers, suggest that government IT-based project failures are here to stay, despite the best intentions of the Cabinet Office, GDS and the Major Projects Authority.

Thank you to campaigner Dave Orr for his email on the recruitment project

Big 4 Universal Credit IT suppliers punished?

By Tony Collins

The  latest draft business case for Universal Credit suggests existing IT suppliers will have little to do with the “end-state digital solution” that is  due eventually to support the roll-out of UC.

The Department for Work and Pensions will use a mixture of its own and external people for the end-state digital solution.

Computer Weekly quotes part of the draft business case as saying:

“To extend the current IT solution we will be using a standard waterfall delivery approach largely using existing suppliers and commercial frameworks, in order to de-risk delivery and ensure UC continues to have a safe and secure introduction.

“The end-state digital solution will be delivered using an agile, and therefore iterative, approach as advocated by the Cabinet Office with significantly less reliance on the large IT suppliers delivering the current UC IT service.”

Politicalscrapbook.net picks up Computer Weekly’s report and says that Iain Duncan Smith “punishes Universal Credit IT suppliers“. 

Costs

Computer Weekly quotes the draft business case as putting the cost of the end-state solution at £106m – comprising external IT costs of £69m and in-house “Design and Build” team costs of £37m.

The total cost of UC IT is now put at £535m – down substantially on the £673m estimate in the DWP’s December 2012 UC business case.

UC project at “red” 

Yesterday the Guardian reported that Francis Maude and his team at the government digital service have objected to the twin-track approach to UC but were outflanked by “a majority” of other government ministers and project advisers, leaked minutes say.

The twin-track approach to UC IT means that the DWP and its main suppliers – HP, Accenture, IBM and BT – continue to develop existing systems (a blend of legacy and new technology) while a separate team develops a new “end-state” system for use by the end of 2017. It’s unclear how the two systems will differ. 

Computer Weekly quotes the latest draft business case as saying it is “unclear what the digital service will deliver and to what timescales”.

Due to the multitude of problems facing universal credit, the project has been coded “red” overall, according to the Guardian.

Comment

Computer Weekly has done well to gain sight of the latest draft business case for UC.

Whoever wrote the draft appears to accept the Cabinet Office’s case for departments to “move away from large ICT projects” and thus “reduce waste, provide a more flexible approach to complex business requirements that are likely to change over time and reduce the risk of project failures”. (National Audit Office, Universal Credit: early progress). 

But is the DWP simply telling the Cabinet Office what it wants to hear?  All the signs are that the big money at the DWP will continue to go to its main IT suppliers. 

The £106m agile “end-state digital solution” is a bonus system which may or may not materialise.  It is in essence a big, agile research project and the DWP is having trouble finding IT professionals to work on it.

If ever it’s a success it could start to replace existing UC IT in 2017 or beyond. But that may never happen. The DWP has already spent more than £300m on existing UC technology and is set to spend a lot more: around £90m. The DWP is unlikely to scrap it.

So HP, IBM, Accenture and BT are all but guaranteed a large income stream from the non end-state UC technology.

Even without the UC project the big 4 are guaranteed a large income from the DWP’s other work which includes:

– Personal Independence Implementation – 2.8bn 2011–2016
– Fraud and error programme – £770m  2012–2015
– Child maintenance group change 1.2bn 2009–2014
– Pensions reform Enabling Retirement Savings programme 1.04bn 2007–2018
– State Pension reform – single tier £114m 2012–2017
– Specialist Disability Employment programme – £203m 2012–2014

The big 4 will also continue to receive a large chunk of the DWP’s IT budget for maintaining and upgrading the existing software, hardware and networks.

Business cases are written by experts in the writing of Whitehall business cases.  Their main purpose is to provide a case for the Treasury to release funds for a project. They give current thinking on costs and benefits. The documents are revised when these change significantly.

So the statement in the UC draft business case that the new end-state digital solution will rely “significantly less” on existing UC IT suppliers means little: it is subject to change.

And the words “significantly less” are  unexplained. They may have no scientific basis. 

Worrying

The big 4 suppliers continue to be all-important to the DWP – and are so enmeshed that they decide at times how much they should be paid, suggests the NAO.

From its latest report on the UC project, the NAO comments on the DWP’s lack of control of suppliers :

– “In February 2013, the Major Projects Authority reported there was no evidence of the Department actively managing its supplier contracts and recommended that the Department needed to urgently get a grip of its supplier management.”

– “[The DWP has] limited IT capability and ‘intelligent client’ function leading to a risk of supplier self-review.”

– “[The DWP has] inadequate controls over what would be supplied, when and at what cost because deliverables were not always defined before contracts were signed.”

– “[The DWP has an] over-reliance on performance information that was provided by suppliers without Department validation.”

– ” … the Department did not enforce all the key terms and conditions of its standard contract management framework, inhibiting its ability to hold suppliers to account.”

So it would be naively optimistic to suppose that if the big 4 were to be frozen out of the end-state solution for UC that it would make much difference to their income from the DWP.      

UC in chaos or not?

A generous interpretation of all the available evidence on the UC project so far is that the DWP is working through, and understanding, the difficulties on an immensely complicated IT-enabled project.

And supporters of the twin-track approach could argue that two completely independent sets of teams are working in parallel and in discreet competition to produce the most successful system. One team comprises the big 4 using waterfall and the other a largely in-house team using agile.  Eventually one system will prevail, even if it’s 2020 or beyond that it handles securely online all types of claims. On completion the system will simplify benefit claims and cut the costs of administration.

A less generous interpretation of the available facts is that the UC IT project  is in chaos and that vast sums continue to be poured into a poorly formed strategy that nobody in government will concede is failing;  all parties are preoccupied with resolving problems as they arise and expecting irrationally that things will come good in the end.  Nobody should expect the full truth to emerge from those who have a deep interest in the project’s success including IDS and his permanent secretary Robert Devereux.

Howard Shiplee, head of the UC project, may still be getting his head around how chaotic things are. The highly capable David Pitchford, who headed UC  for a few months before he quit the civil service last year, came close to saying the project was in chaos. His Major Projects Authority said in February 2013 that the DWP needed to “rethink the delivery approach”, said the NAO.

Indeed the UC project shows many of the usual signs of a government IT-based project failure:

– major changes in the basic assumptions between the business case of December 2012 and the latest draft business case
– excessive secrecy (keeping secret a succession of internal and external reports on the project).
– defensiveness (continued DWP claims that problems are historic)
– a high turnover of leaders
– a culture of good news that “limited open discussion and stifled challenge”, said the NAO
– a lack of control of suppliers (NAO)
– repeated delays
– suppliers that get paid regardless of whether their systems are contributing to a  successful project.

To me things look chaotic but I hope I’m wrong. I’d like UC IT to work. IDS and Shiplee will probably know the whole truth – and they are still in post, to date.  If Shiplee leaves the project before the general election that could be an indication of how bad things really are.   

Top 5 posts on this site in last 12 months

Below are the top 5 most viewed posts of 2013.  Of other posts the most viewed includes “What exactly is HMRC paying Capgemini billions for?” and “Somerset County Council settles IBM dispute – who wins?“.

1) Big IT suppliers and their Whitehall “hostages

Mark Thompson is a senior lecturer in information systems at Cambridge Judge Business School, ICT futures advisor to the Cabinet Office and strategy director at consultancy Methods.

Last month he said in a Guardian comment that central government departments are “increasingly being held hostage by a handful of huge, often overseas, suppliers of customised all-or-nothing IT systems”.

Some senior officials are happy to be held captive.

“Unfortunately, hostage and hostage taker have become closely aligned in Stockholm-syndrome fashion.

“Many people in the public sector now design, procure, manage and evaluate these IT systems and ignore the exploitative nature of the relationship,” said Thompson.

The Stockholm syndrome is a psychological phenomenon in which hostages bond with their captors, sometimes to the point of defending them.

This month the Foreign and Commonwealth Office issued  a pre-tender notice for Oracle ERP systems. Worth between £250m and £750m, the framework will be open to all central government departments, arms length bodies and agencies and will replace the current “Prism” contract with Capgemini.

It’s an old-style centralised framework that, says Chris Chant, former Executive Director at the Cabinet Office who was its head of G-Cloud, will have Oracle popping champagne corks.

2) Natwest/RBS – what went wrong?

Outsourcing to India and losing IBM mainframe skills in the process? The failure of CA-7 batch scheduling software which had a knock-on effect on multiple feeder systems?

As RBS continues to try and clear the backlog from last week’s crash during a software upgrade, many in the IT industry are asking how it could have happened.

3) Another Universal Credit leader stands down

Universal Credit’s Programme Director, Hilary Reynolds, has stood down after only four months in post. The Department for Work and Pensions says she has been replaced by the interim head of Universal Credit David Pitchford.

Last month the DWP said Pitchford was temporarily leading Universal Credit following the death of Philip Langsdale at Christmas. In November 2012 the DWP confirmed that the then Programme Director for UC, Malcolm Whitehouse, was stepping down – to be replaced by Hilary Reynolds. Steve Dover,  the DWP’s Corporate Director, Universal Credit Programme Business, has also been replaced.

4) The “best implementation of Cerner Millennium yet”?

Edward Donald, the chief executive of Reading-based Royal Berkshire NHS Foundation Trust, is reported in the trust’s latest published board papers as saying that a Cerner go-live has been relatively successful.

“The Chief Executive emphasised that, despite these challenges, the ‘go-live’ at the Trust had been more successful than in other Cerner Millennium sites.”

A similar, stronger message appeared was in a separate board paper which was released under FOI.  Royal Berkshire’s EPR [electronic patient record] Executive Governance Committee minutes said:

“… the Committee noted that the Trust’s launch had been considered to be the best implementation of Cerner Millennium yet and that despite staff misgivings, the project was progressing well. This positive message should also be disseminated…”

Royal Berkshire went live in June 2012 with an implementation of Cerner outside the NPfIT.  In mid-2009, the trust signed with University of Pittsburgh Medical Centre to deliver Millennium.

Not everything has gone well – which raises questions, if this was the best Cerner implementation yet,  of what others were like.

5) Universal Credit – the ace up Duncan Smith’s sleeve?

Some people, including those in the know, suspect  Universal Credit will be a failed IT-based project, among them Francis Maude. As Cabinet Office minister Maude is ultimately responsible for the Major Projects Authority which has the job, among other things, of averting major project failures.

But Iain Duncan Smith, the DWP secretary of state, has an ace up his sleeve: the initial go-live of Universal Credit is so limited in scope that claims could be managed by hand, at least in part.

The DWP’s FAQs suggest that Universal Credit will handle, in its first phase due to start in October 2013, only new claims  – and only those from the unemployed.  Under such a light load the system is unlikely to fail, as any particularly complicated claims could managed clerically.

 

Is £40m write-off on a big software project normal?

By Tony Collins

On BBC R4’s “Week in Westminster” on Saturday morning (14/12/13)  guest presenter Isabel Hardman of The Spectator spoke to Conservative MP Richard Bacon and me about big government projects that go wrong.

Hardman mentioned that Bacon has co-written a book  on government failures Conundrum: Why every government gets things wrong and what we can do about it.

Referring to write-offs so far of about £40m on Universal Credit, Hardman asked me whether it was normal for such a write-off on a big project.

I said it wasn’t. The work and pensions secretary Iain Duncan Smith has said it was. When questioned by MPs of the work and pensions committee on 9 December, IDS implied that it was not unusual to write-off a third on large software-based projects. He suggested that research by Forrester supported this view.

Software coding for Universal Credit has cost about £120m so far (excluding hardware, infrastructure, consultancy or other IT-related costs). So IDS suggested that a write off of £40m was only about a third of the software coding costs.

But I haven’t seen any evidence that suggests write-offs of a third of the software costs on a big project are typical.   

I replied to Hardman that although there has been much trial and error on Universal Credit IT, £40m is a lot to write off.

[Trial and error included an attempt, from 2011 onwards, to adopt an agile approach but the National Audit Office said the DWP “experienced problems incorporating the agile approach into existing contracts, governance and assurance structures”. The NAO added that the Cabinet Office “did not consider that the Department (DWP) had at any point prior to the reset [Feb-May 2013]  appropriately adopted an agile approach to managing the Universal Credit programme”. The DWP has now introduced what it calls Agile 2.0, a hybrid approach incorporating elements of  agile with waterfall, though agile purists say it is impossible to combine the two.]

I told Hardman that the write-offs were largely because the DWP was unclear at the outset what the software was supposed to do.”With big IT projects it’s a bit like designing a bridge and you know where one side begins but you’re not sure where the other side ends. They have been learning as they go along and that’s probably why there have been large write-offs,” I said.

Hardman asked Richard Bacon whether it was normal to set out on these big projects without knowing where the bridge was going. Bacon agreed, citing the NPfIT which had led to large write-offs on failed work for England-wide electronic patient records. He said it was not at all abnormal for ministers to set off on big projects without knowing where they were going.  

The good news?

I told Hardman that IDS was at least well informed. He now has the NAO scrutinising the project as well as his own external consultants and the independently-minded Howard Shiplee as head of the project.

But I didn’t think UC would be complete until 2020 at the earliest given that the last big computerisation of benefit systems, Operational Strategy, took about 10 years to complete. Hardman said: “That would be a humiliation for IDS surely?”

I replied that IDS may not even be in politics in 2017. I also said that UC will probably not bring the financial benefits predicted, to judge from the last big computerisation of benefits.  But UC has wide support. Perhaps, I said, it has to work … eventually. 

BBC R4 Week in Westminster – 14/12/13

Universal Credit: more IT uncertainties

By Tony Collins

Shortly after IDS was in the House of Commons yesterday defending his handling of the Universal Credit project – taking an all is well approach – the National Audit Office issued a report that drew attention to the scheme’s uncertainties, write-offs on IT so far of £41.3m, and the five-year depreciation of a further £91m spend on IT that may not be used after the migration from legacy, or transitional, UC systems to in a new “digital” solution.

The legacy Universal Credit  IT infrastructure is a blend of existing DWP IT and technology adapted to UC.

The DWP had originally expected to depreciate the £91m over 15 years but, suggests the NAO, the legacy Universal Credit IT infrastructure may be of little use after 2017/2018.   

Says the NAO:

“…  the underlying issue [is] that the Department has spent £91.0 million on assets that will only support a limited service for 5 years, with clear consequences for public value.”

On what the NAO report calls the “longer-term programme uncertainties” it says that the “overall cost of developing assets to support Universal Credit is subject to considerable uncertainty”.

It adds:

“The Department acknowledges  … that there is uncertainty over the useful economic life of the existing Universal Credit software pending the development of the alternative digital solution and uncertainty over whether Universal Credit claimants will be able to migrate from the current IT infrastructure to the new digital solution by December 2017.”

The NAO’s report on the DWP’s 2012/2013 accounts also notes the uncertainties with the new digital solution. Says the NAO:

“At this early stage in its development, there are uncertainties over the exact nature of the digital solution, and in particular:

– How it will work;

– When it will be ready;

– How much it will cost; and

– Who will do the work to develop and build it.

A Ministerial Oversight Group has approved a spend of between £25m and £32m on the new digital UC solution up to November 2014. DWP officials and suppliers plan to build a core digital service that will deliver to 100 people by then, after which it will assess the results of that work and consider whether to extend the service to increasing numbers.

The NAO suggests that some of the money spent on the new digital solution may also end up being written off.  Says its report:

“As the Department develops the digital solution, so it will start to recognise some of the costs incurred as assets. Without clear and effective management, in the future the Department may also find it needs to impair some of these new digital assets.”

At a hearing of the Work and Pensions Committee on Monday Iain Duncan Smith depicted the write-off of £40m on UC software code so far as normal for any large organisation in the private or public sector that embarks on a major software-based programme.  IDS said that private sector organisations typically write off a third of the money spent on software on a large project. About £120m has been spent on writing UC software code so far.

Amyas Morse, head of the NAO,refers in his report to the “considerable sums that the Department is proposing to invest in a programme where there are significant levels of technical, cost and timetable uncertainty”.

He adds:

“I reiterate both the conclusion and recommendations from my report in September. The Department has to date not achieved value for the money it has incurred in the development of Universal Credit, and to do so in future it will need to learn the lessons of past failures …”

In a short debate on UC in the House of Commons yesterday Rachel Reeves, Shadow Work and Pensions secretary, suggested Iain Duncan Smith was in denial about being in denial.  She put points to him he did not answer directly.

She said that IDS had told the House of Commons on 5 September 2013 that UC will be delivered in time and on budget. On 14 October IDS made the same claim. Reeves said:

“How on earth can this be on time when in November 2011 he [IDS] said:  ‘All new applications for existing benefits and credits will be entirely phased out by April 2014.’

“We have now learned that this milestone will only be reached in 2016. Will the secretary of state confirm that this is a delay of 2 years? … How can the secretary of state say that Universal Credit will be on budget when even by his own admission £40.1m is being written off on IT [software code]? What budget heading was that under?”

Reeves said IDS also revealed on Monday that another £90m will be written off by 2018. She added:

“ …The underlying problem is surely that the secretary of state has not resolved key policy decisions before spending hundreds of millions of pounds on an IT system… the secretary of state is in denial. Doubtless he’ll deny he is in denial….

IDS replied:

“ I said all along and I repeat: this programme essentially [jeers] is going to be on time. By 2017 some 6.5m people will be on the programme receiving benefits.”

He added that UC will roll out without damaging a single person. “The waste we inherited was the waste of people who didn’t listen, rushed programmes and implementing them badly.”

Dame Anne Begg, chair of the Work and Pensions Committee, said that IDS promised UC would be digital by default. “It isn’t,” she said.

“He promised that all new claims would be on UC by May 2014. They won’t…  So why should anyone believe him when he says that delivery of UC is now on track?”

IDS replied: “The proof of this will be as we roll it out…”

Comment

IDS is doing what he has to do: defend the UC project at all costs; and the NAO is doing what it needs to do: highlight the uncertainties and wasted spending.  If IDS admits to his doubts and concerns the opposition will jump on him. At least he is not being kept in the dark any longer by his senior civil servants.  He has his own reliable information – via Howard Shiplee – and from the NAO.  In 2011 he commissioned his own independent “red team” review which led to the pilot Pathfinder projects.

But the uncertainties highlighted by the NAO’s report today could be said to tacitly confirm that the transfer of all relevant claimants to UC project is unlikely to be complete before 2019/2020 at the earliest.  That’s probably not something anyone in government could own up to before the 2015 general election.

And even his advisers may not tell IDS that big government IT projects can be defined by the exceptions. IDS told MPs yesterday that Pathfinder projects indicated that 90% of people are claiming universal credit online and 78% are confident about their ability to budget with monthly payments. That’s 10% who don’t claim online and 22% who may not be able to manage with monthly payments. Will the high number of exceptions prove a show-stopper?

There’s a long way to go before officials and ministers can have confidence in UC IT. But, unlike the NPfIT which had little support in the NHS, most of those involved in the UC project want it work. That could make all the difference. 

Universal Credit to be partly online

By Tony Collins

At yesterday’s Work and Pensions Committee hearing Howard Shiplee, Director General for Universal Credit, confirmed what many have been saying:  that UC will not be an entirely online process.

He said claimants will have to prove who they say they are. He didn’t say how but one suggestion is that claimants may have to produce documents at an interview, and may have to prove changes in circumstances.

This would make online security for UC – which has been a major sticking point –  easier to design.  

Shiplee told MPs yesterday:

“From a security point of view to have everything digital is not at this stage a sensible or appropriate solution.

“It will take some considerable time to get to a totally online system. In fact nobody is operating the types of system we are talking about which are disbursing large sums of money. Nobody is using a totally online approach. You have to prove who you are. You have to prove what you are doing when you change circumstance. If you want to open a bank account you have to go and present yourself.

“I have talked to a lot of financial institutions about this and that is exactly where they are coming from as well.”

Dame Anne Begg, chair of the committee, asked when it was decided that the original approach of “digital by default” was wrong – a “false promise that was never going to be delivered”.

Shiplee replied:

“It is very difficult to talk about promises. There is nothing wrong with having aspirations. If people don’t have aspirations to achieve things there will be no progress. Perhaps that was an aspiration a little too far at a stage in time.”

Another MP, Stephen Lloyd, Liberal Democrat, asked Shiplee about alleged interference of Universal Credit by the Cabinet Office (which is anxious to ensure that UC is not another government IT-related disaster). Lloyd asked if there is any truth in the suggestion that if the Cabinet Office doesn’t stop interfering Shiplee will quit.

Shiplee did not confirm or deny. He said:

“I cannot comment on tittle tattle that I haven’t heard. What I can comment on is that occasionally one has disagreements with people and one has to get on with things. I am charged with having a sense of urgency about these things. I make no excuse for that. There are no other issues that are holding me up…”

Asked by Lloyd on a scale of 1-10 how confident he is that UC will be delivered, and delivered in scale, with the huge volumes intended Shiplee replied:

“I have never been keen on one to tens so I will just give it to you straight. I believe UC can be delivered in the way that has been suggested.

“What we are talking about is automating a system in terms of technology but what in many ways is much more important is the culture change, the change in the way our business operates. All of these that tend to get completely ignored in these sorts of discussions.

“The technology is an enabler but many of the challenges we have not fully faced yet we will face as the business is reconfigured, as tens of thousands of our staff are retrained …there are a whole series of challenges. But can it be delivered? The answer is that there is no doubt in my mind.”

Will it be delivered?

“I believe it will be. It has to be delivered.”

Universal Credit project to abandon digital by default – Brian Wernham’s blog

DWP’s Universal Credit PR line – all is now well

By Tony Collins

The Department for Work and Pensions has submitted a statement to the Work and Pensions Committee, ahead of its hearing this afternoon on Universal Credit, that indicates all is now well with the scheme.

At the hearing today MPs will put questions to Work and Pensions secretary Iain Duncan Smith, Lord Freud, Minister for Welfare Reform, Howard Shiplee, Universal Credit Director General, and Mike Driver, Finance Director General.

MPs on the committee tend to ask gentle questions of Duncan Smith who is expected to say little or nothing negative about the current state of the scheme. His department’s statement to the committee says that the National Audit Office and the Public Accounts produced reports on Universal Credit that were“entirely historical”. 

Under the  new leadership of Shiplee, the Department had “already taken comprehensive action to address issues subsequently cited in both the NAO and PAC reports, including strengthening governance, improving supplier management and tightening financial controls”.

About 6,000 “new” computers in Jobcentres are being installed so that claimants can look and apply for jobs online, as well as make online claims.

“From October we started implementing Digital Jobcentres, beginning in Hammersmith. The Department will continue to roll this out across the whole Jobcentre Plus network, with all sites converted by October 2014.”

The DWP says that in the trials so far 90% of claims were being made online, “with the majority of these completing their application at the first attempt”.

The DWP will “further develop the work started by the Government
Digital Services to test and implement an enhanced online digital service”.

It adds: “The current planning assumption is that the Universal Credit service will be fully available in each part of Great Britain during 2016, having closed down new claims to the legacy benefits it replaced; with the majority of the remaining legacy caseload moving to Universal Credit during 2016 and 2017.

“Final decisions on these elements of the programme will be informed by the
development of the enhanced digital solution.”

Comment:

The DWP and particularly IDS appear locked into the “good news” culture that the health secretary Jeremy Hunt warned about  in the light of the Francis report’s criticism of a “lack of candour” in the NHS.

Before most of the big IT-related disasters in central government, the NPfIT for instance, sets of ministers and senior civil servants praised progress of the projects and dismissed Parliamentary reports as historical.

It’s to IDS’s credit that he has conceded that the 2017 deadline for all claimants to be on Universal Credit will not be met. He didn’t have to admit this. By 2017 IDS may have retired from politics for all we know. But still his optimism may be grossly misplaced.

The signs are that all claimants will not on UC before 2019 at the earliest – and that is subject to the resolution of numerous IT and business practice issues. The NAO report “Universal Credit: early progress” hinted at some of them.

Indeed the NAO revealed that:

“The Department does not yet know to what extent its new IT systems will
support national roll-out.” The signs are the DWP still doesn’t know – and may not know for several years.

The last big benefits computerisation project – Operational Strategy – took about 10 years to complete. It did not achieve the promised financial benefits and benefit systems were not integrated as originally intended but the technology worked well in the end.

There is every reason to believe that the UC  project will have a similar roll-out timeframe. But will IDS ever discuss all the current uncertainties and shortcomings with UC technology?

Patient records go-live “success” – or a new NPfIT failure?

By Tony Collins

John Goulston says the go-live of a new patient records system at his trust is a “success”.

He should know. He’s Chief Executive of Croydon Health Services NHS Trust. He’s also chair of the trust’s Informatics Programme Board which has taken charge of bringing Cerner Millennium to Croydon’s community health services and the local University Hospital, formerly the Mayday.

He was formerly Programme Director of the London Programme for IT at NHS London – a branch of the NPfIT.

In a report two weeks ago Goulston said the trust deployed the “largest number of clinical applications in a single implementation in the NHS”. Croydon went live with Cerner Millennium on 30 September and 1 October 2013.

Said Goulston in his report:

“Administrative functions do not engage clinicians; providing them with a suite of clinical functionality has been justified as each weekday approx. 1,000 staff are logged on and using the system. CHS [Croydon Health Services] has in Phase 1 deployed, in addition to patient administration, the largest number of clinical applications in a single implementation in the NHS England.”

BT helped install Millennium at Croydon under the National Programme for IT.  The trust’s spokesman says the Department of Health provided central funding, and the trust paid for implementation “overheads”.  The Health and Social Care Information Centre was the trust’s partner for the go-live.

The Centre is the successor for Connecting for Health. It has taken on CfH’s officials who continue to help run the NPfIT contracts with BT and  CSC.

Goulston said that Cerner and BT have paid tribute to the trust which installed Millennium in A&E, outpatients, secretarial support and cancer services, and elsewhere.

“Our partners Cerner, BT and Ideal have commented that the Trust has undertaken one of the most efficient roll-outs of the system they have worked on, with more users adopting the system more quickly and efficiently than other trusts … the success we have achieved to date is the result of the efforts of every single system user and all staff members,” said Goulston.

Best Cerner implementation yet?

Optimistic remarks about their launch of Cerner Millennium were also made in 2012 by executives at the Royal Berkshire NHS Foundation Trust.  Their optimism proved ill-judged.

Of the Millennium go-live at Royal Berkshire, trust executives said that it “had been considered to be the best implementation of Cerner Millennium yet and that despite staff misgivings, the project was progressing well”.   This positive message should be disseminated, they said.

Months later they told the Reading Chronicle of patient safety issues and a financial crisis arising from the Millennium implementation.

A Royal Berkshire governors Rebecca Corre was quoted as saying: “There is a patient safety issue when staff write down observations and then there is an hour before they can get it onto the computer. If it is an experienced nurse, they may pick up a problem, but others may not.”

Ed Donald, Chief Executive of Royal Berkshire was quoted as saying:

“Unfortunately, implementing the EPR [electronic patient record] system has at times been a difficult process and we acknowledge that we did not fully appreciate the challenges and resources required in a number of areas.”

Are executives and managers at Croydon Health Services NHS Trust  now similarly afflicted with an unjustified optimism about the success of their Cerner go-live?  

Past consequences of NPfIT go-lives hidden?

The Department of Health has claimed benefits for the NPfIT of £3.7bn to March 2012 but there have been trust-wide failures: thousands of patients have had their appointments, care or treatment delayed by difficulties arising from past implementations of patient record systems under the NPfIT.  For thousands of patients waiting time standards have been exceeded or “breached” because of disruption arising from troubled go-lives.

In nearly every case trusts made it difficult for the facts to come out publicly. Vague or unexplained fragments of information about the consequences of the NPfIT implementation appeared  in different board papers over several months. The facts only emerged after a journalistic investigation that required scrutiny of many board papers and follow-up questions to the trust’s press office.

So Campaign4Change investigated Croydon Health’s implementation of Cerner Millennium to see if the Francis report’s call for a “duty of candour” over mistakes and problems in the NHS have made any difference to the traditional fragmentation of facts after NPfIT go-lives of patient record systems.

The Francis report called for “openness, transparency and candour“.  Trusts were told not to hide sub-standard practices under the carpet. The health secretary Jeremy Hunt said it can be “disastrous” when bad news does not emerge quickly and the public are kept in the dark about poor care.

To my questions about the Cerner Millennium implementation Croydon trust’s spokesman always responded promptly and tried to be helpful. But it appears that trust executives have given him limited information about consequences of the go-live, and have preferred to indulge the “good news” NHS culture that Jeremy Hunt warned about.

On being asked what problems the trust has faced since the go-live the spokesman gave various answers that made no mention of the problems.

“All of our staff received training on the system, and we are continuing to offer our teams support as it is embedded.”

What of the problems arising from the implementation, and has the board been fully informed?

“Millennium has featured regularly on the Corporate Risk Register presented to each Part 1 Board meeting.   In addition, implementation has received detailed confidential consideration at Part 2 of Board meetings, (which is why you won’t find it in our public board papers).”

Given Francis’s call for duty of candour,  should the trust be more open about its problems?

“The initial roll out for CRS Millennium was introduced over three days at the Trust, with a phased approach.  We did this to ensure the system was working in each department, before introducing it in another area.

“We are monitoring waiting time performance and records management so we can identify any issues if they emerge. The system is still being introduced in some services and when this is completed we will be able to assess the overall programme,” said the spokesman.

Does Croydon’s unwillingness to give in its statements to me any details of problems indicate that the culture of a lack of transparency in the NHS will be hard to change, no matter how many times Jeremy Hunt talks about the need for candour when things go wrong?

The spokesman:

“I’d like to be clear about the Trust’s approach:

  • The Trust board has been cited on the roll out of CRS Millennium and any potential risks throughout the process.  As I previously noted, the board received an update in September.  The board meeting, which will take place on Monday of next week, will receive a further update from the Chief Executive.  The papers from this meeting will be published on our website and the meeting takes place in public;
  • A meeting chaired by the Chief Operating Officer has reviewed any operational matters arising on a daily basis.  This is an internal meeting for clinicians and managers which has informed the implementation process;
  • Patients and visitors to the hospital have been kept fully appraised of the introduction of the system and were made aware that they may experience some delays to the check-in process while staff became familiar with the new computer system;

“These actions would suggest that the Trust has been transparent in its approach.  You are welcome to review the board papers when they are published.”

Serious problems now emerge

Croydon did indeed publish its board papers on 25 November 2013 – which is to its credit because not all NHS trusts publish timely board papers.

But it’s mostly in the small print of various board papers that details emerge of Millennium-related problems. The shortcomings are mentioned as individual items rather than in a single, detailed Cerner Millennium deployment report.  This leaves one to question whether trust directors have an overview of the seriousness of the difficulties arising from its implementation of a new patient records system.

These are some excerpts from deep inside Croydon’s latest board papers:

Breaches in waiting time standards

– “CRS Millennium (Cerner) Deployment -Network downtime – Week 1.  In particular, the significant network downtime in week 1 (BT N3 problem) led to no electronic access to Pathology and Radiology which resulted in longer waits for patients in the Emergency Department (ED) leading to a large number of breaches. This was a BT N3 problem which has been rectified with BT providing CHS with the required scale of N3 access (>600 concurrent users and >1,600 users on any day – which is the largest network usage of any trust in England).”

– • “Hospital Based Pathways: The deployment of CRS Millennium was a particular challenge in the month across the multiple service areas within the Directorate of A&E, Surgery and Maternity.

• “Cancer & Core Functions: With the implementation of CRS Millennium, the open pathways part of RTT [referral to treatment – patient waiting times) may fail the standard – validation will be completed after the narrative for this report… “

Excessive waits in A&E

– “The main drivers adversely affecting the performance in the month [October 2013) for A&E were the deployment of CRS Millennium and the commencement of winter pressures due to the seasonality change.  A&E  4-Hour Total Time in Department Target: 95.00%. Actual: 91.57%.”

Over budget

“The Trust position as at October is an adverse variance of £4.1m. This is a significant deterioration on the Month 6 position. The movement is mainly due to a significant reduction in income mainly as a result of operating issues caused by the Cerner deployment (£0.9m)…  Actual £14.8 (£14.8)m; Budget £10.7m; Variance £4.1m.”

“Cerner Millennium: Plan YTD [year-to-date] £245,000; Actual YTD  £621,000;

Significant loss in income

“… A new patient administration system was deployed in the Trust on the 30th September and 1st October (Cerner Millennium). The deployment has resulted in significant loss in income in September and October £ 1.1m. Trust performance on Activity Planning Assumptions and Key Performance Indicators is substantially worse than plan …”

Extra costs

“Medical £412k and admin £148k agency levels continue to be high due to cover for vacancies, annual leave, sickness and release of staff for Cerner training. The Trust has also incurred additional costs associated with the Cerner deployment (£600k) including overtime payments to administration staff and training costs.”

Bid to recover Cerner costs?

“… The Trust is currently forecasting a deficit position of £17.8m, which is £3.3m off the plan submitted to the NHS Trust Development Authority. This is a £3m movement from the month 6 forecast and is as a result of operational issues caused by the Cerner deployment. The current projected impact is an additional costs £1.7m and a loss in activity £1.1m . An application is to be made to recover the additional cost/losses relating to the Cerner deployment [of £2.9m] …”

HSCIC support for delays

“Cerner Millennium – Revised implementation date to Sept 2013 (achieved) ,with resultant additional costs including additional PC requirements of £146k, specialist support services £300k, procurement costs £91k, data cleansing costs £200k.

“Health& Social Care Information Centre (HSCIC) has confirmed support for the delayed implementation will be provided, accounting treatment of support to be confirmed with Department of Health.”

More money to stabilise operational position?

“As a result of operational issues caused by the Cerner deployment , Income is significantly reduced in October. The forecast assumes that the Trust will resume normal operating levels from November and that an element of the income lost will be will be recovered in the latter part of the year. A business case is being submitted to the Trust Board for additional investment in Cerner to stabilise the operational position.

“If there are further operational issues due to the Cerner deployment then this will significantly impact on the year end forecast…”

Over-optimism?

Principal risk -reporting output from Cerner is not accurate or timely. Officer in charge: CEO. Before go-live risk scores: June 2013 – 16; July – 16; Aug  – 10; Sept – 10. After go-live risk score (for Oct): 20 [high risk of likelihood and consequences]

Principal risk – operational readiness following the implementation of Cerner. Officer in charge: COO.  Before go-live risk score 15. Post go-live: 20. Risk rating before go-live – Green. After go-live – Red.

Red risks

Corporate Risk Assurance Framework

Nine risks are reported as Red [two of which relate directly to Millennium]:

“… Reporting output from Cerner is not accurate or timely. Data migration was successful. However reliance on external provider as internal knowledge has not yet been fully gained. A data quality dashboard with exception reporting is in place.

“… Operational readiness following the implementation of Cerner CRS Millennium impact conveyed to Trust Development Authority e.g. ED [Emergency Department] reporting and cost overruns

Risk scores

– Failure of CRS millennium to deliver anticipated benefits – 12. Officer in charge: CEO

– Reporting output from Cerner is not accurate or timely – 20. Officer in charge: CEO

– Operational readiness following the implementation of Cerner – 20. Officer in charge: COO

Croydon’s trust’s response to problems

Said John Goulston, Croydon’s CEO, in his latest [November 2013] report to the board of directors:

“The issues being encountered now with CRS Millennium are not due to any lack of integration testing with legacy applications or testing of workflow. They can be attributed to changing from a 25 year old Patient Administration System (Patient Centre) which did not require working in real time, was simple and intuitive to use, easily configurable and flexible to our needs.

“CRS Millennium’s patient administration functions are almost the complete opposite and the language used is new for our staff i.e. conversations, encounters etc. For our staff it has been a big ask for them to step into and up to such a complex application.”

He added: “The benefits of the new system are that each patient will have a single accurate electronic record that can be viewed and kept up-to-date by hospital and community clinical staff. This will eventually mean less time searching for patient notes, missing documentation and duplicating patient information…

“As with any massive change, there are still some challenges to tackle in making the system work effectively for every single user, in a diverse and complex organisation.

“However the success we have achieved to date is the result of the efforts of every single system user and all staff members. I would like to thank all our staff for their hard work in getting the Trust to this important stage.”

The trust spokesman gave me this statement on the problems:

“The Trust board has been given regular reports on the roll out of CRS Millennium and any potential risks throughout the process, not least through its regular reviews of the Corporate Risk and Board Assurance Frameworks.  As I previously noted, the board received a specific update in September.

“As you already know, November’s board meeting received a further update from the Chief Executive.  The papers from this meeting were published and the meeting takes place in public;  Those attending are invited to put forward questions.

“A meeting chaired by the Chief Operating Officer continues to review operational matters.  This is an internal meeting for clinicians and managers which has informed the implementation process;

“Patients and visitors to the hospital have been kept fully appraised of the introduction of the system and were made aware that they may experience some delays to the check-in process while staff became familiar with the new computer system;

“As you highlight from the board report, Cerner & BT noted that ‘the Trust has undertaken one of the most efficient roll-outs of the system they have worked on’   The papers also note some operational challenges as the system was rolled out.  These have been addressed as part of the daily meetings I reference above – these are mainly concerned with users familiarising themselves with the system and have been addressed through the support and training staff received.

“In terms of the costs, the introduction of CRS Millennium has been supported by central funding from the Department of Health with the Trust paying the implementation overheads.   These costs are a matter of public record and the Trust publishes annual Accounts as part of its Annual Report.”

Comment

When you go into hospital it’s reassuring to know the directors will be well informed and open about problems that could affect you.

The approach of Croydon Health Services NHS Trust to openness about its problems is not reassuring. It is no better or worse than other trusts that have implemented Cerner’s Millennium. In fact the timely publication of its board papers means it is more open than some.

But it should not require a time-consuming journalistic investigation to establish the consequences for patients of an NPfIT go-live. It has required just such an investigation after the go-live of Millennium at Croydon.

Board directors will not have the time to dig for, and piece together, information about internal problems that could delay patient appointments, treatment and care. They need the unpalatable facts in one place. Croydon Health Services has failed to make it easy for patients or board directors to see what has gone wrong.

NPfIT deployments at other trusts have led, cumulatively, to thousands of patients having appointments that were disrupted, or who had to wait longer to be seen than necessary, or whose records were not available, or who were seen with another patient’s records.

In shying away from telling the whole truth trusts take their cue from the top: the Department of Health has always made it hard to establish facts about anything to do with the NPfIT.  Said the Public Accounts Committee in its report The National Programme for IT in the NHS: an update on the delivery of detailed care records systems in July 2011:

 “It is unacceptable that the Department [of Health] has neglected its duty to provide timely and reliable information to make possible Parliament’s scrutiny of this project.

“Basic information provided by the Department to the National Audit Office was late, inconsistent and contradictory.”

Unanswered questions

Croydon has questions to answer, such as how many breaches of waiting time standards it has had, and may still be having, due to problems arising from the go-live. Other unanswered questions:

– What does a “a large number of breaches” in the Emergency Department mean? Have each the patients affected been told?

– Why are the risks related to the implementation much higher after go-live than before, given that the trust has had years to prepare for the go-live, and the many lessons it could have learned from other trusts?

– Exactly what problems are still affecting patients?

In a post-Francis NHS, Jeremy Hunt has demanded openness about mistakes and problems. There is an agreed need for change – but how can Hunt change an NHS culture – indeed a public sector culture – in which senior executives, in troubled IT implementations, will always emphasise the good news over the bad, perhaps hoping the bad will always remain hidden?