Category Archives: Home Office

Is the Post Office to blame for Horizon IT dispute – or is it really ministers and civil servants?

By Tony Collins

How does a public institution behave when it has little effective oversight?

Mr Justice Peter Fraser is expected to rule shortly on a critical question that is at the heart of a long-running IT dispute between the Post Office and hundreds of former sub-postmasters.

His ruling may answer the question of whether the Post Office’s “Horizon” IT or sub-postmasters were likely to have been to blame for unexplained shortfalls of sometimes tens of thousands of pounds shown on local branch systems.

If the Post Office loses the High Court case, it could end up paying damages of hundreds of millions of pounds – which could fall to the taxpayer. The state owns 100% of the Post Office. Public funding of the Post Office amounted to £2bn between 2010 and 2017 and a further funding package of £370m is agreed until 2021. Any damages could be on top of this.

If the case ends up with the Post Office’s needing a taxpayer bail-out, this would raise some obvious questions:

  1. Who in government and the civil service provided oversight when the Post Office decided controversially to trust what was shown on a proprietary computer system rather than the word of hundreds of local branch sub-postmasters?
  2. Who in government and the civil service endorsed the Post Office’s decision to defend litigation that could end up costing taxpayers hundreds of millions of pounds?
  3. Who in government and civil service endorsed the decision to continue defending the litigation – and indeed deepening it – despite excoriating criticisms of the Post Office by two High Court judges?

It is still possible for the Post Office to win the case in which event its actions and decisions may be vindicated. But it has lost every interim ruling so far, in a case which has lasted two years to date.

When asked about their oversight of the Post Office, ministers have distanced themselves.

In August 2019, the then Minister for Postal Services, Kelly Tolhurst, said in a letter that Post Office Limited “operates as an independent, commercial business and the matters encompassed by this litigation fall under its operational responsibility”.

But thanks to extensive research by Eleanor Shaikh, a reader of the blog of journalist Nick Wallis, who is crowd-funded to cover the High Court hearings, we know that civil servants reporting to ministers have extensive responsibilities for oversight of the Post Office.

The state categorises the Post Office as an “Arm’s Length Body”]. Shaikh learned that the Department for Business Energy and Industrial Strategy is required to “exercise meaningful and commensurate oversight of ALB [Arm’s Length Body] strategy, financial management, performance and risk management”.

A 2014 Civil Service document, Introduction to Sponsorship, adds that,

“the Secretary of State is ultimately accountable to Parliament for the overall effectiveness and efficiency of each ALB of which their department is responsible.”

It’s not only about oversight. Civil servants are,

“… expected to play an active role in the governance, financial management, risk management and performance monitoring of ALBs and are responsible for managing the relationship with an ALB on behalf of the Minister and the AO [accounting officer].”

Wallis reports in full on Shaikh’s findings.

How effective has civil service oversight been so far?

The judge’s comments in his ruling of March 2019, which the Post Office is seeking leave to appeal, suggest that there has been little effective civil service challenge to Post Office’s decisions. Indeed, one of the judge’s findings was that,

“The Post Office appears, at least at times, to conduct itself as though it is answerable only to itself.”

The judge also criticised,

  • untrue statements by the Post Office
  • threatening and oppressive behaviour by the Post Office.
  • the Post Office’s appearing “determined to make this litigation, and therefore resolution of this intractable dispute, as difficult and expensive as it can”.
  • the Post Office house style for some senior management personnel giving evidence which was to “glide away from pertinent questions, or questions to which the witness realised a frank answer would not be helpful to the Post Office’s cause”.
  • a culture of secrecy and excessive confidentiality generally within the Post Office but particularly focused on Horizon
  • Post Office witnesses in general who have become “so entrenched over the years, that they appear absolutely convinced that there is simply nothing wrong with the Horizon system at all …”
  • attempts by the Post Office to prevent some evidence from emerging into the public domain by applying to have it struck out as irrelevant
  • attacks by the Post Office on the credibility of sub-postmasters whom the judge found credible as witnesses in the case.
  • some Post Office procedures that went from the sublime to the ridiculous,
  • some Post Office submissions that were “bold, pay no attention to the actual evidence, and seem to have their origin in a parallel world”.
  • the Post Office’s asking a sub-postmistress to extend the local branch’s opening hours a day after her husband, who ran the branch, had died.

Of the Post Office’s most senior witness, a director, the judge described her as highly intelligent. She on occasions gave clear and cogent evidence. She helped to improve the Horizon system and had provided some useful evidence.

But in describing parts of her evidence he also referred to a “degree of obstinacy”, extraordinarily partisan”, “sought to obfuscate matters…”, “disingenuous” and a “disregard for factual accuracy”. He said at one point in his ruling, “I find that she was simply trying to mislead me.”

He concluded, “I find that it is necessary to scrutinise everything she said as a witness, both in her witness statement and in cross-examination, and treat it with the very greatest of caution in all respects.”

Comment

If the judge is right in his criticisms – and it is too early in the appeals process to say conclusively that he is right – is he simply describing the behaviour of a state institution that is, in essence, without higher control?

Civil servants from, among others, the Department for Work and Pensions, HM Revenue and Customs, the Ministry of Defence, Home Office and DEFRA appear regularly before the Public Accounts Committee and are the subject of value-for-money investigations by the National Audit Office. The Post Office has little of this scrutiny.

A large private company has many shareholders and the threat of going bust to keep it in check. But the Post Office is too big and important to the community to be allowed to fail.

When Boeing’s aircraft technology is the subject of independent, detailed and widespread criticism, its planes are grounded indefinitely while regulators investigate.

The Post Office has no fear of any regulators shutting down its Horizon system.

In an accountability vacuum, how can a state institution be expected to behave?

Individuals within a large organisation will have a sense of right and wrong. But collectively, can people within state institutions be expected to do much more than meet the requirements of the culture and law as they perceive it?

That is why effective and rigorous oversight of state institutions is critical, if only to protect the interests of taxpayers.

When the widow of a sub-postmaster who’d died the previous day took over his branch, the Post Office asked her to extend the opening hours, which seems to have surprised the judge. Wouldn’t that behaviour surprise anyone?

When shortfalls were shown on the computer system, how easy was it for the Post Office to demand that sub-postmasters made good the losses sometimes without full investigations? It was easier, perhaps, without effective oversight.

Can the Post Office be held entirely responsible for the Horizon IT debacle? It is a state institution. Responsibility for the debacle lies, therefore, with ministers and civil servants, whatever the outcome of the Horizon dispute.

Nick Wallis’ trial coverage including Eleanor Shaikh’s research on the oversight that ought to be provided by ministers and the civil service.

Computer Weekly’s useful summary of the latest position

 

Civil servant in charge of £9.3bn IT project is not shown internal review report on scheme’s failings.

By Tony Collins

“If people don’t know what you’re doing, they don’t know what you’re doing wrong” – Sir Arnold Robinson, Cabinet Secretary, Yes Minister, episode 1, Open Government.

Home Office officials kept secret from the man in charge of a £9.3bn project a report that showed the scheme in serious trouble.

The Emergency Services Network is being designed to give police, ambulance crew and firemen voice and data communications to replace existing “Airwave” radios.  The Home Office’s permanent secretary Philip Rutnam describes the network under development as a “mission-critical, safety-critical, safety-of-life service”.

But Home Office officials working on the programme did not show an internal review report on the scheme’s problems to either Rutnam or Stephen Webb, the senior responsible owner. They are the two civil servants accountable to Parliament for the project.

Their unawareness of the report made an early rescue of the Emergency Services Network IT programme less likely. The scheme is now several years behind its original schedule, at least £3.1bn over budget and may never work satisfactorily.

The report’s non circulation raises the question of whether Whitehall’s preoccupation with good news and its suppression of the other side of the story is killing off major government IT-based schemes.

With the Emergency Services Network delayed – it was due to start working in 2017 – police, ambulance and fire services are having to make do with the ageing Airwave system which is poor at handling data.

Meanwhile Motorola – which is Airwave’s monopoly supplier and also a main supplier of the Emergency Services Network – is picking up billions of pounds in extra payments to keep Airwave going.

Motorola may continue to receive large extra payments indefinitely if the Emergency Services Network is never implemented to the satisfaction of he emergency services.

EE is due to deliver the network component of the Emergency Services Network. Motorola is due to supply software and systems and Kellogg Brown & Root is the Home Office’s delivery partner in implementing the scheme.

Has Whitehall secrecy over IT reports become a self-parody?

The hidden report in the case of the Emergency Services Network was written in 2016, a year after the scheme started. It said that dialogue between suppliers, notably EE and Motorola, did not start until after the effective delivery dates. Integration is still the main programme risk.

MP SIr Geoffrey Clifton Brown has told the Public Accounts Committee that the report highlighted an absence of clarity regarding dependency on the interface providers, which caused something of an impasse.

He said the report “alluded to the fact that that [a lack of clarity around integration] remains one of the most serious issues and is not showing any signs of resolution”.

Stephen Webb has been in charge of the project since its start but he is the business owner, the so-called “senior responsible owner” rather than the programme’s IT head.

In the private sector, the IT team would be expected to report routinely to a scheme’s business owner.

But in central government, secrecy over internal assurance reports on the progress or otherwise of major IT-related projects is a Whitehall convention that dates back decades.

Such reports are not published or shared internally except on a “need-to-know” basis. It emerged during legal proceedings over the Universal Credit IT programme that IT project teams kept reports secret because they were “paranoid” and “suspicious” of colleagues who might leak documents that indicated the programme was in trouble.

As a result, IT programme papers were no longer sent electronically and were delivered by hand. Those that were sent were “double-enveloped” and any that needed to be retained were “signed back in”; and Universal Credit programme papers were watermarked.

The secrecy had no positive effect on the Universal Credit programme which is currently running 11 years behind its original schedule.

Webb has told MPs he was “surprised” not to have seen review report on the Emergency Services Network. He discovered the report’s existence almost by accident when he read about it in a different report written a year later by Simon Ricketts, former Rolls Royce CIO.

This month the Public Accounts Committee criticised the “unhealthy good news” culture at the Home Office. The Committee blamed this culture for the report’s not being shown to Webb.

The Home Office says it doesn’t know why Webb was not shown the “Peter Edwards” report. The following was an exchange at the Public Accounts Committee between MP Sir Geoffrey Clifton-Brown, Webb and Rutnam.

Clifton-Brown: When you did that due diligence, were you aware of the Peter Edwards report prepared in the fourth quarter of 2016?

Rutnam: No, I’m afraid I was not. The Peter Edwards report on what exactly, sorry?

Clifton-Brown: Into the problems with ESN [Emergency Services Network], in particular in relation to suppliers.

Rutnam: I do not recall it. It may have been drawn to my attention, but I’m afraid I do not recall it.

Webb: It was an internal report done on the programme. I have not seen it either.

Clifton-Brown: You have not seen it either, Mr Webb—the documents tell us that. Why have you not seen such an important report? As somebody who was in charge of the team—a senior responsible officer—why had you not seen that report?

Webb: I don’t know. I was surprised to read it in Simon’s report. [Simon Ricketts.]

Chair: Who commissioned it?

Webb: The programme leadership at the time.

Chair: That is the board?

Webb: The programme director. It was a report to him about how he should best improve the governance. I think he probably saw it as a bit of an external assurance. It probably would have been better to share it with me, but that was not done at the time.

Clifton-Brown: “Probably would have been better to share it”? That report said that dialogue between suppliers, notably EE and Motorola, only started after the effective delivery dates. The report highlighted that there was not clarity regarding dependency on the interface providers, and that caused something of an impasse. It also alluded to the fact that that remains one of the most serious issues and is not showing any signs of resolution. That was in 2016, in that report. Had that report been disseminated, would we still be in the position that we are today?

Webb: I think that we would have wanted to bring forward the sort of [independent] review that the Home Secretary commissioned, and we would have done it at an earlier date.

Clifton-Brown: Why did you need to? You would not have needed to commission another review. You could have started getting to the root of the problem there and then if you had seen that report.

Webb: Yes.

Comment:

Webb and Rutman seem highly competent civil servants to judge from the open way they answered the questions of MPs on the Public Accounts Committee.

But they did not design the Emergency Services Network scheme which, clearly, had flawed integration plans even before contracts were awarded.

With no effective challenge internally and everything decided in secret, officials involved in the design did what they thought best and nobody knew then whether they were right or wrong. With hindsight it’s easy to see they were wrong.

But doing everything in secret and with no effective challenge is Whitehall’s  systemically flawed way of working on nearly all major government IT contracts and it explains why they fail routinely.

Extraordinary?

It’s extraordinary – and not extraordinary at all – that the two people accountable to Parliament for the £9.3bn Emergency Services Network were not shown a review report that would have provided an early warning the project was in serious trouble.

Now it’s possible, perhaps even likely, the Emergency Services Network will end up being added to the long list of failures of government IT-based programmes over the last 30 years.

Every project on that list has two things in common: Whitehall’s obsession with good news and the simultaneous suppression of all review reports that could sully the good news picture.

But you cannot run a big IT-based project successfully unless you discuss problems openly. IT projects are about solving problems. If you cannot admit that problems exist you cannot solve them.

When officials keep the problems to themselves, they ensure that ministers can be told all is well. Hence, ministers kept telling Parliament all was well with the £10bn National Programme for IT in the NHS  – until the scheme was eventually dismantled in 2011.

Parliament, the media and the public usually discover the truth only when a project is cancelled, ends up in the High Court or is the subject of a National Audit Office report.

With creative flair, senior civil servants will give Parliament, the National Audit Office and information tribunals a host of reasons why review reports on major projects must be kept confidential.

But they know it’s nonsense. The truth is that civil servants want their good news stories to remain uncontradicted by the disclosure of any internal review reports.

Take the smart meters roll-out. Internal review reports are being kept secret while officials give ministers and the Department for Business, Energy and Industrial Strategy the good news only. Thus, the latest Whitehall report on smart meters says,

“Millions of households and small businesses have made the smart choice to get a smart meter with over 12.8 million1 operating in smart mode across Great Britain. This world leading roll out puts consumers firmly in control of their energy use and will bring an end to estimated bills.”

Nothing is said about millions of homes having had “smart” meters installed that are neither smart nor compatible for the second generation of smart meters which have a set of problems of their own.

The answer?

For more than 30 years the National Audit Office and the Public Accounts Committee have published seemingly unique reports that each highlight a different set of problems. But nobody joins the dots.

Sir Arnold, the Cabinet Secretary said in “Yes Minister“, that open government is a contradiction in terms. “You can be open, or you can have government.

This is more than a line in a TV satire.  It is applied thinking in every layer of the top echelons of civil service.

Collective responsibility means civil servants have little to fear from programme failures. But they care about departmental embarrassment. If reviews into the progress or otherwise of IT-enabled programmes are published, civil servants are likely to be motivated to avoid repeating obvious mistakes of the past. They may be motivated to join the dots.

But continue to keep the review reports secret and new sets of civil servants will, unknowingly each time, treat every project as unique. They will repeat the same mistakes of old and be surprised every time the project collapses.

That the civil service will never allow review reports of IT programmes to be published routinely is a given. If the reports were released, their disclosure of problems and risks could undermine the good news stories ministers, supported by the civil service, want to feel free to publish.

For it’s a Whitehall convention that the civil service will support ministerial statements whether they are accurate or not, balanced or not.

Therefore, with review reports being kept secret and the obsession with good news being wholly supported by the civil service, government’s reputation for delivering successful IT-based programmes is likely to remain tarnished.

And taxpayers, no doubt, will continue to lose billions of pounds on failed schemes.  All because governments and the civil service cannot bring themselves to give Parliament and the media – or even those in charge of multi-billion pound programmes –  the other side of the story.

Home Office’s “unhealthy good news culture” blamed for Emergency Services Network Delays – Civil Service World

Emergency Services Network is an emergency now – The Register

Home Office not on top of emergency services programme – Public Accounts Committee report, July 2019

More public sector IT-related failures for which nobody will be accountable – a solution?

The Times front page – 23 January 2019

By Tony Collins

Criminal trials were delayed, jurors unable to enrol and witness statements inaccessible.

Quoting a tweet by the authoritative @BarristerSecret, the BBC said the “entire digital infrastructure” of courts was “broken for days”.

@BarristerSecret added,

“No accountability, no lessons learned.”

In the Spectator, Matthew Scott, a criminal barrister at Pump Court Chambers, said,

“Nobody seems to know exactly what has gone wrong or, if they do, they do not like to say.”

His Spectator blog was headlined,

The Spectator – 24 Jan 2019

 

 

“The most irritating fault has been for a few days the near total seizure (or ‘major service degradation’ to use the official non-explanation) of the secure email system (‘CJSM’) which for several years now has been the only authorised means of written communication between the Crown Prosecution Service and defence lawyers, probation, prisons, police and others.”

The Law Society Gazette said,

Law Society Gazette – 22 Jan 2019

 

 

 

The Law Society Gazette gave examples of how the problems had caused disruption and angst in the criminal justice system. It said,

“Major disruption that affected multiple Ministry of Justice IT systems last week continues to cause chaos.

“Lawyers on the front line have told the Gazette that trials have been delayed, jurors have been unable to enrol and practitioners have been prevented from confirming attendance that will enable them to get paid.

“Last week the ministry’s digital and technology team said most systems were improving. However, the Gazette has spoken to practitioners whose experiences suggest otherwise.”

A criminal barrister who spent the day in Leicester Crown Court said  none of the court’s computer systems was operational, jurors could not be enrolled, and no advocates could sign into the Ministry of Justice’s XHIBIT system, an online service that logs lawyers’ attendance so they can get paid.

A lawyer at Lincoln Crown Court said the XHIBIT system was down again. The Crown Court Digital Case System, on which all cases are accessed, was also down.

A criminal defence solicitor arrived at Highbury Magistrates’ Court in London at 9.15am, where there were several clients in the cells. But jailers did not know which courts the cases would be heard in and  because there was no wi-fi in the building magistrates had no access to any papers on their ipads before the hearings.

“The Gazette was told that several people attended Scarborough Magistrates’ Court last week to make statutory declarations in respect of driving matters. ‘Most of these people had come suited and booted, with all the anxiety that marks ordinary members of the public out as different from the frequent flyers who regularly come before the courts.

“These poor souls were left hanging around all morning, until 1pm, when they were advised that the systems were still not back up. Two of them agreed to come back on an adjourned date, 14 days later, but one of them explained that he couldn’t take further time off work. He was asked to come back in the afternoon, in the vain hope that the case management system might be back online.”

Former government chief technology officer Andy Beale quoted The Times in a tweet,

 

 

 

In another tweet, Beale said,

 

 

 

The Guardian reported yesterday (28 January 2019) that the Ministry of Justice knew its court computer systems were “obsolete” and “out of support” long before the network went into meltdown, internal documents have revealed.

The MoJ document, entitled Digital & Technology, said, “Historical under-investment in ageing IT systems has built our technical debt to unacceptable levels and we are carrying significant risk that will result in a large-scale data breach if the vulnerabilities are exploited.”

It added, “We have a Technology 2022 strategy, but it is not funded to help us address the long-term issues with current systems and allow us to make best use of new technologies to improve service delivery.”

It referred to a database used by 16 employment tribunal administrative offices in which the “scale of outage” accounted for 33% of incidents over the previous six months. Users were unable to access systems for a “significant number of hours”.

The report cited problems such as “risk of database corrupted leading to data loss; unable to restore service in a timely manner”, and added: “Judges say they will put tribunal activity on hold because of the poor running of the application.”

Government response

In the Commons, the government’s justice minister Lucy Frazer, responding to an urgent Labour request for a statement on the IT problems, was relaxed in her comments. She said the disruption was “intermittent” and the problems were merely “frustrating”. She added,

“The issue that has arisen relates mainly to email systems. There has been minimal disruption, I am told, to the courts system as a whole.”

She said there had been an “infrastructure failure in our supplier’s data centre”.

“The Prison Service has not been affected and—to correct inaccurate reporting—criminals have not gone free as a result of the problem. We have been working closely with our suppliers, Atos and Microsoft, to get our systems working again, and yesterday we had restored services to 180 court sites, including the largest ones.

“Today (23 January 2019), 90% of staff have working computer systems. Work continues to restore services and we expect the remainder of the court sites to be fully operational by the time they open tomorrow morning. We are very disappointed that our suppliers have not yet been able to resolve the network problems in full.

“This afternoon, the permanent secretary, Sir Richard Heaton, will meet the chief executive of Atos and write personally to all members of the judiciary. I am very grateful to all our staff who have been working tirelessly and around the clock, alongside our suppliers, to resolve the issues.”

Labour’s Yasmin Qureshi asked if Microsoft and Atos have paid any penalties to which Frazer gave a vague, non-committal reply,

“… the permanent secretary is meeting the supplier’s chief executive this afternoon and of course we will look carefully at the contracts, which include penalty clauses.”

Frazer later said the problem related to a “server” which raised questions about how the failure of a single server, or servers, could cause widespread chaos in the courts.

Labour’s Steve McCabe said the server problem was not a  single or unusual event.

“… her Department has been receiving reports of failures in the criminal justice secure email service for at least six months now”.

Police systems

The BBC reported last week that problems with a police IT system were causing some criminals to escape justice.

Nine forces in England and Wales use Athena from Northgate Public Services. They are Bedfordshire, Cambridgeshire, Essex, Hertfordshire, Kent, Norfolk, Suffolk, Warwickshire and West Mercia. The system is designed to help speed up the detection of crimes.

But officers told the BBC’s Victoria Derbyshire programme that it crashes regularly and is overly complicated, meaning some cases are not built in time or dropped.

Developers Northgate Public Services apologised for problems “in small areas”, which it said it was fixing.

A joint response from nine police forces said Athena – which has cost £35m over the past 10 years – had been “resilient and stable, although no system is perfect”.

The system was introduced following a government directive for forces to share intelligence after the Soham murders of Holly Wells and Jessica Chapman, in 2002.

Officers said the intelligence-sharing function works well but problems arise when they use the system to build cases for the Crown Prosecution Service.

The delays it causes means officers can struggle to get the information together in time to charge suspects or the cases are not up to a high-enough standard and are dropped.

Serving officers at Bedfordshire, Hertfordshire and Essex told the programme the process could now take up to twice as long.

The BBC did not name any officers who revealed details of the problems because they could face disciplinary action for speaking out. Their comments included:

  • “The first two weeks it (the system) was brought in were the worst two weeks of my entire career. It’s overly bureaucratic. It doesn’t understand the police investigative process at all. From day one, it malfunctioned. Four years on, it is still malfunctioning”
  • “It often requires information that is totally irrelevant and if you miss just one data entry point (like whether a solicitor is male or female), I have to reject the whole case and send it back to the officer”
  • “Even for a simple shoplift, I probably have to press about 50 buttons, with a 30-second minimum loading time between each task”
  • “There have been incidents where charges have been dropped because of the inadequacies of the system. There have been cases of assaults, albeit fairly minor assaults, but these are still people who should be facing criminal charges”
  • “It slows the whole criminal justice system down. At the moment, it is not fit for purpose. This is the most challenging time I have come across. We’re at breaking point already. This has pushed some officers over the edge”
  • “When you’ve got detainees in a custody block who’ve got various illnesses and ailments, medical conditions that are all recorded on there and they need medication at certain times – it became very dangerous because we were unable to access the records”

The nine forces – which also include those in Cambridgeshire, Kent, Norfolk, Suffolk, Warwickshire and West Mercia – said in a joint statement that they had been working with the supplier to identify and correct issues as they arose.

“Over the 12 months up to November 2018, there have only been 72 hours of total downtime and there are detailed plans in place of how to manage business when this occurs.”

Northgate Public Services, which created Athena, said 40,000 officers accessed the system and benefited from improved criminal intelligence.

It said it was working to make improvements to the “complex system”.

“We recognise there are a small number of areas of the solution where improvements can be made and we apologise for any difficulties this has caused.

“We are working hard with the customer and other parties to make these improvements as a priority.”

Comment:

As @BarristerSecret said,

“No accountability, no lessons learned.”

In central and local government, accountability means suppliers sometimes have to pay small penalties. Outsourcing supplier Capita last year paid Barnet Council about £4.2m in compensation for poor performance.

It was a fraction of the hundreds of millions Capita has received from Barnet Council.

Sometimes the opposite happens and it is the supplier that wins money from the government after a failure.

The Home Office sacked Raytheon over problems on an e-borders IT systems and ended up paying Raytheon £224m in compensation.

The Department of Heath ended up paying Fujitsu hundreds of millions of pounds after the supplier’s contract to deliver systems under the National Programme for IT [NPfIT] was ended.

A major failure in one area of the public sector will not  stop or deter officials from awarding the same supplier a major contract in the same or another part of the public sector.

Were a major failure or legal dispute to preclude a supplier from bidding for further UK public sector work, most if not all major suppliers would today have little UK government business.

A solution?

There is an effective way to encourage IT suppliers and the public sector to avoid public service failures. But the senior civil service isn’t interested.

That solution would be to publish – after every major public services failure – a full, independent third-party report into what went wrong and why.

Some senior officials seem unruffled by public criticism or even contempt after a services failure. But particularly in some of the major departments, there is a high-level fear of the full truth emerging after an administrative disaster.  Departments would do almost anything to avoid IT-related failures if reports on the causes were routinely published.

But unless there is a Parliamentary or public clamour for such internal analyses to be published, they will remain hidden or uncommissioned.

When the National Audit Office publishes a report on a departmental failure, the report has usually been agreed and signed off by the department; and it is usually a one-off report.

When public services descend into chaos, as happened in the court service last week, immense pressure falls on the IT teams to restore normal services urgently. But without the routine publication of reports on major IT-related public service failures, where is the motivation for senior officials to avoid chaos in the first place?

House of Commons debate on the courts’ IT failures

Thank you to Celina Bledowska for her tweet alerting me to the criminal justice IT problems.

A proposed Bill and charter that could change the face of Whitehall IT and save billions

By Tony Collins

A government-commissioned review yesterday backed a Bill that could, if enacted and applied to Whitehall generally, prevent billions of pounds being lost on wasteful projects.

The Public Authority Accountability Bill – known informally as the Hillsborough Law – would establish an offence of intentionally or recklessly misleading the public, media or court proceedings.

It would also impose a legal requirement on public authorities to act with candour, transparency and frankness when things go wrong.

Although the Bill was a reaction, in part, to the cover up by public authorities of their failings in the light of Hillsborough, it could, if enacted, deter public authorities from covering up failings generally – including on major IT programmes.

For decades public authorities have had the freedom – unrestricted by any legislation – to cover up failures and issue misleading statements to the public, Parliament and the media.

In the IT sphere, early problems with the Universal Credit IT programme were kept secret and misleadingly positive statements issued. The National Audit Office later criticised a “good news” culture on the Universal Credit programme.

And still the DWP is fighting to block the disclosure of five project assessment reviews that were carried out on the Universal Credit IT programme between 2012 and 2015.

It could be argued that billions of pounds lost on the NPfIT – the National Programme for IT in the NHS – would have been avoided if the Department of Health had been open and candid at the start of the programme about the programme’s impractically ambitious aims, timescales and budgets.

The Department for Business, Energy and Industrial Strategy is currently keeping secret its progress reports on the £111bn smart meters rollout – which independent experts have said is a failing programme.  The department routinely issues positive statements to the media on the robust state of the programme.

The Public Authority Accountability Bill was drafted by lawyers who had been involved with representing bereaved Hillsborough families. It is aimed mainly at government inquiries, court proceedings and investigations into lapses of public services.

But it would also enshrine into law a duty on public authorities, public servants, officials and others to act within their powers with “transparency, candour and frankness”.

Lawyers who drafted the Bill refer on their website to “institutional defensiveness and a culture of denial” when things go wrong. They say,

“In 2017 we expect public authorities and individuals acting as public servants to be truthful and act with candour. Unfortunately, repeated examples have shown us that this is not generally the case.

“Instead of acting in the public interest by telling the truth, public authorities have tended to according to narrow organisational and individual motives by trying to cover up faults and deny responsibility …”

Backing for the Bill came yesterday from a 117-page report on the Hillsborough disaster by Bishop James Jones. The government commissioned him to produce a report on the experiences of the Hillsborough families so that their “perspective is not lost”.

Jones’ impressive report refers to institutions that “closed ranks, refused to disclose information, used public money to defend its interests and acted in a way that was both intimidating and oppressive”

His report refers to public bodies in general when it points to a “cultural condition” and “mindset” that features an “instinctive prioritisation of the reputation of an organisation over the citizen’s right to expect people to be held to account for their actions”. This, says the report, “represents a barrier to real accountability”.

It adds,

“As a cultural condition, this mindset is not automatically changed, still less dislodged, by changes in policies or processes. What is needed is a change in attitude, culture, heart and mind.”

The report urges leaders of “all public bodies” to make a commitment to cultural change by publicly signing a new charter.

The charter commits public bodies to:

  •  Place the public interest above its own reputation.
  • Approach forms of scrutiny with candour, in an open, honest and transparent way, making full disclosure of relevant documents, material and facts.
  • Learn from the findings of external scrutiny and from past mistakes.
  • Avoid seeking to defend the indefensible or to dismiss or disparage those who may have suffered where the organisation has fallen short.
  • When falling short, apologise straightforwardly and genuinely.
  • Not knowingly mislead the public or the media.

The report says that institutional defensiveness and a culture of denial are “endemic amongst public institutions as has been demonstrated not only by the Hillsborough cover up but countless other examples.”

Stuart Hamilton, son of Roy Hamilton who died at Hillsborough, is quoted in the report as saying,

“Police, officials and civil servants should have a duty of revealing the full facts and not merely selecting some truths to reveal but not others. Not lying or not misleading is simply not good enough. Without this, future disasters cannot be averted and appropriate policies and procedures cannot be developed to protect society.

“Such selective revealing of information also results in the delay of justice to the point where it cannot be served”.

He added,

“I believe that without a change not only in the law but also in the mindset of the public authorities (which a law can encourage) then very little exists to stop the post-event actions happening again.”

IT-enabled projects

Whitehall departments and the Infrastructure and Projects Authority publish their own narratives on the progress on major IT-enabled projects and programmes such as Universal Credit and smart meters.

But their source reports aren’t published.

Early disclosure of failings could have prevented hundreds of millions of pounds being lost on FireControl project, BBC’s Digital Media Initiative, the Home Office Raytheon e-borders and C-Nomis national offender management information projects and the Rural Payments Agency’s CAP delivery programme (which, alone, contributed to EU penalties of about £600m).

Comment:

Yesterday’s beautifully-crafted report into the Hillsborough disaster – entitled “The patronising disposition of unaccountable power” – is published on the Gov.uk website.

It has nothing to do with IT-enabled projects and programmes. But, in an unintentional way, it sums up a public sector culture that has afflicted nearly every Whitehall IT-based project failure in the last 25 years.

A culture of denial is not merely prevalent today; it is pervasive. All Whitehall departments keep quiet about reports on their failings. It is “normal” for departments to issue misleadingly positive statements to the media about progress on their programmes.

The statements are not lies. They deploy facts selectively, in a way that covers up failings. That’s the Whitehall culture. That’s what departments are expected to do.

According to Bishop Jones’ Hillsborough report, one senior policeman told bereaved families that he was not obliged to reveal the contents of his reports. He could bury them in his garden if he wished.

It’s the same with government departments. There is no legal duty to keep programme reports, still less any requirement to publish them.

If Bishop Jones’ charter is signed by leaders of public authorities including government departments, and Andy Burnham’s Bill becomes law,  the requirement for candour and transparency could mean that IT programme progress reports are made available routinely.

If this happened – a big if – senior public officials would have to think twice before risking billions of pounds on a scheme that held out the prospect of being fun to work on but which they knew had little chance of success within the proposed timescales, scope and budget.

It’s largely because of in-built secrecy that the impossibly impractical NPfIT was allowed to get underway. Billions of pounds was wasted.

Some may say that the last thing ministers and their permanent secretaries will want is the public, media and MPs being able to scrutinise what is really happening on, say, a new customs IT project to handle imports and exports after Brexit.

But the anger over the poor behaviour of public authorities after Hillsborough means that the Bill has an outside chance of eventually becoming law. Meanwhile public sector leaders could seriously consider signing Jones’ charter.

John Stuart Mill wrote in 1859 (On Liberty and The Subjection of Women) that the “only stimulus which can keep the ability of the [public] body itself up to a high standard is liability to the watchful criticism of equal ability outside the body”.

 

Raytheon/Home Office IT dispute rolls on

By Tony Collins

Another big, old government IT contract goes wrong. It’s part of civil service tradition that officials blame the supplier for missing milestones and not delivering what the end-users needed or wanted; and the supplier blames the customer for causing or contributing to the alleged defaults.

The Raytheon Systems/Home Office eBorders legal dispute is going along these lines – as did the Department of Health’s dispute with CSC over parts of the failed National Programme for IT [NPfIT].

It’s tradition for the civil service not to take big IT suppliers to court: a hearing could mean that civil servants have to talk about government business in an open courtroom.

Senior Whitehall officials do not want the public knowing how departments are really managed, or not managed.

In 2002 a 44-day court case between National Air Traffic Services and EDS [now HP] ended suddenly – minutes before a senior civil servant was due to give evidence.

Arbitration is different. It’s in secret so a long dispute can be tolerated.

And so a Home Office mega-contract awarded to US company Raytheon in 2007 has ended up in arbitration and is set for a sequence of hearings and appeals that could last years.

It took 10 years for an IT dispute between HP and BSkyB to be settled, and it could take this long for Raytheon and the Home Office to settle their dispute.

Chronology 

In 2003 Tony Blair launches the eBorders programme. He wants a database of foreign travellers entering and leaving Britain to help fight the war on terror.

A year later the Home Office launches Project Semaphore with IBM to pilot an electronic borders system.

In 2007 Jacqui Smith, Labour’s home secretary, signs an eBorders contract with Raytheon Systems as lead supplier and Serco, Detica, QinetiQ and Accenture as subcontractors. It’s worth £750m. Within two years Home Office officials are expressing concern that milestones are being missed.

In 2010 a new coalition government that’s determined not to put up with big, underperforming IT deals, terminates the Raytheon contract after a recommendation by the Major Projects Authority and a coalition review group.

In 2011 it emerges that Raytheon is threatening to sue the Home Office for £500m for repudiating the contract. Raytheon blames project delays on UK Border Agency mismanagement. It’s far from clear that officials knew what they wanted from the systems.  Arbitration proceedings begin.

In 2013 it emerges that IBM, Fujitsu and Serco are carrying out some of the original eBorders work.

Home Office loses arbitration

Last year an arbitration tribunal ruled that the Home Office must pay £224m to Raytheon. It found that the decision to terminate Raytheon’s contract was unlawful on a number of grounds. The Home Office had not fully considered the extent to which the Home Office and the UK Border Agency had caused or contributed to the alleged defaults.

Home Office wins appeal

Now the Home Office has won an appeal against the arbitration tribunal’s ruling. A good account of the appeal judgment is on the Pinsent Masons website. Pinsent Masons was acting for the Home Office.  The appeal judge found that the arbitration award had been tainted by legal irregularities that could have caused a substantial injustice. The judge took the unprecedented step of setting aside the arbitration award and ordered that the dispute be resolved by a new tribunal.

Raytheon appeal

Raytheon has announced that it is appealing. It points out that the arbitration had 42 days of oral hearings with testimony from multiple witnesses, and had issued a 276 page award decision. Raytheon says it is determined to recover the sums it is due because of the “wrongful” termination of the contract.

Comment:

It’s five years since Raytheon’s contract was cancelled. It could easily be another five years before all the rulings and appeals are finally over.

It’s easy in hindsight to say, but would it have been better if the Home Office and coalition ministers had spent longer negotiating with Raytheon rather than doing the macho thing of cancelling the contract?

Pinsent Masons – latest ruling

Raytheon contests Home Office’s High Court verdict over e-Borders
 

Whitehall has taken on 100 technology experts over past year

By Tony Collins

The Cabinet Office says that government departments have taken on more than  100 IT experts over the past year.

The Government Digital Service (GDS) led the recruitment as part of a plan to raise technology-related skills in the civil service.

One appointment is of former Credit Suisse CIO Magnus Falk as the Government’s new Deputy Chief Technology Officer, reporting to Government CTO Liam Maxwell. Other recent technology recruits include:

  • MOJ Chief Technology Officer Ian Sayer, who was Global Chief Information Officer at Electrolux; and
  • Government Chief Technical Architect Kevin Humphries, former Chief Technical Architect at Qatarlyst.

Chief Digital Officer appointments include:

  • HMRC Chief Digital and Information Officer Mark Dearnley, formerly CIO of Vodafone;
  • MOJ CDO Paul Shelter, who previously co-founded two start-ups and was CTO for banking at Oracle;
  • ONS’s Laura Dewis, Deputy Director Digital Publishing, who was Head of Online Commissioning at The Open University;
  • Jacqueline Steed, former Managing Director and CIO for BT Wholesale, who starts as CDO at the Student Loan Company next week; and
  • DWP CDO Kevin Cunnington, who was previously Global Head of Online at Vodafone.

Comment

It’s encouraging that the Cabinet Office, through the GDS, is overseeing the recruitment of IT leaders in government departments. It means the recruits will see their roles as cross-governmental. In the past the civil service culture has required that CIOs show an almost filial respect for their departmental seniors.

It’s a good idea that GDS tries to change age-old behaviours from within by recruiting technology experts with a wide range of experience from the private sector. But how long will they last?

Their challenge will be converting the words “transformation”, “innovation” and “fundamental change” from board papers, press releases, strategy documents, and conference speeches, into actions.

New deputy CTO role in central government – Government Computing

 

 

After two IT disasters, immigration officials launch £208m agile project

By Tony Collins

In 2001 immigration officials cancelled a £77m system with Siemens for a Casework Application system.

The objective had been to create a “paperless office”, help reduce a backlog of 66,000 asylum cases and provide a “single view” of individuals. But the scope was overambitious and the supplier underestimated the complexities. It proved difficult to automate paper-based processes.

In 2010 immigration officials came up with a similar scheme that also failed to meet expectations.  They developed a business case for a flagship IT programme called Immigration Case Work (ICW).

It was designed to draw together all casework interactions between the business and a person, enabling caseworkers to gain a single accurate view of the person applying. It was expected to replace both the legacy Casework Information Database (CID) and 20 different IT and some paper-based systems by March 2014.

A National Audit Office published today says the ICW programme was closed in
August 2013, having delivered “significantly less than planned for £347m.”

So in the end, while the taxpayer has paid hundreds of millions for caseworking systems for immigration staff, many of the workers are still, says the NAO, relying on paper.  Today’s NAO report says:

“Both directorates [UK Visas and Immigration and Immigration Enforcement, which were formerly the UK Border Agency] rely heavily on paper-based working.

“The Permanent Migration team is 100 per cent paper-based and acknowledge this as a barrier to efficiency.”

Immigration officials use some technology to record personal details of people who pass through the immigration system. But:

• A lack of controls mean staff can leave data fields blank or enter incorrect
information. The NAO found many errors in the database.
• There is a history of systems freezing and being unusable.
• A lack of interfaces with other systems results in manual data transfer or
cross‑referencing.

Agile success?

Now, says the NAO, the Home Office has begun a new agile-based programme, Immigration Platform Technologies  (IPT). It is due to cost £208.7 million by 2016-17.

A tool for online applications for some types of visa has already been rolled-out and is being updated using applicant feedback,” says the NAO.

But support contracts for the existing technology [the legacy Casework Information Database] expire in January 2016, before the scheduled completion of IPT in 2017.

The Home Office is “reviewing options for support contracts to cover this gap”.

Margaret Hodge, chairman of the Public Accounts Committee, says of the agile project: “Given its poor track record, I have little confidence that the further £209 million it is spending on another IT system will be money well spent.”

Comment

Is it possible for a genuinely agile project to cost £208m? The point about agile is that it is supposed to be incremental, quick and cheap.  It looks as if the Home Office is running a hybrid conventional/agile programme, as the DWP did with Universal Credit. Either a project is agile or its not. Hybrids, it seems, are not usually successful.

There again is the Home Office congenitally capable of running an agile project?  The Agile Manifesto is based on twelve principles, most of which could be said to be alien to the Home Office’s culture:

1.Customer satisfaction by rapid delivery of useful software
2.Welcome changing requirements, even late in development
3.Working software is delivered frequently (weeks rather than months)
4.Close, daily cooperation between business people and developers
5.Projects are built around motivated individuals, who should be trusted
6.Face-to-face conversation is the best form of communication (co-location)
7.Working software is the principal measure of progress
8.Sustainable development, able to maintain a constant pace
9.Continuous attention to technical excellence and good design
10.Simplicity—the art of maximizing the amount of work not done—is essential
11.Self-organizing teams
12.Regular adaptation to changing circumstances

So what’s needed?

Big government IT-based change programmes tend to be introspective and secretive. Those working on them don’t always feel able to challenge, to criticise, to propose doing things differently.

What would be innovative would be openness and independent challenge, and tough and well-informed Parliamentary scrutiny. It rarely happens. Ask the Home Office for any of its progress reports on its IT-base change programmes and it’ll tell you exactly what the DWP says when asked a similar question: “That’s not something we generally release.”

The NAO report points to a culture problem. “… Having a transparent culture was rated as red on the UK Visas and Immigration risk trends in April 2014.”

Will the new agile project be any more successful than the other 2 major immigration IT projects? The Home Office will doubtless claim success as it usually does. Even when the patient dies it tells Parliament the operation was a success.  For you can say publicly whatever you like when you keep the facts confidential – as IDS at the DWP knows.

Reforming the UK border and immigration system – National Audit Office report