Category Archives: Agile

NAO hopes Universal Credit will cut fraud and error

By Tony Collins

Amyas Morse, the head of the National Audit Office, has again qualified the accounts of the Department for Work and Pensions because of the high level of fraud and error in benefit spending.

The DWP’s accounts have been qualified every year since 1988-89. Morse hopes that Universal Credit will make a positive difference. In a report published today he says that new procedures and systems to verify identity and check entitlement  before payments are made, should mark an opportunity to eliminate some  of the key factors contributing to fraud and error.

But Margaret Hodge MP, Chair of the Committee of Public Accounts, said today the introduction of Universal Credit is full of risks which are compounded by the DWP’s secrecy over the scheme’s progress.

She said:

“The Department has the biggest budget in Whitehall and its inability, 24 years in a row, to administer its spending properly is just unacceptable.

“With fraud and error of £4.5bn in 2011-12, roughly the same as in previous years, huge sums of money are being lost to the public purse that could have been spent on our schools and hospitals. Government spending is at its tightest for over 50 years and it simply can’t afford to carry on like this.

“The Department is relying on the introduction of Universal Credit to get its house in order but the transition to Universal Credit is full of risks and the Department won’t even tell us if it is on schedule.

“The Department has got to get a grip on fraud and error now. Despite its assurances to my Committee, it has not done so and it must do better.”

 Complex benefit system

Morse says it is difficult for the DWP to administer a complex benefits system to a high degree of accuracy in a cost effective way.

“Some benefits, mainly those with means-tested entitlement, are more inherently susceptible to fraud and error due to their complexity, the difficulties in obtaining reliable information to support the claim and the problem of capturing changes in a customer’s circumstances.”

Claimants have to notify the DWP of changes in their personal circumstances.  “The Department has adopted this approach because it does not have routine access to verifiable third party sources of information, or the information may not exist that would allow them to track such changes…

” The complex administration of benefits also allows potential fraudsters the opportunity to present themselves differently to different administering agencies, which are not always sufficiently integrated to identify those instances.

“Because the Department does not have a readily available source of external information against which to verify some aspects of claims, such misrepresentations can result in fraud occurring.”

Errors commonly arise from poor or non-timely exchange of information between the Department and councils over whether a customer is in receipt of, or entitled to, a benefit.

“In practice, given the lack of direct integration between the Department’s systems and those of all local authorities, such errors will be difficult to eliminate.”

That said, the DWP has continued implementing Automated Transfers to Local Authority Systems (ATLAS), an IT development that automatically informs local authorities of new awards or changes in benefits.

From February 2012 councils have received details of changes in benefits administered by the DWP on a daily basis.

How many organisations are failing to deliver on their Agile developments?

By David Bicknell

How many organisations are struggling to see real value and business benefits from their Agile IT projects?

This blog, looking back at some of the predictions for Agile in 2012, argues that a number of organisations that have adopted Agile have an inability to understand its why and how, while others are inadaquately prepared for adoption, resulting in a failure to address management impact across teams and engineering practices in teams.

The piece cites the Cutter Consortium blog which, in looking ahead to 2012, argued that “many organisations worldwide will continue to adopt Agile. Most of them will do so with no expert guidance, with ho-hum results, and with little understanding of why they got those results.

It suggestted that, “People will continue to get their Agile skills certified while others rail against the value and implication of those certificates. Companies will still rely on head hunters to hire Agile coaches, and wonder why those coaches can’t seem to straighten out their Agile implementation.

“Organisations will continue to agonise over micro-estimation of detailed backlogs. They will continue to spend a pretty penny on “adding bodies” to projects riddled with technical debt, while not investing in the skills and habits their developers need to reduce or avoid increasing such debt. Managers will continue to use language like, “We just hired a resource in development” without investing proper attention in the hired person. And downsizings will continue until morale improves.”

Another blog predicted that, “Everyone will claim they are Agile, but that 50% of them will be wrong, and half of the rest won’t get any value from it. There are too many bad development practices at organisations that have too few people, with too little coaching, and hardly any tooling.”

Meanwhile, this survey suggests that Agile development has a higher priority in the private sector (in the US) than in the public sector.

So what is the true picture for Agile? Is it delivering project success, as JP Morgan and John Deere, have found? Or are some organisations adopting Agile almost as a fashion accessory, without really understanding where they’re going?

Related reading

Agile skills gain ground

JP Morgan adopts Agile in Australia

As Agile as a John Deere tractor

How do you create successful software development teams? (Part 2: Outsourcing)

By David Bicknell

I recently reported on a roundtable organised by the Dutch software specialist Software Improvement Group (SIG) which set out to determine what makes successful teams in software development.

The roundtable featured two specialists in creating specialist teams: Andrew de la Haye, chief operating officer, at RIPE Network Co-ordination Centre (RIPE NCC), one of five Regional Internet Registries (RIRs) providing Internet resource allocations, registration services and coordination activities that support the operation of the Internet globally; and author and management expert Kevan Hall, chief executive of Global Integration.

In Part One of the discussion, which focused on creating excellent teams in software development, we examined teamwork, Agile empowerment, a commitment to quality, remote working and getting the right level of teamwork.

In this part of the discussion, we focused on managing multi-disciplinary teams, structure, reducing waste, and outsourcing.

Managing multi-disciplinary teams

Kevan Hall pointed out that when you’re working in a multi-disciplinary environment – for example, if you’re building a very complex piece of kit with tens of thousands of bits – there is a point at which you need to have some co-ordination.

But he added, “There is also a big part of the work where I’m an engineer off doing actual work or I’m somewhere writing code. And that’s not teamwork.  If we have this mentality that everything we do is a team, then we can’t make a decision until the next meeting. I distinguish between a team, which is kind of truly interdependent i.e. if you’ve got multi-disciplinary skills, R&D etc,  you really need to work collaboratively, tightly, and you can’t do it on your own, you need teamwork. But most work isn’t like that: most work is me doing my stuff.

“And therefore a simple hub and spoke group of organisations might be much simpler to do that. When you’re working globally, or virtually, that’s much, much easier because in a hub and spoke structure, if I want to talk to you, I just pick up the phone.  If I’m in a team, I have to go into all your Outlook diaries and hope that in the next month, you’ve got some time where we can at least all get on the phone.

“So hub and spoke is much simpler for virtual teams and for remoteness and those kind of things. So when we are  working collaboratively that’s when we really need to focus because it’s really expensive and quite hard to do.”

Waste reduction and communication

Andrew de la Haye from RIPE explained the need for what he describes as ‘waste reduction.’

“One of the things we do as standard culture in our software teams is every three to four months we do waste reduction sessions. So in the old methodology, you do retrospectives. You start a sprint – a sprint is two weeks – you deliver to the business, and after that, the team sits together and then they discuss what went well and what should be improved in the next sprint. And as a larger group in the whole department, we get them together once every four months for an hour or two at the most and we say, ‘OK. Where is waste? Where do we see waste?”

“And most of the time it is not coding or the real work they do, most of the time it is in the communications area.  And we try to get rid of it. So we changed the team from 2 x 6 to 3 x 4 people. It’s just part of our being to look at the waste we created after the last period and where can we improve. And they became  much more efficient and effective.”

According to Kevan Hall, one of the things you often see with teams is the ‘community decay curve’.

“When you have a team, virtual or not, you have a kick off and everyone’s very enthusiastic. And then you start doing the work, and it’s quite hard. And then you come to the end of something and you’ve succeeded and you have a celebration. Successful virtual teams create a rhythm. For our teams, it’s a year. You have a long old slog and there is a ‘periodicity’ of communication. A software team is perfect because you have a closure, a learning opportunity, a celebration and then you go and do it again. If it’s longer than that, then you have to think about other things that are going to have an impact, like a conference call or a coaching call.

“Even worse, if you’re managing a remote organisation or a remote supplier, the risk is that you only call them when you need something or you’ve got a problem. So they don’t really look forward to your next call. ‘Oh, no. Look who’s on the phone.’ You demotivate people just by your number coming up. It’s about keeping that rhythm. It’s a bit like an ECG. You’ve got to create those peaks to keep motivation high.

“Social media has a very powerful role to play in virtual teams, because it’s much easier to share the other things that I’m doing rather than just project updates. I also like Instant Messenger because if you have people in Asia you can see that they’re ‘on’ and to me it’s just like passing someone in the corridor. It’s the virtual coffee machine. Occasionally, people will see say, ‘If you’re there, can we have a quick call?’ And it’s another part of the rhythm for me – like keeping the heartbeat going.”

Outsourcing

“I used to sell a lot of outsourcing,” said Andrew de la Haye. “But I haven’t seen it really working (teamwise). One of the issues with outsourcing is the commitment bit, which is very important in my teams. My people are committed to me because they know me, and they know what the company stands for. If you outsource to somebody, who are they committed to? You hope that they are committed to the organisation they’re working for, but they’re certainly not committed to you. And they are probably more committed to themselves, especially in India because people move around like crazy.

“So one of the issues with outsourcing is the lack of commitment, I think. I don’t see a solution to that. There are two ways of outsourcing: outsourcing commodity items, where there is a new version of SAP and people need to upgrade. That kind of stuff. That’s good enough – it will work fine. But if you truly need to build applications and you need to work together with a company to create business value, and that’s what a lot of outsourcing is about as well, I haven’t seen it working.

“I tried it again last year, and I gave a company a chance. I had a really good relationship with this consulting firm and they told me that they had an excellent team in India, and ‘Let’s try this project just for a three-month trial.’ And it was more or less the only project in the last five years that went belly-up.”

As Kevan Hall pointed out, when you’re managing across distance, culture, time zones, working through technology, and commercial considerations, outsourcing is so much more complex.

“One of the things we see a lot with clients who have outsourced is what I call the balance of trust and control. Because I don’t know you and I don’t trust you, I tend to control you. And so we go out to India and we have these incredibly heavy processes which we beat you up to make sure you follow without any sense of initiative or change, and then you start complaining that the Indians don’t have any initiative and don’t innovate.

“Well, you’ve told them not to and they’ve very smart people, albeit with higher turnover, and then you’re finding that problem of ‘how do we build trust?’ So many organisations outsource processes and spend an enormous amount of time on process, but they don’t have the travel budget to even go and meet the people who are doing a service for them.

“So how are you ever going to build a relationship? You wouldn’t do it in your own business. So doing it in an even more complex environment…how’s that going to work?”

“You have to look at the type of activity being outsourced,” said Dr Joost Visser, SIG’s Head of Research . “There is a lot of success in outsourcing in all sort of activities. In software application development where you are trying to create business value and where people are being creative, like in the automotive industry, thinking of the next engine or concept car, I think that by basically taking the team you need and pulling it out over locations and over time zones, you’re creating a challenge for the teamwork you need for that activity.”

There is another factor: the customer, suggested Kevan Hall.

“If you decided that you’re going to bring your development team into one place and therefore take away one barrier to complexity, which is distance, which makes a lot of sense, then aren’t you just exporting that level of complexity to the customer? Because they still have to manage with the fact that they still have stakeholders spread around the world in different time zones and different cultures. And they’ve got complex needs. It’s OK for you now. But is that the right thing to do for the customer?

“Human Resources has done that. They’ve gone to specialist centres and business partners. And all that’s done is that the business partner has to manage all the complexity rather than the organisation.”

How do you create successful software development teams? (Part 1)

CIO behind FBI’s Agile-developed Sentinel IT project to leave his post

By David Bicknell

The US CIO behind one of the world’s highest profile public sector Agile IT projects is to leave his post and return to the private sector.

Chad Fulgham, CIO at the FBI will leave next month having overseen the creation of the FBI’s Sentinel case management system. Sentinel replaces the FBI’s outdated Automated Case Support system, with the hope that it will transform the way the FBI does business by moving it from a primarily paper-based case management system to an electronic work flow-based management system of record with enhanced data sharing capabilities.

“When I was hired as the CIO, it was understood Sentinel was going to be one of my top priorities,” said Fulgham. “Today, I can tell you the software coding is done, the new hardware is in place, and it has been quite impressive during initial performance testing. We have trained hundreds of FBI special agents and employees, and it will have a lasting impact on this organisation.”

In a press release announcing Fulgham’s departure, the FBI said that “using a progressive Agile software development methodology, partnering with industry, and employing an aggressive deployment schedule, Sentinel is scheduled to be implemented in summer of 2012.”

The US Inspector General recently issued a report into the use of Agile in the Sentinel project. You can read the report here

The US magazine Information Week has also covered the story

Lifting the lid on Agile within a public sector IT project

Universal Credit: who’ll be responsible if it goes wrong?

By Tony Collins

When asked whether Universal Credit will work, be on budget and on time, Ian Watmore, Permanent Secretary, Cabinet Office, gave a deft reply. He told Conservative MP Charlie Elphicke on 13 March 2012:

“From where I sit today, I think all the signs are very positive. I am never going to predict that something is going to be on time and on budget until it is.”

If the plans do not fall into place who, if anyone, will be responsible? In theory it’ll be Iain Duncan Smith, the Secretary of State for Work and Pensions. But as Watmore told the Public Administration Committee, there are several other organisations involved. Although the DWP and HMRC are building the IT systems, the success of Universal Credit also relies on local authorities, which are overseen by the Department for Communities and Local Government.

There are also the Cabinet Office and the Treasury whose officials seek to “ensure that what is going on is appropriate” said Watmore.

If Univeral Credit goes awry all the departments may be able to blame the private sector: the employers that must pass PAYE information to HMRC so that the Revenue’s Real-Time Information element of Universal Credit can work.

David Gauke is the minister responsible for HMRC so would he take some of the blame if Real-Time Information didn’t work, or was not on budget, or was delayed?

Or would the main IT suppliers Accenture and IBM take any of the blame? Highly unlikely, whatever the circumstances.

There is also a dependency on the banks.

But nothing is wrong … is it?

All those putatively responsible for Universal Credit continue to say that all is going well.

Duncan Smith told the House of Commons on 5 March 2012:

“We are making good progress towards the delivery of universal credit in 2013, and I have fortnightly progress meetings with officials and weekly reports from my office. I also chair the universal credit senior sponsorship group, which brings together all Government Departments and agencies that are relevant to the delivery of universal credit.

“Design work is well under way and is being continually tested with staff and claimants, and the development of the necessary IT systems will continue in parallel.”

He said that universal credit will reduce complexity by putting together all the benefits that are relevant to people going back to work – though benefit systems that are not relevant to the coalition’s “Work programme” will not be included in the DWP’s Universal Credit IT consolidation.

To reduce risks Universal Credit will be phased in over four years from October 2013, each stage bringing in a different group of claimants.

But …

Campaign4Change has asked the DWP to publish its various reports on the progress of Universal Credit and it has refused, even under the Freedom of Information Act. It seems the DWP’s secretiveness is partly because all of the risks related to Universal Credit have not been mitigated. We will report more on this in the next few days.

Meanwhile to try and answer the question in our headline: who’ll be responsible if Universal Credit goes wrong? The answer is: the private sector probably. Or rather nobody in the public sector.

Can hundreds of millions be spent on Universal Credit in an agile way?

Universal Credit suppliers Accenture and IBM look to India for skills.

Is Universal Credit a brilliant idea that’s bound to fail?

Universal Credit latest

Universal Credit and the banks.

New child support system has 90,000 requirements – in phase one

                               A new old-style government IT disaster?

By Tony Collins

While officials in the Cabinet Office offcials try to simplify and cut costs of Government IT, a part of the Department for Work and Pensions has commissioned a system with 90,000 requirements in phase one.

The projected costs of the child maintenance system have risen by 85% and the delivery date has slipped by more than two years.

Even with 90,000 requirements, phase one, which is due to go live in October, excludes 70 requirements that are “deemed critical” says a report published today by the National Audit Office.

The NAO report indicates that the Child Maintenance and Enforcement Commission has commissioned an old-style large IT system using traditional developing techniques and relying on large companies.

G-Cloud and SMEs have not featured in the Commission’s IT strategy – and it abandoned agile techniques last year on its child maintenance project.

The Commission put the cost of its new child maintenance system at £149m in January 2011. Ten months later it put the cost at £275m, an 85% increase. The Commission was unable to give the NAO a full explanation for the difference.

Lessons from past failures not learned?

Today’s NAO report says there is a risk the Commission will repeat mistakes by the Child Support Agency whose IT system and business processes were criticised in several Parliamentary reports. The Commission takes in the work of the Child Support Agency – and indeed runs its own systems and the Child Support Agency’s in parallel.

Officials at the Commission told the NAO they have a good track record of holding back IT releases until they are satisfied they will work.  “Nevertheless, we found that the Commission is at risk of repeating many of the mistakes of 2003,” said the NAO. Those mistakes include over-optimism and a lack of internal expertise to handle suppliers.

Mixing “agile” and “waterfall” doesn’t work

Initially civil servants at the Commission tried to “mix and match” agile and traditional developing techniques – which Agile advocates say should not be attempted.

In 2011 the Commission gave up on agile and “reverted to a more traditional approach to system development” says the NAO report.

The mix and match approach meant there were two distinct routes for specifying requirements and “resulted in duplicated, conflicting and ambiguous specifications”.  The Commission did not have previous experience of using the agile approach.

The Commission’s child maintenance system was due to go live in April 2010 but the delivery date has slipped three times. Phase one is now due to go live in October 2012 and phase two in July next year but the NAO report raises questions about whether the go-lives will happen successfully. The Commission has not planned in its financial estimates for the failure of the system.

The NAO finds that the Commission has struggled to make its requirements for the new system clear. The Commission’s main developer Tata Consulting Services has had protracted discussions over the meaning and implementation of requirements.

The NAO also hints that IT costs may be out of control. It says the Commission may not secure value for money without properly considering alternative options for restructuring and “adequately controlling its IT development …”

These are some of the NAO’s findings:

IT costs could increase further

“The new system is based on ‘commercial off-the-shelf’ products. However, a recent audit by Oracle identified that the performance, maintainability and adaptability of the new system would be key risks. This could increase the cost of supporting the system. The scheme does not yet include plans for the integration with HM Revenue & Customs’ Real Time Information system due to be implemented in 2013, or introducing Universal Credit because of the differing timescales,” says the NAO which adds:

“Achieving the Commission’s plans without further cost increases or delays appears unlikely. The Commission reported to the audit committee in October 2011 on the high risk that the change programme may not deliver phase two functionality within agreed timescales … The Commission did not develop a benefits realisation plan until November 2011.”

103,000 of Commission’s 1.1m cases are handled manually

“Ongoing technical problems have resulted in a large number of cases being removed from the IT system and managed manually. These are known as clerical cases … The Commission has had to operate the ‘old’ and ‘current’ schemes in parallel.  Due to flaws in the IT systems for each scheme, some 100,000 cases have had to be processe:d separately by clerical staff at a cost of £48 million,” says the NAO. It takes 900 contractors to manage the clerical cases.

Comment

Despite numerous NAO reports on failures of Government IT-based projects over the past 30 years the disasters are still happening, with the same mistakes repeated: over-optimism in every aspect of the project including timetables and financial estimates; excessive complexity and over-specification, no sign of cost-consciousness and, worst of all, an apparent indifference to being held accountable for a major failure.

A glance at the monthly outgoings of the Commission (well done to the coalition for requiring departments and agencies to publish contracts over £25,000) show sizeable and regular payments to familiar names among the large suppliers: HP Enterprise Services (formerly EDS), Capgemini, Tata Consultancy Services, BT Global Services and Capita. There is hardly an SME in sight and no sign of imaginative thinking.

Meanwhile some senior officials at the Commission put in monthly expenses for thousands of pounds in travel, accomodation and subsistence for “Commission meetings”. One wonders: to what useful effect?

Officials at the Cabinet Office are trying to change the culture of departments and agencies. They are encouraging departmental heads to do things differently. They advocate the use of  SMEs to show how new ways of working can trounce traditional approaches to projects.

But the Cabinet Office has little influence on the Department of Work and Pensions. Indeed the DWP has lost its impressive chief innovator James Gardner.

We praise the NAO for noting that the Commission risks repeating the IT-related and project management mistakes of the Child Support Agency. But we note with concern that the NAO still puts up with Whitehall’s non-publication of  Gateway reviews, which are independent reports on the progress or otherwise of big and risky IT-based projects.

Would the Commission have been so apparently careless of the risks if it had known that regular Gateway reports on its shortcomings would be published?

How many more government IT-based projects are late, over budget and at risk of failing, their weaknesses hidden by an unwritten agreement between the coalition and civil servants to keep Gateway reviews secret?

NAO report – Child Maintenance and Enforcement Commission: cost reduction

Government repeating child support mistakes – ComputerworldUK

Why effective project management should focus on people, not just processes

By David Bicknell

I recently read an interesting post in the Gallup Management Journal which argued that when it comes to project management, most organisations put their practices before their people.

In other words, they place more emphasis on ‘rational’ factors, such as the process itself, and rather less on emotional drivers that could actually deliver project excellence – actually, just a project success would do! – such as their employees’ engagement with the project and company.

The piece, by Benoit Hardy-Vallee, points out that, “Project management is integral to the business world. Milestones, kickoff meetings, deliverables, stakeholders, Gantt charts, and work plans constitute the everyday world of most managers, whether they are called “project managers” or not. Given the vast experience organisations have with project management, it’s reasonable to wonder why all projects aren’t completed on time, on scope, and under budget.”

It argues that cost and time overruns on IT projects have had a profound effect on national economies, and suggests that one estimate of the IT project failure rate is between 5% and 15%, which represents a loss of $50 billion to $150 billion per year in the United States. In Europe, although the figures look pretty dated, they are still staggering in size: IT project failures  cost the European Union €142 billion in 2004.

What’s more, the piece argues, this trend is here to stay. With an ever-growing need for accessible and integrated data, organisations require larger platforms to manage supply chains, customer relationships, and dozens of other crucial systems.

“Mega-software projects are now common in private and governmental organisations, and development is not slowing down, especially in emerging economies.”

The blog argues that large projects, especially those in the IT sectors, already have a poor record. And forcing team members to adapt to project management processes and procedures only makes it more likely that the project will fail.

It goes on to suggest that a different, more powerful behaviour-based project management might be a better way of  enabling project groups to gain higher levels of emotional commitment and performance from their team members, as well as increased levels of emotional involvement from stakeholders to help improve both engagement and performance.

“A typical project management approach focuses on processes, policies, and procedures. Every task and step is described in detail by a set of rules.  Many companies implement rigid processes that dictate behaviour and use statistical methods to control quality (such as total quality management, kaizen, lean management, and Six Sigma). Process guides and rulebooks support work practices, while quality control systems assess and improve these practices.

“The problem with a single-minded focus on processes and methodologies is that once people are given procedures to follow, compliance replaces results. Everybody is concerned about how to do the job, not about the outcome if the job is done well.

“Companies that take this approach do so for valid reasons: They can’t manage what they don’t measure. More importantly, they can’t let projects run without any direction, hoping for the best. However, by relying on managing only these rational factors, organisations fail to harness the power of human nature by engaging employees’ emotions.”

The article concludes: “It’s time to update project management not with more methodologies, but with more emotional content. Employees’ and stakeholders’ disengagement can make a project fail, but behaviour-based management can make projects succeed.”

Gallup Management Journal

Bridging the divide: an engineered approach to IT projects

The State Auditor in California recently criticised a planned high speed rail system between San Francisco and Los Angeles because the project suffered from critical, on-going oversight problems. In this guest blog, Bob Evans, founder and Managing Director of TestIT Software Assurance, explains why it is critical to have a ‘single source of truth’ for any IT development, to provide the required level of cohesion, discipline, control and transparency that should be expected from any engineering project.

The risks associated with developing or changing IT systems are well documented. IT failures always bring despair and reputational damage to all involved.

Do you remember the scene in Blackadder where General Melchett suggested that walking slowly (again) towards the German machine guns would be “the last thing they’d expect” – and so “that’s what we’re going to do”? This seems to be the attitude found in many IT procurements. What’s needed is a fresh, radical and innovative approach, especially in these changed times where senior management focus is on delivery and cost.

Keeping Control

Establishing and maintaining control of an outsourced project is the single, most important part of IT development; it is imperative for the purchaser to remain in full control at all times. In all of the failure scenarios that we have researched, it is obvious in every case that control has been lost, with always calamitous consequences.

The nature of the procurement process and inevitable time pressure means that the requirements of a new software system aren’t always well-defined at project inception. Typically, specifications are incomplete or ambiguous and put together from a range of disparate sources, with non-existent internal process and control. The “silo” attitude that is often encountered across departmental organisations is usually a key factor here.  Requirements that are not made clear at the start of the project will inevitably lead to confusion, delays, additional cost and even to dispute.

And if a contract is awarded on the basis of a flawed specification, the chosen vendor is in a strong position to justify delays and ramp up the costs. When planned schedules are missed and costs spiral out of control, well intended remedial actions can then create new, unforeseen problems, leading to even more rework.

The culture of care and diligence found in many traditional engineering environments is sometimes lacking in the IT industry and in our experience, engineering discipline is usually the first casualty when pressure is applied. Very quickly, the focus shifts to fire-fighting and a project loses sight of its objectives. It’s like building a bridge – but when halfway across, only fitting every other bolt.

 Contrived Tests

It’s no surprise that applications that have seemingly passed an Acceptance Test, when deployed on a live system, prove to be problematic. Validating the effectiveness of an IT system is typically a contrived process – put simply, tests are designed to pass! They would be – they are usually designed, controlled and often even run by the software vendor.

If you were buying a used car from a local garage, you’d get the RAC to come along and check out the mechanics. You wouldn’t even think of asking the mechanic who worked at that garage to do the inspection would you? But invariably this is the case in IT.

As discussed above, it is imperative that full control of the project remains with the purchaser. But without, continual up to date feedback and independent metrics, it’s hard to know what’s really going on. And the critical decision – when to go live – cannot be made with confidence.

Agile Development

The concept of Agile Development has been round for many years. However, it is still to be seen whether this approach can really work on a large, complex project. A properly managed set of sprints – with precise objectives, proper controls and diligent, independent validation at appropriate times may indeed lead to a more rapid and successful conclusion. However, it should be noted that as development continues, the needs of the business will necessarily change. If controls are not adequately maintained, no process – not even “Agile” ones – can keep up. What is delivered is what the vendor believes is required, rather than what is actually required by the business. And no matter what methodology is used for developing software, at the end of the development cycle it is essential to verify, independently and thoroughly, that the product meets the needs of the business.

The Agile Manifesto focuses on “working software over comprehensive documentation”. Documentation is of course often cumbersome. However, minimising the amount of information while maximising the value of the information is what’s really needed.

When it’s too late – and organisations end up mired in a legal dispute, we’ve been called in to play the part of the pathologist. It is soon apparent that the project was doomed from the start – no spec, no metrics, no control, no hope. Suppliers who didn’t listen, purchasers who didn’t actually know what they needed in the first place.

But there is another way. The Maritime and Coastguard Agency recently used independent software assurance to ensure success of its high-profile CERS/SVD project. There was an acknowledgement right from the start that requirements were bound to change and controls put in place to manage this. There were efficient, timely tests – not at the project end, but continuous tests, right from project inception. There was an approach that asked:  “What can we do given the available time and budget?”, rather than the popular “one-shot, whistle and bells” approach. And there was pro-active searching for and identifying issues early on – when the supplier was still on site – which meant that remedial actions were fixed by the supplier, at no additional cost to the project. Independent, constantly updated metrics also meant that the Maritime and Coastguard Agency stayed in complete control.

It isn’t rocket science. But for IT projects, the discipline driven by an engineering-based approach is generally more likely to lead to success. That’s why bridges get built – and IT projects often don’t. 

TestIT Software Assurance

As Agile as a John Deere tractor

By David Bicknell

Thanks to Rally Software’s Agile Blog for a pointer to a Computerworld post about the use of Agile development at the tractor maker John Deere & Co.

It seems that John Deere has moved 800 software developers into an Agile development process  in around a year.

This involved recreating the company’s software development effort around new teams that included developers, systems engineers, customer support and marketing personnel, testers, all working closely together.

It is ironic that although  John Deere’s software development work is incremental through an Agile approach that is designed to deliver speed, innovation, quality, customer focus and teamwork,  the company’s actual move to adopt Agile as a development philosophy was more of a Big Bang approach than an incremental one, and was partly designed to overcome any resistance.

DWP defends £316m HP contract

By Tony Collins

The Department for Work and Pensions could lead the public sector in technical innovations. It has had some success in cutting its IT-related costs. It has also had some success so far with Universal Credit, which is based on agile principles.

It has further launched an imaginative welfare-to-work scheme , the so-called Work Programme, which seeks to get benefit claimants into jobs they keep.

Despite media criticism of the way the scheme has been set up – especially in the FT – a report by the NAO this week made it clear that the DWP has, for the most part, taken on risks that officials understand.

Some central government departments have updated business cases as they went through a major business-change programme and not submitted the final case until years into the scheme, as in parts of the NPfIT.

But the DWP has implemented the Work Programme unusually quickly, in a little more than a year, by taking sensible risks.  The NAO report on the scheme said the business case and essential justification for the Work Programme were drawn up after key decisions had already been made. But the NAO also picked out some innovations:

– some of the Work Programme is being done manually rather than rush the IT

– suppliers get paid by results, when they secure jobs that would not have occurred without their intervention. And suppliers get more money if the former claimant stays in the job.

– the scheme is cost-justified in part on the wider non-DWP societal benefits of getting the long-term unemployed into jobs such as reduced crime and improved health.

So the DWP is not frightened of innovation. But while Universal Credit and welfare-to-work scheme are centre stage, the DWP is, behind the safety curtain, awarding big old-style contracts to the same suppliers that have monopolised government IT for decades.

Rather than lead by example and change internal ways of working – and thus take Bunyan’s steep and cragged paths – the DWP is taking the easy road.

It is making sure that HP, AccentureIBM and CapGemini are safe in its hands. Indeed the DWP this week announced a £316m desktop deal with HP.  EDS, which HP acquired in 2008, has been a main DWP supplier for decades.

DWP responds to questions on £316m HP deal 

I put it to the DWP that the £316m HP deal was olde worlde, a big contract from a former era. These were its responses. Thank you to DWP press officer Sandra Roach who obtained the following responses from officials. A DWP spokesperson said:

“This new contract will deliver considerable financial savings and a range of modern technologies to support DWP’s strategic objectives and major initiatives such as Universal Credit.

“The DWP has nearly 100,000 staff, processing benefits and pensions, delivering services to 22 million people.

“DWP is on schedule to make savings of over £100m in this financial year for it’s Baseline IT operational costs, including the main IT contracts with BT and HPES [Hewlett Packard Enterprise Services].

“All contracts have benchmarking clauses to ensure best value for money in the marketplace.

“The five year contract was awarded through the Government Procurement framework and has been scrutinised to ensure value for money.”

My questions and the DWP’s answers:

Why has the DWP awarded HP a £316m contract when the coalition has a presumption against awarding contracts larger than £100m?

DWP spokesperson: “The Government IT Strategy says (page 10) ‘Where possible the Government will move away from large and expensive ICT projects, with a presumption that no project will be greater than £100m. Moving to smaller and more manageable projects will improve project delivery timelines and reduce the risk of project failure’.

“HM Treasury, Cabinet Office and DWP’s commercial and finance teams have scrutinised the DWP Desktop Service contract to ensure that it represents the most economically advantageous proposition.”

What is the role, if any for SMEs ?

DWP: “There are a number of SMEs whose products or services will form part of or contribute to the DWP Desktop Service being delivered by HP, for example ActivIdentity, Anixter, AppSense, Azlan, Click Stream, Cortado, Juniper Networks, Quest Software, Repliweb Inc, Scientific Computers Limited (SCL), Westcon etc.”

Why is there no mention of G-Cloud?

DWP: “Both the new contract and the new technical solution are constructed in such a way as to support full or partial moves to cloud services at DWP’s discretion.”

Comment:

For the bulk of its IT the DWP is trapped by a legacy of complexity. It is arguably too welcoming of the safety and emollients offered by its big suppliers.

The department is not frightened by risk – hence the innovative Work Programme which the NAO is to be commended on for monitoring at an early stage of the scheme. So if the DWP is willing to take on sensible risks, why does it continue to bathe its major IT suppliers in soothingly-large payments, a tradition that dates back decades? What about G-Cloud?

DWP reappoints HP on £316m desktop deal

DWP signs fifth large deal with HP

“DWP awards Accenture seven year application services deal”

“DWP awards IT deals to IBM and Capgemini”