Here’s a great article written by Charles Symon’s discussing current challenges in software project estimation and how different organizational cultures deal with them differently.http://nesma.org/2015/10/chaotic-and-controlled-software-project-estimating/. According to the author, in a study of 105 software projects completed between 1997 and 2007 in the UK public sector – 30% were terminated, 57% experienced cost overruns averaging 30.5% and 33% suffered major delays. (“Cost over-runs, delays and terminations: 105 outsourced public escort ICT projects – D. Whitfield). And this is only one study; any of us who live in the software world have heard more than our share of tales of woe related to software projects gone bad.
According the Symons, the reasons for these failures, going back at least 30 years generally fall into two categories:
The author splits the software world into two broad categorizations:
The focus of the paper is how the chaotic organizations can move into more controlled environments. All readers involved in delivering software projects already knows the answer… teach the chaotic organizations to follow the data. We all also know that is often easier said than done.
The author presents an example of Renault, an organization firmly in the controlled world (for more on Renault follow this link… http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7000066). The example revolves around their purchase of Electronic Control Units for the vehicles they produce. Not surprisingly, the average family car has approximately 50 of these units that control all of the electronics in the vehicle. Even less surprising, an important part of these units is the software that does much of the heavy lifting. A simplification of the process that Renault uses to successfully negotiate with the suppliers who develop and deliver the software for these units follows:
Clearly it’s a bit more complicated than that but the bottom line is that the first step on the path from Chaos to Control is to start collecting data.
To be fair, the author does acknowledge that an organization such as Renault is able to operate in the Controlled World because they are estimating projects where specifications are complete and requirements are well hashed out. Organizations in the Chaotic world tend to meet demise due to estimates that are performed very early on in the process, before requirements are firm when there is much uncertainty. He is also pretty quick to point out that maybe an estimate performed at this point in the project shouldn’t be the one to hang one’s hat on for all perpetuity.
Having said this, data collection can be an important first step on the path to control and in fact may facilitate a fairly impressive journey down that path. Symon’s cites a process that was developed 15 years ago by the Government of the State of Victoria in Australia. Though this process has seen widespread success locally (proponents claim cost overruns can be reduced to within 10%), it’s adoption has not been impressive. In a nut shell the process works as follows:
In other words the customer assumes the risk of adding or changing requirements while the supplier assumes the risk of bidding the ‘right’ unit price.
Bottom line – if you feel your organization’s practices are closer to chaotic than controlled – check out this article and see how well reasoned data collection can start you down the path to successful project estimation.