Software's dirty little secret
by Jason Bloomberg, Senior Analyst, ZapThink, LLC
Since the days of Bletchley Park's Colossus, the world's first programmable
computer, the creation of software has been separate from the production of the machines that run that software. For the first time, a machine was programmable instead of purpose-built. In other words, people did not determine the specific requirements for computers before they built them. Instead, programmers wrote software later to meet those requirements. No longer did hardware have purpose-built requirements; instead, people had the meta-requirement of programmability -- the requirement that they be flexible enough to meet as-yet undefined requirements at some point in the future.
Today, we use the term high technology to refer in part to programmable machines -- whether they be computers or any number of other devices with the computer chips that enable them to meet the meta-requirement of programmability. While computers are high tech, the surprising fact is that software itself is almost always low tech, because software is generally built for specific purposes. Programmers rarely, if ever, build software applications for the sort of general purpose uses that a computer is suitable for. We have done an extraordinary job of building computer chips that can run everything from weather forecasters to video games -- but the software itself is only good for one kind of activity or the other.
Software has been low-tech for so long that we're all used to it that way. After all, software production is still a craft-based enterprise, with experienced practitioners turning out custom software in small teams. Just as when cobblers produced shoes and seamstresses fashioned clothing, today's software is either entirely custom or appallingly ill-fitting. Custom software is enormously expensive, often requiring teams of developers, and only meets the particular needs of the moment. Meanwhile, commercial off-the-shelf (COTS) software is rarely flexible enough to meet all the needs of its users, requiring users to work within the constraints of the software, rather than the other way around. In any case, regardless of whether it's custom or COTS, today's software is of appallingly low quality -- and that's software's dirty little secret.
The challenge facing us today is whether new, Service-oriented (SO) approaches to software will help to resolve this quality issue. Clearly, there is no guarantee that implementing a Service-Oriented Architecture (SOA) will improve quality -- people can still implement SOAs poorly, after all. The real questions are first, whether SOA done right will raise the level of software quality overall, and second, what will it take to do SOA right?
Revisiting software quality
Bring up the word "quality" in a business context, and people think of one of two things -- either lowering the defect rate as approaches like Six Sigma and ISO 9001 advocate, or formalizing the manufacturing and development processes, as Total Quality Management espouses. Both approaches can apply to the production of software, as well as a wide range of manufactured goods. Developers and testers are the most familiar with the bug hunt and fix approach to software quality, and engineers and IT management within the enterprise often look to the Capability Maturity Model as the established approach to formalizing the processes of creating and managing software.
Revisiting software quality Bring up the word "quality" in a business context, and people think of one of two things -- either lowering the defect rate as approaches like Six Sigma and ISO 9001 advocate, or formalizing the manufacturing and development processes, as Total Quality Management espouses. Both approaches can apply to the production of software, as well as a wide range of manufactured goods. Developers and testers are the most familiar with the bug hunt and fix approach to software quality, and engineers and IT management within the enterprise often look to the Capability Maturity Model as the established approach to formalizing the processes of creating and managing software.
Here is the critical point: virtually all software created up to this point is fundamentally of low quality, since it's all built to meet pre-defined requirements, and those pre-defined requirements are rarely the true requirements for the software. The only way software quality will ever improve is for software to become high tech. The key insight here is that today's common understanding of what software quality means is lacking, because those definitions apply to purpose-built software. We must take a step back, so that we can judge software quality based upon its flexibility and agility, rather than how few defects it has, or how well-documented the process of creating it might be.
Will service orientation lead to higher software quality?
Business agility is the most fundamental benefit of SOA, where business agility means being able to meet as-yet undefined, changing business requirements, and leverage such change for competitive advantage. Business agility is thus the linchpin of high-tech software. Businesses require software that responds quickly and efficiently to a changing business environment, and SOAs promise this level of agility.
What is it about SO software approaches, then, that provide such business agility? What technology advances are we making today that are precursors of the vision of high-tech software? The vision of high-tech software paints a long-term goal, and the following achievements illustrate the progress we're already making:
ZapThink believes that Service Orientation is one of the key mechanisms for leaving the world of low-tech, low-quality software behind, and achieving the goals of high-tech software. Clearly, much work remains to be done, and SO alone does not guarantee quality. However, the trend toward high-tech software is apparent in the progress vendors and IT end-users are making today. ZapThink predicts that we will see a gradual decline in custom programming in the enterprise, as users become able to configure business applications to meet changing requirements. At the same time, companies will need fewer IT developers, as the software they purchase becomes more agile. After all, software vendors should be the companies that produce the software, while enterprises in other lines of business should concentrate on what they do best instead.
Finally, ZapThink predicts the end of craft software, as standards mature and vendors learn how to build high-tech software. Software production will achieve benefits analogous to those that mass production achieved -- consistent quality at substantially lower cost, leading to a new era of software quality. As the industry matures and becomes high-tech, software will no longer be judged on how well it can meet today's requirements, but rather how flexibly it can meet tomorrow's challenges. Will Service Orientation solve the software industry's "dirty little secret" of appalling quality? Only time will tell, of course. There's no question, however, that if vendors become able to deliver software that can truly meet as-yet undefined business requirements, then enterprises will demand such software.
Copyright 2004. Originally published by ZapThink LLC, reprinted with permission. ZapThink LLC provides quality, high-value, focused research, analysis, and insight on emerging technologies that will have a high impact on the way business will be run in the future. To register for a free e-mail subscription to ZapFlash, click here.
For more information:
- Looking for free research? Browse our comprehensive White Papers section by topic, author or keyword.
- Are you tired of technospeak? The Web services Advisor column uses plain talk and avoids the hype.
- For insightful opinion and commentary from today's industry leaders, read our Guest Commentary columns.
- Hey Codeheads! Start benefiting from these time-saving XML Developer Tips and .NET Developer Tips.
- Visit our huge Best Web Links for Web services collection for the freshest editor-selected resources.
- Visit Ask the Experts for answers to your Web services, SOAP, WSDL, XML, .NET, Java and EAI questions.
- Couldn't attend one of our Webcasts? Don't miss out. Visit our archive to watch at your own convenience.
- Choking on the alphabet soup of industry acronyms? Visit our helpful Glossary for the latest lingo.
- Discuss this article, voice your opinion or talk with your peers in the SearchWebServices Discussion Forums.
This was first published in September 2004