Software as a service

So, a recent article came out from Ray Lane of Kliener Perkins on "The Coming Service Revolution", and brought to mind a couple of thoughts.

As with many 'paradigm shifts', the service revolution is one that has been going on for some time and will continue to proceed, perhaps at an accelerated rate compared to historicals. Being of the mind that 'the cup is both half full and half empty', I tend to view these as additional modes of operation rather than replacement modes.

Let me explain what I mean. It is very rare that a particular way of doing business or selling things or system architecutre or you name it, is exclusively the way. What you generally find is many different models are required to fit into the many different models of doing business and living life. Sure, for the software-as-service market to grow faster, it will need to displace the software-as-license model as the market itself continues to grow. Additionally, new capabilities and ways of doing business will be born because of this new model--things we could only concieve of previously may now become feasible whether due to cost model changes, or simply the fact that the network is there and available in a 24/7 connected/dicsonnected, wired/wireless way. But does this fundamentally shift all software away from a license model?

My hypothesis is that there are some things that are better as a service and some things that are not so appropriate. This may be naive and old fashioned and you may claim that I'm not thinking far enough ahead and I'm missing the point. TBD.

It would also be interesting to find out how much software-as-service software and technology companies use. Those on the leading edge of pushing this modus operandi -- are they embracing it themselves? Are they using Salesforce.com -- are they using, for example, Sun's $1/cpu-hr and $1/GB-mo service? Are they chosing to use a platform like GrandCentral's to create business interactions?

My guess is yes, but for specific things and as a portion of overall spending. To what extent this ratio changes is indeed the bigger question.

I also like the model that Sun has for licensing -- $50/Employee/Year With Infinite Right-to-Use -- I can buy into that model as being more likely to replace 'one-time with 18% support fees and required upgrade cycles' model.

So, going forward, I see a healthy mix of the software-as-service and the rent-a-license models gradually replacing the one-time software license model. This will be augmented and supported by the use and adoption of open source licensing which will become the backbone and the infrastructure for many operations in the future. People will still pay for the service, support, expertise and differentiation that they require.

Kipp

TAG and the world

Somewhat off my normal topic, I recently attended a Technology Association of Georgia event (Georgia Technology Summit – in which my current company made top 10 Georgia innovative companies, and my previous company was in the top 40) – but I digress – anyway, hear Jeffrey Rosensweig (Associate Dean for Corporate Relations at the Goizueta Business School of Emory University) speak. His site is www.globalguru.com and he has a number of interesting presentations available for download.

He has an interesting global perspective on things and does a lot of demographics, aging, fertility, etc. analysis factored against global trend in dollar strength, gdp (national and global), trade deficits, and many others, which shed some light on a couple things for me. First, based on his projections, India will surpass China as the #1 population around 2030 – due to the fertility rate, population statistics, and the fact that there are constraints on China’s population growth. Second was how dark (http://www.globalguru.com/request.php?21) the world is in general and where the population centers are. Makes you feel rather puny. A very good speaker and somebody who would be a wonderful professor to have…

Also got to witness Ted Turner (as he received the Captain of Innovation award). It was inspiring to hear him talk about the early days of CNN and how he persevered through many challenges. Beyond what he has already done, he has now taken on several global causes:

1) Environment and our ability to sustain our world

2) Alternative fuel (related to #1, but other cause/effects as well)

3) Nuclear armament destruction – why do we need these weapons?

There were some other items, but these were the key things that came out for me.

Kipp

What's on a CTO's top book shelf?

Thanks to my friend and colleague, Mitchell Friedman, I have what I consider a top shelf top shelf at work.  The list of books includes:

 

• A. K. Dewdney, The Turing Omnibus
• Terrence W. Pratt & Marving V. Zelkowitz, Programming Languages – Design and Implementation (Third Edition)
• Edward A. Feigenbaum & Julian Feldman, Computers and Thought
• Alec Sharp & Patrick McDermott, Workflow Modeling
• Wil van der Aalst & Kees van Hee, Workflow Management – Models, Methods, and Systems
• Christopher Alexander, The Timeless Way of Building
• Christopher Alexander, et al., The Oregon Experiment
• Christopher Alexander, et al., A Pattern Language
• Harvard Business Review, Managing the Value Chain
• Tom Mochal & Jeff Mochal, Lessons in Project Management
• Claus Heinrich with Bob Betts, Adapt or Die – Transforming your Supply Chain into an Adaptive Business Network
• DiBona, Ockman & Stone, Open Sources Voices from the Open Source Revolution
• Eric S. Raymond, The Cathedral & The Bazaar
• Frank Rose, West of Eden – the end of innocence at Apple Computer
• David A. Schmaltz – The Blind Men and the Elephant
• Peter Schwartz, The Art of the Long View
• Eric Raymond, The New Hacker’s Dictionary
• Douglas R. Hofstadter & Daniel C. Dennett, The Mind’s I
• Douglas R. Hofstadter, Metamagical Themas: Questing for Essence of Mind and Pattern
• Douglas R. Hofstadter, Godel, Escher, Bach (actually, this is on my shelf by my bed…but it would look good here!)
• Christiane Fellbaum, WordNet – An Electronic Lexical Database
• Philip N. Johnson-Laird, The Computer and the Mind – An Introduction to Cognitive Science
• Douglas E. Comer & David L Stevens, Internetworking with TCP/IP – Volumes I, II, and III
• Edward Tufte, The Visual Display of Quantitative Information
• Edward Tufte, Envisioning Information
• Edward Tufte, Visual Explanations

 

My second shelf is not nearly as lively, consisting primarily of linux, java, algorithm and compiler books…

 

Feel free to suggest additional books that should be on my list…I may have them elsewhere!

 

Kipp

 

Aspect Oriented Information?

My last post was on languages for handling information.  As I considered further, perhaps we can lean on some work in the computer languages with respect to aspect oriented programming…

 

AOP provides facilities for what are called crosscutting concerns – these are concerns that cross more than one ‘module’.  Things such as security, transaction integrity, and logging generally fall into this camp.  Are there similar concerns in information management that can be extracted from the information itself and handled as aspects of the information?

 

Perhaps…some examples might be:

 

-          access control

-          creation time

-          author

-          reliability

-          recency

 

As such, the information can be treated as a stream and the ‘aspects’ can be injected/tested/verified/etc. as an aspect of the information rather than muddying up the information stream itself.  Would this help?  I think in some cases it would…as part of my query, I offer up my ‘aspect parameters’ as well as my ‘information parameters’.  Or, this could be done as a second level filter on the returned information (except for the access control part of the query).

 

To some extent, existing search engines do this on our behalf – they sort by recency, relevancy, etc. and some base their results on your own personal track record.  Can I have more control over this?  Would it make sense?  How would you implement it, or does this truly reside in the information gatherer/disseminators such as Google?  Can the information providers/producers provide better indications of the information that can be leveraged by other tools downstream?

 

To this last, I believe the answer is yes – there is a lot of information lossage along the way from producer to consumer, and we can do better.

 

Kipp

 

Information Annotation

Just spent some time catching up on (well, at least made a dent) on my backlog of magazines. A Queue mag had a series of articles on computer languages. New languages they said, come about for a couple of reasons, and I paraphrase:

1) Better performance (generally order of magnitude in order to displace an old one)
2) Better abstraction/programmer efficiency
3) New application/usage (web)
4) Specialized usage (parallel)

There are also incremental improvements that have been and continue to be made on existing languages as we learn how to do things better.

Anyway, this set of articles got me to thinking about the language of information and how we handle, manipulate and specify information. I'm not really familiar with this area, but what are the available languages for information specification? I can think of several, loosely:

1) Databases - in these the meta information is stored implicitly and explicitly in the database system itself
2) HTML - information embedded in structure, some implicit information can be retrieved
3) SGML/XML - more information stored in the markup including some semantics
4) RDF et al. - additional relationships and semantic information included with the information itself

I'm sure I'm missing a lot so I'll keep digging. Nonetheless, these all seem woefully inadequate and insufficient to enable real reuse of information. There are so many attributes of the information that are perhaps orthogonal to the actual information and yet are required to truly scale and make a usable infostructure.

Is a new language of information needed? Or can we use existing systems to facilitate these needs? Things like access, ownership, authorship, timeliness, expiration, accuracy, etc. It seems that we need additional mechanisms to create and maintain this meta information beyond what currently exists.

Kipp




__________________________________
Do you Yahoo!?
Send holiday email and support a worthy cause. Do good.
http://celebrity.mail.yahoo.com

Unstructered Information Management

UIM is something that IBM has been doing a lot of research and development on.  I caught this reference from an article in the NY Times (http://www.nytimes.com/2004/12/26/business/yourmoney/26techno.html) entitled “At I.B.M., That Google Thing Is So Yesterday”.  This article refers to some work being done under the direction of Arthur Ciccolo within IBM Research (http://www.research.ibm.com/UIMA/index.htm) at the T.J. Watson Research Center. 

 

Their goal is to create an infrastructure that provides the ability to combine the various information extraction and knowledge discovery techniques in an effective fashion – rather than each one having to re-process the information, is there a way to leverage each of these using some infrastructure and get better throughput and results?  I’ve only begun to dig through their publications, but they recently had an entire IBM Systems Journal issue dedicated to this area of research (http://www.research.ibm.com/journal/sj43-3.html).

 

Kipp Jones

 

I'd like to explore the idea behind CyberINFOstructure a bit further. How is this different from the CyberINFRAstructure? What is meant by this distinction?

To date, a lot of high performance computing and the related infrastructure is around computing -- cpu, performance, bandwitdth and throughput. The focus seems to be on the bottom layer, the infrastrcuture if you will.

The information that lives on top of this has been given some cycles, but generally in a specific manner related to a problem at hand. I believe there needs to be a more concerted effort to understand and create a more reliable infostrcture on top of this infrastructure. This layer should support:

• Information and source discovery
• Information pedigree
  
• Information access
• Information classification and semantics
• Information composition
  
• Information translation

These capabilities reside on top of the basic infrastructure and provide common facilities for applications to access and use information that resides within the grid/enterprise/world.

I'll dig deeper into each of these topics next.

Focus on Research

Key topics of interest include:

• Web Technologies (web services, semantic web, search, retrieval, etc.)
• Information Quality and Availability (get it when you need it, proper semantics, verifiable pedigree, etc.)
• Cyberinfrastructure (or as I prefer cyberINFOstructure -- a focus on the infrastructure that provides access to the inforamation rather than the comptuing side of the infrastructure)

I intend to build on and improve these 3 pillars to understand how they can be applied towards two areas:

• Enterprise Computing
• Scientific Computing

I believe there are some fundamental process, algorithms, and capabilities that can be created to provide support for both of these activities. Clearly each has some specific needs that will be different from the other and we may need to go down one path quite a ways to fully undertand the particular needs, but ultimately I'd like to circle back to find the commonalities across these domains.

The next step is to identify and isolate relevant research related to these topics and begin to distill it into a more focused set of ideas.

Research, Development and Operations

I'm back from my hiatus. I spent a good 10 days on a whirlwind trip across the great plains of Nebraska and Kansas (with some Missouri time in there). It was a good break and time to spend with friends and family. Always a good idea in my book.

But, now that I'm back, been thinking a lot about a lot of things. In particular, I'm still going through the Atkins report, a report that was published by the NSF detailing what should be done to fund the CyberInfrastructure. There are a lot of good nuggets in this document. Below is one I thought elucidated some good distinctions between Research, Development, and Operations.


Research

Research is a competition of ideas. Allocation of resources starts with the program announcement and evaluation of the resulting proposals. This is bottom-up, stating the evaluation criteria with detailed initiatives arising from the research community. Overlap or duplication is acceptable where different researchers pursue competing visions for accomplishing similar ends. Post-evaluation is based on the intellectual quality and impact of the research outcomes.

Development

Development is a competition of plans. An overriding goal of development is to limit duplication of effort, and concentrate resources on a set of integrated and maintained software distributions collectively covering the scope of the ACP. Thus, development is partitioned and assigned to organizations based on the responsiveness to needs and credibility of their plan for pre-defined concrete outcomes. Post-evaluation is based on how effectively the plan has been implemented and also on how extensively the outcomes are adopted and used and on user satisfaction.


Operations

Operations is a competition for users. Operations serve end-users, domain scientists, and engineering researchers, responsively providing service and support. There should be two or more competitive operational options available to users. A primary point of post-evaluation should be the satisfaction of the users who are served, and to a lesser extent the number of users who are served, based on input from the user community.


-----------

Kipp




__________________________________
Do you Yahoo!?
Friends. Fun. Try the all-new Yahoo! Messenger.
http://messenger.yahoo.com/

Semantic integration

Another article from David McGoveran[1] (gotta admit he writes some good stuff) notes that the primary types of semantic transofrmation are:



*
Combining two or more fields having different data types
*
Decomposing a field into two or more new fields
*
Aggregating multiple values
*
Disaggregating aggregate values
*
Consolidation
*
Synchronization
*
Generalization
*
Sub-typing

I include them here so I don't lose them.

He goes on to state something that fits in with my thoughts regarding TDQM (Total Data Quality Management) although my thoughts extend outside of an enterprise and really drive towards a supporting infrastructure for TDQM rather than the processes and responsibility questions that are addressed by TDQM.

Here are the elements of TDQM:


1. Fill the repository incrementally, never “upfront.” This is a pragmatic, not academic, effort.
2. Ensure that the repository supports a theory of semantic types. It should define data semantics by capturing constraints and not just data syntax, and relate them to existing types through dependencies.
3. Don’t accept application software unless data semantics has been defined in an importable data model.
4. Use versioning, partitioning, and type relationships to organize metadata. Never delete it.
5. Commit to driving application development and integration projects from the repository.
6. Use data integration tasks as opportunities to use, refine and validate the repository.

These are all very good points and certainly make a lot of sense. #3 is a tough one for companies to enforce, and we probably need to think of compensating actions to take for those instances where the absolutes are not an option.

I'd also take #5 a lot further to say that it is not just driving application development and integration projects from the repository, that a lot of the applications themselves can be made more valuable to the users by leveraging the repository. There is a lot of value in having this information available and we need to find ways to leverage it.


[1] Data Integration, Part VIII, eAI Journal, January 2003








Kipp Jones - CTO
nuBridges, LLC - www.nubridges.com
eBusiness is Business
cell: 404.213.9293
work: 770.730.3722

Business Semantics

Case in point:

 

http://www.eaijournal.com/PDF/Business%20Semantics%20-%20McGoveran_1.pdf

 

An article published back in 2000 about the semantics of data and why it is important to understand the meaning of the data in order to do business to business integration.  The author, David McGoveran, argues the point that of the 2 of the 3 main ingedients that are required for an integrated information exchange have been adequately solved:

 

1) Connectivity

2) Timley capture and purveyance of data

3) Understanding the data

 

I agree with this premise, as well as the conclusion he draws that all "public data elements pertaining to a set of integrated applications, whether stored in a relational database or not, as though they were attributes of a formally designed relational database."

 

I disagree with the method by which we need to get there.  According to the author, "maintainable business semantics...is worth a little formal design effort involving application vendors and developers."  Yes, formal design is necessary, but I say it is insufficient.

 

Why?  Because the tools for formal design and the method for maintaining the semantics after the formal design and managing change to these formal designs are fundamentally missing.  It is like having CASE tools that don't do round trip.  Sure, it's valuable the first time, but the value degrades exponentially over time, and in fact, I would argue that the uncertainty that is caused by the lack of integrity of the documentation versus the acutal causes the documentation to be virtually worthless right off the bat.

 

If I don't have assurances that I have the right version of the documentation for the system that I'm using, I'll probably spend extra time verifying it...and thus I've lost a good amount of the value of having the documentation even if it is a small fraction of the documentation that is actually invalid.  I use the term documentation to refer to any artifcats regarding the semantics of the information, its relationship to other information and the methods by which I can gain access to and/or manipulate the information.

 

I would also point out that much of the metadata about an actual data model is embedded in databases, contained in their system catalogs.  And yet this information is not easily accessible to most humans, it's not easily exchanged, nor is it sufficient to specify the semantics of the information.

 

We need more, and it can't be solely dependent on the actions of the few, the proud, the "data architects."  We are dealing with living systems that evolve over time.  They can't rely on rigid constructs and upfront knowlege.  They must be able to adapt, grow, expand, connect and self-correct over time.

 

I regard this as the challenge.

 

Kipp

 

Kipp Jones - CTO
nuBridges, LLC - www.nubridges.com
eBusiness is Business
cell:  404.213.9293
work:  770.730.372

On Information Quality

A fundamental difference that I have with some people is that I cannot insist that information quality be specified from the onset.  Rather, information must be injected into the systems with whaterver quality it currently has.

 

To me, this is like the debate of closed hypertext systems versus open hypertext systems that raged prior to the WWW taking off.  Closed systems required high quality data with full referential integrity.  Yes, this provided a nice clean environment and once complete, was generally of a high quality.  The problem was, that producing fully 'cleaned' information with full referential integriity from the outset is difficult.  The onus is put on the human to make all of this happen prior to the information even being captured in the system.

 

This is the critical break down.  The hurdles to adding information to the system must be low.  Information must be able to be injected into the system ad hoc with little preparation and cleansing.  It should be added, captured, and annotated.

 

The system should be responsible for helping determine the quality of the information.  It should have mechanisms in place to help 'clean' up the information.  It should have anti-entropy mechanisms, data validation mechanisms, anomolous data isolation mechanims, and sufficient feedback loops to ensure a constant increase in the overal quality of the information in the system.

 

You can certainly understand both the desire and the reasoning behind 'closed' information stores.  The database community has lived or died by the 'quality' of the information in the database.  If a foreign key constraint is missing, or a table is missing referential integrity, the whole thing starts to fall apart.  Why is this?  It's because the system was built to depend on the upfront quality of the data rather than relying on mechanisms and systems that handle 'dirty' data and are able to recover from situations in which everything is not pristine.

 

This model is still valuable for some domain of problems, but it is an ever decreasing set of problems.

 

The other thing that has driven the requirement for 'clean' data has been the cost of computing, networks, algorithms and storage.  All of these factors made it much more cost effective to demand data quality up front rather than worry about creating a system which can deal with uncertainty.  By storing only 'clean' data, the system stores only what it needs, no more.  The semantics and the relationships of all of the data are stored with in the structure of the information, thus not requiring any external representation of the relationships.

 

The Web as an open hypertext system, was able to grow super exponentially due in large part because of its open architecture which did not require any kind of referential integrity, quality criteria, or 'gatekeeper' function.  Information has been injected into the WWW at such a rapid rate that it is currently very difficult to even estimate the global size of the WWW.  There is no doubt that there is 'bad' data and low quality information on the Web today.  What is interesting to watch is some of the natural(?) or evovled mechanisms which have come into play to isolate and improve the overall quality of information on the Web.  Many of these mechanisms are human in nature today (such as manual linking), but there is much that can be done to improve the qualtiy through automated systems.

 

An early attempt was made with the Atlas Link Database that we worked on in '95.  The goal of this system was to use embedded knowlege within the system (link hrefs and referer information) to continuously update and correct broken links.  This is just a small element of the overall problem, but certainly starts to demonstrate the power of using the information to do self correction.

 

With the continual improvements in the Semantic Web, Web Services and other related technologies, the Web is moving from a massively linked open hypertext system to a massively linked open database system.  I believe that we are currently embroiled in some similar arguments about closed versus open in the database world that we had 10 years ago in the hypertext world.

 

Ultimately, the open model will prevail for its ability to scale across domains, networks, and technologies.  But this will not happen without a lot of work on the mechanisms to judge, rank, correct, and clean the information that is injected into the system.

 

Kipp

 

Kipp Jones - CTO
nuBridges, LLC - www.nubridges.com
eBusiness is Business
cell:  404.213.9293
work:  770.730.3722

 

WWW2004

Arrived in NY (after a 2 hour delay in Atlanta due to a storm in DC) last night. Checked in and slept.

Registered this morning and ran into Joseph Hardin, now at U of Michigan. I bumped into him several times when he was at UIUC back in the day when I was working on the NCSA web server adding the atlas functionality to it...which was mere months after the whole Mosaic thing took place and everybody moved from Urbana-Champaign out to the Valley to make it rich.

We'll see what today has in store, should be a lot of semantics!

Kipp

Monday

A couple of items to note:

 

First, Ken pointed me to a very nice package for setting up sites: Mambo http://www.mamboserver.com/  This open source software seems to rock.

 

Second, started integrating Jess into BizCQ.  Need to continue working with that and expand the web service interface.  Need a better way to create rules for Jess related to BizCQ.

 

Third, heading to NY tomorrow for WWW2004 to present a poster on BizCQ. 

 

Lastly, good weekend with the kids.  Two soccer games and one Ballet picture day.  Also, had fun having Aunt LaLa in town.  Too bad Brian couldn't come and play...

 

Kipp

 

Kipp Jones - CTO
nuBridges, LLC - www.nubridges.com
eBusiness is Business
cell:  404.213.9293
work:  770.730.3722

 

On Expenses

Why is that when a company who you have asked to help you feels like it is okay to have you pay more for something than they would themselves?

 

Case in point. recently had a training course (which is another topic in and of itself) on site in which we were responsible for expenses.  The expenses for a 2 day training course came in at over $1000.  Granted this includes flight and hotel, but it certainly wasn't an international flight, and it's not like staying in NY.

 

It would seem to me that normal business sense would have you charge your customer what you would expect to be charged if the roles were reversed.  Just because somebody else is paying doesn't mean that there are no rules about reasonable expense.  Companies would do well to set a limit for 'reasonable' and require notification/approval for out of bounds items.

 

Rant, rant, rant

 

On another note...

I'm going to my 20th high school reunion in a few days.  Class of '84 which graduated with 14 people from Beaver Valley High School in Lebanon, Nebraska.  Probably not a lot of people out there have visited.  The town now has about 75 people in it, none of which are my classmates.

 

In fact we're having it Lincoln, Nebraska...which would be really great if a Husker game was going on...

 

In addition to that travel, I'm presenting a poster at the 13th International World Wide Web conference in NY, NY next week.  Haven't been to one of these since '96.  Looking forward to seeing where things are and getting a sense for what's next in the WWW world.

 

Kipp

 

Kipp Jones - CTO
nuBridges, LLC - www.nubridges.com
eBusiness is Business
cell:  404.213.9293
work:  770.730.3722

 

Checking to see if I can still blog...

Been awhile since I was out here, hopefully can start it up for real this time.

Some interesting things in technology I've been looking at:
- Space technology - interested in where business is going to go wrt space
- BPM - we've went deep into BPM for our new product release, where else is BPM and workflow technology useful
- Semantics - still interested in semantic mapping, semantics of change, information quality via semantics
- Rules engines - how can rules engines help with semantic problems?

On the science side:
- evolution - very interesting topic
- things nano
- anti-gravity

Other than that, keeping the kids going takes up any extra time I may have...

Interesting ontology editor and framework from Stanford:

The Protégé Ontology Editor and Knowledge Acquisition System

The current name for their company is MotionSpeak, rather catchy. Some really good thought has gone into this thing.

Questions I have are:
1) How far behind are companies like macromedia and microsoft on competing technologies? At least on the publishing side...
2) If the first target is kiosk operation, how much of the infrastructure to manage, distribute, authorize, charge, track, bill, etc. has been built. Who manages what aspects of the process and system, advertisers, advertising agents, host, host syndicate owner, others?
3) Others have targeted ASP model tools (Javu Technologies for example which built an extensive suite of non-linear editing tools for online movie editing and publishing). Is it the authoring tool, the publishing tool, or the management tool that you see as primary drivers of the business?
4) How does this compete/complement the double clicks of the world?
5) Seems like the quickest hit would be to hit the Yahoo or eBays. The complexities of establishing a management and distribution system for the other outlets may take some time.

So, Steve Youngblood and Volker Shultz have put together an idea, prototype and business plan for a company they call PointWare. In esscence, it is a flash publishing and hosting (asp) system targeting advertisers (small to medium) who want dynamic content in their online ads. Potentially targetting things such as coffee shop kiosk type advertising, online auction sites (yahoo, ebay), and double click like advertising organizations.

The system is really nice visually and creates a nifty swf file when done that is easily editable and publishable. They have done a good job with the UI and the experience, however if you are used to direct manipulation (e.g. power point) you will be somewhat disappointed in the awkwardness that this interface forces you into.

A nice tool, and some interesting potential. It also is in the arena of information publishing which does interest me.

They would like to consider me as a potential 3rd person in their company. I find this quite flattering, and have seriously considered how I could become involved. However, with the other things currently going on in my life, I'm going to have to bow out.