Archive for the ‘Government’ Category

Open eGovernment Data

Monday, November 28th, 2011

The Open Source movement is moving into government data.  Governments are finding a new source of untapped economic stimulus with the mountains of data they collect.  The  data is collected for the ultimate good of the public but rarely shared because information access was too people intensive and expensive up until recently.  Things have changed.

GOV opendata1 300x168 Open eGovernment Data

ETALAB (France), data.gov.uk (UK), data.dc.gov (Washington, DC, US), whitehouse.gov/open (US), and countless other local and national governments have open their data coffers.  In the case of DC for instance, the cost of publishing the data was $50K for the city. The DC government expected it to spur the creation of a few new ventures, and a bit of private investments.  Instead, 50 startups were born and $3M invested.  There is a world of open data coming to the private software industry.

Open Government data is also going to be Big Data.  The size of data collected is by definition larger larger than traditional “enterprise data” for instance (especially at the national level).  The tools being developed for big data will solve some of the issues with access and real time analytics that exit with government data.  Exorbyte MatchMaker is one of these tools.  That’s why government agencies have already chosen MatchMaker for their search and data access challenges (2 national European census agencies, German Finance Ministry, and more).

Are you ready for open government data?  Any ideas what would make sense to build with this data?

Big Data Search

Monday, November 28th, 2011

Big Data1 300x225 Big Data SearchEvery economic cycle comes with its host of enterprise software trends.  Big Data hs become a recognized phenomenon in 2011.  In May 2011 McKinsey released the “Big data: The next frontier for innovation, competition, and productivity” report. It started with:  ”The amount of data in our world has been exploding and analyzing large data sets—so-called big data—will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus”.

IBM, Oracle, SAP, Microsoft, SalesForce.com, and others are all aiming their development efforts at Big Data (see vldb.org).  The amount of data produced, collected and stored by online activities to which companies, their customers, their partners, and their sales channels participate has grown enormously.  Tools are being developed that allow affordable long-term storage.  New columnar in-memory database formats have emerged that enable near-real-time analytics.  Fast growing stratups and open source solutions have also converged with their own new NoSQL formats (InfiniDB, LucidDB, InfoBright, Hadoop, NoSQL, etc.)     MatchMaker, Exoryte’s Universal Search platform, is the perfect answer to search within Big Data.

The challenges of search within big data are:

  • Searching Big Data though SQL queries is simply too slow and inflexible – fuzzy or advanced search requires a search indexer layer or  something different than traditional on-disk relational DB formats.
  • Indexing large databases can be long, disruptive to normal database operation and require complex hardware infrastructures.
  • Running complex queries and fuzzy logic requires so much calculation and lookups that new search strategies are required.

Exorbyte MatchMaker is made to address these challenges and our professional services team has proven repeatedly tht they can be addressed:  Allianz (the world’s 12th-largest financial services group),  German Finance Ministry, and more blue chip and government organizations tun o us each year for that very expertise.

What do you think of Big Data?

Travel Sites are Usability Centric or Dead

Tuesday, November 2nd, 2010

It’s well know travel ecommerce is a price game.  You either have the lowest price or you are out.  But there is a another big success factor hiding behind the price obsession of online travel vendors: usability.  For us at Exorbyte, the term “usability” associated with the large structured databases of travel products that the industry builds its online business on, means we can help.

I believe that the sheer complexity of the travel process makes usability a primary focus for travel customers.  If you are buying a book on a poorly designed online store, all you risk is probably 2 or 3 clicks more until you figure our how to find, order and pay for your book.  On a travel site, things can get 10 times uglier: flights, layovers, hotel descriptions, multi-airline trips, car rental insurance, rewards program preferences, dates, times, and countless other parameters factored in a complex trip design.  That probably why Exorbyte is regularly approached by travel companies looking for a solution to complex catalog search problems.  We have designed several solutions for the travel industry that I describe below.

Online Travel Transations Graph1 Travel Sites are Usability Centric or Dead

Online Travel Bounce Graph

In an early 2010 survey of online travel stores (PhoCusWright – see right) high prices were the main driver to visitor bouncing off the sites.   However, a long list of other reasons follow (not wanting to register, slow sites, frustration, information clutter, confusion, site crash, etc.) of which most could be defined by the term “bad usability”.

www1 Travel Sites are Usability Centric or Dead

Gomez online travel loyalty

Loyalty is in short supply on the buyers side.  Travel site operators have learned the hard way that users rarely give them more than a couple of chances to impress with their usability.  36% of users report in another study by Gomez (see above) in January this year that they wouldn’t stick around after a couple of bad usability experiences.  17% would even switch after the first failure.  That’s an impatient bunch of people.  If you travel once-in-a-while you can equate this phenomenon to the low tolerance for bad service and tendency to shout at ground airlines staff which airport travelers demonstrate when a flight is late or overbooked.  At least, online they can just switch to a different vendor.  So they do.

We have dabbled in travel usability at Exorbyte for a while.  Here is an example of a European travel site that uses our intelligent autocomplete to set millions of airport transfer pick-up and drop-off locations:  http://hotelshuttle.com/

See also the video below of one of our nicer travel UIs.  One of the most neglected area is the sales of complex packages.  As a user of sites like LastMinute you could think that the feeling of clutter and lack of context is purposeful because most packages are unsold low quality items for other travel agencies.  However, this is often far from the truth.  If you think advanced flight search is a big barrier to the free flow of traffic towards purchasing the ideal product (not sure about the exact name or ATA code for an airport for example), imagine what it looks like when the form is supposed to include parameters for flights, hotels, rental cars, trains, airport transfers, etc.  All-in-one.  That’s what we have been working with L’Tur (LastMinute’s biggest competitor in Europe) to resolve using a very advanced autocomplete we called FlexSearch.  We must admit to failing to convince L’Tur to keep this up at their site because the conversion rate performance wasn’t proved but if you know anything about usability, you’ll enjoy and dream of the possibilities.  See video below.