Category Archives: Amazing

FAST Forward 2009: Notes from the third day

Bjørn Olstad: Microsoft’s vision for enterprise search

Search as a transparent and ubiquitous layer providing information and context seamlessly – from a search box (tell me what you want in 1.4 words and I will answer) to a conversational interface (giving pointers to more information and suggestions for continued searches, to a natural interface.

Demo of Microsoft Surface: Camera interface, can recognize things. Multiuser (as opposed to Apple. Showed an application built on search with touch – whenever you touch an information object a query goes towards an ESP implementation and brings up all the information available on that object.

Very impressive demo of Excel Gemini: How do you fit enterprise data into Excel. (Picture of a VW bug with a jet engine.) Pulls 100 million rows into Excel, sort them (instantly), slices and dices. Built on top of ESP, does extreme compression, takes advantage of high memory, allows publishing of live spreadsheets to Sharepoint. Extremely impressive, worth the whole conference.

Bjørn continues talking about search as a platform: Demoing Globrix.com, where you can ask questions about apartments and houses and get a rich search experience where you can change attributes and the data changes dynamically. Globrix does not hold content themselves, but crawls available content on the web and shows it (much like Kayak.com for airline tickets).

Another demo: Search for entertainment based on location, friends and content. Moving from there to a focused movie site. This is federated search that understands some of the semantics (understands that “David Bowie” refers to a person and therefore only search certain databases.) Also incorporates community (letting users edit the results and feed them back).

FAST AdMomentum – advertising network – has had tremendous growth.

Content analytics: How can you lay a foundation for a good search experience by focusing on data quality? Demo: Content Integration Studio, sucking out semantics from unstructured text and writing it back both to the search engine and to databases (such as an HR database).

Panel session on enterprise search

Hitachi consulting (Ellen): Very big focus on the economy now, almost all conversations are about that topic. eDiscovery is important: Looking at many sources with a view towards risk discovery and risk mitigation.

EMC consulting (Mark Stone): Natural interfaces will be important, frees up the mind to focus on the information rather than the interface. Shows a video of a small girls using the Surface table and how she very quickly starts to focus on the pictures she is manipulating rather than the interface – she completely forgets that she is working with a computer.

Sue Feldman, IDC: We have to get beyond the document paradigm. I want to see interfaces that will immerse me in the sea of information and explore it, without having to think about what application it is in.

Sue Feldman: Core issue with search: Data quality and making it a rich experience for the user. Anthropological, linguistic and cultural issues, getting people to understand both what they are seeing and what they are looking for.  We are just beginning on this journey. From keyword matching and relevance ranking to pulling the user in, having a dialogue with the information. What we are seeing is hybrid systems that combine collaboration, search, analysis etc.

AMR Research: There is a religious war going on, between collaborative systems, portals, content management systems, and search. They all claim to be the answer to the problem of connecting users with their data. There is also consolidation in the market, partially driven by the economy, but there is also a consolidation of functionality and an explosion in new ideas, many small companies coming up with new ideas.  No one technology is going to solve all of these problems. Lots of opportunity because Microsoft is gobbling up all these technologies, trying to provide one product that covers most (Sharepoint).

Q: Examples of interaction management?

Hitachi consulting: Best examples currently found in collaboration and community software.

EMC: There is a tool out there that searches not only blogs, but specifically the comment sections of blogs, looking for mentions of products. Do sentiment analysis, find out what the customers are saying about you.

Sue Feldman: Searching through corporate communications in lawsuit situations. Ad targeting. And what is the relationship between search and innovation?

Hitachi: Innovation comes from finding what you did not expect to find.

Q: This question always comes up: Search is a commodity – or is it? What is the current market doing for search adoption?

AMR: I am not sure who says that, there is so much room for innovation, so I can’t understand why anyone would say it is commoditized. Go out there and find the opportunities.

Sue F: Well, search is a tool, like a screwdriver. But I really need a screwdriver. The toolbox has expanded so much. I see the search market continuing to explode even though the technology is tanking. Possible that we will see a disruption with a new platform based on information management, access and collaboration.

EMC: We are seeing growth, the business will mature because companies have to focus on what the business really needs.

Sue Feldman & others: Search use awards

Customer awards:

  • Best productivity advancement: Verizon Business.
  • Best digital market application (I): McGraw-Hill Platts (doing industry-specific searches, 50% increase in trial subscriptions, 40% increase in revenue.)
  • Best digital market application (II): SPH Search (reader interaction and content integrated with newspaper sources, federated search.)
  • Social computing: Accenture (internal search on people profiles and content)
  • User engagement: Kakaku.com, Japan (700m pageviews, 18m unique users)
  • User engagement: AutoTrader (peak query level of 1500 qps)

Partner awards:

  • Digital market solution: Comperio (use of search for user interaction)
  • Social computing solution: NewsGator (enterprise social computing on top of Sharepoint)
  • User experience solutions: EMC Consulting
  • Partner of the year: Hitachi consulting.

Yes!

Yes!

As I said after reading his book in in 2005:

In an age of seemingly simpleminded politics and increasingly spin-oriented politicians, it is rather reassuring to know that at least one US senator has the experience of life in the less privileged lane; the perseverance and intellectual capability to analyze deeply entrenched issues and work at resolving them; and the willingness to keep the complex issues complex and […] the simple things simple.

Computers + Biology = Virus Detector

This is the kind of read that makes you proud to be even remotely connected to computers, science and academia…..

Innosuing, not innovating

image Endnote, owned by Thomson Reuters Reuters, is suing the main creator of Zotero, Dan Cohen (Or, rather, they are suing GMU, his university.) The reason is that Zotero includes a tool that can convert Endnote styles to Zotero (much like Openoffice has functionality for converting from MS-Word or other formats).

Now, there is a brilliant market move. Endnote is primarily used by academics. I have used it since around 1991, and for a couple of years I was a beta tester (and had the T-shirt to prove it.) Aside from the T-shirt, I got zilch for my efforts (and I did find a bug or two.) Neither did the thousands of academics who have created bibliography styles for various journals and uploaded them to Endnote’s web site.

I can’t think of a better way than a law suit to make people move to Zotero. This definitely does it for me – unless Thomson Reuters pulls this stupid suit. Come to think of it, we have a number of users at the Norwegian School of Management, I am sure I can persuade quite a few of them to switch sides…..

Suing an academic for creating software for other academics which draws on work of other academics when your primary market is academics? Have they hired hired lawyers from the music industry?

Zotero is a better tool, too. Shared lists, bibliographies, support for clipping from searches, including Google Scholar. Instant saves from browsing.

Time to move, methinks. Let me see, how hard would it be to migrate my 2100+ article database….

Update two hours later: Boingboing is on the case.

Update 10 hours later: Check out the Boingboing comments – Streisand effect in the making. John Mark Ockerbloom has a thoughtful piece on the suit.

A power plan for the US

Bob Cringely proposes an upgrade to the US grid as well as a moratorium on incandescent light. Not sure about the underlying statistics, but I have always wondered about the puny 110V and ancient (often spaghetti) cabling found even in affluent neighborhoods over there. Not to mention the efficiency loss from the thin copper. 18% less power use? On the surface, this seems like a good idea to me.

The Wired Beauty of Bridges

I don’t normally like collections of pictures with commentary, but this Wired collection of beautiful Bridges provided a nice break.

You are what you eat, and we eat oil

Michael Pollan: The Omnivore’s Dilemma: A Natural History of Four Meals, 2006

Michael Pollan is the author of In Defense of Food: An Eater’s Manifesto, where he basically took on the flood of diet advice and replaced it with “Eat food. Not too much. Mostly plants.” In this book, he discusses the problem of what to eat today, which is not something most species wonder about, either because food is scarce and they will eat everything they can lay their hands on, or because they are so specialized that they can only eat one kind of food (like koalas and eucalyptus leaves, of pandas and bamboo shoots and leaves.) This choice is faced by all omnivores, such as humans.

The book tracks down the history of three meals: One industrial, one pastoral (i.e., organically grown), and one personal, where Pollan had to make everything himself, including hunting down the meat. Or, in other words, one meal from industrial society, one from the traditionally agricultural, and one from a society of foragers. The further back you go, the more he has to fudge the experience (and the same goes for the producers/foragers, I suspect.)

The industrial part of the book talks about corn, a plant that supplies the basis for most of what we eat (from corn flakes to meat (cattle now eat corn rather than grass) to sweeteners). Corn is highly productive, but cannot exist without human intervention. The rather twisted logic here is that the productivity of the farmer destroys farm life, and may destroy food as well.

The organically grown part is based on an analysis of an organic farm (“small” organic as opposed to “big” organic such as Whole Foods) which relies on local markets, crop and species rotation, and quality rather than quantity for profits. Back-breaking work and battles with a regulatory regime set up for industrialized farming (for instance, the meat processing plant needs to have a bathroom specifically for the USDA inspector).

The foraging part, of course, verges into the artificial – Pollan hunts feral pigs, but does it by SUV and with a high-powered rifle with a scope. But it is fun, and allows for some pretty interesting discussions of our relationship to food.

The book is full of interesting viewpoints and facts, and tells you things that you did not know – for instance that “free-range” chicken means that the chicken have access to grass and air. However, since they only live 8 weeks and have access to grass and air through a door that they don’t dare venture out of, having always lived inside, this does not mean the chicken has had a life that much different from the fully industrialized chicken.

Here is one quote I liked (page 293): “The adult human brain accounts for 2 percent of our body weight but consumes 18 percent of our energy, all of which must come from carbohydrates. Food faddists take note […]”

In other words, the book is the supply-side prelude to In Defense of Food. I have not read that one, but it is on my list of books to read, triggered by Omnivore’s Dilemma. In the meantime, I listen to his talk at Google, and so can you:

Back to nature

Stuart Buck tries running practically barefoot… Interesting observations, since we undoubtedly are not designed for running and landing hard on our heels. On the other hand, we aren’t designed for running on asphalt either.

As for the Five-Finger shoes, I wonder what the reaction would be if you wore them on the subway. 

Homeland Security bars Rodrigo (y Gabriela) Sanchez

This is rather hard to believe, but apparently, the US Homeland Security department has decided that Rodrigo Sanchez, the melodic half of famous guitar duo Rodrigo y Gabriela, has the same name as someone barred from entering the United States, and therefore barred him from entering the US. Consequently, the couple has had to postpone or cancel a number of shows they were going to have in the US.

Aside from the fact that Rodrigo & Gabriela are world famous and have been on Letterman and the Tonight Show with Jay Leno, you would think that neither "Rodrigo" nor "Sanchez" are unusual names in Mexico, or for that matter in any Spanish-speaking country.

Hard to believe.

In the meantime, check out this fun interview with music:

Hanging exports

Gallows exporter?The BBC report about a UK farmer exporting gallows to Africa is making the rounds in the blogosphere. I personally find this a little hard to believe – not from the concept itself, but the pricing: Isn’t £12k a little much to pay for a few beams of oak and some metal? Especially if you are a cash-strapped African country (though the regime may have the money) with occasionally inadequate transportation? I would think that if anything could be manufactured locally, this could.

As for £100,000 portable "execution systems", I suspect a hoax here….even though this is from BBC.

(Via BoingBoing and others)

A severe case of rhythmia

This young man, Tony Royster jr., is simply amazing. I found it very hard to sit still here.