I’m a sourcer and a researcher. The key for me is to be presented with information in a clear concise manner. I look for resources that give me additional informantion based on its ability to understand what I might be searching for. What I have is keywords, but a good semantic search engine will imply more than keywords. It’s important for recruiting.

A while back I wrote about Hakia, a search engine I use as a compliment to the big 3 for semantic search for recruiting. Well, I still use it today and in a recent training I had the opportunity to demo some fun things with the search engine. It’s really a nice alternative and in most cases the results are better streamlined.

This past year Hakia went through a refresh changing its interface but more importantly the search capabilities and the way the results are presented. I really like the fact that you are searching in a true semantic fashion through Qdexing (coined by Hakia). I’ve been following them for a bit and studying their approach.

I just not too sure about the claim that they are searching sites recommended by Librarians. Seems a bit weird.

What is Qdexing? (Summarized from there site)

QDEX was created by Hakia and essentially analyzes the content on a given page. The algorithm extracts all possible queries from the page from which the search begins. These queries are used to navigate into all possible results structuring real sentences and meaningful results. All of this is completed prior to your search on the backend.

If you have not already, I recommend trying Hakia.

Here is a very lame video from Hakia that made me take a nap with no audio but I wanted to share it with you.

It’s important to understand semantic search for recruiting whether you are a recruiter or sourcing / researching expert. I’m always on the lookout for great semantic search tools and other useful search engines for recruiting. Do you have any favorite search engine tools for semantic search or just for regular recruiting or sourcing?

Related posts:

1. My Top 3 Semantic Search Engines
2. 10 Top #metasearch Engines for #recruiting & #sourcing
3. Search Engine News: Blekko: Trying to Slash the Competition

Have you subscribed to our feed yet? Get straight Recruiter Talk HERE: (We give away cool things)

Back in the year 2000 I worked on a software product that tested potential drugs based on algorithms applied to organic chemistry  data. Why was the product important for customers at drug development companies? First, the program could explore many more potential drug formulas than any older methods. Second, a clinical test of a potential drug is very time consuming and expensive. Make a decision based on software, rejecting a drug, and the savings and productivity are huge. Only drugs that are really promising can then go to real life tests.

I see an analogy there. I think this is really what online sourcing is about:

1)      Finding more potential candidates.

2)      Spending less time and money screening unqualified people and more time talking to the qualified people.

  Do online sourcing right, and you are more often on the phone with the right people!

Just a few years ago online sourcers mostly used Boolean search on the web and on Job Boards. These days the set of tools is expanding and it’s hard to keep up with the new technologies. Some sourcing tools vendors promise to eliminate any need to learn complex search syntax. Sounds great! However, the abundance of tools and sites seems only to complicate the sourcing process for many. To select the right sourcing methods, we need to have some understanding of the ideas and technologies behind the tools. Only with this understanding the above two advantages 1) and 2) can be achieved. So I’d like to do a brief walk through some modern terms and technologies, to try and help you navigate. (While I will provide examples, my goal is to explain concepts, not to give an overview of existing tools.)

Here are the terms I will talk about:

• Semantic Search
• Deep Web Search
• Real Time Search

Semantic Search

Semantic is meaning. Semantic search engines can be either general or specialized.

General semantic search engines have a really hard task: making sense of very broad and very large sets of data. Many of the general semantic engines are subject for research papers and conference talks; few general semantic engines are of practical use to sourcers for now. Take a look at this image, for example; this is what Cluuz made of my search for a specific job title. This looks fun but is hardly relevant to efficient sourcing. (Cluuz seems useful for people search though; check it out.

Before I move on to talk about specialized tools, I would like to recommend this cool general semantic search site:

It does an excellent job answering questions about terminology, concepts, industry news, and more.  Tools that concentrate on specific tasks, like the task of finding profiles and resumes, can do much better than general tools in providing meaningful results. They are often called vertical search engines. Pipl.com is an example of a vertical search engine.

Vastness of data is an obstacle for semantic search engines’ performance, even for those engines that are specialized. Here are two options to implement semantic search:

1)      Create a tool that queries a database. Searching within a database, even a large one, is technically much easier than searching the web. The recently added Monster power search can find people who are not job hoppers, or come from a top school. Not bad!

2)      Pick a set of data from the web based on an initial search, with possible false positives, and then parse, sort and filter this set. There are excellent tools for sourcers that work this way, such as Broadlook Diver and eGrabber ResumeGrabber. This methodology is also included in some CRM and ATS systems along with other functionality.

There are Google search tricks that can provide elements of this second (“staged”) approach even without using a specialized tool.  The tricks would force Google to display critical parts of the found documents, to enable filtering without extra clicks.

As an example, use a substring “email * * com” or “contact * * com” added to your typical search for resumes on Google, and see (and potentially collect) email addresses right in Google’s results pages. Here is an example of filtering: if the contact email address in a resume ends in .au, and you are searching for candidates in the UK, this resume is a false positive.

Existing semantic search tools for recruiters may also be based on one or more of the following; this list can be extended:

1)      Searching for proximity of keywords in a document such as a resume; “managed” near “people” probably means that we had found a manager.

2)      Recognizing synonyms and abbreviations and using them to search. Engineer is like developer; PwC is the same as PricewaterhouseCoopers.

3)      Making assumptions about keyword weights (i.e. importance) by parsing a job description and/or allowing the user to add weights to keywords. The title and any synonyms for the title are more important than the skills listed in a job description; must-haves are more important than nice-to-haves. 

4) Working based on keyword clouds. This means knowing which words often appear together and adding those words to a search, to help target the best results. As an example, known certifications in an industry may be added as extra keywords in a search for candidates.

While I can suggest Google search tricks for the above methods 1), 2), there’s no way to tell any major web search engines about weights of keywords (3). As for the method 4), it’s clear that creating a customized keyword cloud sitting in your semantic search tool would be to a big advantage for the user. I have seen a demo of Pure Discovery that works with clouds of words.

Great as they are, the semantic tools need to understand Boolean logic to be useful. The Boolean AND, OR and NOT do not really present a difficulty for anybody I have ever met. (What’s difficult is not the Boolean logic but the advanced operators). The Monster’s new sleek tool is not capable of Boolean, and it’s a problem for me. I can’t, for example, exclude candidates who work for employers that I am not allowed to solicit candidates from, such as my own clients.

As of January 2010 I have not seen one single semantic tool for recruiters that I’d recommend as the tool of choice. Also, no matter what tools we pick, to remain competitive, we all need to retain sites like Google, Yahoo, and Bing in our toolboxes for a while. (Include Yahoo as longs as Yahoo’s own search is still around.)

 Search engines crawl the web by going from a web page to all of the links in the page, saving their content, and proceeding to do the same with every page they find. (This is a bit simplified.) The pages found this way are called surface web. The pages that cannot be found this way are called, by definition, the Deep Web

I saw a tweet from somebody who wanted to delay sourcing on the Deep Web until she masters the surface web. However, you are already accessing the Deep Web if you have at least one account at a social network or a Job Board. Google has no password to Monster or CareerBuilder, and cannot search them, but you can.

Most Social Media sites have both a Deep Web and a surface web component to them. As an example, a LinkedIn profile will show different data for logged in LinkedIn users and for logged out people (and for naturally “logged out” search engines). Good reasons to learn what constitutes the Deep Web components of membership-based sites are to figure out: 1) complementary ways to source and 2) ways to cross-reference data from different sources. Interestingly, Facebook has recently made a decision to change the parts of it that are deep and surface; this makes a big difference for sourcers.

Other pages that belong to the Deep Web, along with membership-based, password-protected sites, are: pages that are generated on the fly, based on user’s queries to databases; pages that are not linked to other pages; pages in odd formats that cannot be read by search engines; and pages that explicitly ask search engines not to index them.

Real Time

If you are on Twitter, the easiest way to experience real time search is to search on its home page. It accepts advanced Boolean syntax, by the way. A large, and growing, number of sites search across Social Media and pick tweets, blogs, posts, news, chats, etc. in real time.

Did you know that Google now searches in real time, and so does Bing? Try looking for the “Updates” option on Google and you will see dynamically updated results. The search engines have recently made deals with Twitter, Facebook, and a few other major networks to be able to do that.

Real time search on Google is new technology, and I feel it’s not surface web (not crawled) and not quite deep web (since most of these results can be found by crawling, though much later). I’d say real time search has become a third kind of search, so we now have:

1. Surface (pages found by crawling)
2. Deep Web (pages that cannot be found by crawling) 
3. Real Time (pages that can be found by crawling but are found faster by getting them directly  from target sites)

Real time search is critical for sourcers who want to be ahead of the competition. If you haven’t used Google alerts before, it’s time to try them.

Selecting the Right Tools

When you choose the sourcing tools and sites, it’s important to figure out where the data is coming from. And no, not “everything is picked from LinkedIn now” (as I read in a forum post recently). We can use the Semantic, Deep Web, and Real Time notions to compare tools. Selecting only one tool may deprive you of useful sources.

Here are a few examples. Zoominfo crawls the web; its data is organized in part surface (visible to search engines) and part deep web (visible with a membership). Jigsaw has data entered by its members; some of its data is visible to all and some is hidden. All company data in Jigsaw is on the surface web, and no membership is required to see it. Pipl.com gets results dynamically from the surface as well as from the deep web. Compare Jigsaw, Zoominfo, and Pipl data against LinkedIn’s and you get validated data which will let you call more target people. As for semantic sourcing tools, give them a good trial run before you buy and check what the technology does and does not.

Happy sourcing!

Leave your thoughts below to add yourself into the drawing to win 3 FREE months of referYes Sourcer. It’s painless and only takes a comment.

About the author

  Irina is an Executive and Technical Recruiter, an Expert Sourcer and a Web/Social Media Researcher and Trainer. For the past five years she has been a Partner with Brain Gain Recruiting, placing senior full-time employees in software development, IT, ERP, strategy consulting, and finances. She has an MS in Mathematics and a strong technical background. Irina is the Winner of the SourceCon Challenge in 2009. Read about Irina’s training webinars and DVDs on her blog Boolean Strings + Social Media. Irina runs several active recruiter online communities, including the Boolean Strings Network. Here is Irina’s LinkedIn Profile. Follow her on Twitter at @braingain.

Related posts:

1. 50 Awesome Search Engines and more for #Recruiters
2. 11 Research, Data Capture and Search Engine Tools from our readers for #Recruiters
3. Hakia – Semantic Search displayed well

Have you heard of Wolfram Alpha? You might have, but if not this is something you are going to want to keep your eyes out for.

So, this is a little different that my normal reviews on technology in that I have never actually used the product. But neither have you. In fact, nobody in the public sector has, not even beta testers, unless you are part of the development team at Wolfram Alpha, and even than only a select few are privileged. The tool goes live May 1st 2009.

The other day I had the pleasure of speaking with a lead Business Development guy at Wolfram, and got to understand what all of the hype is about. After reading another post centered on Semantic search and a few tools I was recommending, Gary Clarke of Wolfram reached out to me to discuss the technology and how this will change search as we know it. I had the opportunity to run through a live hour (one on one) demo of the new search tool and I’ve got to tell you that it is pretty darn impressive

In a nutshell, the geniuses over at Wolfram have built a “Computational Knowledge Engine” built on top of mathematica that will serve as the world’s first true natural language search engine. It differs form the likes of Powerset or Wiki, and far exceeds the inner workings of Google; in fact Alpha computes answers, returning only one result. This result according to Alpha is the correct answer to your question.

It computes answers? That’s correct, and I saw it work. This database is not just packed with questions and relevant answers. This system actually takes your question, breaks it down and computes the answers to multiple questions providing you with one direct answer. If that wasn’t enough, I asked Gary to take me through some examples regarding demographics and salary to simulate some intelligence gathering as if I were completing this for a client.

Some of the results I was curious to see examples of were pertained to:

• Salary comparisons
• Demographic Breakdowns
• Industry Growth

Not only did it give me the info I needed in a clear and concise manner, it provided me with a report complete with graphs, comparisons and real time links to all of the sources the information was gathered from. This report is printable and there you have it. Two hours of research minimized to one direct question.

Alpha has been called many things in the past during its highly secretive development including the “Google Killer “but lets be real, Google is simple. It’s a search engine that allows us to gather information that is relevant to our search and information that we need or want; but it does not compute answers. Alpha on the other was engineered to return “knowledge about human knowledge.”

This is a huge project that involves more than 100 brainiacs creating a computational database that serves as the foundation for the data. And this is where your results come from; credible, verified sources that are housed in the Alpha brain.

So the question I have is: Can something like this be leveraged for recruiting? (Other than the example I gave above) Natural Language search is here and it’s not going away anytime soon. In my estimation, a system like Alpha at least in its beginning stages will show value when searching for facts about something or someone factual.

I am very curious to learn your thoughts on natural language search and how this will change how we gather intelligence. And if you haven’t already, take a look at my posting from last week “Is recruiting a purely electronic transaction?”. This could very well start us on the path.

Please leave a comment and let’s have a great conversation about this search changing tool. I will perform a real-time demo in the coming weeks as a beta test for Wolfram. I will follow this up with some real experience as well.

No related posts.

A question came in this week regarding search; specifically “Semantic Search.” What is it? What’s the value? And do I need to go to school to learn it?

Let’s start this off quick and dirty. I’ll break this down in a few parts.

• Semantic Search vs. Typical Search
• My Top 3 Semantic Search Engines

Before I get started I ask that you please leave a comment with your thoughts and/or your own tool! I’d like to share your post with our audience!

Do you need to go to school to learn it?

No, but I would say subscribe to the blog to learn more about cutting edge search if you are slightly lost. Semantic search is simple at face value and for the purpose of your searching all you really need to understand is how it works and how you need to approach the system.

A semantic search works off of language, Meanings and discovery. The biggest differentiator to your normal search engines is that typical search engines search for keyword relevance and occurrence on a specific page or set of pages within websites. Semantic Search leverages real thoughts or language making it superior in locating relevant information for your search. Have you ever wondered what tags are and how they fit into the meaning?

A better way to understand the use of tags is that they identify content and create a road map to relevant and searchable information. In general, Semantic Search is the next gen search engine that only a few have been remotely successful with and a ton more are investing heavily in.

Check it out for yourself. Here are my top 3 that I encourage you to check out!

Powerset

Powerset aims to narrow search results allowing you to aggregate, summarize and navigate information. Powerset is a Microsoft venture acquired 2008. Currently the search is limited to 3 areas all based off of Wikipedia.

Use: I used Powerset to search wikis each day. I have great success gathering intelligence, like client information, sales information etc.

Hakia

Hakia in my estimation is by far one of the best if not the best available engines available. The results are relevant, they are fresh and updated and from what I have always found they are pulled from credible sources and are easier to cite if needed.

Use: Recruiting, Company searches, publications and quotations from executives

MiddleSpot.com

MiddleSpot.com is a search engine that allows you to visually search, edit and share your results in multiple workpads or spaces. I’ve previously had the opportunity to chat with one of the founders of MiddleSpot. You can read the interview HERE.

MiddleSpot is visually appealing and very relevant in it’s return.

Use: recruiting, intelligence and project sharing with groups

There you have it. Semantic Search explained and my top 3 Semantic Search tools (as of today, but probably different tomorrow)

Feel free to leave a comment with your favorite tool!

Need a Job – Check out our Newest Postings! CLICK HERE

Related posts:

1. Hakia – Semantic Search displayed well
2. 50 Awesome Search Engines and more for #Recruiters
3. 10 Top #metasearch Engines for #recruiting & #sourcing