See how BA Insight is combining SharePoint and Elasticsearch for their Enterprise-wide search.

<html><head></head><body>Personally, I began working with Elasticsearch two years ago. The company I work for, BA Insight, a partner of Elastic, bet on Elasticsearch one year ago and incorporated it into all of our products. We&#x2019;ve been wonderfully pleased with the power of what you can do with it, and in this blog, I&#x2019;ll discuss how we&#x2019;ve combined Elasticsearch with SharePoint for the enterprise search use case.
<h2>Combining Elasticsearch with SharePoint</h2>Elasticsearch developers may not be too familiar with<a href="https://products.office.com/en-us/sharepoint/collaboration"> SharePoint</a>, but it&#x2019;s ubiquitous. More than 200,000 organizations use SharePoint today, often as their UI of choice for employee-facing applications, because it is easy for administrators and end users to tailor. BA Insight has been working in the SharePoint ecosystem for 10 years, and has a very tight relationship with Microsoft, so it&#x2019;s home base for us. When we started working with Elasticsearch we focused first on making a great solution for enterprise search with Elasticsearch as the underlying search engine and SharePoint as the UI.

Example application: Fund Management Portal
 
<img src="https://api.contentstack.io/v2/assets/57750f6ecb714f326193b60d/download?uid=blt7db17b4f66d5bbe8" data-sys-asset-uid="blt7db17b4f66d5bbe8" alt="BA Insight Screenshot.png">
 
This screenshot is an example of a typical application, designed for investment managers at financial services companies. We&#x2019;re told by these users that it has become the first thing people check at the beginning of the day, and something they use constantly throughout the day. We&#x2019;ve set up specific search screens for these financial analysts that encapsulates areas of interest and includes search tabs and embedded Kibana visualizations to drill down into fund performance. It includes:
<ul>
	<li>Personalized dashboard for each user with current activity (my deals, my investments, my regional news), related things that could help me (knowledge in my area of expertise, knowledge related to my deals, potential experts for my deals), and related things I might help others with (deals in the same sector as my deals, deals in my area of expertise). Each of these is just a content-by-search web part, which fires a query when the page is loaded. We&#x2019;ve made it contextual through logic based on the user profile that shapes the query.</li>
	<li>Content from a variety of different systems that surfaces in different views (search everything, search knowledge, search people, search news). This is made possible by connectors we&#x2019;ve built into the Elasticsearch index, and each view results in a different SharePoint result source (you can add a new one in three clicks). We&#x2019;re up to<a href="http://bainsight.com/sharepoint-connectors#connectors"> 55 pre-built connectors for Elasticsearch</a>.</li>
	<li>Investment Analysis center that uses Kibana visualizations along with BA Insight&#x2019;s Visual Refiners product for exploration of funds, trends, etc.</li>
</ul><img src="https://api.contentstack.io/v2/assets/5775104931b4ecb04307503a/download?uid=blt9be2af99c0f5bb59" data-sys-asset-uid="blt9be2af99c0f5bb59" alt="Kibana screenshot.png"> <h2>Elasticsearch vs. SharePoint&#x2019;s built-in search</h2>We&#x2019;ve traditionally worked with the search engine included with SharePoint, and still do a lot with it. However, there are several things that we do now that we couldn&#x2019;t do before we started using Elasticsearch. Most notably:
<ul>
	<li>Real-time indexing has been a huge benefit to our customers. In other enterprise search engines, the latency on the content side is measured in minutes, and therefore making financial transactions searchable has been a nightmare.<a href="https://www.elastic.co/guide/en/elasticsearch/guide/current/near-real-time.html"> Elasticsearch&#x2019;s real-time indexing</a> has provided immense value in a number of verticals, but it&#x2019;s especially popular in financial services.</li>
	<li>GeoSearch &#x2014; searching and presenting things in 2D and 3D spaces &#x2014; is something that our oil and gas customers are very interested in. This is not available natively with SharePoint, but it&#x2019;s a very strong<a href="https://www.elastic.co/guide/en/elasticsearch/reference/2.3/query-dsl-geo-distance-query.html"> capability</a> in Elasticsearch.</li>
	<li>Complex Queries &#x2014; such as regular expression queries &#x2014; and<a href="https://www.elastic.co/blog/out-of-this-world-aggregations"> pipeline aggregations</a> are particularly valuable for research and logistics applications. Our customers here do very complex searches for specific patents, part numbers, chemicals, proteins, genomes, etc. Many of these just weren&#x2019;t possible before using Elasticsearch.</li>
</ul><h2>What does the future look like?</h2>This is an exciting time. Elastic is growing incredibly fast as a company, and SharePoint is also in a huge resurgence with lots of new releases, so we are sort of holding on to a rocket ship with each hand. I&#x2019;m particularly excited about:
<ul>
	<li>X-Pack - We use<a href="https://www.elastic.co/v5"> X-Pack</a> with our customers as a value-added capability. For example, our customers can set alerts with Watcher, get information about when reports are ready, and get periodically scheduled updates. We&#x2019;ve also been able to make our software leverage X-Pack without always requiring it.</li>
	<li>Graph &#x2013;<a href="https://www.elastic.co/products/graph"> Elastic&#x2019;s new Graph API</a> (which is part of X-Pack) is very powerful, and it&#x2019;s a good match for our text analytics capabilities, like entity extraction and relationship extraction. We already work with Microsoft&#x2019;s Office Graph, but that is in many ways a sealed &#x2018;black box&#x2019;. Elasticsearch is the opposite &#x2013; completely open and transparent, so we can build cool things with it quickly.</li>
	<li>Community &#x2013; we are a relative newcomer to the Elasticsearch community. SharePoint also has a vibrant community, but the intersection is small &#x2013; which I think is an opportunity to cross-pollinate. As we get more involved with the Elasticsearch community, we&#x2019;re looking for ways to contribute and are open to all suggestions.</li>
	<li>Multi-platform &#x2013; we&#x2019;re starting to see more folks who are really interested in pre-built connectors, document preview, and some of our other products, but who are not using SharePoint, SQL, or Windows at all. They&#x2019;re asking us to remove dependencies so that they can use our products in different environments. New territory for us, but not rocket science, so we&#x2019;ve started down that path. I&#x2019;d love to hear from folks about their needs and experiences around this.</li>
</ul>
We have also got some cool applications, and interesting case studies in the pipeline. And of course in the near term, we are excited about helping customers adopt and succeed with our products, and with Elasticsearch.
 
<hr><img src="https://api.contentstack.io/v2/assets/57751169cb714f326193b824/download?uid=blt6b8cf616d7cb1597" data-sys-asset-uid="blt6b8cf616d7cb1597" alt="headshot.png" width="127" height="156" style="float: left; width: 127px; height: 156px; margin: 0px;">
&#xA0; Jeff Fried (@jefffried) is a longstanding search nerd and CTO of BA Insight.
</body></html>

ba-insight-elasticsearch-full-bleed.jpg

logo.jpeg

Betting on Elasticsearch for Enterprise-wide Search with BA Insight

Get started

pattern-footer-cta-generic-bottom-left-172x90-blue-bg.svg

pattern-footer-cta-generic-bottom-right-145x250-blue-bg.svg

pattern-footer-cta-generic-top-left-145x250-blue-bg.svg

pattern-footer-cta-generic-top-right-172x90-blue-bg.svg

Generic - Blue - Color

Blog Footer CTA

Sign up for Elastic Cloud free trial

Blog Footer

Jeff Fried

Articles By

Register to Attend

Sign In to Attend

Register to Watch

You'll also receive an email with related content

Watch Now

Learn More

Contact Info

See All Posts

What to explore next...

Load more news

Load more press releases

Load More

View more learning opportunities

More

Date

Location

Agenda

Hosted by

Related workshops

See when this webinar starts in my time zone

Highlights

Featured webinar

On-demand webinar

Upcoming webinar

View next

Register now

Explore similar demos

Video for

Small image for

Share

Continue reading

Share by email

Print

View more posts

Global Virtual Event

Translate Content

AUTHOR

Articles by Jeff Fried

Betting on Elasticsearch for Enterprise-wide Search with BA Insight

Sign up for Elastic Cloud free trial

Products & Solutions

Company

We're hiring

Resources

Solutions

Elastic (ELK) Stack

New

Featured topics

News

AUTHOR

Articles by Jeff Fried

Betting on Elasticsearch for Enterprise-wide Search with BA Insight

Sign up for Elastic Cloud free trial

We're hiring