<img src="https://api.contentstack.io/v2/assets/575e4cfb58208ba076e29312/download?uid=blt43110f5aa6d6f785?uid=blt43110f5aa6d6f785" data-sys-asset-uid="blt2184c3e4c52662b9" alt="exceptionless-logoBLK.png" width="220" height="55" style="float: right;width: 220;height: 55;margin: 0px;text-align: right;"/><a href="http://exceptionless.com/" target="_blank">Exceptionless</a> is an open source technology company that deals in real-time event reporting and logging, focusing specifically on error reporting. Our goal is to help the world's developers improve their applications and user experience by being… well... exceptionless.<h2>To be Without Exception</h2>Exceptionless provides real-time error reporting for JavaScript, Node, <a href="http://www.asp.net/" target="_blank">ASP.NET</a>, Web API, WebForms, WPF, Console, and MVC apps. Everything is pulled into a dashboard that organizes each event into a simple yet robust and fully-featured view that gives you quick access to actionable data that will help your app become exceptionless!We’ve learned quite a bit since the first version of Exceptionless, and we’d love to share our story on why we ended up migrating to Elasticsearch with great success.In the first version of Exceptionless, we were using MongoDB for our primary document data store. We chose it for it’s ease of use, ability to scale out instead of up, and the cross platform story. It worked pretty well until we started to grow, then we began having issues scaling several features, such as real-time dashboards with automatic time zone shifting, backups, restores, and storage.<h2>Real-time Dashboards</h2>When we first built our real-time based dashboards with MongoDB, we had to do a ton of research on timezones, which is a monumental task in and of itself. We found that we would need to pre-aggregate data into 15 minute buckets of time (to account for different time zone offsets) into separate collections, in addition to our event collections. This would allow us to quickly return statistics data for any 15 minute time frame, but it also added the expense of additional storage and processing time needed to shift the buckets of stats into the desired time zone with each request.We were really excited to learn that, by moving to Elasticsearch, we would not only solve this difficult problem using the <a href="https://www.elastic.co/guide/en/elasticsearch/reference/master/search-aggregations-bucket-datehistogram-aggregation.html" target="_blank">date_histogram</a>, but that it would also allow us to:<ul><li><a href="https://github.com/exceptionless/Exceptionless/blob/master/Source/Core/Utility/EventStats.cs#L65-L104" target="_blank">Get live statistics for any timezone offset for any time range</a></li><li>Index much faster, since we don’t need to pre-aggregate data</li><li>Add new visualizations without worrying about having the pre-aggregated data</li><li>Maintain a lot less code</li><li>Remove pre-aggregated statistic collections</li></ul><img src="https://api.contentstack.io/v2/assets/575e4cfb9985d58976377cc0/download?uid=bltbe3e7df2bdbd0bbe?uid=bltbe3e7df2bdbd0bbe" data-sys-asset-uid="blt07c992ddc2a7987f" alt="Exceptionless dashboard.png" style="max-width: 100%;"/>Fig. 1: Exceptionless Dashboard<img src="https://api.contentstack.io/v2/assets/575e4cfb3dc542cb38c0955c/download?uid=blt0f2841bbb054afe2?uid=blt0f2841bbb054afe2" data-sys-asset-uid="blt01704e52b2a441ee" alt="K3 dashboard.png" style="max-width: 100%;"/> Fig. 2: Exceptionless Kibana 3 Dashboard<h2>Backup and Restoring</h2>One of the huge pain points prior to moving to Elasticsearch was backing up MongoDB. There isn’t a lot of documentation for doing so in production, which leads users to bring down the cluster to do a quick backup via MongoDump, zip the backup, and upload it to some destination. The other option is to pay monthly fees and run an extra node for the MMS service, which does oplog backup and restore.One of the most underrated features of using Elasticsearch is backups and restores! It has been the most pleasant experience to configure and use. We setup a <a href="https://github.com/exceptionless/Exceptionless/wiki/Elasticsearch-setup-guide#run-the-scripts-on-a-cron-job" target="_blank">Cron job</a> on one of our nodes to run <a href="https://github.com/elastic/curator" target="_blank">curator</a> for cleanup, and to run a backup to azure blob storage via the <a href="https://github.com/elastic/elasticsearch-cloud-azure" target="_blank">cloud-azure plugin</a>. The nicest thing about this is you can quickly choose exactly what index to restore to a development machine if you wish to debug production data, while keeping your data secure and backed up in the cloud.<h2>Disk Space</h2>After migrating our data we found&nbsp;that it used about one-fifth the disk space as MongoDB (please note that <a href="https://www.mongodb.com/blog/post/whats-new-mongodb-30-part-3-performance-efficiency-gains-new-storage-architecture" target="_blank">WiredTiger</a> wasn’t released until sometime after we migrated). This allows us to cut our storage costs across the board.<h2>Scaling Out</h2>There is nothing worse than waking up to find that a VM reboot of one of the nodes or adding a new node caused your MongoDB cluster configuration to become corrupted. This is a very scary situation we once had to deal with and resolve by restoring the cluster configuration. We always found that dealing with the MongoDB cluster configuration is something you don’t touch if it’s working.We love how easy it is to <a href="https://github.com/exceptionless/Exceptionless/wiki/Elasticsearch-setup-guide" target="_blank">setup and manage</a> an Elasticsearch cluster. It’s a dream come true! No matter how you want it to run, it’s just a simple configuration setting or REST call away! Best of all, you can share your configuration with others to get feedback!<h2>Conclusion</h2>We are very happy with the move to Elasticsearch and continue to receive additional value from it with every release. We really like that it’s easy to setup and is open source friendly! <img src="https://api.contentstack.io/v2/assets/575e4cfb43e9adc538714cf1/download?uid=blt58e52d5f94c85043" data-sys-asset-uid="blt58e52d5f94c85043" alt="blake_niemyjski_headshot.jpg" width="101" height="144" style="float: left;width: 101;height: 144;text-align: left;"/>Blake Niemyjski is a full time open source software architect and private pilot. Since the late 90’s, Blake's curiosity has been focused around developing software that helps the masses. As a hobbyist developer turned student and professional, Blake's passion is to further his knowledge and create technologies for the future.

exceptionless-dashboard-no-navigation.jpg

filter-search.png

Being Exceptionless with Elasticsearch

Start free trial

Blog Footer CTA

Sign up for Elastic Cloud free trial

Blake Niemyjski

The content on this page is not available in the selected language. As Elastic grows globally, we continue to support content in multiple languages.

The content on this page is not available in the selected language.

El contenido de esta página no está disponible en el idioma seleccionado. Elastic está trabajando para garantizar que el contenido esté disponible en varios idiomas. Gracias por tu paciencia mientras trabajamos.

By submitting you acknowledge that you've read and agree to our <a href="/legal/elastic-cloud-account-terms" target="_self">Terms of Service</a>, and you agree to receive the <a href="/legal/privacy-statement#how-we-use-the-information" target="_self">selected communications</a> at the contact details you provided above. See <a href="/legal/privacy-statement/" target="_self">Elastic’s Privacy Statement</a> for more details or to opt-out at any time.

Communication Preferences - ONLY for /communication-preferences

Al enviar, confirma que ha leído y acepta nuestras <a href="/es/legal/elastic-cloud-account-terms" target="_self">Condiciones de servicio</a>, y que acepta recibir las <a href="/es/legal/privacy-statement#how-we-use-the-information" target="_self">comunicaciones seleccionadas</a> en los detalles de contacto que proporcionó anteriormente. Consulte la <a href="/es/legal/privacy-statement/" target="_self">Declaración de privacidad de Elastic</a> para obtener más información o para cancelar su suscripción en cualquier momento.

By submitting you acknowledge that you've read and agree to our <a href="/legal/serverless-preview-terms" target="_blank">Terms of Service</a>, and that Elastic may <a href="/legal/privacy-statement#how-we-use-the-information" target="_blank">contact you</a> about our related products and services, using the details you provide above. See <a href="/legal/privacy-statement/" target="_blank">Elastic’s Privacy Statement</a> for more details or to opt-out at any time.

Serverless GDPR Text

Al enviar, confirma que ha leído y acepta nuestras <a href="/es/legal/serverless-preview-terms" target="_self">Condiciones de servicio</a>, y que Elastic puede <a href="/es/legal/privacy-statement#how-we-use-the-information" target="_self">ponerse en contacto con usted</a> acerca de nuestros productos y servicios relacionados. Consulte la <a href="/es/legal/privacy-statement/" target="_self">Declaración de privacidad de Elastic</a> para obtener más información o para cancelar su suscripción en cualquier momento.

By submitting you agree to <a href="/agreements/global/cloud-services-monthly" rel="nofollow">Elastic Cloud Terms of Service</a>. Your personal data will be processed in accordance with <a href="/legal/privacy-statement">Elastic's Privacy Statement</a>.

Cloud Trial GDPR Text

Al enviar esta información, aceptas los <a href="/es/agreements/global/cloud-services-monthly" rel="nofollow">Términos de servicio de Elastic</a>. Los datos personales se procesarán de conformidad con la <a href="/es/legal/privacy-statement">declaración de privacidad de Elastic</a>.

By submitting you acknowledge that you've read and agree to our <a href="/legal/terms-of-use" target="_blank">Terms of Service</a>, and that Elastic may <a href="/legal/privacy-statement#how-we-use-the-information" target="_blank">contact you</a> about our related products and services, using the details you provide above. See <a href="/legal/privacy-statement/" target="_blank">Elastic’s Privacy Statement</a> for more details or to opt-out at any time.

Newsletter GDPR Text

Al enviar, confirma que ha leído y acepta nuestras <a href="/es/legal/terms-of-use" target="_self">Condiciones de servicio</a>, y que Elastic puede <a href="/es/legal/privacy-statement#how-we-use-the-information" target="_self">ponerse en contacto con usted</a> acerca de nuestros productos y servicios relacionados. Consulte la <a href="/es/legal/privacy-statement/" target="_self">Declaración de privacidad de Elastic</a> para obtener más información o para cancelar su suscripción en cualquier momento.

Hosted by

All Solutions

Follow us on Youtube

Watch now (no PT)

Articles by

Share by Email

Filters

All (no PT translation)

Contact information

See when this webinar starts in my time zone

Ver cuándo comienza este webinar en mi zona horaria

Thank you for your interest!

Register to Attend

Small image for

Register to Watch

Continue reading

Featured webinar

What to explore next...

Reset all

Load more press releases

Sign In to Attend

Share

Upcoming webinar

Learn more

Search Integrations

Share on Reddit

Share on Twitter

Share on Facebook

Load more news

View more posts

On-demand webinar

Follow us on Facebook

Author

Press Release

You'll also receive an email with related content.

You'll also receive an email with related content

Además, te enviaremos contenidos relevantes

Print

Contact Info

Overview

Video for

Read less

Register now

Share this story

See All Posts

See all top stories

View next

Can't make it? Register and we'll send you the recording. You'll also receive an email with related content

¿No puedes asistir? Regístrate y te enviaremos la grabación. También recibirás un correo electrónico con contenido relacionado.

Follow us on LinkedIn

Highlights

Explore similar demos

Follow us on Twitter

Share on LinkedIn

Load More

See more insights

Speakers

Close

Thank you for registering. We will send you a confirmation email soon.

Gracias por registrarte. Te enviaremos un correo electrónico de confirmación pronto.

Author

Articles by Blake Niemyjski

Being Exceptionless with Elasticsearch

Sign up for Elastic Cloud free trial