Event Overview
OpenSearchCon is the annual conference that brings the OpenSearch community together to learn, connect, and collaborate. Users, administrators, and developers attend to explore solutions to real-world problems, network with peers, and explore the future of search, observability, and security applications.
Migrating Queries from Lens and Saved Objects — Data Tangles to Data Order
With Sarah Hudspeth and Jason Ng
Migrating between logging solutions is never easy—but moving off a proprietary Kibana instance turned into an unexpectedly complex adventure. We had to extract filters, queries, and navigate a maze of nested query JSONs in older versions of Kibana and OpenSearch—all without the benefit of backwards compatibility.
In this talk, we’ll share the automation and tooling we developed to locate and convert the filters and queries buried in Lens and Visualization data objects. Our approach to wrangling KQL, DQL, and Lucene query languages and untangling complex data schemas. You’ll leave with a deeper understanding of how log data can be structured and restructured effectively.
The session includes a demo of our tooling in action and broader recommendations on how to approach similar migrations from closed-source platforms. Whether you’re facing a migration or just want to understand more about the data powering Lens and Saved Object, you’ll come away with a deeper grasp of what’s under the hood—and how to work with it on your own terms.
Ingestion at Scale: Open Source Pipelines for getting data into OpenSearch
With Anurag Gupta
OpenSearch powers many critical use cases across analytics, observability, and security – However, OpenSearch is only as useful as the data you feed into it.
In this session, we will explore how to data into OpenSearch from a variety of inputs. We will discuss open source tools like Fluent Bit, Data Prepper, and OpenTelemetry Collector and cover their integrations. We will also talk about different types of data such as logs, metrics, and traces and how to leverage these tools and schemas to power a variety of OpenSearch use cases.
In addition to talking about different open source tools we will walk through real-world examples of architecture, deployment patterns, and lessons learned from production environments.
Share This:
Speakers
Field Architect | Chronosphere
Field Architect | Chronosphere
Field Architect | Chronosphere
Anurag is a Field Architect at Chronosphere and is a maintainer of the Fluentd and Fluent Bit project. Previously, he was the co-founder of Calyptia, a telemetry pipeline company that was acquired by Chronosphere. Anurag worked at Elastic, driving cloud products and creating the Elastic Operator product. His experience also includes tenure at Treasure Data heading enterprise open source with Fluentd, and Microsoft Azure Log Analytics, working on Observability as a cloud provider.
Senior Solutions Architect | Chronosphere
Senior Solutions Architect | Chronosphere
Senior Solutions Architect | Chronosphere
Self-taught Data Scientist. I use Python, pandas, SQL, statistical analysis, data visualization, machine learning and other engineering skills in order to build products and communicate insight and meaning from data.
Implementation Engineer | Chronosphere
Implementation Engineer | Chronosphere
Implementation Engineer | Chronosphere
