awesome-opensearch
A curated list of links and resources for OpenSearch. Maintained by the folks @ BigData Boutique (makers of Pulse AI SRE for OpenSearch)
https://github.com/bigdataboutique/awesome-opensearch
Last synced: 12 days ago
JSON representation
-
š Articles & Resources
-
Vector & Hybrid Search
- Guide to migrating data from Elasticsearch to OpenSearch
- How to optimize OpenSearch costs (video)
- Amazon OpenSearch H1 2023 in review
- Amazon OpenSearch H2 2023 in review
- Amazon OpenSearch Serviceās vector database capabilities explained
- The OpenSearch Blog
- OpenSearch Project Roadmap 2024ā2025
- Choosing the k-NN algorithm
- Amazon OpenSearch Blogs
-
-
š¤ Conferences & Meetups
- OpensearchCon Europe 2025 - 30 April ā 1 May 2025 in Amsterdam, Netherlands
-
š Helpful Documentation Sections
-
Vector & Hybrid Search
- Creating and Managing Domains
- Configuration Changes
- Registering a Manual Snapshot Repository
- SAML Authentication
- UltraWarm Storage
- Index State Management (AWS)
- Supported Operations
- Installation Quickstart
- Index State Management
- Data Streams
- Snapshots
- Alerting
- Trace Analytics ā Getting Started
- Logstash
- Data Prepper
- Installation Quickstart
- Index State Management
- Data Streams
- Snapshots
- Alerting
- Trace Analytics ā Getting Started
- Logstash
- Data Prepper
-
-
š Helpful Sections in the Documentation
- Get started with ANN on OpenSearch
- k-NN Index Documentation
- ElasticSearch 7.10 Documentation - Some areas still aren't well-covered by the Opensearch documentation
- AWS Opensearch Developers Guide
- Installation Quickstart
- Index State Management - Mastering ISM is critical for many OpenSearch uses
- Data Streams
- Snapshots
- Alerting
- Integrations
- Trace Analytics - Getting Started
- Logstash
- Data Prepper
- Installation Quickstart
- Index State Management - Mastering ISM is critical for many OpenSearch uses
- Data Streams
- Snapshots
- Alerting
- Integrations
- Trace Analytics - Getting Started
- Logstash
- Data Prepper
-
š Managed Services
-
Vector & Hybrid Search
-
-
š Official Opensearch Links
-
š Official OpenSearch Links
-
š OpenSearch Ambassadors
-
Vector & Hybrid Search
-
-
š Talks Navigation
-
Architecture & Scaling
- Develop for Core Performance - Samuel Herman, DataStax I'm breaking down key insights from our latest RFC that's shaping the future of core OpenSearch performance. https://github.com/opensearch-project/OpenSearch/issues/16841 It touch on core fundemental issues that are essential to master to take⦠|
- From Zero To Maintainer: How We Implement Generation of Code for 4 Clients (JS... Torekeldi Niyazbek - Torekeldi Niyazbek, DEMETRA SYSTEMS As a Maintainer of the OpenSearch Specification Repository, Iād like to share how we addressed a major challenge in maintaining OpenSearch clients (Ruby, Python,⦠|
- Keynote: The State of OpenSearch User Groups: Building a Global Community - Kris Freedain, Amazon Web Services In this talk, OpenSearch Community Manager Kris Freedain shares the journey and insights gained from building OpenSearch's global User Group program. From its humble beginnings following⦠|
- Multi-tenant Workload Management in OpenSearch - tenant Workload Management in OpenSearch - Kaushal Kumar & Kunal Khatua, Amazon Dive deep into OpenSearch workload management and optimize your cluster's performance and resource allocation. This talk is suitable for both seasoned users and newcomers to OpenSearch. We'll cover workload⦠|
- Recreating Production Workload Behavior Is an Art, Not a Science - Ian Hoang & Rishabh Singh, Amazon Web Services Every OpenSearch workload behaves and evolves differently. Users strive to understand their production workloadās behavior by running performance tests. But this is often done with⦠|
- Transforming Data Aggregation in Opensearch: Achieving 100x Faster Per... Ankit Jain & Sandesh Kumar - Ankit Jain & Sandesh Kumar, AWS Efficient data analysis and visualization heavily rely on the performance of aggregations in Opensearch. However, optimizing the performance of aggregations in the multi-phase and⦠|
- Uberās Innovations in OpenSearch for a Cloud Native, Serverless... Pallavi Priyadarshini & Yupeng Fu - Pallavi Priyadarshini, Amazon Web Services & Yupeng Fu, Uber In this session, Uber, a premier member of the OpenSearch Foundation, will share how the unique demands of their low-latency, high-throughput search platform have⦠|
- Reimagining Search : Scaling OpenSearch Across an Enterprise - Platform Centric Approach - Turja Narayan Chaudhuri, Big4 Consulting Search is no longer just a featureāitās a critical capability that drives innovation, efficiency, and decision-making across enterprises. However, scaling OpenSearch⦠|
- Taming Your Query Latency - Jason Hinch, Atlassian Struggling to tame the latency of your OpenSearch query? Atlassian was facing the exact problem with a query which had grown organically over a number of years of relevance improvements. Learn how they dove into the internals of OpenSearch to⦠|
- Uberās Innovations in OpenSearch for a Cloud Native, Serverles... Pallavi Priyadarshini & Charu Jain - Pallavi Priyadarshini, AWS & Charu Jain, Uber In this session, Uber, a premier member of the OpenSearch Foundation, will share how the unique demands of their low-latency, high-throughput search platform have driven impactful⦠|
- Keynote: OpenSearch on Kubernetes at Atlassian - Cameron Stewart, Principal Software Engineer, Atlassian At Atlassian Opensearch powers core search functionality across our products. Supporting such critical applications requires a reliable foundation. This talk discusses how we achieve that using⦠|
- A Deep Dive Into OpenSearch Plugin Architecture and Introducing Hot... - Pranav Garg & Aman Kumar, Amazon Web Services In this talk, weāll take a deep dive into the service architecture behind OpenSearch plugins and how they integrate with the core services. Weāll then transition⦠|
- Accelerating OpenSearch With Streaming: Apache Arrow, Flight, Data... - Saurabh Singh & Harsha Vamsi, Amazon Web Services As search and analytics workloads scale, OpenSearch needs faster, cloud-native foundations. This talk presents a new streaming framework in OpenSearch, while⦠|
- Advancing OpenSearch With gRPC and Protobuf at Uber: A High-Performance... - Performance API for Modern Search - Karen Xu & Shuyi Zhang, Uber This session explores Uber's integration of gRPC and Protocol Buffers into OpenSearch, introducing a high-performance, strongly-typed communication layer optimized for⦠|
- Beyond the Code: Evolving OpenSearch's Release Process for... - Jiaxiang Zhu & Sayali Gaikawad, Amazon Web Services Releasing in open source isn't just about CI jobs and artifact buildsāit's about making the process transparent, accessible, and scalable for everyone. In this talk, we⦠|
- CYOP: Create Your Own Plugin - Gaurav Gupta; Nishtha Mittal & Craig Perkins, Amazon Web Services Ever wanted to extend OpenSearch with your own custom functionality? In this hands-on session, weāll walk through the entire process of building an OpenSearch plugin from scratch, code to deployment.⦠|
- Deep Dive Into OpenSearch Pull-Based Ingestion at Uber - Based Ingestion at Uber - Varun Bharadwaj, Uber & Yupeng Fu, Uber Inc In this session, Uber, a premier member of the OpenSearch Foundation, will present an in-depth overview of the architecture of the pull-based ingestion feature contributed to OpenSearch. Unlike⦠|
- Digging Into OpenSearchās Memory: Lucene and JVM Garbage Collection Under the... - Yeonghyeon Ko, SK hynix OpenSearch indexing creates short-lived Java objects from Lucene analyzers and field types, which impact heap behavior, GC frequency, and node performance. This session explores how⦠|
- Flexible OpenSearch Data Management With Apache Iceberg: Data... - Sotaro Hikita & Shuhei Fukami, Amazon Web Services Managing data for OpenSearch workloads sometimes requires organizations to rebuild indices, conduct testing with different data versions, and⦠|
- Innovating at Scale: Lessons from Pegasystems' OpenSearch Journey - Amanda Katona, NetApp Instaclustr & Satya Mishra, Pegasystems Speakers: Satya Mishra, Amanda Katona How do you scale infrastructure to meet the demands of massive workloads while keeping operations efficient and innovation front⦠|
- Introducing the OCSF Normalization Playground for Preparing Data for... - Kevin Fallis, Amazon Web Services & Chris Helma, Alto Pharmacy The OCSF Normalization Playground is a tool that enables developers and security engineers to rapidly create and test⦠|
- Next-Gen Search: How Uber and the OpenSearch Community Built a Cloud Native 3.0- Shubham Gupta, Uber - Gen Search: How Uber and the OpenSearch Community Built a Cloud Native 3.0 - Shubham Gupta, Uber OpenSearch 3.0 marks a major step toward a fully cloud-native, modular search engine architecture. In this session, Uberāan OpenSearch Foundation premier memberāshares how the scale and latency⦠|
- OpenSearch Joins a Foundation: A Blueprint for Community-Led Migration- Jiaxiang Zhu & Saurabh Singh - Led Migration - Jiaxiang Zhu & Saurabh Singh, Amazon Web Services What does it take to move a large, active open-source project into a new foundation? Spoiler: it's way more than renaming a GitHub org. In this talk, we share how OpenSearch is⦠|
- Operating OpenSearch at Scale: Lessons From Managing 10,000+ Clusters Across... - Hariharan Gandhi, SAP SE Running OpenSearch as a managed service at massive scale is no small feat. In this session, weāll explore the architectural and operational strategies behind hosting tens of⦠|
- Scaling OpenSearch: Next-Generation Shard Allo... - Generation Shard Allocation for High-Performance Clusters - Rishab Nahata, Arpit Bandejiya & Himshikha Gupta, In large-scale OpenSearch clusters, shard allocation has long been a significant bottleneck, often leading to extended waiting times and potential API timeouts.⦠|
- Sharding 2.0: Unlocking Infinite Search Scalability in OpenSearch - Vikas Bansal & Paras Jain, Amazon Web Services Search systems are hitting a wall. Static sharding causes hotspots, slow queries, and costly overprovisioning. But what if your search infrastructure could evolve in real⦠|
- Work Smarter, Not Harder: Discover Your OpenSearch Clusters Breaking...- Mike Oviedo & Rishabh Singh - Mike Oviedo & Rishabh Singh, Amazon Web Services Understanding how your OpenSearch cluster behaves under load is critical for capacity planning, stability, and regression detection. Traditional⦠|
- Maximize Resource Efficiency with Separated Index and Search Workloads
-
Community / Keynote
- Keynote: Closing Remarks - Nate Boot, Amazon Web Services |
- Keynote: Welcome & Opening Remarks - Dagney Braun, Amazon Web Services; Jochen Kressin, Eliatra & Search Guard; Eric Pugh, OpenSource Connections |
- Keynote: Closing Remarks - Kuldeep Yadav, Amazon Web Services |
- Strengthening India's FOSS Community - Ansh Arora, FOSS United This talk presents an in-depth exploration of FOSS United's (see fossunited.org) mission to galvanize the Free and Open Source Software (FOSS) movement across India. The talk aims to share insights into the initiatives and programs⦠|
- OpenSearch: From Code to Community - Andrew Ross, Principal Engineer, AWS |
- Welcome & Opening Remarks - Dotan Horovits, Senior Developer Advocate, OpenSearch |
- 10 Billion Downloads: Insights and Trends in Open Source - Avi Press, Scarf In this talk, we share the up-to-date results and fresh insights of an in-depth analysis of data gathered from over 10 billion events analyzed across thousands of projects. The analysis reveals a clearer view of the latest⦠|
- Growing a Vibrant Open Source OpenSearch Community in China - Charlie Yang, Amazon Web Service The Chinese OpenSearch community begins from scratch when nobody knows this engine, and now it becomes a strong contributing force. We will demonstrate a big growing market of opensource and the⦠|
- Keynote: The Aryn Journey - Growing a Gen AI Startup on OpenSearch and the Road Ahead - Growing a Gen AI Startup on OpenSearch and the Road Ahead - Mehul Shah, CEO & Co-founder, Aryn In this talk, Iāll recount Arynās journey on how we built our GenAI product and company from inception to now around OpenSearch. OpenSearch is not only the foundation on which⦠|
- Keynote: The OpenSearch Community, Building the Future Together, AWS, NVIDIA and SAP - Carl Meadows, Director of Product, AWS Corey J. Nolet, Principal Architect, NVIDIA Hariharan Gandhi, Product Owner/Tech Lead - Cloud Logging, SAP SE |
- Keynote: Welcome Back - Kassian Wren, Open Source Technology Evangelist, NetApp Instraclustr |
- Keynote: Welcome Back - Eric Pugh, Founder, OpenSource Connections |
- Unconference: Python Now! An OpenSearch world with/in/on Python - Eric Pugh, co-founder, OpenSource Connections & Charlie Yang - Software Development Manager, AWS Python is the lingua franca of ML/AI. With the super evolution speed of python nowadays, it becomes the āonlyā in the AI world. This⦠|
- Why Content (no, Not Just Docs) Needs More From the Open-Source Community - Source Community - Kassian Wren, NetApp Instaclustr Code isnāt the only thing that makes an open-source project. Thereās time. Nearly all unpaid time. Time spent cursing at failing integration tests, crafting PR comments, etc. People⦠|
- Keynote: Opening Remarks
- Keynote: OpenSearch: From Project to Community-Driven EcosystemāBuilding Sustainable Governance Together
- Keynote: Illuminating the Japanese Market with the Power of OpenSearch
- Keynote: Closing Remarks
-
General / Other
- A Tool for Eyeballing: Better Than NDCG? - Stavros Macrakis & Eric Pugh There are lots of statistics we can calculate for search relevance: NDCG, precision, MAP, ā¦. OpenSearch 3.0 calculates and displays them for you. But metrics donāt tell the whole story. In particular, NDCG canāt give you the⦠|
- Unconference Session: DevOps is a Foreign Language (Or Why There Are No Junior SREs) - Joshua Lee, Altinity |
- Unconference Session: Keeping Data Silos Truly Isolated - Sakshi Nasha, Cohesity |
- Unconference Session: Optimising Search Relevance Using Querqy - Rene Kriegler, OpenSource Connections |
- Unconference Session: Search QPS - Aswath Srinivasan, AWS |
- Unconference Session: Test Search On Any Website With Quepid and Some Janky Javascri... Charlie Hall - Charlie Hall |
- Unconference Session: The Power of Data Visualizations - Karsten Schnitter, SAP |
- OpenSearch Migrations: Modernize Without Worry - Peter Nied & Brian Presley, Amazon Web Services No matter what version you're runningāwhether itās legacy Elasticsearch or an earlier OpenSearch releaseāyou can adopt OpenSearch 3.x with zero risk to your existing cluster using the Migration⦠|
- Unconference: Context is all you need? - Navnit Shukla, Sr. Specialist Solution Architect Data and AI, AWS Often time data spread across multiple data sources (search, EDW, DB, noSQL, Saas, etc) and when you are building ā production grade AI/GenAI applications, you need to connect the dot. Now⦠|
- Unconference: How will AI + Search (IR) converge? - Stavros Macrakis, Product Manager, Search, AWS AI + IR = ? Search / Info Retrieval |
- Unconference: OpenSearch is not a database! - Gene Alpert, Sr. Analytics Specialist TAM, AWS Unstructured No integrity enforcement No data independence So stop trying to ājoinā indexes and flatten/de-normalize your data! |
-
Ingest & Pipelines
- From Bug To PR: Turning Customer Pain Points Into Upstream Contributions - Brian Graf & Alex Bunday, NetApp Instaclustr Open source thrives when users become contributors. Yet many organizations struggle to bridge the gap between finding bugs and contributing fixes back to the community. At NetApp⦠|
-
Monitoring & Observability
- Data Prepper or Logstash: Helping You Choose Your Ingestion - David Venable, Amazon & Krishna Kondaka, Amazon Web Services OpenSearch Data Prepper is a pipeline tool within the OpenSearch project for data ingestion. A common question that comes up within the open-source community is how it relates⦠|
- Effortless Collaboration With OpenSearch Workspace : A Hands-On Demo - On Demo - Abhay Baiju, Atlassian & Shambhavi Sarin, Salesforce In a large organisation at scale, collaborating effectively on analytics and observability is a major challenge. Sharing the right set of permissions with the right⦠|
- FinOps for Observability: Reining in Hidden Monitoring Costs Across Distributed Teams - Amir Jakoby, Sawmills FinOps has revolutionized cloud cost management, with many vendors emerging over the years to offer tools to curb skyrocketing cloud expenses. However, in distributed organizations, where⦠|
- Mastering and Monitoring Our Smart Home With OpenSearch - Pietro Mele & Benjamin Dauvissat, Adelean Who watches the watchmen? Released several years ago, the open-source project Home Assistant is becoming increasingly popular for managing our smart homes. Its plugin architecture and the large⦠|
- Real-Time Analytics UX: Designing OpenSearch Interfa... Xenia Tupitsyna, Laura Pavlov, Aparna Sundar - Time Analytics UX: Designing OpenSearch Interfaces for Security and Observability Teams - Xenia Tupitsyna, AWS; Laura Pavlov, Amazon Web Services; Aparna Sundar, OpenSearch Project Join us to explore how user research drives technical innovation in OpenSearch. Discover how our UX team rebuilt⦠|
- Security Monitoring of OpenSearch With OpenSearch - Nils Bandener, Eliatra & Craig Perkins, Amazon One of the really cool aspects of OpenSearch is its ability to serve as a monitoring tool for itself. Let's have a look at how to piece together a monitoring solution for OpenSearch using components⦠|
- Testing, Testing, Testing! - Darshit Chanpura & Derek Ho, Amazon Geared towards developers looking to contribute to a new or existing OpenSearch or OpenSearch Dashboards plugin, this talk will explore the testing practices of the OpenSearch project in depth. We'll delve into the functional test⦠|
- Using OpenSearch With OpenTelemetry To Solve Real World Scenarios - Shambhavi Sarin, Salesforce & Abhay Baiju, Atlassian In this presentation, weāll go over a real world scenario where we used OpenTelemetry to collect data from logs, metrics and traces and OpenSearch to store and search them. We⦠|
- Beyond Slow Logs: Implementing Advanced Query Insights in OpenSearch - Siddhant Gupta, AWS Query Insights delivers deep visibility into search query execution, offering detailed metrics and actionable recommendations to help users optimize their search operations. This feature analyzes query⦠|
- Monitoring Your OpenSearch Cluster Effectively - Ashish Singh & Shourya Dutta Biswas, Amazon Web Services OpenSearch's distributed architecture and its versatility in catering to diverse use cases contribute to the unique challenges that can arise, leading to system degradation. This talk will⦠|
- OpenTelemetry Auto Instrumentation for Effortless Observability - Hanshal Mehta, CloudRaft We will be looking into how to instrument applications with minimum effort using OpenTelemetry auto-instrumentation. Specifically, we will deploy a simple Node.js application that demonstrates the⦠|
- Operating Opensearch - The Kubernetes Way - The Kubernetes Way - Pratik Parikh, Simbian OpenSearch is a powerful open-source search and analytics engine, but running it effectively on Kubernetes requires a well-structured approach. In this session, I will explore how to deploy, configure, and operate OpenSearch in a⦠|
- Journey To Cost-Optimized OpenSearch: A Deep Dive Into Segment Replication - Optimized OpenSearch: A Deep Dive Into Segment Replication - Varun Bansal & Ashish Singh, Amazon Web Services Operating OpenSearch at scale often means paying for the same indexing work N+1 times. Document replication re-runs the full indexing pipeline on every replica, inflating⦠|
- Mastering the Query Insights Dashboard in OpenSearch - David Zane & Chenyang Ji, Amazon Web Services This session offers a focused walkthrough of the Query Insights Dashboard, highlighting its exciting new features and core functionality. Given the shorter format, weāll concentrate on practical⦠|
- Autoscaling Search and Analytics in Kubernetes: The OpenSearch Operator Advantage - Pawel Wlodarczyk, Eliatra Discover how the OpenSearch Operator seamlessly integrates into the Kubernetes ecosystem, enabling GitOps workflows with ArgoCD for effortless, declarative cluster management. Explore the⦠|
- Building Modern Observability Architecture With OpenSearch, OS Ingest... - Luis Tiani & Lucas Vieira Join us for an insightful session showcasing a complete observability architecture using AWS managed open source solutions. Through practical demonstrations, we'll explore⦠|
- Extending OpenSearch: A Practical Guide To Building Custom Plugins - Lucian Precup & Oceane Piedallu, Adelean OpenSearch is a powerful open-source search and analytics suiteābut its true strength lies in its extensibility. In this session, weāll take a hands-on look at how developers can build,⦠|
- From Bottlenecks To Breakthroughs: Optimizing Aggregation in OpenSearch for Lightning-Fas... A. Jain - Fast Analytics - Ankit Jain, Amazon Web Services Efficient data analysis and visualization in OpenSearch depend on fast, scalable aggregations. Yet optimizing performance in a distributed, multi-phase query engine⦠|
- From Kernel To Cloud: Building a Complete Open Source Observ... - Anirudha Jadhav & Shenoy Pratik Gurudatt, Amazon Web Services Modern cloud-native environments demand comprehensive observability, but achieving this without vendor lock-in remains challenging. This session demonstrates⦠|
- Kubernetes Under the Magnifying Glass: Observability With OpenSearch - Arnab Chatterjee, Nomura As Kubernetes adoption grows, ensuring the health and performance of clusters becomes increasingly complex. This session explores how OpenSearch can simplify observability for Kubernetes workloads by⦠|
- OpenTelemetry With OpenSearch: Use-Cases, Status and Roadmap - Hershko, Pulse | OpenSearchCon NA 2025 | OpenTelemetry With OpenSearch: Use-Cases, Status and Roadmap - Itamar Syn-Hershko, Pulse OpenTelemetry is becoming (or already became) the de-facto standard for monitoring in the cloud and beyond. In this session we'll learn why OpenTelemetry (or OTel in short) is important, how to start using it⦠|
- Operating an OpenSearch Powered E-commerce Search Engine at Scale - commerce Search Engine at Scale - Lucian Precup & Amine Gani, Adelean What does it take to run a search engine that powers over 1000 e-commerce storesāeach with unique catalogs, configurations, and user behaviors? This talk explores the search engine from a DevOps⦠|
- Vital Signs: OpenSearch and Bioobservability - Nate Boot, OpenSearch The observability principle isnāt just a tech buzzword - it actually originates from control theory and systems engineering. Despite being also widely used in software engineering, what it really refers to is how well you can⦠|
- Mastering Search Performance: Advanced Query Insights for Production OpenSearch
- 30 Minutes To Zero: Slashing Debug Time With WhatIsWrongWithThis? - scoped debugging pattern that streams rich diagnostics into OpenSearch for instant analysis. |
-
Neural & Semantic Search
- Bringing Down the Cost of Your OpenSearch Clusters - Aswath Srinivasan, OpenSearch @ AWS & Priyanshi Omer, AWS Cost for running OpenSearch also always been a huge factor. In spite of OpenSearch being completely open-source and no licensing cost, when you are dealing with terabytes and petabytes of⦠|
- Zero To Hero: Building a Developer-First Search Experience With OpenSearch - First Search Experience With OpenSearch - Unnati Mishra, VMware Walk through our journey of creating a developer-centric documentation search platform that understands code snippets, technical context, and user intent. Learn how we enhanced OpenSearch's⦠|
- Managing the Managed: Advanced Automation and Security for Amazon...- Luciano Taranto & Derrike Nunn - Luciano Taranto & Derrike Nunn, Amazon Web Services Join us as we share our journey of operating OpenSearch at scale through Amazon's managed service offering. We'll demonstrate how we've solved common⦠|
- OTeL/Piped Processing Language: Simplifying Observability Queries With Open...- Peng Huo & Ashwin Pc - Peng Huo & Ashwin Pc, Amazon Web Services Observability practitioners face a common challenge: complex query syntaxes that impede efficient analysis of logs, metrics, and traces. This talk⦠|
-
Operations Automation
- Finding Alternatives to Security Manager - Gulshan Kumar, Amazon OpenJDK has decided to permanently disable security manager (JSM/security-manager) starting JDK 24-- considering it as legacy. Java security manager is used extensively in Opensearch to sandbox Opensearch process. This sandboxing⦠|
- Migrating Queries From Lens and Saved Objects -- Data Tangles To Data... - - Data Tangles To Data Order - Sarah Hudspeth & Jason Ng, Chronosphere Migrating between logging solutions is never easyābut moving off a proprietary Kibana instance turned into an unexpectedly complex adventure. We had to extract filters, queries, and⦠|
- Practical Migration From Distributed OpenSearch Environments To Enterprise-wide SIEM Platform - world SIEM consolidation across AWS accounts, covering migration strategy, cost reduction, and operational lessons. |
- Rule-Based Auto-Tagging in OpenSearch: A Flexible Approach To Multi Tenancy - based request classification and workload routing to simplify multi-tenant OpenSearch environments. |
- From Chaos To Control: GitOps Disaster Recovery With the OpenSearch Operator
-
RAG & LLM Integration
- Analytics Performance at Scale: The OpenSearch Star Tree Index Journ... Bharathwaj G & Sandesh Kumar - Bharathwaj G & Sandesh Kumar, Amazon Web Services In observability and analytics workloads, aggregation queries are fundamental but often become a performance bottleneck as OpenSearch aggregations scale linearly with document⦠|
- Building a Communication Platform With OpenSearch for Optimized Text and Multi-Modal D... Satej Sahu - Modal Data - Satej Sahu, Zalando SE Building a communication platform that handles diverse data typesāemails, chats, attachments, and filesācan be complex. Storing and organizing this data in a way that makes it⦠|
- Building a Resilient, Petabyte-Scale Logging Platform With OpenSearch - Scale Logging Platform With OpenSearch - Mark Kavanagh & Parth Pandit, Amazon Web Services This talk will dive deep into building a multi-region, highly scalable enterprise-grade logging platform on OpenSearch. The platform can scale to handle over 100 terabytes of⦠|
- Building a Secure and Scalable LLM Infrastructure With OpenSearch - Pedro Guimarães & Peter De Sousa, Canonical OpenSearch provides several tools for search and information retrieval, important in many stages of prompt processing. However, to be used in a varied range of industries and regulations⦠|
- Building an Open Source Observability Stack from Raw Telemetry - Joshua Lee, Altinity This session will guide you through the process of building a complete observability stack from the ground up using raw telemetry data ingested directly into a datastore, combining a variety of open source signals⦠|
- Building the Future of Search: Hybrid Approaches With Neural Sparse a... Aditya Soni & Seema Saharan - Aditya Soni, Forrester & Seema Saharan, Autodesk Forget the old search paradigmsāAI is here to change everything! By blending sparse (traditional term-based) and dense (vectorized) search methods, OpenSearch⦠|
- Creating an API Definition for OpenSearch Retroactively - Pranav Garg & Sachet Jayaram Alva, Amazon The standard way for creating APIs is to first define the API contract, use that to generate classes and write your application around it. But what happens when the application is already in place⦠|
- Cross-Reference Code Mapping System With Opensearch - Reference Code Mapping System With Opensearch - Irine Benoy & Ismaël Hassane, Oracle Leveraging OpenSearch, we propose a Cross-Reference Code Mapping System to dynamically map medical products across terminologies and regulatory frameworks. For example, it maps Paracetamol (UK) to⦠|
- Dive Deep on OpenSearchās Vector Search - Jon Handler, Amazon Web Services & Yuye Zhu, Amazon Search engines take in a query and return a set of results that best satisfy the need of the searcher. Words from a text box, user interface facets, and some user identity information have been the clues⦠|
- Enhancing Application Observability With OpenSearch and OpenTelemetry - Karsten Schnitter, SAP SE How do you know whether your applications are running smoothly or struggling? OpenSearch can provide insights and analyze telemetry data of your applications. Modern observability revolves around three⦠|
- Exploring Tiered Caching in OpenSearch: Optimizing Performance With... Ankit Jain & Sagar Upadhyaya - Layered Caching Strategies - Ankit Jain & Sagar Upadhyaya, AWS Join us for an in-depth exploration of tiered caching in OpenSearch, a powerful search and analytics engine. Caching plays a crucial role in optimizing⦠|
- High Availability Architecture With OpenSearch - Gaurav Bafna & Varun Bansal, Amazon Dive deep into the cutting-edge strategies for designing robust, highly available OpenSearch clusters that maintain peak performance even in the face of infrastructure challenges. This session will showcase how to⦠|
- How To Start Contributing To OpenSearch Without Any Prior Knowledge on Op... Abdul Muneer Kolarkunnu - Abdul Muneer Kolarkunnu, NetApp Instaclustr Abstract: Contributing to an open-source project like OpenSearch can seem daunting, especially without prior knowledge of the product. In this presentation, I will share⦠|
- Improve Auction House Search With Vector Capabilities: Bedrock or SageMaker Serv... Mikhail Chumakov - Mikhail Chumakov, Actum Digital Search engines guide users from their initial goals to the information that fulfills those goals. The retrieved items are deemed relevant when they align with the⦠|
- Managing Over 1,000 OpenSearch Clusters in a Private Cloud - Sun Ro Lee, LINE In this session, we'll share our experience managing over 1,000 OpenSearch clusters in a private cloud, focusing on technologies used for stable operations and cost reduction. The LINE Cloud team provides OpenSearch as a⦠|
- Maximizing OpenSearch Cluster Performance: A Comprehensive Benchmarkin... Govind Kamat & Mike Oviedo - Govind Kamat & Mike Oviedo, Amazon Performance testing OpenSearch clusters requires careful consideration of numerous variables and methodologies. While OpenSearch Benchmark (OSB) and its associated workloads provide⦠|
- OpenSearch Dashboards: Past Progress and Future Roadmap - Nate Boot, Amazon Web Services This session will provide an overview of key advancements in OpenSearch Dashboards delivered in 2024, including the launch of the next-generation OpenSearch UI. Highlights include multiple data source⦠|
- OpenSearch Indexes Made Easy: Terraform, Python, and a Sprinkle of M... Yulia Barabash & Laysa Uchoa - Yulia Barabash & Laysa Uchoa, Nordcloud, IBM Company Versioning OpenSearch indexes is critical for maintaining data integrity, ensuring seamless updates, and enabling rollback capabilities in modern CICD pipelines. This⦠|
- Optimizing OpenSearch Cluster Performance With Dynamic Shardi... Aswath Srinivasan & Robert Hoffmann - Aswath Srinivasan & Robert Hoffmann, Amazon Web Services Many OS users, especially those new to Lucene-based search engines, struggle with sharding best practices. This often results in inefficient shard sizes, leading to⦠|
- Overcoming Challenges in Building a Multi-Tenant Logging Platf... David Riepl & Maximilian Scharizer - Tenant Logging Platforms for Kubernetes - David Riepl & Maximilian Scharizer, RISE GmbH This talk will explore how OpenSearch can be leveraged to build a centralized and multi-tenant log analysis platform that provides logging-as-a-service to several⦠|
- PutOpenSearchVector QueryOpenSearchVector: Use Case of Two Python NiFi Processo... Vincenzo Lombardo - Vincenzo Lombardo, Seacom With NiFi version 2.x, the ability to interface with OpenSearch using pre-built Python components (processors) was introduced. These processors address various needs related⦠|
- RAG From Text and Images Using OpenSearch and Vision Language Mod... Jakub Zavrel & Batu Helvacioglu - Jakub Zavrel & Batu Helvacioglu, Zeta Alpha With the rapid rise of Large Vision Language Models, radically new approaches to multimodal information retrieval have been proposed. Methods like ColPali and Document Screenshot⦠|
- Supercharging OpenSearch for RAG: Lessons From a Large-scale GenAI... Nabeel Janjua & Akarsha Sehwag - scale GenAI Deployment - Nabeel Janjua, HDI AG & Akarsha Sehwag, Amazon Web Services In this session, we'll delve into the critical optimizations and fine-tuning strategies that propelled HDI Germany P&C and Life Insurance, a Talanx AG⦠|
- Unconference Session: Query Understanding with LLM - Praveen Mohan Prasad, AWS |
- Unifying Diverse Logs in Big Data Systems for Seamless Analysis and Action with OpenSe... Satej Sahu - Satej Sahu, Zalando SE In modern big data ecosystems like Databricks, logs from different jobs, stages, and components can be highly diverse, making it difficult to gain comprehensive insights into⦠|
- Unlock NextGen Agentic Product Search With ML and LLM Innovations of OpenSea... Praveen Mohan Prasad - Praveen Mohan Prasad, AWS In the realm of search, Machine Learning plays a pivotal role in enhancing the user experience throughout the entire lifecycle, from ingesting documents to delivering highly relevant results⦠|
-
Programming Languages
Categories
š Talks Navigation
214
š Helpful Documentation Sections
23
š Helpful Sections in the Documentation
22
š Articles & Resources
11
š Official OpenSearch Links
9
š Official Opensearch Links
7
š Training & Tutorials
5
š OpenSearch Ambassadors
5
āļø Useful Tools
4
š Managed Services
4
š Training and Tutorials
2
š¤ Conferences & Meetups
1
š¤ Upcoming Events
1