AI News HubLIVE
站内改写6 分钟阅读

待翻译:AWS vector solutions: Build agentic AI where your data lives

AI 服务暂时不可用,以下为来源摘要,待恢复后补全翻译:AWS offers a broad portfolio of vector search built directly into the databases and storage services you already use, with no standalone vector database or data migration required. This post covers six purpose-built services, a decision framework for choosing the right engine, and customer proof points for each.

来源AWS Machine Learning Blog作者: Marc Trimuschat

AI 服务暂时不可用,以下为来源正文,待恢复后补全翻译。

Agentic AI is changing how you work, and vector search powers the retrieval layer that makes agents accurate, contextual, and grounded in real data. Agents plan, reason, and take action across multi-step workflows, making fast, relevant access to your organization’s knowledge essential. That knowledge already has a home across databases, object stores, search engines, and unstructured sources such as PDFs, recorded video calls, and the systems your teams use every day. AWS vector solutions bring intelligent search and retrieval to your data where it already lives, helping agents find and use the right context without requiring you to move or duplicate your data. For new workloads where no existing data store applies, we offer a clear decision model across six purpose-built solutions so you can choose the right vector solution for your agentic AI and analytics workloads. Why vectors matter and top use cases for agentic AI Vectors are the language of AI. They bridge frontier models and the scattered organizational knowledge accumulated over decades. By representing data as high-dimensional vectors, applications can understand semantic meaning, identify relationships across text, images, audio, and video, and maintain context across sessions. Whether you’re working with product descriptions, security logs, or media libraries, vectors convert everything into a shared mathematical space so you can compare and search across modalities. Combined with frontier AI models, vectors are the foundation for intelligent, context-aware, personalized, and user-specific experiences: Retrieval Augmented Generation (RAG) and knowledge bases ground frontier model responses with trusted data retrieved at runtime, improving accuracy, reducing hallucinations, and generating responses aligned with organizational knowledge. Semantic search retrieves information based on meaning and intent rather than exact keyword matches, allowing users to discover relevant content even when different terminology is used. Hybrid search combines lexical search with semantic search to deliver comprehensive results across structured and unstructured data. GraphRAG combines semantic search with knowledge graphs to deliver accurate, context-rich, and traceable responses for enterprise scenarios requiring multi-step reasoning. Knowledge graphs connect entities, such as people, products, documents, and concepts through explicit relationships, supporting more intelligent search, discovery, and AI-powered reasoning. With the options outlined in the previous section, vectors support several use cases, including: Real-time recommendation systems identify products, content, or experiences that align with user interests for personalization through vector similarity across retail, media, and entertainment. Anomaly and fraud detection identifies unusual patterns in high-dimensional data, supporting earlier detection of threats, cyber security issues, or equipment failures. Multimodal content discovery searches across text, images, audio, and video using a single query based on semantic meaning rather than file type or metadata. The good news is you don’t need a new database for most of these use cases. With AWS, you get vector capabilities where your data already lives, across the services and databases that you already know and use, with no data migration required. The following figure shows the breadth of AWS vector capabilities and top use cases for agentic AI. Figure 1: Breadth of AWS vector capabilities for your agentic AI use cases First principle: Add vectors where your data already lives This is the principle that guides our entire approach. If you already have an AWS data store, add vector search to that data store. Don’t introduce a new service unless there’s a compelling reason to do so. Vectors stay with the source data, removing cross-service hops and combining vector search with native query capabilities. When you use your existing data store, you remove the learning curve for new programming tools, APIs, SDKs, and more. You also can be confident that your existing data stores meet your requirements. As an example, your databases proven in production for scalability, availability, and performance will continue to deliver now with vector search. Finally, when your vectors and data are stored in the same place, your applications run faster. There’s no data sync or data movement to worry about. You also realize cost savings by building on investments that you’ve already made. If your data is already in Amazon OpenSearch Service, Amazon Simple Storage Service (Amazon S3), Amazon Aurora PostgreSQL, Amazon DynamoDB, Amazon ElastiCache for Valkey, or Amazon Neptune, add vectors where the data already is. The right vector search solution follows the data, not the other way around. For new workloads, identify your dominant requirement: latency, cost, or access pattern, and choose the engine optimized for it. Many workloads need a balance of search, scale, and agentic AI integration. For those, default to Amazon OpenSearch Service, which combines lexical, vector, hybrid, and agentic search in a single system with high throughput, low latency, and relevant results at scale. The following decision model can help you select the right vector solution based on your workload requirements. Figure 2: Decision model for vector engines Amazon OpenSearch Service: The default for new workloads Amazon OpenSearch Service is a managed retrieval engine that combines lexical, vector, and hybrid search in a single system with high throughput, low latency, and relevant results at scale. It supports multiple indexing strategies, vector quantization, and metadata filtering, scaling from simple RAG applications to advanced multi-signal retrieval. Machine learning (ML)-powered auto-optimization removes manual tuning by selecting the right configurations automatically. GPU acceleration indexes massive datasets up to 10x faster at a quarter of the cost, while UltraWarm and Writable Warm tiers reduce storage costs for less frequently accessed data. Choose OpenSearch Service as the default for new workloads because most new workloads don’t have a single dominant requirement. They need a balance of search, scale, and agentic AI integration. OpenSearch Service provides the most flexibility across latency, vector volume, queries per second (QPS), cost efficiency, hybrid search, and ease of adoption. It covers the broadest set of use cases including RAG, anomaly detection, multimodal content discovery, and any workload requiring hybrid search. It supports multi-billion vector volumes, handles thousands of QPS, and serves more than 100,000 monthly active customers processing over 10 trillion requests per month. The next generation of Amazon OpenSearch Serverless is built for agentic AI and dynamic workloads. It autoscales 20x faster than its previous generation, provisions in seconds, and ramps from zero to thousands of requests per second. It also scales back to zero when idle, delivering up to 60% cost savings compared to provisioning for peak capacity. You only pay for consumed capacity. If your agents aren’t running, you pay nothing. Adobe adopted OpenSearch Service to scale its Acrobat AI Assistant to serve hundreds of millions of users. This is a conversational generative AI engine integrated directly into Adobe’s document ecosystem. Amazon S3 Vectors: Cost-optimized vector storage at any scale Amazon S3 Vectors, a capability of Amazon S3, is the first cloud object store with native support to store and query vectors. It brings the cost structure, scale, and simplicity of S3 to vector storage, reducing the cost of uploading, storing, and querying vectors by up to 90 percent compared to specialized vector databases. This makes it cost-effective to build and maintain billion-scale vector indexes that improve AI agent memory, context, and semantic search across content stored in Amazon S3 with zero infrastructure to manage. Since the general availability of S3 Vectors, customers have been performing tens of millions of queries per day on average, a more than 5x increase over the preview period. Two recent enhancements improve the query experience and pricing. First, S3 Vectors now supports up to 10,000 search results per query, a 100x increase that’s especially valuable for multi-stage retrieval pipelines that apply reranking, aggregation, or deduplication to produce a more relevant result set. Second, query charges on vector indexes with over 10 million vectors are now reduced by up to 80%, significantly lowering costs for running similarity search across large-scale AI, RAG, and semantic search workloads. Choose Amazon S3 Vectors when you need cost-effective vector storage with simple vector search and metadata filtering for infrequent queries of large vector datasets. It’s recommended when latency can be approximately 100 ms or more, or for fast-growing vector datasets at moderate QPS. It supports up to two billion vectors per vector index with pay-per-query pricing, so you pay for stored vectors while query costs accrue only when you search. Common use cases include semantic search over data lakes, RAG-based knowledge retrieval, large-scale vector storage, and batch retrieval. Customers also work directly with vectors and indexes through the S3 API. BMW Group uses S3 Vectors as a building block for its hybrid search solution that is powered by an intelligent search agent built with Amazon Bedrock AgentCore. Engineers can query 20 petabytes of data in plain natural language, combining S3 Vectors for semantic similarity searches and Amazon Athena for SQL queries. Amazon DynamoDB: Single-digit millisecond vector search at any scale Amazon DynamoDB is a serverless, fully managed, distributed NoSQL database with single-digit millisecond performance at any scale. Vector search with DynamoDB delivers single-digit millisecond latency at over 99 percent recall designed for any scale, even trillions of vectors. It’s fully serverless with no servers to provision, patch, or manage, and no software to install, maintain, or operate. The zero infrastructure management that you love with DynamoDB, including no versions, no maintenance windows, and no downtime maintenance, is also available on vector search. Vector search in DynamoDB introduces a new index you create on the attribute that stores vector embeddings. It supports up to 4,096 dimensions, Euclidean, cosine, and dot-product distance functions, and inline filtering. DynamoDB vector search works with DynamoDB global tables, both with multi-Region eventual consistency and strong consistency. DynamoDB serves over a million customers. Customers already use DynamoDB today for agentic workloads, such as holding session context during conversations and tracking state across multi-step tasks. With vector search, DynamoDB can support semantic retrieval for long-term memory in agentic applications. Other use cases include RAG, multimodal similarity search, and recommendation engines. And you can do all of this in one serverless database, no separate vector store to maintain and synchronize data, and no new API to learn. Choose DynamoDB vector search when your operational data already lives in DynamoDB, or you need single-digit millisecond vector search at any scale with zero infrastructure management. Globant is a digitally native company that builds AI-powered products and digital transformation solutions for enterprises around the world. “We already build client solutions on DynamoDB, so having native vector search in the same database is extremely valuable — no need to replicate data into a separate vector store or manage a second system. It’s fully serverless, scaling automatically across virtually any scale, so we only pay for what each client uses, and it delivers the real-time, low-latency search that user-facing AI experiences demand. [truncated for AI cost control]