AI Notes

Learn a lot

Tag: go

  • Medallion Architecture

    The Medallion Architecture is a data lakehouse architecture pattern popularized by Databricks. It’s designed to progressively refine data through a series of layers, ensuring data quality and suitability for various downstream consumption needs. The name “Medallion” refers to the distinct quality levels achieved at each layer, similar to how medals signify different levels of achievement.… Read more

  • Data Lake vs. Data Lakehouse: Understanding Modern Data Architectures

    Organizations today grapple with ever-increasing volumes and varieties of data. To effectively store, manage, and analyze this data, different architectural approaches have emerged. Two prominent concepts in this landscape are the data lake and the data lakehouse. While both aim to provide a centralized data repository, they differ significantly in their design principles and capabilities.… Read more

  • k-NN (k-Nearest Neighbors) search in OpenSearch

    To perform a k-NN (k-Nearest Neighbors) search in OpenSearch after loading your manuals (or any documents) as vector embeddings, you’ll use the knn query within the OpenSearch search API. Here’s how you can do it: Understanding the knn Query The knn query in OpenSearch allows you to find the k most similar vectors to a… Read more

  • Building a Product Manual Chatbot with Amazon OpenSearch and Open-Source LLMs

    This article guides you through building an intelligent chatbot that can answer questions based on your product manuals, leveraging the power of Amazon OpenSearch for semantic search and open-source Large Language Models (LLMs) for generating informative responses. This approach provides a cost-effective and customizable solution without relying on Amazon Bedrock. The Challenge: Navigating through lengthy… Read more

  • Distinguish the use cases for the primary vector database options on AWS

    Here we try to distinguish the use cases for the primary vector database options on AWS: 1. Amazon OpenSearch Service (with Vector Engine): 2. Amazon Bedrock Knowledge Bases (with underlying vector store choices): 3. Amazon Aurora PostgreSQL/RDS for PostgreSQL (with pgvector): 4. Amazon Neptune Analytics (with Vector Search): 5. Vector Search for Amazon MemoryDB for… Read more

  • Scaling a vector database

    Scaling a vector database is a crucial consideration as your data grows and your query demands increase. Here’s a breakdown of the common strategies and factors involved in scaling vector databases: Why Scaling is Important: Common Scaling Strategies: Techniques for Horizontal Scaling: Factors to Consider When Scaling: Choosing the Right Scaling Strategy: The best scaling… Read more

  • Spring AI and Langchain Comparison

    A Comparative Look for AI Application DevelopmentThe landscape of building applications powered by Large Language Models (LLMs) is rapidly evolving. Two prominent frameworks that have emerged to simplify this process are Spring AI and Langchain. While both aim to make LLM integration more accessible to developers, they approach the problem from different ecosystems and with… Read more

  • Automating Customer Communication: Building a Production-Ready LangChain Agent for Order Notifications

    In the fast-paced world of e-commerce, proactive and timely communication with customers is paramount for fostering trust and ensuring a seamless post-purchase experience. Manually tracking new orders and sending confirmation emails can be a significant drain on resources and prone to delays. This article presents a comprehensive guide to building a production-ready LangChain agent designed… Read more

  • Loading and Indexing data into a vector database

    Vector databases store data as high-dimensional vectors, which are numerical representations of data points. Loading data into a vector database involves converting your data into these vector embeddings. Indexing is a crucial step that follows loading, as it organizes these vectors in a way that allows for efficient similarity searches.Here’s a breakdown of the process: Read more

  • Building a Hilariously Insightful Image Recognition Chatbot with Spring AI

    Building a Hilariously Insightful Image Recognition Chatbot with Spring AI (and a Touch of Sass)While Spring AI’s current spotlight shines on language models, the underlying principles of integration and modularity allow us to construct fascinating applications that extend beyond text. In this article, we’ll embark on a whimsical journey to build an image recognition chatbot… Read more