Welcome to Metadocs, the blog on AI software development

Discover top-notch articles designed to help you build AI applications ready for production. Our focus is on delivering straightforward and practical content that you can apply instantly. Dive into our posts today and start leveraging their insights without delay!

RAG, Anthropic, LLM

Contextual Retrieval: a powerful RAG technique that your wallet will like

With the recent launch of Contextual Retrieval from Anthropic which has terrific results for RAG, it is interesting to explain how it works, and why it can make sense money wise if used correctly. To do that, we will explain the basis of RAG, do the cost calculation and even explain the limits!

Rav
October 25, 2024

LLM, Anthropic, Cost optimisation, OpenAI

How Prompt Caching Works: A Deep Dive into Optimizing AI Efficiency

Prompt Caching representation

Rav
October 17, 2024
1 Comment

Bedrock, LLM

How to make AWS Bedrock Langchain chains faster using BedrockCross-region inference

You have created an application using LangChain and AWS Bedrock and you are wondering how to have better performances and how to be more resilient ? Say no more, in this blog post we will see AWS Bedrock newest features:…

Rav
October 11, 2024

How Moshi Works: A Simple Guide to the to Open Source Real Time Voice LLMs

You’ve probably heard a lot about large language models (LLMs) these days—OpenAI’s GPT models, Google’s Bard, or maybe even Meta’s LLaMA. But what if I told you there’s a model that takes things to the next level by making these…

Rav
October 2, 2024