Category Deployment

Explore the best way to deploy your own open source LLMs on your own using a variety of technologies.

Bedrock, Deployment, Langchain, LLM

Monitor your Langchain app cost using Bedrock with Langfuse

Do you have or want to create a Langchain with AWS Bedrock and are concerned about monitoring costs? Say no more! You are in the right place. Introduction In this post, you will learn: As usual, we will be as…

Rav
July 3, 2024

Langchain, Deployment

Add monitoring easily to your Langchain chains with Langfuse

You have created a nice Langchain application using the latest best practices (that you read on this blog, right? Of course!) and you are wondering how you are going add monitoring to it ?You have come to the right place.…

Rav
June 18, 2024

LLM, Deployment

Use your own LLM endpoint with Langchain

Learn how to integrate easily your custom deployed LLM models on AWS Sagemaker into your Langchain codes.

Rav
April 2, 2024

LLM, Deployment

Never use local LLM again, do this instead

Image of an user wondering about local LLM

Learn the limits of Local LLM and never use them again unless you have no choice and find out you can do it then.

Rav
March 22, 2024

LLM, Deployment

Deploy an LLM on AWS in 5 min

Find out how you can deploy easily your own LLM models from Hugging Face on AWS using AWS Sagemaker. Introduction In this blog post, we are going to deploy an open-source LLM, Mistral 7B, on AWS in literally 5 min…

Rav
March 19, 2024