PromptLayer
PromptLayer is a platform for prompt engineering. It also helps with the LLM observability to visualize requests, version prompts, and track usage.
While
PromptLayerdoes have LLMs that integrate directly with LangChain (e.g.PromptLayerOpenAI), using a callback is the recommended way to integratePromptLayerwith LangChain.
Installation and Setup
To work with PromptLayer, we have to:
- Create a
PromptLayeraccount - Create an api token and set it as an environment variable (
PROMPTLAYER_API_KEY)
Install a Python package:
pip install promptlayer
Callback
See a usage example.
import promptlayer # Don't forget this import!
from langchain.callbacks import PromptLayerCallbackHandler
API Reference:PromptLayerCallbackHandler
LLM
See a usage example.
from langchain_community.llms import PromptLayerOpenAI
API Reference:PromptLayerOpenAI
Chat Models
See a usage example.
from langchain_community.chat_models import PromptLayerChatOpenAI
API Reference:PromptLayerChatOpenAI