LangSmith
Connect
Connect LangSmith from the terminal. Pass --help for the flags LangSmith accepts.
praxen integration connect --type langsmithA service key from Settings → API Keys in LangSmith, with access to the workspace you want to connect.
Connect your LangSmith workspace with a service key.
- In LangSmith settings, open API Keys and create a service key for the workspace you want to connect.
- Paste the key into Praxen Inc. Praxen Inc. checks it and finds the region, the organization, and the workspace. If the key can read more than one workspace, pick the one to connect.
Read LangSmith traces, runs, feedback, and datasets through Praxen Inc., and request API changes. Changes require safety review and approval.
Praxen Inc. watches each tracing project for changes in errors, latency, tokens, and cost, and adds a webhook action to each of your LangSmith alert rules, so an alert that fires opens an issue in Praxen Inc.
Praxen Inc. uses these LangSmith APIs:
| LangSmith API | What it unlocks |
|---|---|
GET /api/v1/sessions | Lists tracing projects with their run counts, error rates, latency, tokens, and cost. |
POST /api/v1/runs/query, GET /api/v1/runs/{id} | Finds failing and slow runs and opens a whole trace. |
POST /api/v1/sessions/{id}/dashboard | Reads error rate, latency, token, and cost series per project. |
GET /api/v1/feedback | Reads feedback scores and comments on runs. |
GET /api/v1/datasets, GET /api/v1/examples | Reads datasets and their examples. |
/api/v1/platform/alerts | Reads your alert rules and adds the Praxen Inc. webhook action to each one. |
langsmithApi | Calls any LangSmith API; calls that change state require safety review and approval. API keys and trace ingestion are not available. |
Disconnecting removes the Praxen Inc. webhook action from your alert rules and leaves the service key in LangSmith. Remove it under Settings → API Keys in LangSmith.
Disconnect
Disconnecting stops every sync and check and deletes the credentials Praxen Inc. held. Praxen Inc. removes what LangSmith's API lets it remove. The following stays until you remove it yourself:
- LangSmith API key
praxen integration disconnect <id>Tools
8Operations agents can perform in threads.