← All integrations
LangSmith

LangSmith integration. Catch error, latency and cost changes in your LLM apps on LangSmith.

Praxen Inc. watches your LangSmith projects for changes in errors, latency and cost, picks up your alert rules, and opens failing traces to find the cause.

Get started for free

LangSmith tools.

The calls Praxen Inc. can make to LangSmith when it looks into an issue.

LangSmith
  • langsmithListProjects List LangSmith tracing projects with run counts, error rates, latency, tokens and cost
  • langsmithQueryRuns Search LangSmith runs and traces by project, time window, status, run type and filter
  • langsmithGetTrace Read one LangSmith trace as a run tree with latency, tokens, cost and errors
  • langsmithGetProjectMetrics Read LangSmith project metrics over time: traces, errors, latency, LLM calls, tokens and cost
  • langsmithListFeedback List LangSmith feedback scores and comments on runs
  • langsmithListDatasets List LangSmith datasets and read dataset examples
  • langsmithListAlertRules List LangSmith alert rules and where each rule sends its alerts
  • langsmithApi Call the connected LangSmith REST API

Common questions.

Does Praxen Inc. replace LangSmith?

No. Your LangSmith setup stays where it is. Praxen Inc. connects to it and adds the triage, root cause and fixes on top.

Connect it once. Then get back to shipping.

Get started for free