Skip to content

Commit f47161f

Browse files
committed
docs: include all operations/endpoints that have audit logging enabled
1 parent 2ff3f46 commit f47161f

1 file changed

Lines changed: 31 additions & 10 deletions

File tree

src/langsmith/audit-logs.mdx

Lines changed: 31 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -93,24 +93,45 @@ To forward audit log events to an external SIEM or logging platform, you can run
9393

9494
| Category | Operations (`api.operation`) |
9595
|----------|-----------|
96-
| **API keys & credentials** | `create_api_key`, `delete_api_key`, `create_personal_access_token`, `delete_personal_access_token`, `create_service_key`, `delete_service_key` |
96+
| **API keys & credentials** | `create_api_key`, `delete_api_key`, `create_personal_access_token`, `delete_personal_access_token`, `create_service_key`, `delete_service_key`, `create_service_account`, `delete_service_account`, `list_org_personal_access_tokens`, `list_org_service_keys` |
9797
| **Roles** | `create_role`, `update_role`, `delete_role` |
98+
| **Organizations** | `create_organization`, `create_provisioned_saas_org`, `create_tenant`, `invite_provisioned_org_member`, `claim_pending_organization_invite`, `delete_pending_organization_invite` |
9899
| **Organization members** | `invite_user_to_org`, `invite_users_to_org_batch`, `update_org_member`, `delete_org_member`, `delete_org_pending_member`, `add_basic_auth_users_to_org`, `update_basic_auth_user` |
99-
| **SSO & authentication** | `create_sso_settings`, `update_sso_settings`, `delete_sso_settings`, `update_login_methods`, `update_default_sso_provision_organization` |
100+
| **SSO & authentication** | `create_sso_settings`, `update_sso_settings`, `delete_sso_settings`, `update_login_methods`, `get_sso_settings`, `get_sso_settings_current`, `get_login_methods`, `send_sso_email_confirmation`, `confirm_sso_user_email`, `login` |
100101
| **SCIM provisioning** | `create_scim_token`, `update_scim_token`, `delete_scim_token`, `create_scim_user`, `update_scim_user`, `delete_scim_user`, `create_scim_group`, `update_scim_group`, `delete_scim_group` |
101-
| **Billing & business info** | `update_organization_info`, `update_business_info`, `update_payment_plan`, `update_payment_method`, `create_payment_setup_intent`, `create_payment_checkout_session`, `confirm_payment_checkout_session`, `create_payment_account_link` |
102-
| **Workspaces** | `create_workspace`, `update_workspace`, `delete_workspace`, `add_member_to_workspace`, `add_members_to_workspace_batch`, `delete_workspace_member`, `update_workspace_member`, `delete_workspace_pending_member`, `update_workspace_secrets`, `unshare_entities`, `set_tenant_handle` |
103-
| **Data retention** | `update_ttl_settings`, `update_usage_limit`, `delete_usage_limit` |
102+
| **Billing & business info** | `update_organization_info`, `update_business_info`, `update_payment_plan`, `update_payment_method`, `create_payment_setup_intent`, `create_payment_checkout_session`, `create_payment_account_link` |
103+
| **Workspaces** | `create_workspace`, `update_workspace`, `delete_workspace`, `add_member_to_workspace`, `add_members_to_workspace_batch`, `delete_workspace_member`, `update_workspace_member`, `delete_workspace_pending_member`, `claim_pending_workspace_invite`, `delete_pending_workspace_invite`, `update_workspace_secrets`, `unshare_entities`, `set_tenant_handle` |
104+
| **Data retention & usage limits** | `update_ttl_settings`, `update_usage_limit`, `delete_usage_limit` |
104105
| **Tracing projects** | `update_tracer_session`, `delete_tracer_session`, `delete_tracer_sessions` |
105-
| **Datasets** | `create_dataset`, `create_csv_dataset`, `update_dataset`, `delete_dataset`, `delete_datasets`, `update_dataset_version`, `update_dataset_splits`, `share_dataset`, `unshare_dataset`, `clone_dataset`, `create_experiment_via_upload`, `create_playground_experiment`, `create_comparative_experiment`, `delete_comparative_experiment` |
106-
| **Examples** | `create_example`, `create_examples`, `update_example`, `update_examples`, `delete_example`, `delete_examples` |
107-
| **Deployments** | `create_deployment`, `update_deployment`, `delete_deployment` |
106+
| **Runs & traces** | `query_run`, `query_runs`, `query_trace`, `query_trace_messages`, `batch_query_trace_messages`, `query_threads`, `query_thread_traces`, `read_run`, `read_runs`, `delete_runs`, `get_run_cluster`, `generate_runs_query` |
107+
| **Datasets** | `create_dataset`, `create_csv_dataset`, `update_dataset`, `delete_dataset`, `delete_datasets`, `update_dataset_version`, `update_dataset_splits`, `share_dataset`, `unshare_dataset`, `clone_dataset`, `download_dataset`, `generate_dataset`, `generate_shared_dataset_query`, `get_dataset_comparison_view`, `stream_dataset_comparison_view`, `read_dataset_delta`, `read_shared_delta`, `read_shared_delta_stream`, `create_experiment_via_upload`, `create_playground_experiment`, `create_comparative_experiment`, `delete_comparative_experiment` |
108+
| **Examples** | `create_example`, `create_examples`, `update_example`, `update_examples`, `delete_example`, `delete_examples`, `read_example`, `read_examples`, `get_example`, `list_examples`, `count_examples`, `sync_examples`, `validate_example`, `validate_examples` |
109+
| **Experiments** | `create_experiment_view_override`, `update_experiment_view_override`, `delete_experiment_view_override`, `get_experiment_view_override`, `get_experiment_view_overrides`, `evaluate_experiment` |
110+
| **Evaluators** | `create_evaluator`, `update_evaluator`, `delete_evaluator`, `bulk_delete_evaluators`, `execute_custom_code` |
111+
| **Feedback** | `create_feedback_config`, `update_feedback_config`, `delete_feedback_config`, `create_feedback_formula`, `update_feedback_formula`, `delete_feedback_formula`, `read_feedback`, `read_feedbacks`, `stream_feedback_delta` |
112+
| **Annotation queues** | `create_annotation_queue`, `update_annotation_queue`, `delete_annotation_queue`, `delete_annotation_queues`, `populate_annotation_queue`, `export_annotation_queue`, `add_annotation_queue_reviewer`, `remove_annotation_queue_reviewer`, `add_runs_to_annotation_queue`, `create_annotation_queue_run_status`, `update_annotation_queue_run`, `get_annotation_queue_run`, `get_annotation_queue_runs`, `delete_annotation_queue_run`, `delete_annotation_queue_runs`, `resolve_annotation_queue_run`, `get_pairwise_queue`, `list_pairwise_queues`, `list_pairwise_entries` |
113+
| **Alerts** | `create_alert_rule`, `update_alert_rule`, `delete_alert_rule`, `test_alert_rule` |
114+
| **Filter views** | `create_filter_view`, `update_filter_view`, `delete_filter_view`, `rename_filter_view` |
115+
| **Prompt commits & hub** | `create_commit`, `create_directory_commit`, `delete_directory`, `create_hub_environment`, `update_hub_environment`, `delete_hub_environment` |
116+
| **Prompt canvas quick actions** | `create_prompt_canvas_quick_action`, `update_prompt_canvas_quick_action`, `delete_prompt_canvas_quick_action` |
108117
| **Prompt webhooks** | `create_prompt_webhook`, `update_prompt_webhook`, `delete_prompt_webhook`, `test_prompt_webhook` |
109-
| **Bulk exports** | `create_bulk_export`, `cancel_bulk_export`, `read_bulk_export_destination`, `create_bulk_export_destination`, `update_bulk_export_destination` |
118+
| **Deployments** | `create_deployment`, `update_deployment`, `delete_deployment` |
119+
| **Bulk exports** | `create_bulk_export`, `cancel_bulk_export`, `get_bulk_export`, `get_bulk_export_run`, `get_bulk_export_runs`, `get_bulk_export_runs_filtered`, `list_bulk_exports`, `create_bulk_export_destination`, `update_bulk_export_destination`, `read_bulk_export_destination`, `list_bulk_export_destinations` |
110120
| **Resource tags** | `create_tag_key`, `update_tag_key`, `delete_tag_key`, `create_tag_value`, `update_tag_value`, `delete_tag_value`, `create_tagging`, `delete_tagging` |
111121
| **Access policies** | `create_access_policy`, `delete_access_policy`, `list_access_policies`, `read_access_policy`, `attach_access_policies`, `read_role_access_policies` |
112-
| **Custom charts** | `create_chart`, `update_chart`, `delete_chart`, `create_chart_section`, `update_chart_section`, `delete_chart_section`, `clone_chart_section`, `create_org_chart`, `update_org_chart`, `delete_org_chart`, `create_org_chart_section`, `update_org_chart_section`, `delete_org_chart_section` |
122+
| **Custom charts** | `create_chart`, `update_chart`, `delete_chart`, `read_chart`, `read_charts`, `read_chart_preview`, `create_chart_section`, `update_chart_section`, `delete_chart_section`, `clone_chart_section`, `read_chart_section`, `create_org_chart`, `update_org_chart`, `delete_org_chart`, `create_org_chart_section`, `update_org_chart_section`, `delete_org_chart_section`, `read_tracing_dashboard` |
113123
| **Model pricing** | `create_model_price_map`, `update_model_price_map`, `delete_model_price_map` |
124+
| **MCP servers & tools** | `create_mcp_server`, `update_mcp_server`, `delete_mcp_server`, `register_mcp_server_oauth`, `mcp_proxy`, `create_mcp_vendor_settings`, `update_mcp_vendor_settings`, `delete_mcp_vendor_settings`, `invalidate_mcp_tools_cache`, `create_tool`, `update_tool`, `delete_tool` |
125+
| **Gateway policies** | `create_gateway_policy`, `update_gateway_policy`, `delete_gateway_policy` |
126+
| **Forge configurations** | `create_forge_configuration`, `update_forge_configuration`, `delete_forge_configuration`, `trigger_forge_configuration` |
127+
| **Insights jobs** | `create_insights_job`, `update_insights_job`, `delete_insights_job`, `create_insights_job_config`, `update_insights_job_config`, `delete_insights_job_config`, `generate_insights_job_config`, `get_insights_job_runs` |
128+
| **Fleet usage limits & webhooks** | `create_fleet_usage_limit`, `update_fleet_usage_limit`, `delete_fleet_usage_limit`, `create_fleet_webhook`, `update_fleet_webhook`, `delete_fleet_webhook`, `test_fleet_webhook` |
129+
| **Sandbox proxy profiles** | `create_sandbox_proxy_profile`, `update_sandbox_proxy_profile`, `delete_sandbox_proxy_profile` |
130+
| **Playground settings** | `create_playground_settings`, `update_playground_settings`, `delete_playground_settings` |
131+
| **Self-hosted licensing** | `create_self_hosted_customer`, `update_self_hosted_customer`, `mint_self_hosted_license`, `update_self_hosted_license` |
132+
| **Feature model defaults** | `upsert_feature_default_model`, `delete_feature_default_model`, `upsert_feature_disabled_model`, `delete_feature_disabled_model` |
133+
| **Onboarding** | `create_onboarding_state`, `update_onboarding_state` |
134+
| **NPS** | `submit_nps_response` |
114135

115136
## FAQ
116137

0 commit comments

Comments
 (0)