Skip to content

feat: add root-level tools map with customParameters to AI Config types#141

Merged
jsonbailey merged 8 commits intomainfrom
jb/aic-1935/custom-tool-params
Apr 27, 2026
Merged

feat: add root-level tools map with customParameters to AI Config types#141
jsonbailey merged 8 commits intomainfrom
jb/aic-1935/custom-tool-params

Conversation

@jsonbailey
Copy link
Copy Markdown
Contributor

@jsonbailey jsonbailey commented Apr 20, 2026

Summary

  • Adds AITool frozen dataclass with name, type?, parameters?, and custom_parameters? fields
  • Adds tools: Optional[Dict[str, AITool]] to AICompletionConfig, AICompletionConfigDefault, AIAgentConfig, and AIAgentConfigDefault
  • Adds _parse_tools() helper in client.py that parses the root-level tools map from flag variations
  • Updates _completion_config and __evaluate_agent to parse and propagate tools, falling back to default.tools when absent
  • Exports AITool from ldai.__init__
  • Adds tests/test_tools.py with 6 tests covering tools in completion config, agent config, default fallback, and serialization

Background

The LaunchDarkly backend now includes a root-level tools map (sibling to model) in AI Config flag variations. This is separate from model.parameters.tools[] which is the raw array passable to LLM providers as-is. LLM providers reject unknown properties, so customParameters cannot live inside model.parameters.tools[] — hence the split.

Wire format:

{
  "tools": {
    "web-search-tool": {
      "name": "web-search-tool",
      "type": "function",
      "parameters": { ... },
      "customParameters": { "some-custom-parameter": "some-custom-value" }
    }
  }
}

customParameters is camelCase in the wire format; the Python model uses custom_parameters (snake_case) and serializes back to camelCase in to_dict().

Note

Supersedes PR #106 (devin/1773277027-add-tool-instructions-examples) which had the wrong structure (list instead of map, wrong fields key/version/instructions/examples).

Test plan

  • poetry run pytest — all existing tests pass, 6 new tests for tools coverage
  • Verify AITool.to_dict() serializes custom_parameters as customParameters

🤖 Generated with Claude Code


Note

Medium Risk
Medium risk because it changes the public AI config data model and flag-variation parsing for completion_config/agent_config, which could affect downstream consumers and serialization expectations.

Overview
Adds first-class support for a root-level tools map in AI Config flag variations by introducing the LDTool model (including customParameters wire-format support) and wiring it into AICompletionConfig* and AIAgentConfig*.

Updates LDAIClient evaluation to parse variation['tools'] via _parse_tools() and expose it on returned configs, and exports LDTool from ldai. Adds a focused test suite covering parsing behavior (tools present vs absent) and LDTool.to_dict() camelCase serialization/omissions.

Reviewed by Cursor Bugbot for commit 7c522ae. Bugbot is set up for automated code reviews on this repo. Configure here.

@jsonbailey jsonbailey marked this pull request as ready for review April 24, 2026 22:19
@jsonbailey jsonbailey requested a review from a team as a code owner April 24, 2026 22:19
Comment thread packages/sdk/server-ai/src/ldai/__init__.py Outdated
Adds AITool dataclass and tools map (keyed by tool name) to completion
and agent config types. The root-level tools map is distinct from
model.parameters.tools[] which remains passable to LLM providers as-is.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@jsonbailey jsonbailey force-pushed the jb/aic-1935/custom-tool-params branch from 826f6bb to 6661d5f Compare April 24, 2026 22:25
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Comment thread packages/sdk/server-ai/src/ldai/client.py Outdated
Comment thread packages/sdk/server-ai/src/ldai/client.py Outdated
jsonbailey and others added 3 commits April 27, 2026 09:09
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Comment thread packages/sdk/server-ai/src/ldai/client.py Outdated
jsonbailey and others added 2 commits April 27, 2026 09:26
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…ites

The variation call already incorporates the default via default_dict;
applying a second-level default here is incorrect.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

There are 2 total unresolved issues (including 1 from previous review).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit ccc744e. Configure here.

Comment thread packages/sdk/server-ai/src/ldai/client.py Outdated
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@jsonbailey jsonbailey merged commit f17c535 into main Apr 27, 2026
46 checks passed
@jsonbailey jsonbailey deleted the jb/aic-1935/custom-tool-params branch April 27, 2026 15:48
@github-actions github-actions Bot mentioned this pull request Apr 27, 2026
jsonbailey added a commit that referenced this pull request May 6, 2026
🤖 I have created a release *beep* *boop*
---


<details><summary>launchdarkly-server-sdk-ai: 0.19.0</summary>

##
[0.19.0](launchdarkly-server-sdk-ai-0.18.0...launchdarkly-server-sdk-ai-0.19.0)
(2026-05-05)


### ⚠ BREAKING CHANGES

* StructuredResponse replaced by RunnerResult with new "parsed" property
* AgentResult replaced by RunnerResult and Managed Result
* Removed ModelRunner and AgentRunner protocols
* Removed invoke_method, invoke_structured_model from AIProvider base
class.
* ModelResponse was replaced by RunnerResult
* Add ManagedResult, RunnerResult, and Runner protocol; rename invoke()
to run()
([#148](#148))
* Swap track_metrics_of parameter order to match spec
([#144](#144))

### Features

* Add evaluations support to ManagedAgent.run()
([#153](#153))
([442f46a](442f46a))
* Add judge evaluation support to agent graphs
([#142](#142))
([3d5a6a9](3d5a6a9))
* Add ManagedGraphResult, GraphMetricSummary, and AgentGraphRunnerResult
types
([#151](#151))
([301e24c](301e24c))
* Add ManagedResult, RunnerResult, and Runner protocol; rename invoke()
to run()
([#148](#148))
([88d4ddc](88d4ddc))
* Add root-level tools map with customParameters to AI Config types
([#141](#141))
([f17c535](f17c535))
* bake sampling_rate into Judge at construction; simplify Evaluator to
List[Judge]
([#159](#159))
([86c79e6](86c79e6))
* Update LangChain runners to implement Runner protocol returning
RunnerResult
([#150](#150))
([62a8e25](62a8e25))


### Bug Fixes

* Add runtime DeprecationWarnings to deprecated methods
([#145](#145))
([2189b81](2189b81))
* AgentResult replaced by RunnerResult and Managed Result
([fbb0b4b](fbb0b4b))
* build judge input as string; strip legacy judge config messages
([#165](#165))
([e6942a6](e6942a6))
* Fall back to model.parameters.tools when root tools absent
([#146](#146))
([2c30d75](2c30d75))
* Graph tracking refactor — ManagedAgentGraph drives tracking for new
runner shape
([#154](#154))
([20a5020](20a5020))
* ModelResponse was replaced by RunnerResult
([fbb0b4b](fbb0b4b))
* parse model.parameters.tools as list
([#160](#160))
([fb53e99](fb53e99))
* reference correct PyPI package names in provider load error messages
([#164](#164))
([48761c9](48761c9))
* Removed invoke_method, invoke_structured_model from AIProvider base
class.
([fbb0b4b](fbb0b4b))
* Removed ModelRunner and AgentRunner protocols
([fbb0b4b](fbb0b4b))
* Replace done_callback with coroutine chain for judge tracking
([#147](#147))
([1e1f36b](1e1f36b))
* StructuredResponse replaced by RunnerResult with new "parsed" property
([fbb0b4b](fbb0b4b))
* Swap track_metrics_of parameter order to match spec
([#144](#144))
([53db736](53db736))
</details>

<details><summary>launchdarkly-server-sdk-ai-langchain: 0.6.0</summary>

##
[0.6.0](launchdarkly-server-sdk-ai-langchain-0.5.0...launchdarkly-server-sdk-ai-langchain-0.6.0)
(2026-05-05)


### Features

* Add judge evaluation support to agent graphs
([#142](#142))
([3d5a6a9](3d5a6a9))
* Migrate LangGraph runner to AgentGraphRunnerResult; clean up legacy
shape detection
([#156](#156))
([efa8e00](efa8e00))
* Support conversation history directly in AI Provider model runners
([#166](#166))
([4bb3e78](4bb3e78))
* Update LangChain runners to implement Runner protocol returning
RunnerResult
([#150](#150))
([62a8e25](62a8e25))


### Bug Fixes

* build judge input as string; strip legacy judge config messages
([#165](#165))
([e6942a6](e6942a6))
</details>

<details><summary>launchdarkly-server-sdk-ai-openai: 0.5.0</summary>

##
[0.5.0](launchdarkly-server-sdk-ai-openai-0.4.0...launchdarkly-server-sdk-ai-openai-0.5.0)
(2026-05-05)


### Features

* Add judge evaluation support to agent graphs
([#142](#142))
([3d5a6a9](3d5a6a9))
* Support conversation history directly in AI Provider model runners
([#166](#166))
([4bb3e78](4bb3e78))
* Update OpenAI graph runner to return AgentGraphRunnerResult with
GraphMetrics
([#155](#155))
([388b7af](388b7af))
* Update OpenAI runners to implement Runner protocol returning
RunnerResult
([#149](#149))
([382e662](382e662))


### Bug Fixes

* build judge input as string; strip legacy judge config messages
([#165](#165))
([e6942a6](e6942a6))
</details>

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).

<!-- CURSOR_SUMMARY -->
---

> [!NOTE]
> **Medium Risk**
> Primarily a release/version bump, but it publishes **breaking API
changes** (move to unified `Runner.run()`/`RunnerResult` and removal of
`invoke_*` methods), which can break downstream integrations.
> 
> **Overview**
> Cuts a new release across the core SDK and provider packages:
`launchdarkly-server-sdk-ai` to `0.19.0`, LangChain provider to `0.6.0`,
and OpenAI provider to `0.5.0`, updating the release manifest and
package metadata accordingly.
> 
> Changelogs document the shipped breaking API surface changes (notably
removing `invoke_model()`/`invoke_structured_model()` in favor of
`run(...)` and standardizing returns on `RunnerResult`) plus
accompanying feature/fix entries; the core package version
constants/docs (`__version__`, `PROVENANCE.md`) are updated to match.
> 
> <sup>Reviewed by [Cursor Bugbot](https://cursor.com/bugbot) for commit
a20d7a5. Bugbot is set up for automated
code reviews on this repo. Configure
[here](https://www.cursor.com/dashboard/bugbot).</sup>
<!-- /CURSOR_SUMMARY -->

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: jsonbailey <jbailey@launchdarkly.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants