feat(agent): add support for agent collab, orch and FM in prompt

[krokoko]

Fixes #998 and #999 and #1011

• Add support for multi agent collaboration
• Add support for custom orchestration
• Add support for foundation model in prompt override configuration
• Update documentation for guradrails

See comments in the PR below to get output of tests

---

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the project license.

[krokoko]

The following code snippet:

const customerSupportAgent = new bedrock.Agent(this, 'CustomerSupportAgent', {
      foundationModel: bedrock.BedrockFoundationModel.ANTHROPIC_CLAUDE_3_5_SONNET_V1_0,
      instruction: 'You specialize in answering customer support questions about our products.',
      userInputEnabled: true,
      shouldPrepareAgent:true
    });

    const customerSupportAlias = new bedrock.AgentAlias(this, 'CustomerSupportAlias', {
      agent: customerSupportAgent,
      aliasName: 'production',
    });

    const mainAgent = new bedrock.Agent(this, 'MainAgent', {
      name: 'MainAgent',
      instruction: 'You are a helpful assistant that can answer general questions and route specialized customer support questions to the customer support agent.',
      foundationModel: bedrock.BedrockFoundationModel.ANTHROPIC_CLAUDE_3_5_SONNET_V1_0,
      agentCollaboration: bedrock.AgentCollaboratorType.SUPERVISOR,
      agentCollaborators: [
        new bedrock.AgentCollaborator({
          agentDescriptor: { aliasArn: customerSupportAlias.aliasArn },
          collaborationInstruction: 'Route customer support questions to this agent.',
          collaboratorName: 'CustomerSupport',
          relayConversationHistory: bedrock.RelayConversationHistoryType.TO_COLLABORATOR,
        }),
      ],
    });

Deploys correctly:

[aws-rafams]

Overall, the interfaces appear well-designed and intuitive. My only suggestion pertains to the Agent Descriptor. In my opinion, it would be more consistent and clear to replace it with IAgentAlias. This aligns better the naming convention used in the console, which features a simple Agent Alias and makes no mention of AgentDescriptor.
Apart from this minor adjustment, the work is pretty neat. Great job!

[trey-rosius]

Hi folks, will this PR be merged anytime soon ?

[ztanruan]

any update on this request ?

[krokoko]

Testing with the a collaborator agent, working as expected:

[krokoko]

Testing with 2 collaborators:

Requests are properly routed:

[krokoko]

Testing custom orchestration:

with the following code snippet (lambda code from here:

 // Create a Lambda function for custom orchestration
    const orchestrationFunction = new lambda.Function(this, 'OrchestrationFunction', {
      runtime: lambda.Runtime.PYTHON_3_10,
      handler: 'index.handler',
      code: lambda.Code.fromAsset(path.join(__dirname, '../lambda/orchestration')),
    });

    // Create an agent with custom orchestration
    const agent = new bedrock.Agent(this, 'CustomOrchestrationAgent', {
      name: 'CustomOrchestrationAgent',
      instruction: 'You are a helpful assistant with custom orchestration logic.',
      foundationModel: bedrock.BedrockFoundationModel.AMAZON_NOVA_LITE_V1,
      orchestrationType: bedrock.OrchestrationType.CUSTOM_ORCHESTRATION,
      customOrchestration: {
        executor: bedrock.OrchestrationExecutor.fromlambdaFunction(orchestrationFunction),
      },
    });

The stack deploys correctly and custom orchestration is correctly applied:

Custom logic is correctly invoked:

[krokoko]

Testing prompt override foundation model:

const customerSupportAgent = new bedrock.Agent(this, 'CustomerSupportAgent', {
      foundationModel: bedrock.BedrockFoundationModel.ANTHROPIC_CLAUDE_3_5_SONNET_V1_0,
      instruction: 'You specialize in answering customer support questions about our products.',
      userInputEnabled: true,
      shouldPrepareAgent:true
    });

    const customerSupportAlias = new bedrock.AgentAlias(this, 'CustomerSupportAlias', {
      agent: customerSupportAgent,
      aliasName: 'production',
    });

    const agent = new bedrock.Agent(this, 'Agent', {
      foundationModel: bedrock.BedrockFoundationModel.AMAZON_NOVA_LITE_V1,
      instruction: 'You are a helpful and friendly agent that answers questions about literature.',
      userInputEnabled: true,
      codeInterpreterEnabled: false,
      shouldPrepareAgent:true,
      agentCollaboration: bedrock.AgentCollaboratorType.SUPERVISOR_ROUTER,
      agentCollaborators: [
        new bedrock.AgentCollaborator({
          agentAlias: customerSupportAlias,
          collaborationInstruction: 'Route customer support questions to this agent.',
          collaboratorName: 'CustomerSupport',
          relayConversationHistory: true,
        }),
      ],
      promptOverrideConfiguration: bedrock.PromptOverrideConfiguration.fromSteps(
        [
          {
            stepType: bedrock.AgentStepType.ROUTING_CLASSIFIER,
            stepEnabled: true,
            foundationModel: bedrock.BedrockFoundationModel.AMAZON_NOVA_LITE_V1
          }
        ]
      )
    });   

Stack deploys correctly. Collaborator routing is correctly configured to the new model:

[krokoko]

any update on this request ?

PR is open now, once reviewed it will be in

[MichaelWalker-git]

LGTM