amazon bedrock

[Vihanth]

Description

adding amazon bedrock to access anthropic.claude-3-5-haiku LLM.

Issues

New feature

Type of change

List the type of change like below. Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds new functionality)
• Breaking change (fix or feature that would break existing design and interface)
• Others (enhancement, documentation, validation, etc.)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

[ashahba]

Thanks @Vihanth for this PR.

[srinarayan-srikanthan]

bedrock microservice with / without streaming is working. But when integrated with megaservice only non streaming is working. streaming is giving empty string as output.

[chensuyue]

The pre-commit.ci robot is not allowed to commit into your org, so please fix the issue locally.

[chensuyue]

pip install pre-commit
pre-commit install