Skip to content

feat: Amazon Bedrock support ⛰️ - #40

Merged
Marti2203 merged 1 commit into
AutoCodeRoverSG:mainfrom
JGalego:feat/bedrock
Jun 8, 2024
Merged

Marti2203 merged 1 commit into
AutoCodeRoverSG:mainfrom
JGalego:feat/bedrock

Conversation

@JGalego

@JGalego JGalego commented May 7, 2024

Copy link
Copy Markdown
Contributor

Overview

This PR adds support for the following models available on Amazon Bedrock:

  • Claude 3 Haiku
  • Claude 3 Sonnet
  • Claude 3 Opus

Instructions

  1. Build image

    docker build --rm -f Dockerfile -t acr .
  2. Set up AWS credentials

    # See https://litellm.vercel.app/docs/providers/bedrock
    export AWS_REGION_NAME=...
    export AWS_ACCESS_KEY_ID=...
    export AWS_SECRET_ACCESS_KEY=...
  3. Start image

    docker run -it $(env | grep AWS_ | xargs printf ' -e %s') -p 3000:3000 -p 5000:5000 acr
  4. Start web UI

    cd /opt/auto-code-rover/demo_vis/
    sed -i 's/gpt-4-0125-preview/bedrock\/anthropic.claude-3-sonnet-20240229-v1:0/g' main.py
    bash run.sh
  5. Head over to http://localhost:3000

  6. Click 💡 Try example? 💡

  7. Click 🚀 Boot Now! 🚀

    bedrock-acr

@JGalego
JGalego marked this pull request as draft May 7, 2024 13:58
@JGalego
JGalego marked this pull request as ready for review May 7, 2024 15:41
@yuntongzhang
yuntongzhang self-requested a review May 13, 2024 12:51
@Marti2203
Marti2203 merged commit 2393bb0 into AutoCodeRoverSG:main Jun 8, 2024
@Marti2203

Copy link
Copy Markdown
Collaborator

Hi @JGalego , I tested the model driver today. Only added Claude 2 to the patch just for completeness sake. Looks good, thanks for the contribution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants