Validating inference framework image tags

[tiffzhao5]

Added unit test to this: #338

Needed to rebase so created a separate PR.

Querying ECR to check for existing images for each inference framework.

[yunfeng-scale]

thanks for the contributions!

i'm worried about the overhead of adding these tags / redeploy model engine server whenever we're adding a new image. possible to query ECR and check existence of the image?

[tiffzhao5]

thanks for the contributions!

i'm worried about the overhead of adding these tags / redeploy model engine server whenever we're adding a new image. possible to query ECR and check existence of the image?

hm I see that's a good suggestion, I'll give it a try and see if it works!

[tiffzhao5]

thanks for the contributions!
i'm worried about the overhead of adding these tags / redeploy model engine server whenever we're adding a new image. possible to query ECR and check existence of the image?

hm I see that's a good suggestion, I'll give it a try and see if it works!

@yunfeng-scale I implemented querying ECR -- what are your thoughts?

[yunfeng-scale]

it seems a some commits were reverted, can you bring them back?

[yunfeng-scale]

please fix @yixu34 's comment