Skip to content

Run functional tests every 2 hours and add another workflow that runs…#1020

Merged
ytimocin merged 2 commits into
edgefrom
ytimocin/updateFuncTests
Apr 8, 2024
Merged

Run functional tests every 2 hours and add another workflow that runs…#1020
ytimocin merged 2 commits into
edgefrom
ytimocin/updateFuncTests

Conversation

@ytimocin
Copy link
Copy Markdown
Contributor

… the tests on AKS instead of k3d

  1. Run tests every 2 hours
  2. Increase the VM sizes for the eshop-azure and eshop-aws tests
  3. Add a new test workflow that runs every 2 hours and runs tests on AKS instead of k3d

Goal:
We will be collecting data for a week to see if the flakiness can be caused by k3d cluster.

@ytimocin ytimocin force-pushed the ytimocin/updateFuncTests branch 9 times, most recently from 238a9b7 to f9bd925 Compare March 22, 2024 18:36
@ytimocin ytimocin marked this pull request as ready for review March 22, 2024 18:41
Comment thread .github/workflows/test-aks.yaml Outdated
Comment on lines +167 to +233
- name: Build images
if: steps.gen-id.outputs.RUN_TEST == 'true' && matrix.images != ''
run: |
# split images and directories into arrays
IFS=',' read -ra images <<< "${{ matrix.images }}"
IFS=',' read -ra directories <<< "${{ matrix.directories }}"
echo "Building images: $images"
echo "Directories: $directories"
for index in "${!images[@]}"; do
image=${images[$index]}
directory=${directories[$index]}
echo "Building image $image from directory $directory"
docker build -t ghcr.io/radius-project/$image:${{ github.run_id }} $directory
docker tag ghcr.io/radius-project/$image:${{ github.run_id }} ghcr.io/radius-project/$image:${{ github.run_id }}
# We need to think about how we can delete these images at the end of the run
docker push ghcr.io/radius-project/$image:${{ github.run_id }}
done
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is where we build the necessary images and push them to GHCR. Would love to get ideas on this approach. I see that for some tests we are using the latest tag but for some we are building images. What would the best approach be here?

Comment thread .github/workflows/test-aks.yaml Outdated
if: steps.gen-id.outputs.RUN_TEST == 'true' && steps.gen-id.outputs.ENABLE_DAPR == 'true'
run: |
helm repo add dapr https://dapr.github.io/helm-charts/
helm upgrade --install dapr dapr/dapr --version=1.6 --namespace dapr-system --create-namespace --wait
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated this so that if Dapr is installed there is no error.

@ytimocin ytimocin force-pushed the ytimocin/updateFuncTests branch 4 times, most recently from 36bf504 to 45d9032 Compare March 22, 2024 19:35
Comment thread .github/workflows/test-aks.yaml Outdated
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
AZURE_LOCATION: westus3
AKS_RESOURCE_GROUP: samples-functional-tests
AKS_CLUSTER_NAME: samples-aks
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ytimocin If you use the existing aks cluster, workflow must clean up the existing resource first before starting the test. I recommend to add the code to delete namespace first before starting the test.

Comment thread .github/workflows/test-aks.yaml Outdated
aws eks update-kubeconfig --region ${{ env.AWS_REGION }} --name ${{ steps.gen-id.outputs.TEST_EKS_CLUSTER_NAME }}
timeout-minutes: 60
continue-on-error: false
- name: Install Dapr
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you use /test/azure/ bicep template, dapr is installed and maintained by AKS. So I would disable this one for AKS cluster.

@ytimocin ytimocin force-pushed the ytimocin/updateFuncTests branch 13 times, most recently from 9a4526b to a8f758f Compare March 24, 2024 21:35
@ytimocin ytimocin force-pushed the ytimocin/updateFuncTests branch 24 times, most recently from e9cd591 to f70e55c Compare April 3, 2024 18:38
@ytimocin ytimocin force-pushed the ytimocin/updateFuncTests branch from f70e55c to d77c6ba Compare April 3, 2024 22:04
… the tests on AKS instead of k3d

Signed-off-by: ytimocin <ytimocin@microsoft.com>
Signed-off-by: ytimocin <ytimocin@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants