remove numbagg and numba from the upstream-dev CI
#7416
Merged
numbagg and numba from the upstream-dev CI
#7416