[Benchmarking] Performance Benchmarking Dashboard

[asfimport]

This is parent task to serve as a starting point for all performance benchmarking dashboard related tasks.

Original discussion started here: https://lists.apache.org/thread.html/278e573445c83bbd8ee66474b9356c5291a16f6b6eca11dbbe4b473a@%3Cdev.arrow.apache.org%3E

 

 

Reporter: Areg Melik-Adamyan / @aregm

Related issues:

• [Benchmarking] Support for on-demand and automated benchmarks (blocks)
• [Benchmarking] Decide which benchmarks are part of regression checks (is blocked by)

_{Note: This issue was originally created as ARROW-4317. Please see the migration documentation for further details.}

[pitrou]

We now have a continuous benchmarking Web UI at https://conbench.ursa.dev/