Update Arrow to apache-arrow-4.0.1#6

Merged

Avogar merged 1389 commits intoClickHouse:masterfrom

Avogar:update

Jun 1, 2021

This pull request is big! We're only showing the most recent 250 commits

Commits on Mar 31, 2021

ARROW-12108: [Rust] [DataFusion] Implement SHOW TABLES
alamb
committed
ARROW-12028 ARROW-11940: [Rust][DataFusion] Add TimestampMillisecond support to GROUP BY/hash aggregates

Evan Chan
authored and
alamb
committed
ARROW-12165: [Rust] inline append functions of builders

ritchie46
authored and
alamb
committed
ARROW-12143: [CI] R builds should timeout and fail after some threshold and dump the output.

authored and
lidavidm
committed

Commits on Apr 1, 2021

PARQUET-1990: [C++] Refuse to write ConvertedType::NA

pitrou
authored and
emkornfield
committed
ARROW-12110: [Java] Implement ZSTD compression

emkornfield
and
emkornfield
committed
ARROW-11858: [GLib][Gandiva] Add Gandiva::Filter and related functions
kou
committed
ARROW-12171: [Rust] clean up clippy lints
alamb
committed
ARROW-12107: [Rust][DataFusion] Support `SELECT * from information_schema.columns`
alamb
committed
ARROW-12160: [Rust] Add `into_inner()` to StreamWriter

ericwburden
authored and
alamb
committed
ARROW-10354: [Rust][DataFusion] regexp_extract function to select regex groups from strings

sweb
authored and
alamb
committed
ARROW-12097: [C++] Modify BackgroundGenerator so it creates fewer threads

westonpace
authored and
lidavidm
committed
ARROW-12068: [Python] Stop using distutils
pitrou
committed
ARROW-12169: [C++] Fix decompressing file with empty stream at the end

pitrou
authored and
lidavidm
committed
ARROW-12000: [Documentation] Add note about deviation from style guide on struct/classes

westonpace
authored and
lidavidm
committed

Commits on Apr 2, 2021

Commits on Apr 3, 2021

ARROW-12112: [Rust] Create and store less debug information in CI and integration tests
alamb
committed

Commits on Apr 4, 2021

ARROW-12194: [Rust][Parquet] Bump zstd to v0.7

aldanor
authored and
alamb
committed
ARROW-12186: [Rust][DataFusion] Fix regexp_match test

seddonm1
authored and
alamb
committed
ARROW-12034: [Developer Tools] Formalize Minor PRs

emkornfield
and
emkornfield
committed
ARROW-12193: [Dev][Release] Use downloadable URL for archive download

kou
authored and
nealrichardson
committed

Commits on Apr 5, 2021

Commits on Apr 6, 2021

Commits on Apr 7, 2021

ARROW-12237: [Packaging][Debian] Add support for bullseye
kou
committed
ARROW-12228: [CI] Create base image for conda environments

kszucs
authored and
kou
committed
ARROW-12242: [Python][Doc] Tweak nightly build instructions
pitrou
committed
ARROW-12112: [CI] Reduce footprint of conda-integration image

pitrou
authored and
kszucs
committed
ARROW-11475: [C++] Upgrade mimalloc

pitrou
authored and
kszucs
committed
ARROW-11464: [Python] Fix parquet.read_pandas to support all keywords of read_table

jorisvandenbossche
authored and
kszucs
committed
ARROW-9451: [Python] Refuse implicit cast of str to unsigned integer
pitrou
committed
ARROW-12040: [C++] Fix potential deadlock in recursive S3 walks

westonpace
and
pitrou
committed
ARROW-12241: [Python] Make CSV cancellation test more robust
pitrou
committed
ARROW-12154: [C++][Gandiva] Fix gandiva crash in certain OS/CPU combinations

projjal
authored and
praveenbingo
committed
ARROW-12168: [Go][IPC] Implement Compression handling for Arrow IPC

Matthew Topol
authored and
emkornfield
committed
ARROW-12190: [Rust][DataFusion] Implement parallel / partitioned hash join

Dandandan
authored and
alamb
committed
ARROW-12082: [R][Dataset] Allow create dataset from vector of file paths

ianmcook
authored and
nealrichardson
committed
ARROW-12141: [R] Bindings for grepl

ianmcook
authored and
nealrichardson
committed
ARROW-12235: [Rust][DataFusion] LIMIT returns incorrect results when used with several small partitions
alamb
committed
ARROW-12224: [Rust] Use stable rust for no default test, clean up CI tests
alamb
committed
ARROW-11906 [R]: Make FeatherReader print method more informative

jonkeane
authored and
nealrichardson
committed
ARROW-11832: [R] Handle conversion of extra nested struct column

romainfrancois
authored and
nealrichardson
committed
ARROW-12249: [R] [CI] Fix test-r-install-local nightlies

jonkeane
authored and
nealrichardson
committed
ARROW-11754: [R] Support dplyr::compute()

ianmcook
authored and
nealrichardson
committed

Commits on Apr 8, 2021

Commits on Apr 9, 2021

Commits on Apr 11, 2021

Commits on Apr 12, 2021

ARROW-12299: [Python] Recognize new filesytems in pq.write_to_dataset

jorisvandenbossche
authored and
lidavidm
committed
ARROW-12140: [C++][CI] Fix Valgrind failures in Grouper tests
pitrou
committed
ARROW-11984: [C++][Gandiva] Implement SHA1 and SHA256 functions

authored and
praveenbingo
committed
ARROW-12069: [C++][Gandiva] Implement IN expressions for Decimal type

authored and
praveenbingo
committed
ARROW-12146: [C++][Gandiva] Implement CONVERT_FROM(expression, replacement char) function

jpedroantunes
authored and
praveenbingo
committed
ARROW-12323: [C++][Gandiva] Implement castTIME(timestamp) function

anthonylouisbsb
authored and
praveenbingo
committed
ARROW-11972: [C++][R][Python][Dataset] Extract IPC/Parquet fragment scan options

lidavidm
authored and
bkietz
committed
ARROW-12314: [Python] Accept columns as set in parquet read_pandas

jorisvandenbossche
authored and
lidavidm
committed
ARROW-11761: [C++] Increase public API testing

pitrou
authored and
kou
committed
ARROW-6248: [Python][C++] Raise better exception on HDFS file open error

pitrou
authored and
lidavidm
committed
ARROW-12333: [JS] Remove jest-environment-node-debug and do not emit from typescript by default

domoritz
authored and
nealrichardson
committed
ARROW-12303: [JS] Use iterator instead of yield

domoritz
authored and
nealrichardson
committed
ARROW-12236: [R][CI] Add check that all docs pages are listed in _pkgdown.yml

thisisnic
authored and
nealrichardson
committed

Commits on Apr 13, 2021

ARROW-12342: [Packaging] Fix tabulation in crossbow templates for submitting nightly builds
kszucs
committed
ARROW-12326: [C++] Avoid needless c-ares detection

kou
authored and
kszucs
committed
ARROW-12352: [CI][R][Windows] Remove needless workaround for MSYS2

kou
authored and
kszucs
committed
ARROW-11752: [R] Replace usage of testthat::expect_is()

thisisnic
authored and
kszucs
committed
ARROW-12277: [Rust][DataFusion] Implement Sum/Count/Min/Max aggregates for Timestamp(_,_)
alamb
committed
ARROW-12288: [C++] Create Scanner interface

westonpace
authored and
lidavidm
committed
ARROW-12332: [Rust] [Ballista] Add simple api server in scheduler

msathis
authored and
andygrove
committed
ARROW-12248: [C++] Avoid looking up ARROW_DEFAULT_MEMORY_POOL environment variable too late

pitrou
authored and
lidavidm
committed
ARROW-11839: [C++] Use xsimd for generation of accelerated bit-unpacking
pitrou
committed
ARROW-12357: [Archery] Bump Jinja2 version requirement

pitrou
authored and
kszucs
committed
ARROW-11070: [C++][Compute] Implement power kernel

authored and
nealrichardson
committed
ARROW-12316: [C++] Prefer mimalloc on Apple

pitrou
authored and
nealrichardson
committed
ARROW-12304: [R] Update news and polish docs for 4.0
nealrichardson
committed

Commits on Apr 14, 2021

ARROW-12309: [JS] Make es2015 bundles the default

domoritz
authored and
kou
committed
ARROW-12269: [JS] Move to eslint

domoritz
authored and
kou
committed
ARROW-12354: [Packaging][RPM] Use apache.jfrog.io/artifactory/ instead of apache.bintray.com/
kou
committed
ARROW-12351: [CI][Ruby] Use ruby/setup-ruby instead of actions/setup-ruby

kou
and
kszucs
committed
ARROW-11924: [C++] Add streaming version of FileSystem::GetFileInfo
pitrou
committed
ARROW-12361: [Rust] [DataFusion] Allow users to override physical optimization rules

andygrove
authored and
alamb
committed
ARROW-12294: [Rust] Fix boolean kleene kernels with no remainder

ch-sc
authored and
alamb
committed
ARROW-12374: [CI][C++][cron] Use Ubuntu 20.04 instead of 16.04

kou
authored and
kszucs
committed
ARROW-12330: [Developer] Restore values at counters column of Archery benchmark

kiszk
authored and
kszucs
committed
ARROW-12287: [C++] Create enumerating generator

westonpace
and
lidavidm
committed
ARROW-12262: [Doc] Enable S3 and Flight in docs build
pitrou
committed
ARROW-11677: [C++][Docs] Add basic C++ datasets documentation
lidavidm
committed
ARROW-12220: [C++][CI] Thread sanitizer failure

westonpace
authored and
lidavidm
committed
ARROW-12379: [C++] Fix ThreadSanitizer failure in SerialExecutor

pitrou
authored and
lidavidm
committed
ARROW-12385: [R] [CI] fix cran picking in CI

jonkeane
authored and
lidavidm
committed
ARROW-12353: [Packaging][deb] Rename -archive-keyring to -apt-source
kou
committed
ARROW-12375: [Release] Remove rebase post-release scripts

kszucs
authored and
kou
committed
ARROW-12384: [JS] Use let/const and clean up eslint rules

domoritz
authored and
kou
committed
ARROW-11475: [C++] Revert "Upgrade mimalloc"
lidavidm
committed
ARROW-12161: [C++][Dataset] Revert async CSV reader in datasets

westonpace
authored and
lidavidm
committed
ARROW-12382: [C++] Bundle xsimd if runtime SIMD level is set
lidavidm
committed
ARROW-11468: [R] Allow user to pass schema to read_json_arrow()

thisisnic
authored and
nealrichardson
committed
ARROW-12370: [R] Bindings for power kernel

Mauricio Vargas
and
nealrichardson
committed
ARROW-11477: [R][Doc] Reorganize and improve README and vignette content

ianmcook
and
nealrichardson
committed

Commits on Apr 15, 2021

ARROW-12273: [JS] [Rust] Remove coveralls

domoritz
authored and
kou
committed
ARROW-12376: [Dev] Log traceback for unexpected exceptions in archery trigger-bot

lidavidm
authored and
kou
committed
ARROW-11797: [C++][Dataset] Provide batch stream Scanner methods

bkietz
and
lidavidm
committed
ARROW-12381: [Packaging][Python] macOS wheels are built with wrong package kind

kszucs
authored and
kou
committed
ARROW-12017: [R] [Documentation] Make proper developing arrow docs

jonkeane
and
nealrichardson
committed
ARROW-12057: [Python] Remove direct usage of pandas' Block subclasses (partly)
jorisvandenbossche
committed
ARROW-7215: [C++][Gandiva] Implement castVARCHAR(numeric_type) functions

authored and
praveenbingo
committed
ARROW-12337: [Rust] add DoubleEndedIterator and ExactSizeIterator traits

ritchie46
authored and
alamb
committed
ARROW-12250: [Rust] [Parquet] Fix failing arrow_writer test

nevi-me
authored and
alamb
committed
ARROW-11472: [Python][CI] Remove temporary pin of numpy in kartothek integration build
jorisvandenbossche
committed
ARROW-12317: [Rust] JSON writer support for time, duration and date

houqp
authored and
alamb
committed
ARROW-12397: [Rust] [DataFusion] Simplify readme example

witchard
authored and
alamb
committed
ARROW-12390: [Rust] Inline from_trusted_len_iter, try_from_trusted_len_iter, extend_from_slice

Dandandan
authored and
alamb
committed
ARROW-12246: [CI] Sync conda recipes with upstream feedstock

xhochy
and
jorisvandenbossche
committed
ARROW-12396: [Python][Docs] Clarify serialization/filesystem docstrings about deprecated status

jorisvandenbossche
authored and
pitrou
committed
ARROW-12188: [Docs] Switch to pydata-sphinx-theme for the main sphinx docs
jorisvandenbossche
committed
ARROW-12151: [Docs] Add Jira component + summary conventions to the docs

jonkeane
authored and
kszucs
committed
ARROW-9731: [C++][Python][R][Dataset] Implement Scanner::Head

lidavidm
authored and
kszucs
committed
ARROW-11568: [C++][Compute] Rewrite mode kernel

cyb70289
and
pitrou
committed
ARROW-12383: [JS] Upgrade dependencies

domoritz
authored and
kszucs
committed
ARROW-12408: [R] Delete Scan()
lidavidm
committed
ARROW-8900: [C++][Python] Expose Proxy Options as parameters for S3FileSystem

sahil1105
authored and
pitrou
committed
ARROW-12401: [R] Fix guard around dataset___Scanner__TakeRows

ianmcook
authored and
nealrichardson
committed
ARROW-12406: [R] Fix checkbashism violation in configure

jonkeane
authored and
nealrichardson
committed
ARROW-12409: [R] Remove LazyData from DESCRIPTION

jonkeane
authored and
nealrichardson
committed
ARROW-12405: [Packaging] Fix apt artifact patterns and artifact uploading from travis
kszucs
committed
ARROW-12389: [R] [Docs] Add note about autocasting

jonkeane
authored and
nealrichardson
committed
ARROW-12367: [C++] Stop producing when PushGenerator was destroyed
pitrou
committed
ARROW-12402: [Rust] [DataFusion] Implement SQL metrics example

andygrove
authored and
kszucs
committed
ARROW-12335: [Rust] [Ballista] Use latest DataFusion

andygrove
authored and
kszucs
committed
ARROW-6103: [Release][Java] Remove mvn release plugin

kszucs
and
andygrove
committed
ARROW-12400: [Rust] Re-enable tests in arrow::array::transform

tustvold
authored and
alamb
committed

Commits on Apr 16, 2021

ARROW-12111: [Java] Generate flatbuffer files using flatc 1.12.0

nbauernfeind
authored and
emkornfield
committed
ARROW-12104: [Go][Parquet] Second chunk of Ported Go Parquet code

Matthew Topol
authored and
emkornfield
committed
ARROW-11999: [Java] Support parallel vector element search with user-specified comparator

liyafan82
authored and
emkornfield
committed
ARROW-12380: [Rust] [Ballista] Basic scheduler ui

msathis
authored and
andygrove
committed
ARROW-12421: [Rust] [DataFusion] Disable repartition rule

andygrove
authored and
alamb
committed

Commits on Apr 17, 2021

ARROW-12429: [C++] Fix incorrectly registered test
lidavidm
committed
ARROW-12419: [Java] Remove to download flatc binary for s390x

kiszk
authored and
kou
committed
ARROW-12433: [Rust] Update nightly rust version

alippai
authored and
andygrove
committed
ARROW-12334: [Rust] [Ballista] Aggregate queries producing incorrect results

edrevo
authored and
andygrove
committed
ARROW-12437: [Rust] [Ballista] Create DataFusion context without repartition
andygrove
committed
ARROW-12421: [Rust] [DataFusion] Fix topkexec failure

Dandandan
authored and
andygrove
committed

Commits on Apr 18, 2021

Commits on Apr 19, 2021

ARROW-12395: Create RunInSerialExecutor benchmark

westonpace
authored and
pitrou
committed
ARROW-7906: [C++] [Python] Add ORC write support

committed
ARROW-12289: [C++] Create basic AsyncScanner implementation

westonpace
authored and
lidavidm
committed

Commits on Apr 20, 2021

Commits on Apr 21, 2021

Commits on May 17, 2021

ARROW-12520: [R] Minor docs updates

jonkeane
authored and
kszucs
committed
ARROW-12601: [R][Packaging] Fix pkg-config check in r/configure

ianmcook
authored and
kszucs
committed
ARROW-11926: [R] preparations for ucrt toolchains

authored and
kszucs
committed
ARROW-12622: [Python] Fix segfault in read_csv when not on main thread

lidavidm
authored and
kszucs
committed
ARROW-12617: [Python] Align orc.write_table keyword order with parquet.write_table

jorisvandenbossche
authored and
kszucs
committed
ARROW-12568: [C++][Compute] Fix nullptr deference when array contains no nulls

authored and
kszucs
committed
ARROW-12571: [R][CI] Run nightly R with valgrind

jonkeane
authored and
kszucs
committed
ARROW-12642: [R] LIBARROW_MINIMAL, LIBARROW_DOWNLOAD, NOT_CRAN env vars should not be case-sensitive

ianmcook
authored and
kszucs
committed
ARROW-12663: [C++] Fix a cuda 11.2 compiler segfault

galipremsagar
authored and
kszucs
committed
ARROW-12670: [C++] Fix extract_regex output after non-matching values

pitrou
authored and
kszucs
committed
ARROW-12746: [Go][Flight] append instead of overwriting outgoing metadata

Matthew Topol
authored and
kszucs
committed
ARROW-12774 : [C++][Compute] replace_substring_regex() creates invalid arrays => crash

nirandaperera
authored and
kszucs
committed
ARROW-12578: [JS] Remove Buffer in favor of TextEncoder API to support bundlers such as Rollup

domoritz
authored and
kszucs
committed
ARROW-12776: [Archery][Integration] Fix decimal case generation in write_js_test_json
kszucs
committed
ARROW-12769: [Python] Fix slicing array with "negative" length (start > stop)

jorisvandenbossche
authored and
kszucs
committed
ARROW-12806: [Python] test_write_to_dataset_filesystem missing a dataset mark

jorisvandenbossche
authored and
kszucs
committed
ARROW-12619: [Python] pyarrow sdist should not require git
kszucs
committed
ARROW-12603: [C++][Dataset] Backport fix for specifying CSV column types (#10344)
lidavidm
authored

Commits on May 19, 2021

Commits on Jun 1, 2021

Merge tag 'apache-arrow-4.0.1' of github.com:apache/arrow into update
avogar
committed