Executing child queries on queriers#1730

Closed

owen-d wants to merge 97 commits intocortexproject:masterfrom

owen-d:feature/query-sharding

Commits on Dec 4, 2019

ast mapping
owen-d
committed
wrapper types for querier roundtripping and in memory series set
owen-d
committed
query sharding middleware
owen-d
committed
embeds all selectors for distribution to queriers
owen-d
committed
shardsummer in middleware uses vectorsquasher
owen-d
committed
value conversion unit tests
owen-d
committed
downstreamSeries.Seek method & adds unit tests
owen-d
committed
corrects embedded queryable label matching/dispatching & adds unit tests
owen-d
committed
Series{Iterator,Set} expects to call Next() before At() initially (assumably for 0 ln series)
owen-d
committed
middleware embeds engine + unit tests
owen-d
committed
exports ConcreteSeries{,Set}
owen-d
committed
removes custom Series{,Set,Iterator} impls in favor of queriers concrete impl
owen-d
committed
concreteSeries moved to its own pkg
owen-d
committed
wiring for multiple sharding configs
owen-d
committed
NodeMapper ASTMapper adapter which requires less verbose impls
owen-d
committed
adds NodeMapper ifc to simplify ASTMapper impls
owen-d
committed
queries assume milliseconds
owen-d
committed
dont shard requests across multiple shard configs
owen-d
committed
lazy queryable and chunkstore to their own packages
owen-d
committed
querysharding uses a lazy querier
owen-d
committed
linter fixes
owen-d
committed
__name__ label via constant

owen-d
and
cyriltovena
committed
corrects error source

owen-d
and
cyriltovena
committed
linting
owen-d
committed
ast unit test cases, removes use of unkeyed fields
owen-d
committed
shard aware storage filtering
owen-d
committed
s/FilterIndexQueries/FilterReadQueries/ for consistency
owen-d
committed
add promql test to verify splitting

cyriltovena
authored and
owen-d
committed
more promql equivalence tests, removes avg as we do not parallelize it
owen-d
committed
corrects astmapping sums behavior
owen-d
committed
adds ShardAnnotation type for enclosing __cortex_shard__ logic
owen-d
committed
injects __cortex_shard__ labels for chunks in series_store
owen-d
committed
exports LabelsSeriesID from pkg/chunk
owen-d
committed
shard aware ingester queries
owen-d
committed
allows all functions as parallel
owen-d
committed
parallel functions improvements/tests
owen-d
committed
fix missing rebased files

cyriltovena
authored and
owen-d
committed
Implement the new queryrange.Handler

cyriltovena
authored and
owen-d
committed
Add missing comment

cyriltovena
authored and
owen-d
committed
Add the new sum shard middleware to the query range

cyriltovena
authored and
owen-d
committed
moves querysharding into queryrange package
owen-d
committed
approximates rate test
owen-d
committed
approximates more floating point calculation combinations
owen-d
committed
populates chunkstore test shard factor via validation
owen-d
committed
Adds some trace tags and logs

cyriltovena
authored and
owen-d
committed
logging mapped queries
owen-d
committed
Adds a warning if no shard exists in config

cyriltovena
authored and
owen-d
committed
Improve error formating

cyriltovena
authored and
owen-d
committed
Fixes empty matchers and add some logs

cyriltovena
authored and
owen-d
committed
simplifies shard-aware series index searching
owen-d
committed
Fixes inject shard label

cyriltovena
authored and
owen-d
committed
Add more logging in the ingester code

cyriltovena
authored and
owen-d
committed
fixes copy/pasted comment
owen-d
committed
sorts memorySeries metrics for deterministic hashing in ingester
owen-d
committed
Don't change the inMemorySeries metric

cyriltovena
authored and
owen-d
committed
Removes shard label in ingester.QueryStream

cyriltovena
authored and
owen-d
committed
clean up logs

cyriltovena
authored and
owen-d
committed
shardsumming reduces shard result dimensions when possible
owen-d
committed
astmapper squashes children together to support concat instead of OR
owen-d
committed
Codedc ifc for query sharding, concats instead of ORing when possible
owen-d
committed
logs filtered queries
owen-d
committed
instruments chunk cache decoding
owen-d
committed
only sorts metrics for an existing series [ingester]
owen-d
committed
further instruments cachingIndexClient and chunkstore
owen-d
committed
addtl instrumentation
owen-d
committed
fixes now-exported LabelsSeriesID call that was missed in rebase
owen-d
committed
querier.Chunkstore moved to new pkg, update refs
owen-d
committed
user_state shard testing ensures shards are filtered correctly by checking hash
owen-d
committed
changes embeddedSeparator to <|> in order to minimize collision chance
owen-d
committed
removes defaultfilterReadQueries indirection
owen-d
committed
computes rowshards in one fn
owen-d
committed
fixes issue with computed rowshards not being injected
owen-d
committed
middle shard filter test
owen-d
committed
isolates shard-aware logic in ingesters
owen-d
committed
minor function doc improvements
owen-d
committed
json codex instead of hex to support arbitrary embedded queries, improves comments
owen-d
committed
shardannotation methods where possible
owen-d
committed
exports OrSquasher
owen-d
committed
reuses astmapper.ShardFromMatchers
owen-d
committed
benchmarks OR nodes vs Concat
owen-d
committed
linting fixes
owen-d
committed
adds querier.sum-shards to changelog
owen-d
committed
does not attempt to map query AST when conf.RowShards < 2
owen-d
committed
benchmarks sharding queries
owen-d
committed
benchmark both linear time queryable and constant time queryables
owen-d
committed
removes OR node combining benchmark
owen-d
committed
moves MockShardedQueryable test helper to queryrange pkg
owen-d
committed
adds astmapping test for parallelizing legs of histogram_quantile fn
owen-d
committed
cache friendly query sharding
owen-d
committed
moves querysharding to unreleased/master in changelog
owen-d
committed
subtreeMapper for better query delegation
owen-d
committed
middleware correctness tests
owen-d
committed
gofmt linting
owen-d
committed
subtreeFolder should not fold leaf scalars/string nodes
owen-d
committed
introduces query-audit, a query correctness tool
owen-d
committed
increase logging verbosity for query-audit reports
owen-d
committed
query sharding in arguments.md
owen-d
committed