Skip to content

Conversation

@selsong
Copy link
Contributor

@selsong selsong commented Sep 4, 2025

Description

Backport #3993 timechart PR into 2.19-dev branch
manual backport due to conflict

* WIP: Support timechart grammar / AST

Signed-off-by: Selina Song <selsong@amazon.com>

* WIP: Support span=unit in timechart

Signed-off-by: Selina Song <selsong@amazon.com>

* Return correct column format after span=unit

Signed-off-by: Selina Song <selsong@amazon.com>

* sort by @timestamp, group by aggregate function

Signed-off-by: Selina Song <selsong@amazon.com>

* WIP: pivot table by field

Signed-off-by: Selina Song <selsong@amazon.com>

* Correct pivot format for by field

Signed-off-by: Selina Song <selsong@amazon.com>

* Fix aggregation composite bucket limit
Signed-off-by: Selina Song <selsong@amazon.com>

* Add timechart.rst doc and PPLQueryAnonymizer test

Signed-off-by: Selina Song <selsong@amazon.com>

* Add ExplainIT for timechart

Signed-off-by: Selina Song <selsong@amazon.com>

* Restore reverse ExplainIT

Signed-off-by: Selina Song <selsong@amazon.com>

* Update explainIT timechart

Signed-off-by: Selina Song <selsong@amazon.com>

* spotlessApply formatting

Signed-off-by: Selina Song <selsong@amazon.com>

* format IT

Signed-off-by: Selina Song <selsong@amazon.com>

* Add limit parameter

Signed-off-by: Selina Song <selsong@amazon.com>

* Add limit=0 means no limit, show all values, no other

Signed-off-by: Selina Song <selsong@amazon.com>

* Add useother parameter

Signed-off-by: Selina Song <selsong@amazon.com>

* clean up format, fix column order

Signed-off-by: Selina Song <selsong@amazon.com>

* add test for formatter

Signed-off-by: Selina Song <selsong@amazon.com>

* Increase test coverage for formatter

Signed-off-by: Selina Song <selsong@amazon.com>

* Rename bin option expression, modify constructor

Signed-off-by: Selina Song <selsong@amazon.com>

* Make test data smaller, update IT, rst

Signed-off-by: Selina Song <selsong@amazon.com>

* add explain output to IT

Signed-off-by: Selina Song <selsong@amazon.com>

* Add limitation to rst, format, comment

Signed-off-by: Selina Song <selsong@amazon.com>

* Add test coverage formatter

Signed-off-by: Selina Song <selsong@amazon.com>

* Refactor formatter for clarity

Signed-off-by: Selina Song <selsong@amazon.com>

* fix NPE

Signed-off-by: Selina Song <selsong@amazon.com>

* add import

Signed-off-by: Selina Song <selsong@amazon.com>

* update mapping to match smaller dataset

Signed-off-by: Selina Song <selsong@amazon.com>

* update explainIT

Signed-off-by: Selina Song <selsong@amazon.com>

* Fix explainIT, improve code structure

Signed-off-by: Selina Song <selsong@amazon.com>

* spotless

Signed-off-by: Selina Song <selsong@amazon.com>

* Support diff position parameters, count default 0 not null, update doc rst

Signed-off-by: Selina Song <selsong@amazon.com>

* fix count aggr type int

Signed-off-by: Selina Song <selsong@amazon.com>

* rename @timestamp column

Signed-off-by: Selina Song <selsong@amazon.com>

* move parameter extraction to PPLService

Signed-off-by: Selina Song <selsong@amazon.com>

* clean up PPLService

Signed-off-by: Selina Song <selsong@amazon.com>

* fix count type test, doc rst format

Signed-off-by: Selina Song <selsong@amazon.com>

* add test coverage

Signed-off-by: Selina Song <selsong@amazon.com>

* WIP: SQL query with limit useother

Signed-off-by: Selina Song <selsong@amazon.com>

* revert QueryService

Signed-off-by: Selina Song <selsong@amazon.com>

* add limit useother to SQL query

Signed-off-by: Selina Song <selsong@amazon.com>

* SQL query working, WIP column rename

Signed-off-by: Selina Song <selsong@amazon.com>

* use loadIndex in IT

Signed-off-by: Selina Song <selsong@amazon.com>

* Rename fields to match, update doc

Signed-off-by: Selina Song <selsong@amazon.com>

* revert QueryResult

Signed-off-by: Selina Song <selsong@amazon.com>

* revert gradle build

Signed-off-by: Selina Song <selsong@amazon.com>

* fix format

Signed-off-by: Selina Song <selsong@amazon.com>

* Add count fill zero, update toSQL tests, doc

Signed-off-by: Selina Song <selsong@amazon.com>

* fix nits

Signed-off-by: Selina Song <selsong@amazon.com>

* Fix rename aggregation only no by field

Signed-off-by: Selina Song <selsong@amazon.com>

* Update SQL test

Signed-off-by: Selina Song <selsong@amazon.com>

* revert OS Exec Engine edits

Signed-off-by: Selina Song <selsong@amazon.com>

* correct OS Exec Engine revert to 5ec9603

Signed-off-by: Selina Song <selsong@amazon.com>

* restore OS Exec Engine

Signed-off-by: Selina Song <selsong@amazon.com>

* update QueryAnonymizer Test to reflect default

Signed-off-by: Selina Song <selsong@amazon.com>

* WIP: Add null=1, Other fill zero wip

Signed-off-by: Selina Song <selsong@amazon.com>

* Add doctest and update ExplainIT

Signed-off-by: Selina Song <selsong@amazon.com>

* Replace detectFieldIndices function

Signed-off-by: Selina Song <selsong@amazon.com>

* update explainIT

Signed-off-by: Selina Song <selsong@amazon.com>

* Fix Other in zero fill case

Signed-off-by: Selina Song <selsong@amazon.com>

* Fix OTHER in zero fill case

Signed-off-by: Selina Song <selsong@amazon.com>

* spotless format

Signed-off-by: Selina Song <selsong@amazon.com>

* update doc with null example

Signed-off-by: Selina Song <selsong@amazon.com>

* null not included in limit calc

Signed-off-by: Selina Song <selsong@amazon.com>

* update SQL test

Signed-off-by: Selina Song <selsong@amazon.com>

* update SQL test format

Signed-off-by: Selina Song <selsong@amazon.com>

* Update ExplainIT with count

Signed-off-by: Selina Song <selsong@amazon.com>

* remove unused code

Signed-off-by: Selina Song <selsong@amazon.com>

* Fix SQL tests nullable

Signed-off-by: Selina Song <selsong@amazon.com>

* spotless format

Signed-off-by: Selina Song <selsong@amazon.com>

---------

Signed-off-by: Selina Song <selsong@amazon.com>
Signed-off-by: Selina Song <selinasong6@gmail.com>
Co-authored-by: Selina Song <selsong@amazon.com>
(cherry picked from commit e2678a1)
@selsong selsong force-pushed the backport/backport-3993-to-2.19-dev branch from 370b35d to f6469d0 Compare September 4, 2025 23:24
Signed-off-by: Selina Song <selsong@amazon.com>
@qianheng-aws qianheng-aws merged commit f662af8 into opensearch-project:2.19-dev Sep 5, 2025
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants