Skip to content

Conversation

@xinyiZzz
Copy link
Contributor

@xinyiZzz xinyiZzz commented Aug 27, 2024

Fix: #36340
Introduced in: #34850

adbc_driver_manager.OperationalError: IO: [FlightSQL] connection error: desc = "transport: Error while dialing: dial tcp 0.0.0.0:8029: connect: connection refused" (Unavailable; DoGet: endpoint 0: [uri:"grpc+tcp://0.0.0.0:8029"])

When query results are returned from FE Arrow Flight server, and Doris FE and ADBC ​​Client are not on the same machine, such as show tables;, show databases;, the IP in FlightInfo returned by FE to the client is wrong, and 0.0.0.0 is returned instead of the real IP of FE. The client fails to pull the results from 0.0.0.0.

No problem when query results are returned from BE Arrow Flight server, such as the normal query statement select * from xxx.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xinyiZzz
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 27, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 37817 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 84bcc110926cf9dbad3f284eb44a9b2ceaf283c9, data reload: false

------ Round 1 ----------------------------------
q1	17661	4495	4302	4302
q2	2016	186	171	171
q3	11842	926	1137	926
q4	10512	725	737	725
q5	7767	2828	2835	2828
q6	223	136	135	135
q7	961	627	591	591
q8	9313	2047	2078	2047
q9	7079	6506	6513	6506
q10	6995	2239	2203	2203
q11	502	250	242	242
q12	392	221	223	221
q13	18371	3044	3051	3044
q14	271	231	234	231
q15	525	482	481	481
q16	499	404	382	382
q17	978	677	733	677
q18	7312	6840	6907	6840
q19	1399	1051	1037	1037
q20	713	330	334	330
q21	3956	3144	2892	2892
q22	1135	1023	1006	1006
Total cold run time: 110422 ms
Total hot run time: 37817 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4352	4278	4382	4278
q2	382	275	273	273
q3	2865	2662	2659	2659
q4	1926	1703	1646	1646
q5	5551	5672	5725	5672
q6	223	132	134	132
q7	2253	1818	1822	1818
q8	3337	3430	3513	3430
q9	8848	8738	8683	8683
q10	3586	3419	3379	3379
q11	601	518	507	507
q12	828	684	664	664
q13	14618	3166	3218	3166
q14	308	320	301	301
q15	539	492	480	480
q16	492	434	447	434
q17	1843	1555	1537	1537
q18	8054	7822	7778	7778
q19	1767	1599	1608	1599
q20	2150	1934	1873	1873
q21	5892	5601	5642	5601
q22	1134	1031	1037	1031
Total cold run time: 71549 ms
Total hot run time: 56941 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191754 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 84bcc110926cf9dbad3f284eb44a9b2ceaf283c9, data reload: false

query1	1237	876	877	876
query2	6304	1948	1918	1918
query3	10709	4061	3968	3968
query4	59634	26644	23264	23264
query5	5406	501	524	501
query6	402	168	165	165
query7	5750	296	297	296
query8	282	202	202	202
query9	8738	2501	2480	2480
query10	486	267	258	258
query11	17772	15055	15120	15055
query12	171	104	104	104
query13	1498	409	386	386
query14	10898	7476	6783	6783
query15	232	176	182	176
query16	7486	430	467	430
query17	1131	589	557	557
query18	1943	294	289	289
query19	286	148	151	148
query20	125	112	111	111
query21	210	102	102	102
query22	4635	4367	4455	4367
query23	34607	33306	33225	33225
query24	5934	2982	2810	2810
query25	529	383	387	383
query26	690	153	156	153
query27	1798	281	279	279
query28	3607	2077	2073	2073
query29	677	398	419	398
query30	219	153	154	153
query31	939	751	797	751
query32	75	50	55	50
query33	423	285	283	283
query34	875	485	477	477
query35	826	718	715	715
query36	1064	938	911	911
query37	136	79	77	77
query38	3979	3772	3845	3772
query39	1430	1415	1391	1391
query40	206	114	111	111
query41	45	45	44	44
query42	111	99	93	93
query43	493	462	476	462
query44	1091	746	752	746
query45	196	163	178	163
query46	1092	746	750	746
query47	1910	1794	1847	1794
query48	398	301	305	301
query49	779	437	449	437
query50	826	421	421	421
query51	7204	7088	6979	6979
query52	138	85	90	85
query53	249	179	175	175
query54	556	454	451	451
query55	74	75	76	75
query56	276	254	250	250
query57	1216	1069	1067	1067
query58	226	220	260	220
query59	3131	2919	2743	2743
query60	289	271	267	267
query61	102	96	99	96
query62	741	661	678	661
query63	218	181	191	181
query64	2766	651	645	645
query65	3172	3159	3131	3131
query66	671	338	326	326
query67	15347	15138	15243	15138
query68	2862	577	593	577
query69	391	281	284	281
query70	1187	1044	1090	1044
query71	341	278	277	277
query72	5339	4091	3966	3966
query73	754	333	336	333
query74	9117	8711	8716	8711
query75	3402	2691	2729	2691
query76	1371	1023	996	996
query77	532	321	314	314
query78	9713	9263	9115	9115
query79	1031	537	543	537
query80	699	513	504	504
query81	451	235	232	232
query82	235	136	134	134
query83	167	155	154	154
query84	264	77	72	72
query85	681	289	280	280
query86	318	291	290	290
query87	4481	4258	4408	4258
query88	3534	2388	2383	2383
query89	390	292	283	283
query90	1926	202	201	201
query91	197	108	100	100
query92	61	49	51	49
query93	1069	532	532	532
query94	697	298	270	270
query95	331	264	260	260
query96	586	274	267	267
query97	3179	3048	3107	3048
query98	209	216	200	200
query99	1488	1250	1258	1250
Total cold run time: 303669 ms
Total hot run time: 191754 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.62 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 84bcc110926cf9dbad3f284eb44a9b2ceaf283c9, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.49	0.53
query6	1.14	0.72	0.74
query7	0.02	0.01	0.02
query8	0.05	0.04	0.05
query9	0.53	0.49	0.49
query10	0.56	0.55	0.54
query11	0.15	0.11	0.11
query12	0.14	0.12	0.12
query13	0.61	0.59	0.58
query14	0.77	0.79	0.77
query15	0.84	0.82	0.83
query16	0.38	0.38	0.38
query17	1.05	1.07	0.98
query18	0.22	0.21	0.21
query19	1.86	1.72	1.72
query20	0.01	0.02	0.01
query21	15.39	0.67	0.65
query22	4.17	7.74	1.94
query23	18.29	1.38	1.25
query24	2.09	0.23	0.21
query25	0.16	0.08	0.08
query26	0.27	0.17	0.17
query27	0.07	0.07	0.08
query28	13.28	1.02	1.01
query29	12.62	3.32	3.29
query30	0.24	0.05	0.05
query31	2.88	0.41	0.38
query32	3.27	0.48	0.47
query33	2.96	3.00	3.01
query34	17.02	4.45	4.34
query35	4.51	4.50	4.46
query36	0.66	0.49	0.49
query37	0.17	0.16	0.15
query38	0.15	0.15	0.14
query39	0.04	0.03	0.04
query40	0.16	0.14	0.12
query41	0.10	0.05	0.04
query42	0.05	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.44 s
Total hot run time: 30.62 s

Copy link
Contributor

@wangbo wangbo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xinyiZzz xinyiZzz merged commit 96d614f into apache:master Sep 1, 2024
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request Sep 1, 2024
… error `0.0.0.0:xxx, connection refused` (apache#40002)

Fix: apache#36340
Introduced in: apache#34850

```
adbc_driver_manager.OperationalError: IO: [FlightSQL] connection error: desc = "transport: Error while dialing: dial tcp 0.0.0.0:8029: connect: connection refused" (Unavailable; DoGet: endpoint 0: [uri:"grpc+tcp://0.0.0.0:8029"])
```

When query results are returned from FE Arrow Flight server, and Doris
FE and ADBC ​​Client are not on the same machine, such as `show
tables;`, `show databases;`, the IP in FlightInfo returned by FE to the
client is wrong, and `0.0.0.0` is returned instead of the real IP of FE.
The client fails to pull the results from `0.0.0.0`.

No problem when query results are returned from BE Arrow Flight server,
such as the normal query statement `select * from xxx`.
yiguolei pushed a commit that referenced this pull request Sep 2, 2024
… server error 0.0.0.0:xxx, connection refused (#40229)

pick #40002
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
… error `0.0.0.0:xxx, connection refused` (#40002)

Fix: #36340
Introduced in: #34850

```
adbc_driver_manager.OperationalError: IO: [FlightSQL] connection error: desc = "transport: Error while dialing: dial tcp 0.0.0.0:8029: connect: connection refused" (Unavailable; DoGet: endpoint 0: [uri:"grpc+tcp://0.0.0.0:8029"])
```

When query results are returned from FE Arrow Flight server, and Doris
FE and ADBC ​​Client are not on the same machine, such as `show
tables;`, `show databases;`, the IP in FlightInfo returned by FE to the
client is wrong, and `0.0.0.0` is returned instead of the real IP of FE.
The client fails to pull the results from `0.0.0.0`.

No problem when query results are returned from BE Arrow Flight server,
such as the normal query statement `select * from xxx`.
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request Nov 11, 2024
… error `0.0.0.0:xxx, connection refused` (apache#40002)

Fix: apache#36340
Introduced in: apache#34850

```
adbc_driver_manager.OperationalError: IO: [FlightSQL] connection error: desc = "transport: Error while dialing: dial tcp 0.0.0.0:8029: connect: connection refused" (Unavailable; DoGet: endpoint 0: [uri:"grpc+tcp://0.0.0.0:8029"])
```

When query results are returned from FE Arrow Flight server, and Doris
FE and ADBC ​​Client are not on the same machine, such as `show
tables;`, `show databases;`, the IP in FlightInfo returned by FE to the
client is wrong, and `0.0.0.0` is returned instead of the real IP of FE.
The client fails to pull the results from `0.0.0.0`.

No problem when query results are returned from BE Arrow Flight server,
such as the normal query statement `select * from xxx`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] transport: Error while dialing: dial tcp 0.0.0.0:9090

5 participants