[feature](meta) queries as table valued function (#)#25052

Nitin-Kashyap · 2023-10-06T12:56:25Z

Proposed changes

Add queries view as table function.
Proxy result to other FEs and return merged results back to BE.

Issue Number: close #25051

github-actions · 2023-10-06T13:04:32Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2023-10-06T13:06:58Z

clang-tidy review says "All clean, LGTM! 👍"

gensrc/thrift/PlanNodes.thrift

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-09T05:34:03Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-09T07:39:52Z

clang-tidy review says "All clean, LGTM! 👍"

yiguolei

LGTM

yiguolei · 2023-10-10T01:12:05Z

run buildall

github-actions · 2023-10-10T01:12:47Z

PR approved by at least one committer and no changes requested.

github-actions · 2023-10-10T01:12:49Z

PR approved by anyone and no changes requested.

hf200012

LGTM

doris-robot · 2023-10-10T02:25:18Z

TeamCity be ut coverage result:
Function Coverage: 36.31% (8149/22443)
Line Coverage: 28.44% (65167/229170)
Region Coverage: 27.37% (33768/123394)
Branch Coverage: 24.04% (17205/71564)
Coverage Report: http://coverage.selectdb-in.cc/coverage/18b3ac0324db05fbb68ec2097d1c0031c23c2280_18b3ac0324db05fbb68ec2097d1c0031c23c2280/report/index.html

doris-robot · 2023-10-10T02:40:31Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.23 seconds
stream load tsv: 557 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17162285897 Bytes

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T04:41:58Z

clang-tidy review says "All clean, LGTM! 👍"

yiguolei · 2023-10-10T06:11:33Z

run buildall

doris-robot · 2023-10-10T06:48:28Z

TeamCity be ut coverage result:
Function Coverage: 36.28% (8149/22461)
Line Coverage: 28.42% (65177/229296)
Region Coverage: 27.35% (33773/123482)
Branch Coverage: 24.03% (17208/71620)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e0c5eabe0d60c4fde96a31435993bc2dc6f73524_e0c5eabe0d60c4fde96a31435993bc2dc6f73524/report/index.html

doris-robot · 2023-10-10T07:07:00Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.73 seconds
stream load tsv: 558 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size: 17162305550 Bytes

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T11:57:11Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T14:08:39Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T17:08:10Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T07:13:30Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T09:23:59Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T14:03:28Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2023-10-11T14:03:34Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T17:07:48Z

clang-tidy review says "All clean, LGTM! 👍"

yiguolei · 2023-10-12T03:12:17Z

run buildall

yiguolei · 2023-10-12T03:12:31Z

run buildall

github-actions · 2023-10-12T03:21:30Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2023-10-12T04:23:29Z

TeamCity be ut coverage result:
Function Coverage: 36.22% (8154/22510)
Line Coverage: 28.34% (65285/230391)
Region Coverage: 27.05% (33810/124985)
Branch Coverage: 23.88% (17250/72234)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7eed37ff2dda03e45f8515ff52ec05689d0f6a8a_7eed37ff2dda03e45f8515ff52ec05689d0f6a8a/report/index.html

doris-robot · 2023-10-12T04:41:09Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.17 seconds
stream load tsv: 561 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size: 17162077919 Bytes

yiguolei

LGTM

…he#25052) 1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE. Co-authored-by: yiguolei <676222867@qq.com>

Nitin-Kashyap force-pushed the feature-queryView branch from 3b49250 to 50372cc Compare October 6, 2023 12:57

yiguolei reviewed Oct 7, 2023

View reviewed changes

gensrc/thrift/PlanNodes.thrift Outdated Show resolved Hide resolved

Nitin-Kashyap force-pushed the feature-queryView branch from 50372cc to a385a28 Compare October 9, 2023 05:24

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 9, 2023

[feature](meta) queries as table valued function (apache#25052)

a385a28

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap requested a review from yiguolei October 9, 2023 05:26

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 9, 2023

[feature](meta) queries as table valued function (apache#25052)

18b3ac0

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from a385a28 to 18b3ac0 Compare October 9, 2023 07:30

yiguolei approved these changes Oct 10, 2023

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 10, 2023

github-actions bot added the reviewed label Oct 10, 2023

hf200012 approved these changes Oct 10, 2023

View reviewed changes

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023

[feature](meta) queries as table valued function (apache#25052)

e0c5eab

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 18b3ac0 to e0c5eab Compare October 10, 2023 04:33

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023

[feature](meta) queries as table valued function (apache#25052)

3e63ca7

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from e0c5eab to 3e63ca7 Compare October 10, 2023 11:48

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023

[feature](meta) queries as table valued function (apache#25052)

2fd275e

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 3e63ca7 to 2fd275e Compare October 10, 2023 13:59

Nitin-Kashyap force-pushed the feature-queryView branch from 2fd275e to 4d4dd10 Compare October 10, 2023 16:58

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023

[feature](meta) queries as table valued function (apache#25052)

4d4dd10

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 11, 2023

[feature](meta) queries as table valued function (apache#25052)

3836ee0

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 4d4dd10 to 3836ee0 Compare October 11, 2023 07:01

Nitin-Kashyap force-pushed the feature-queryView branch from 3836ee0 to 4d0c4cb Compare October 11, 2023 09:15

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 11, 2023

[feature](meta) queries as table valued function (apache#25052)

4d0c4cb

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 11, 2023

[feature](meta) queries as table valued function (apache#25052)

c0a62fc

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 4d0c4cb to c0a62fc Compare October 11, 2023 13:55

[feature](meta) queries as table valued function (apache#25052)

42cd5b0

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from c0a62fc to 42cd5b0 Compare October 11, 2023 16:58

Merge branch 'master' into feature-queryView

7eed37f

yiguolei approved these changes Oct 12, 2023

View reviewed changes

yiguolei merged commit bdb64ea into apache:master Oct 12, 2023

zhiqiang-hhhh mentioned this pull request Dec 20, 2023

[fix](meta_scanner) fix meta_scanner process ColumnNullable #28711

Merged

Conversation

Nitin-Kashyap commented Oct 6, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Uh oh!

github-actions bot commented Oct 6, 2023

Uh oh!

github-actions bot commented Oct 6, 2023

Uh oh!

Uh oh!

github-actions bot commented Oct 9, 2023

Uh oh!

github-actions bot commented Oct 9, 2023

Uh oh!

yiguolei left a comment

Choose a reason for hiding this comment

Uh oh!

yiguolei commented Oct 10, 2023

Uh oh!

github-actions bot commented Oct 10, 2023

Uh oh!

github-actions bot commented Oct 10, 2023

Uh oh!

hf200012 left a comment

Choose a reason for hiding this comment

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

github-actions bot commented Oct 10, 2023

Uh oh!

yiguolei commented Oct 10, 2023

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

github-actions bot commented Oct 10, 2023

Uh oh!

github-actions bot commented Oct 10, 2023

Uh oh!

github-actions bot commented Oct 10, 2023

Uh oh!

github-actions bot commented Oct 11, 2023

Uh oh!

github-actions bot commented Oct 11, 2023

Uh oh!

github-actions bot commented Oct 11, 2023

Uh oh!

github-actions bot commented Oct 11, 2023

Uh oh!

github-actions bot commented Oct 11, 2023

Uh oh!

yiguolei commented Oct 12, 2023

Uh oh!

yiguolei commented Oct 12, 2023

Uh oh!

github-actions bot commented Oct 12, 2023

Uh oh!

doris-robot commented Oct 12, 2023

Uh oh!

doris-robot commented Oct 12, 2023

Uh oh!

yiguolei left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Comments

Nitin-Kashyap commented Oct 6, 2023 •

edited

Loading